Wiki

Clone wiki

rfx / Home

About this project

Rfx - the framework for Reactive Big Data Processing

Why Rfx is awesome ?

You can write a Reactive-SQL and get pushed data results from REST API Server via WebSocket

E.g: SUBSCRIBE * FROM News WHERE category in [‘big data’, ‘marketing’,’mobile’,‘real-time’] ORDER BY FacebookLikeCount

Key philosophy “readily responsive to a stimulus”, aka: readily responsive to {data, context, relationship}. The data, the user and the context store as ONE entity. So we could do mining, analytic, search and recommend information faster in real-time.

the implementation: adapting Reactive Lambda Architecture

Theory

Log Server

Message Queue

Backend

  • Distributed processing with http://akka.io
  • Speed layer query using In-Memory NoSQL Redis http://redis.io
  • Batch layer using Hadoop and SQL query engine http://phoenix.apache.org
  • Networking Netty http://netty.io and http://vertx.io

Frontend

  • HTML5 + jQuery, http://sigmajs.org http://d3js.org http://nvd3.org
  • https://angularjs.org

Documents

http://www.mc2ads.com/p/rfx-for-big-data-developer.html

Updated