{"id":664,"date":"2016-02-18T12:52:31","date_gmt":"2016-02-18T12:52:31","guid":{"rendered":"http:\/\/blog.stratio.com\/?p=664"},"modified":"2023-09-20T13:43:45","modified_gmt":"2023-09-20T13:43:45","slug":"how-to-aggregate-data-in-real-time-with-stratio-sparta","status":"publish","type":"post","link":"https:\/\/www.stratio.com\/blog\/how-to-aggregate-data-in-real-time-with-stratio-sparta\/","title":{"rendered":"How to aggregate Data in Real-Time with Stratio Sparta"},"content":{"rendered":"

When working with Big Data, it’s frequent to have the need to aggregate data in real-time, whether it comes from a specific service, such as social networks (Twitter, Facebook…) or even from more diverse sources, like a weather station<\/span>.<\/span>\u00a0A good way to process these large amounts of information is with\u00a0<\/span>Spark Streaming<\/a><\/strong>,<\/strong>\u00a0it provides us all the data in real time, but it has one problem: you have to program it yourself.<\/span><\/p>\n

How to process and aggregate data<\/b><\/h2>\n


\n\"Aggregate<\/a><\/p>\n

To avoid this, we can use\u00a0<\/span>Stratio Sparta<\/a><\/strong>\u00a0to process and aggregate data. It helps us by reducing raw information and making it useful after it\u2019s processed. Later we\u2019ll persist the result in a\u00a0<\/span>MongoDB<\/a><\/strong>\u00a0cluster and provide the streaming through WebSockets with\u00a0<\/span>Node.js<\/a>.<\/strong><\/p>\n

Stratio Sparta is a very flexible, simple to use tool that allows us to transform raw information with\u00a0Morphline,<\/strong>\u00a0through its web interface, and aggregate data in different dimensions and time ranges.<\/p>\n

\"Aggregate<\/a><\/p>\n

First Steps with Stratio Sparta<\/b><\/h2>\n

First of all, we must\u00a0<\/span>install Stratio Sparta<\/a><\/strong>\u00a0as indicated in Stratio\u2019s documentation. For this example we\u2019ve used the\u00a0<\/span>Stratio Manager<\/a><\/strong>\u00a0and installed our 3 machine clusters with MongoDB and Stratio Sparta. With it we can also monitor our different service resources.<\/span><\/p>\n

After we install it, we can execute it and it will open its service in the 9090 doc where we can start to set up the different parameters:<\/span><\/p>\n