Technical monitoring of the mobile operator’s network

To build a cost-efficient system with massively parallel processing architecture (MPP) on the Apache Hadoop HDP/HDF platform.

To build an MPP system for statistical data collection and analytics, the following distributions were utilized:
Storage based on the HDP platform – Hadoop Data Platform (open-source software under the Apache license)
Real-time data collection based on the HDF (NiFi) platform – Hadoop Data Float (open-source software under the Apache license)
A data virtualization layer – TIBCO Data Virtualization was also added to the architecture to address the issues of multi-channel data integration and holistic representation of data stored in varied sources.

Multi-channel integration and holistic data presentation with Tibco Data Virtualization tools. Linear scalability of data storage capacities based on the Dell/EMC Isilone object-oriented storage technology, along with the increased response speed up to 1-5 seconds.