Use Cases
Using XPRESSmp™ for Time-Critical Log Analysis (Hadoop Front-End)
Challenges Addressed:
- Massive, timely data ingest
- Low latency processing
- Massive scalability
- Data visualization and optimization
- Right-now analysis
A company needs to maximize its ROI on Hadoop, and:
- Ingest log records and reassemble them at (and above) 2 million records/second
- Have the ability to view activity – and perform real-time analysis - as it happens
- A high-availability, resilient solution
XPRESSmp provides high-volume, low-latency ingest across a cluster, ingesting log records and sending reassembled records to Hadoop for back-end batch analysis. For the company's real-time needs, XPRESSmp enables a real-time overview of activity on 'right-now' dashboards. Real-time analysis of the most current data is available with low-latency query processing. And, to ensure high availability and resilience, XPRESSmp employs replication and transaction logging to disc.
This enables the company to handle the current log record rate, and have a solution that is easily scalable for workload increase. XPRESSmp enables predictability and timeliness of processing, and provides a real-time command-and-control system for immediate insight and analysis. And finally, with XPRESSmp as a front-end 'right-now' accelerator to Hadoop, the company maximizes its ROI on Hadoop.
