Architecture

Overview

Mach5 Search is real-time, scalable data lake built on cheap, cloud object storages (AWS S3, Google Cloud Storage, and Azure Blob Store). Out of the box, Mach5 Search provides a number of different tools that often missing from typical data lakes provide immense value and increase productivity:

• Full-text and customizable indexing
• an API-compatible implementation of OpenSearch, which includes compatibility with the surrounding ecosystem (logstash, beats, etc.)
• MQL: a simple, powerful, pipe-based query language similar to Kusto Query Language and Splunk Query Language
• Dashboards, visualizations, and notebooks for interactive analyses and reporting
• Flux: a powerful data ingestion, transformation, and routing tool