log1010x

log1010x is an open-source, cross-platform framework for collecting, processing, and querying large volumes of event logs and time-series data in real time. It provides a unified interface for instrumented applications and back-end processing, with emphasis on low latency, scalability, and flexible storage options.

The architecture centers on a modular pipeline consisting of client SDKs, a ingest broker, and a storage and query layer. Data is ingested as events with timestamp, attributes, and payload, serialized in multiple formats. The system supports pluggable transports (TCP, UDP, HTTP) and a schema registry to manage evolving data models.

Features include high throughput ingestion with backpressure, fault tolerance and replay, schema evolution, retention policies, role-based access control, and a built-in query layer with a SQL-like language and dashboards integration. It offers support for multiple backends, including time-series databases, object stores, and search indexes, as well as optional on-disk columnar storage for analytics.

Typical usage involves instrumenting applications with a log1010x client, configuring pipelines, selecting storage backends, and deploying one or more brokers to route data. Operators can define retention, sampling, and aggregation rules, and visualize data in compatible dashboards.

History and governance: started as an academic project in 2018, later released as an open-source project under MIT license. It is maintained by a core team and a global contributor community, with regular releases and documented APIs.