#apache-kafka tag

Grafana Labs Releases Mimir 3.0 with Redesigned Architecture for Enhanced Performance and Reliabilit

The main feature of the 3.0 release is a new decoupled architecture. This change fixes a key limitation found in earlier versions. In earlier versions of Mimir, the ingester component handled both reading and writing. This setup meant that heavy query loads could hurt ingestion performance. The new design adds Apache Kafka as an asynchronous buffer between ingestion and query tasks. This allows each path to scale on its own and removes the cross-path dependencies that affected system stability before.

Software development

fromMedium

2 months ago

Harnessing Real-Time Data: Integration of MySQL, Debezium, Kafka, Scala

Build a real-time data pipeline using MySQL, Debezium, Kafka, and Scala to capture and stream database changes for continuous processing and analytics.

#linkedin

fromMedium

3 months ago

Software development

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

Tech industry

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

Software development

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

DevOps

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

Software development

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

Tech industry

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

Software development

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

Tech industry

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

Software development

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

DevOps

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

Software development

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

fromMedium

3 months ago

Tech industry

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

LinkedIn replaced Apache Kafka because growth to 1.2 billion users and 32 trillion daily records exceeded Kafka's scalability and operational limits.

Tech industry

fromMedium

3 months ago

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

LinkedIn outgrew Apache Kafka and built Northguard & Xinfra to handle scale of 1.2 billion users, 32 trillion daily records, and 17PB data.

Artificial intelligence

fromTechzine Global

3 months ago

Confluent introduces Streaming Agents for real-time AI agents

Confluent launched Streaming Agents to enable enterprise-grade, real-time AI agents that use up-to-date streaming data and integrate with tools, databases, and models.

Data science

fromHackernoon

3 years ago

Building a Real-Time Change Data Capture Pipeline with Debezium, Kafka, and PostgreSQL | HackerNoon

Effective data engineering requires proficient setup of Change Data Capture (CDC) to enhance data synchronization and availability.

#apache-kafka#apache-kafka

Grafana Labs Releases Mimir 3.0 with Redesigned Architecture for Enhanced Performance and Reliabilit

Harnessing Real-Time Data: Integration of MySQL, Debezium, Kafka, Scala

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Beyond Kafka: How LinkedIn Built Northguard & Xinfra to Scale Event Streaming for the Next Decade!

Confluent introduces Streaming Agents for real-time AI agents

Building a Real-Time Change Data Capture Pipeline with Debezium, Kafka, and PostgreSQL | HackerNoon

#apache-kafka
#apache-kafka