#data-pipelines

[ follow ]
#data-contracts #schema-management #apache-iceberg #vpc #data-lakehouse #producer-consumer #polars #apache-spark
Startup companies
fromInfoQ
21 hours ago

Etleap Launches Iceberg Pipeline Platform to Simplify Enterprise Adoption of Apache Iceberg

Managed Iceberg pipeline platform unifies ingestion, transformation, orchestration, and table operations inside customers' VPCs, enabling enterprise Iceberg adoption without building custom stacks.
#data-contracts
more#data-contracts
Data science
fromInfoQ
1 month ago

Decathlon Switches to Polars to Optimize Data Pipelines and Infrastructure Costs

Migrating small-to-medium data workloads from Apache Spark to Polars yields major performance and cost improvements by enabling single-node execution and faster in-memory processing.
Artificial intelligence
fromInfoQ
2 months ago

Nexla Launches Express: A Conversational Platform for AI Data Engineering

Express enables natural-language creation of production-ready data pipelines by automating data discovery, connection, and transformation without manual coding.
Data science
fromMedium
5 months ago

Building Resilient Data Systems: Key Lessons from Veronika Durgin

Neglected data engineering tasks are crucial for stable and agile data pipelines.
[ Load more ]