#data-platform

[ follow ]
fromInfoQ
1 day ago

Pinterest's Moka: How Kubernetes Is Rewriting the Rules of Big Data Processing

In a two-part blog series, Soam Acharya, Rainie Li, William Tom and Ang Zhang describe how the Pinterest Big Data Platform team considered alternatives for their next-generation massive-scale data processing platform as the limits of the existing Hadoop-based system, known internally as Monarch, became clear. They present Moka as the outcome of that search, and as their EKS based cloud native data processing platform, which now runs production workloads at Pinterest scale.
DevOps
fromTechzine Global
1 month ago

Databricks raises $4 billion and reaches valuation of $134 billion

It wasn't like two months ago, but constant,
Artificial intelligence
US politics
fromFortune
1 month ago

Trump orders 'Genesis Mission' for AI companies to work on scientific breakthroughs with universities, national labs | Fortune

Federal government will partner with tech companies and universities to centralize scientific data and accelerate AI-driven engineering, energy, and national-security discoveries.
Startup companies
fromTechzine Global
2 months ago

VAST Data secures CoreWeave deal for $1.17 billion

CoreWeave's multi-year $1.17 billion deal makes VAST Data the primary data platform for CoreWeave's AI GPU cloud, providing major revenue and strategic alignment.
Tech industry
fromTechzine Global
3 months ago

Mega merger in the data world: Fivetran and dbt Labs join forces

Fivetran and dbt Labs will merge to build an open, interoperable data platform that simplifies data management, supports AI, and keeps dbt Core open source.
Data science
fromIT Pro
3 months ago

How EDF empowered its decision-makers with a consolidated data strategy

EDF consolidated legacy systems into DataVolt using Informatica, Snowflake, and Power BI to provide on-demand data insights and accelerate clean energy deployment.
fromInfoQ
4 months ago

Building a Resilient and Inclusive Engineering Culture with Matthew Card

I'm an engineering manager at the BBC. The BBC is quite big, so in other terms, I would be a head of software engineering or a senior engineering manager. So, what I'm trying to get across here is that I have a department, I look after a part of the data platform, wider organization. I look after the core platform, which is the core infrastructure platform that builds out the infrastructure for the platform.
Careers
fromMarTech
4 months ago

AI's personalization magic starts with the data you can't see | MarTech

As with anything, having the correct setup is critical. For AI, that means establishing a robust, centralized data platform - combining both structured and unstructured datasets - so brands can improve the relevance of their communications and enhance customer experiences. Accuracy and governance are fundamental Whether you're setting up a simple customer segmentation or a complex lifetime value model, the core tenets of strong data foundations remain the same.
Artificial intelligence
Startup companies
fromSilicon Valley Journals
9 months ago

Bauplan Emerges with $7.5M Seed to Simplify AI and Data Infrastructure for Software Engineers

Bauplan simplifies data infrastructure management for software engineers using Python, eliminating the need for specialized data teams.
[ Load more ]