A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

Today, at its annual Data + AI Summit, Databricks announced that it is open-sourcing its core declarative ETL framework as Apache Spark Declarative Pipelines, making it available to the entire Apache ...

Resilinc, the leading provider of agentic AI-driven supply chain risk and compliance intelligence, today announced it has architected its platform on the Databricks Platform to power large-scale, ...

The no-code ETL tool works by combining a generative AI assistant for pipeline creation and Unity Catalog for governance. Databricks showcased a new no-code data management tool, powered by a ...

A core element of any data retrieval operation is the use of a component known as a retriever. Its job is to retrieve the relevant content for a given query. In the AI era, retrievers have been used ...

Who needs rewrites? This metadata-powered architecture fuses AI and ETL so smoothly, it turns pipelines into self-evolving engines of insight. In the fast-evolving landscape of enterprise data ...