Data Pipeline 4

Terracotta simplifies LLM experimentation with a unified platform for training and evaluation. Terracotta is a platform designed to simplify and accelerate the process of experimenting with Large Language Models (LLMs). It streamlines the training and evaluation of LLMs by providing a unified interface for managing models, data, and evaluations. Terracotta aims to supercharge the LLM iteration process, making it more intuitive and efficient.

AI-powered, open source chat-based ETL tool for data engineering. Ask On Data is an AI-powered, open source chat based ETL tool for data engineering. Via chat, it enables tasks like data migration, cleaning, and analysis, making it accessible for data scientists and engineers to enhance efficiency effortlessly. It is a Natural Language Processing (NLP) based GenAI powered data engineering tool with agentic capabilities, allowing users to harness the power of data without coding skills.

ChatDBT is a GenAI-powered visual designer for building DBT data pipelines. ChatDBT is a GenAI data pipeline visual designer that seamlessly integrates GenAI to build data pipelines for DBT (Data Build Tool). It allows users to create models via prompting, offers auto lineage discovery, context highlighting and dimming, full data ownership, and instant chat with the author.

Cloud-native data orchestrator for building, scheduling, and monitoring reliable AI & data pipelines. Dagster is a cloud-native orchestrator designed for the entire development lifecycle, offering integrated lineage and observability, a declarative programming model, and best-in-class testability. It serves as a modern data orchestrator platform that helps teams build, schedule, and monitor reliable data pipelines quickly and flexibly. Dagster acts as a unified control plane for building, scaling, and observing AI & data pipelines with confidence. It enables users to model various data assets like tables, files, and ML models, providing a built-in catalog, lineage, and cost insights from day one. The platform automatically tracks, documents, and audits every dataset to ensure data integrity, compliance, and transparency throughout its lifecycle. Dagster integrates with any stack, from S3 to Snowflake to PowerBI, and is built to provide an excellent developer experience while offering data leaders the transparency, control, and insights they need.