modern-data-stack

Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0

A simple low-cost finance data pipeline orchestration. All you need is just python & SQL.

Set up a Cost-Effective Modern Data Stack for a Charity

Lightweight, open source, locally-hosted Modern Data Stack

Orca is a modern data warehouse implementation built around HackerNews data.

🧱 Tinkering around with a bunch of open source data tools.

A minimal modern data stack with working data pipelines in a single Docker container.

elevata is an open-source Architecture Runtime for modern data platforms — turning metadata into explicit, discoverable, controllable, executable, auditable, and deterministic data architecture.

sediment — A dataset-agnostic, local-first analytics-engineering framework — dbt + DuckDB + a trust-first NL→SQL agent, runs offline with one command.

Conecte os dados do Facebook Ads ao seu banco de dados Postgres com Airbyte e Mage.

A minimal modern data stack with working data pipelines in a single Docker container.

🎯 DBT Masterclass with CI/CD | Hands-on Data Transformation Guide A comprehensive tutorial repository for mastering Data Build Tool (DBT) from scratch to deployment! Includes Bronze-Silver-Gold architecture, testing, snapshots, macros, and production CI/CD workflows. Follow along with the 5-hour video tutorial! 🚀

A local-first Modern Data Stack (MDS) reference architecture using dlt for ingestion, dbt for transformation, and DuckDB as the high-performance compute engine and semantic layer.

A data analytics platform built with Apache Superset to analyze and visualize Major League Baseball statistics. This project combines the power of modern data analytics tools with America's favorite pastime.

Real-time stock market analytics pipeline using Kafka, Airflow, dbt, Snowflake, and Power BI. Built with a modern Bronze–Silver–Gold architecture for streaming analytics.

NexusData is a high-performance Data Lakehouse ecosystem designed for seamless ingestion, automated quality assurance, and scalable data transformation. It extracts real-time metrics from the Steam API, orchestrating the journey from raw data to analytical insights using a robust Medallion Architecture.

🚀 Roadmap de estudos e laboratórios técnicos para o Indicium Lighthouse 2026. Foco em Modern Data Stack: SQL avançado, modelagem dimensional e dbt.

Modern Data Stack pipeline for high-throughput stream ingestion and sub-50ms columnar OLAP analytics using DuckDB, Polars, and FastAPI.

A complete, running analytics stack: model2data -> dlt -> DuckDB -> dbt -> Evidence. Clone it and run it with no account, no credentials and no cloud project; point it at a real database by changing one connection string.

A Claude Code harness that turns a session into an agentic data engineer for SMBs — packaged as an installable plugin, built from a skillpack of skills that stand up a cheap, self-hostable Modern Data Stack (Tailscale + dlt + BigQuery + dbt + optional MCP), end-to-end and headless.