The Metadata Driven framework for Databricks Lakeflow Declarative Pipelines (formerly Delta Live Tables). Metadata framework that generates production ready Pyspark code for Lakeflow Declarative Pipelines
Metadata-driven framework for Databricks Spark Declarative Pipelines. Config-driven, pattern based approach to batch & streaming across the medallion architecture. Deploys via Declarative Automation Bundles. Built for simplicity, extensibility, and alignment with the Databricks product roadmap.
Provide an easy way with Python to protect your data sources by searching its metadata. 🛡️
An open-source framework for automated sensitive data classification and adaptive privacy-preserving transformations in data pipelines.
DataCoolie — A Python data pipeline framework for Polars and Spark, across Local, AWS, Microsoft Fabric, and Databricks.
elevata is an open-source Architecture Runtime for modern data platforms — turning metadata into explicit, discoverable, controllable, executable, auditable, and deterministic data architecture.
Open Source meda collection package that gives power to the user to seed their self-hosted media library.
Meta#Grid is a meta data tooling/framework for BI and data warehousing
A python script to sort home-made media by date, camera, etc...
Metadata-driven data quality rules engine for Microsoft Fabric + Purview. Multi-criteria rule matching, wildcard support, dynamic Spark SQL evaluation, severity scoring, and Purview DQ integration. Ships with a complete insurance industry example.
Laboratório de engenharia e governança de dados com pipelines orientados por metadados, Airflow, PostgreSQL, MinIO, Docker e OpenMetadata.
Pythonic Metaprogramming
A metadata-driven engine that compiles CDISC define.xml into executable validation logic.
A metadata-driven PySpark data pipeline on Databricks using Medallion Architecture (Bronze, Silver, Gold). Features an OOP-based framework orchestrated via dbutils.run for dynamic configuration and retail sales analytics
ontology-driven, event-driven and evidence-based Binance Spot/Futures research and paper-trading platform with deterministic risk, validation and decision governance.
A metadata‑driven, audit‑ready ELT framework for SQL Server → Snowflake migration.
Metadata-driven DAG orchestration with durable execution state, retries, watermarks, and dependency-aware recovery.
Metadata based Data Harmonization Ontology Model
A production-grade cryptocurrency data pipeline built on GCP that ingests real-time market data from the CoinGecko API, implements Medallion architecture (Raw → Staging → Curated), and supports idempotent backfill and metadata-driven incremental processing for reliable, scalable analytics.
Metadata-driven Spark framework for reproducible ingestion of Brazilian federal open data.
To associate your repository with the metadata-driven topic, visit your repo's landing page and select "manage topics."