data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
-
Updated
Oct 20, 2026 - Python
#
data-loading
Here are 42 public repositories matching this topic...
Podium: a framework agnostic Python NLP library for data loading and preprocessing
-
Updated
Dec 12, 2022 - Python
This repository is a working ETL framework which utilizes user data from Spotify API using ➲Python for Extraction and Transformation ➲SQL for Data Loading and Staging ➲Airflow for Data Orchestration and Monitoring ➲PowerBI for Reporting
scheduling data-transformation data-visualization orchestration api-call etl-pipeline data-loading data-modelling
-
Updated
Apr 16, 2023 - Python
High-level API for tar-based dataset
-
Updated
Feb 3, 2024 - Python
A fast and easy-to-use Remote sensing Image format COnverter for High-throughput Deep-Learning (rico-hdl).
converter deep-learning remote-sensing high-throughput hydro data-loading eurosat bigearthnet hyspecnet-11k bigearthnet-s1 bigearthnet-s2 bigearthnet-mm uc-merced ssl4eo-s12 major-tom-core
-
Updated
May 7, 2025 - Python
Very fast loader for libsvm / svmlight sparse data files in Python (Cython): SciPy sparse matrices, gzip and bz2 input, an alternative to sklearn's load_svmlight_file.
python fast machine-learning cython scikit-learn loader sparse-data scipy libsvm-format sparse-matrix libsvm svmlight data-loading
-
Updated
Oct 20, 2026 - Python
omniload is a polyglot data loader based on dlt. Copy data between any source and any destination.
etl data-warehouse data-engineering data-lake warehouse dataloader warehouse-management data-pipeline datalake dlt data-ingestion etl-framework data-loading data-load duckdb datalake-etl data-loading-framework data-loaders dlt-destination
-
Updated
Oct 20, 2026 - Python
DLT (www.github.com/dlt-hub/dlt) source for Morphais (www.morphais.com)
-
Updated
Jun 18, 2026 - Python
Differentiable data pipelines for JAX/Flax NNX: HuggingFace, TFDS and ArrayRecord sources, augmentation stages, scan-based epochs, exact mid-epoch resume.
python machine-learning streaming deep-learning dataloader flax data-augmentation data-pipeline grain input-pipeline differentiable jax tensorflow-datasets data-loading huggingface checkpointing huggingface-datasets flax-nnx orbax arrayrecord
-
Updated
Oct 19, 2026 - Python
DLT (www.github.com/dlt-hub/dlt) Source for Affinity (www.affinity.co)
-
Updated
Oct 13, 2026 - Python
Fast, accurate streaming of training data from cloud storage for PyTorch. Community-maintained fork of MosaicML Streaming.
python machine-learning streaming deep-learning cloud-storage pytorch dataset distributed-training data-loading
-
Updated
Oct 16, 2026 - Python
An experiment sandbox for Deep Learning Data Loading analysis.
-
Updated
Aug 10, 2023 - Python
DLT (www.github.com/dlt-hub/dlt) source for Personio (www.notion.com)
-
Updated
Aug 24, 2026 - Python
ColumnCore is a high-performance analytical database system designed for beginners or small projects. It supports a rich SQL dialect, runs within the same process as the application, has a vectorized query execution engine, and uses a columnar storage format.
sql database data-validation data-storage data-import data-analysis columnar-storage vectorization data-processing schema-inference data-conversion performance-optimization data-loading
-
Updated
Sep 22, 2023 - Python
Library to load various vision datasets from disk
-
Updated
Sep 19, 2019 - Python
This tool rapidly converts loose files scattered within any folder into a consolidated H5 file. This allows for faster read operations with lower memory requirement.
-
Updated
Apr 8, 2021 - Python
`Spltr` is a simple PyTorch-based data loader and splitter. It may be used to load arrays and matrices or Pandas DataFrames and CSV files containing numerical data with subsequent split it into train, test (validation) subsets in the form of PyTorch DataLoader objects.
deep-learning pytorch dataset neural-networks easy-to-use splitter data-preprocessing data-preparation data-loader data-loading train-test-split data-preprocess pytorch-dataloader-objects train-test-validation data-split pytorch-dataset-split easy-split easy-data-split data-split-pytorch train-split-pytorch
-
Updated
Sep 21, 2020 - Python
DLT (www.github.com/dlt-hub/dlt) source for Slack (www.slack.com)
-
Updated
Aug 12, 2026 - Python
Food-101 benchmark comparing PyTorch DataLoader with minimal-dataset-pytorch across worker counts, image sizes and batch sizes.
python performance-engineering benchmarking data machine-learning concurrency python3 pytorch data-engineering data-analysis dataloader gil mlops data-loading food101 food101-dataset
-
Updated
Sep 14, 2026 - Python
python docker airflow docker-compose scheduled-tasks astro time-interval-data apache-airflow etl-pipeline dags data-loading astronomer
-
Updated
Jul 17, 2025 - Python
Add this topic to your repo
To associate your repository with the data-loading topic, visit your repo's landing page and select "manage topics."