A Scalable Architecture for Text Correction and Normalization
-
Updated
Dec 21, 2025 - Python
#
chunk-processing
Here are 8 public repositories matching this topic...
Spring Batch Training Code Samples
-
Updated
Sep 17, 2017 - Java
Leadership Coach AI Agent with Youtube knowledge base and Web Search
ffmpeg logging chatbot tts knowledge-base ai-engine youtube-extractor chunk-processing rag grammar-correction vector-embedding transcribe-audio-files streamlit-webapp openai-api yt-dlp ai-agent llm whisper-ai vector-store web-search-agent
-
Updated
Mar 11, 2025 - Python
Efficiently import very large CSV files into a database using Laravel 12 seeders. This project demonstrates memory-safe CSV streaming, chunked inserts, and optimized performance for handling millions of records without timeouts.
mysql php laravel performance data-import laravel-framework laravel-tutorial csv-import database-seeder chunk-processing laravel-example laravel-seeder laravel-seed bulk-insert large-csv laravel-12
-
Updated
Jan 24, 2026 - Hack
A professional, web-based application designed specifically for handling and analyzing large CSV and text files that are too massive for conventional spreadsheet software. Built with Python and Flask, it provides a robust, browser-based interface for searching, previewing, and exporting data from files that can exceed several gigabytes in size.
big-data rest-api data-visualization self-hosted file-handling data-analysis data-tools text-processing data-management data-search data-processing data-exploration csv-parser large-files file-search data-export csv-viewer local-server chunk-processing large-datasets
-
Updated
Sep 27, 2025 - Python
Save up to 45% disk on Minecraft servers with compact .linear region files
minecraft compression bukkit paper minecraft-server linear minecraft-plugin zstd anvil folia chunk-processing papermc ai-generated minecraft-optimization canvasmc region-format horizon-plugin
-
Updated
Oct 15, 2026 - Java
A high-performance Change Data Capture (CDC) tool for comparing CSV files and detecting differences. Built with Python and optimized for speed using Polars, NumPy, and xxHash.
python csv etl numpy bigdata xxhash data-engineering data-processing data-migration cdc data-audit chunk-processing polars data-diff data-comparision
-
Updated
Jun 3, 2025 - Python
A Go-based microservice for managing the lifecycle of data chunks across distributed processing workflows, including creation, validation, tracking, processing, completion, expiration, and cleanup.
go api kubernetes golang microservice queue backend event-driven cloud-native workflow-management observability message-driven chunk-processing distrubted-systems data-lifecycle async-processing
-
Updated
Oct 18, 2026 - Go
Add this topic to your repo
To associate your repository with the chunk-processing topic, visit your repo's landing page and select "manage topics."