Build software better, together

omkarcloud / botasaurus

Sponsor

Star

The All in One Framework to Build Undefeatable Scrapers

Updated Jul 26, 2026
Python

d60 / twikit

Sponsor

Star

python search bot client wrapper twitter-bot scraper twitter twitter-api scraping python3 twitter-client scrape tweepy x twitter-scraper python-web-scraper x-api twitter-internal-api

Updated Mar 10, 2026
Python

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

Updated Feb 1, 2022
Python

jpjacobpadilla / Stealth-Requests

Star

Undetected web-scraping & seamless HTML parsing in Python!

python data web-crawler http-client http-requests requests web-scraping xpath data-extraction html-parsing webscraping python-web-scraper python-scraping

Updated Sep 19, 2026
Python

oxylabs / Python-Web-Scraping-Tutorial

Star

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

python crawler scraping web-scraping python-web-crawler webscraping web-crawler-python python-web-scraper python-projects web-scraping-python github-python web-scraping-api scraper-python amazon-scraper-python json-database-python

Updated Sep 24, 2025
Python

oxylabs / aliexpress-scraper

Star

Easily collect public AliExpress data like prices, product details, and ratings with AliExpress Scraper API

aliexpress aliexpress-crawler aliexpress-spider e-commerce-api email-crawler aliexpress-api python-web-scraper aliexpress-scraper scraper-api alibaba-api e-commerce-scraper github-python ali-scraper

Updated Jun 22, 2026
Python

thewebscraping / tls-requests

Sponsor

Star

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

Updated Feb 23, 2026
Python

Conso1eCowb0y / Deepminer

Star

Deep web crawler and search engine

Updated Aug 4, 2020
Python

Decodo / Google-News-scraper

Star

📰 Python Google News scraper for headlines, summaries & sources. Media monitoring, trend analysis with proxy rotation & automated CSV export.

python requests web-scraping data-extraction beautifulsoup google-scraper google-news google-news-scraper news-scraper trend-analysis news-analytics media-monitoring python-web-scraper proxy-rotation google-news-api scraping-google-trends headless-scraping decodo

Updated May 6, 2026
Python

J4NN0 / linkedin-web-scraper

Star

LinkedIn Python Web Scraper to collect and store company data

scraper selenium webscraper scrapy-spider scrapy selenium-webdriver webscraping scraping-websites openpyxl scrapy-crawler scrapy-tutorial scrapy-demo selenium-python webscraper-website webscraping-search webscraper-api python-web-scraper python-excel

Updated Dec 18, 2023
Python

Decodo / Python-scraper-tutorial

Star

A short introduction to scraping with Python with given steps and an example scraper script.

python learning crawler data-science data-mining scraping web-scraping beautifulsoup python-web-crawler webscraping web-crawler-python python-web-scraper python-projects web-scraping-python github-python web-scraping-api scraper-python json-database-python

Updated May 14, 2025
Python

stabldev / mangareader-api

Star

A Python based web scraping api built with fastapi to get manga contents.

python anime scraping manga web-scraping mangareader python-web-scraper fastapi manga-api

Updated Jan 26, 2026
Python

sallamy2580 / python-web-scrapping

Star

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

Updated Jul 21, 2022
Python

JohnScooby / Google-Scraper

Star

A Simple Python Based Google Search Results Scraper.

python scraper webscraping scrapy-crawler google-search dorker google-search-using-python python-web-scraper google-dorking dorking google-scraping web-scraping-project

Updated Oct 31, 2022
Python

kowshika-n / Python-Scrapers

Star

This repo includes a collection of Python scripts and tools built for enabling web scraping and data entry. Results are extracted and exported to CSV or Excel files as per requirements.

python automation python-library python-script webscraper freelance scripts-collection python-scripts webscraping freelancing freelancer standalone-snippets python-tools python-web-scraper python-scrapers

Updated Jun 3, 2021
Python

nirantak / scraper

Sponsor

Star

Python web scrapers

python scraper scraping selenium beautifulsoup python-web-scraper playwright

Updated Jul 15, 2022
Python

1x-eng / chart_data_extractor

Star

This webservice will help scrape data out of chart(s) presented on any given website. (At this moment, I only support scrape from HighCharts and AmCharts. Other libraries, maybe next time).