160+ open-source tools: Web Data APIs, MCP servers, scrapers, AI agent data tools & awesome lists.
Google Maps · LinkedIn · Social Media · E-commerce · Search · MCP Servers
@DataScrape · CoreClaw
Building the largest open-source Web Data Infrastructure ecosystem on GitHub. 160 production-ready repos covering scraper tools, CoreClaw product APIs, competitor alternatives, AI agent data connectors, and curated awesome lists.
| Product | Description |
|---|---|
| Google Maps Scraper API | Local business data extraction for lead gen & local SEO |
| LinkedIn Data API | B2B contact and company data for sales automation |
| Social Media Data API | Instagram, TikTok, YouTube, Facebook, Reddit data |
| E-commerce Data API | Amazon, Walmart, eBay product and pricing data |
| Search Data API | Google SERP data for SEO and market intelligence |
Join the DataScrape Discord community to discuss web data APIs, MCP servers, and AI agent workflows.
| Repository | Description |
|---|---|
| agentic-data-pipeline | Agentic Data Pipeline - Real-time web data pipeline for AI a |
| ai-agent-data-tools | AI Agent Data Tools - Connect AI agents to real-time web dat |
| ai-agent-web-scraper | AI Agent Web Scraper - LLM-powered data extraction for agent |
| mcp-data-tools | MCP Data Tools - Model Context Protocol server for web data |
| rag-data-source | RAG Data Source - External web data for Retrieval-Augmented |
| Repository | Description |
|---|---|
| awesome-google-maps | Awesome Google Maps - Curated tools for Google Maps data ext |
| awesome-lead-generation | Awesome Lead Generation - Curated B2B lead gen tools, APIs, |
| awesome-web-scraping | Awesome Web Scraping - Curated list of scraping tools, APIs, |
| Repository | Description |
|---|---|
| brightdata-alternative | Best Bright Data Alternative - Web data platform for AI agen |
| outscraper-alternative | Best Outscraper Alternative - Google Maps data extraction AP |
| oxylabs-alternative | Best Oxylabs Alternative - Residential proxy and web scrapin |
| phantombuster-alternative | Best PhantomBuster Alternative - LinkedIn & social media aut |
| scraperapi-alternative | Best ScraperAPI Alternative - Web scraping API with proxy ro |
| scrapingbee-alternative | Best ScrapingBee Alternative - Web scraping API with JS rend |
| scrapingdog-alternative | Best ScrapingDog Alternative - Web scraping API for develope |
| serpapi-alternative | Best SerpAPI Alternative - Google SERP API with better rate |
| texau-alternative | Best TexAu Alternative - LinkedIn automation and lead genera |
| zenscrape-alternative | Best Zenscrape Alternative - Web scraping API for structured |
| Repository | Description |
|---|---|
| medium-scraper | Scrape Medium articles, authors, and publication data |
| substack-scraper | Scrape Substack newsletters, posts, and subscriber data |
| Repository | Description |
|---|---|
| amazon-product-api | Amazon Product API - Real-time product, pricing, and review |
| best-amazon-scraper | Best Amazon Scraper - Extract product data, prices, reviews, |
| best-google-maps-scraper | Best Google Maps Scraper - Extract business data, reviews, r |
| best-instagram-scraper | Best Instagram Scraper - Extract posts, profiles, stories, a |
| best-linkedin-scraper | Best LinkedIn Scraper - Extract profiles, companies, and con |
| best-tiktok-scraper | Best TikTok Scraper - Extract videos, hashtags, sounds, and |
| best-web-scraping-api | Best Web Scraping API Comparison - CoreClaw vs competitors f |
| best-youtube-scraper | Best YouTube Scraper - Extract video data, transcripts, and |
| business-data-api | Business Data API - Company data, contact info, and firmogra |
| coreclaw-review | CoreClaw Review - Web Data API platform features, pricing, a |
| data-extraction-api | Data Extraction API - Structured data extraction for SaaS, A |
| google-maps-data-api | Google Maps Data API - Structured local business data for AI |
| google-maps-scraper-api | Google Maps Scraper API - Production-ready REST API for loca |
| google-search-api | Google Search API - SERP data extraction for SEO and market |
| instagram-data-api | Instagram Data API - Structured Instagram data for influence |
| lead-generation-api | Lead Generation API - Extract B2B contact data, company info |
| linkedin-data-api | LinkedIn Data API - B2B contact and company data for sales a |
| web-data-api | Web Data API - Turn public web pages into structured data vi |
| Repository | Description |
|---|---|
| amazon-reviews-scraper | Scrape amazon reviews scraper data |
| bing-search-scraper | Scrape bing search scraper data |
| caleprocure-scraper | Scrape caleprocure scraper data |
| dealwatch-scraper | Scrape dealwatch scraper data |
| ebay-items-scraper | Scrape ebay items scraper data |
| irs-990-nonprofit-search | Scrape irs 990 nonprofit search data |
| ny-business-entity-scraper | Scrape ny business entity scraper data |
| snapchat-profile-scraper | Scrape snapchat profile scraper data |
| spotify-profiles-search-scraper | Scrape spotify profiles search scraper data |
| texas-trec-scraper | Scrape texas trec scraper data |
| zoominfo-company-scraper | Scrape zoominfo company scraper data |
| Repository | Description |
|---|---|
| discord-server-scraper | Scrape Discord servers, channels, and member lists data |
| Repository | Description |
|---|---|
| facebook-group-scraper | Scrape Facebook groups, members, and group posts data |
| Repository | Description |
|---|---|
| google-news-scraper | Scrape Google News articles, headlines, and source data |
| google-trends-scraper | Scrape Google Trends data, search interest, and trending top |
| Repository | Description |
|---|---|
| linkedin-job-scraper | Scrape LinkedIn job postings, salaries, and application data |
| linkedin-sales-navigator-scraper | Scrape LinkedIn Sales Navigator leads and accounts data |
| Repository | Description |
|---|---|
| spotify-scraper | Scrape Spotify songs, playlists, artists, and podcasts data |
| Repository | Description |
|---|---|
| amazon-asin-scraper | Amazon ASIN scraper - lookup ASIN data and product informati |
| amazon-price-scraper | Amazon price scraper - track prices and extract pricing hist |
| amazon-product-scraper | Amazon product scraper - extract product details, images, an |
| amazon-review-scraper | Amazon review scraper - extract product reviews and ratings |
| amazon-scraper-api | Amazon scraper API - REST API for Amazon data extraction |
| apify-google-maps-scraper | Compare Apify Google Maps Scraper with modern alternatives. |
| apify-indeed-scraper | Apify-style Indeed scraper alternative - free & open source |
| apify-instagram-scraper | Compare Apify Instagram Scraper with modern alternatives. Co |
| apify-reddit-scraper | Apify-style Reddit scraper alternative - free & open source |
| apify-tiktok-scraper | Apify TikTok scraper alternative - free Python TikTok scrape |
| apify-zillow-scraper | Apify-style Zillow scraper alternative - free & open source |
| awesome-apify-alternatives | A curated list of the best Apify alternatives for web scrapi |
| best-apify-alternative | The best Apify alternative for Google Maps, LinkedIn, YouTub |
| best-apollo-scraper-reddit | Reddit community recommended Apollo scraper alternative |
| best-ebay-scraper | The best eBay scraper for extracting products, prices, selle |
| best-facebook-scraper | The best Facebook scraper for extracting public pages, posts |
| best-google-search-scraper | The best Google Search scraper for extracting organic result |
| best-indeed-scraper | The best Indeed scraper for extracting job listings, compani |
| best-reddit-scraper | The best Reddit scraper for extracting posts, comments, subr |
| best-walmart-scraper | The best Walmart scraper for extracting products, prices, re |
| best-zillow-scraper | The best Zillow scraper for extracting property listings, pr |
| blog | CoreClaw blog - web scraping infrastructure insights. Served |
| bright-data-alternative | Free open-source Bright Data alternative - web scraping prox |
| crawler-google-places | Scrape crawler google places data |
| cruisemapper-cruises-scraper | Scrape cruisemapper cruises scraper data |
| cslb-contractor-license-search | Scrape cslb contractor license search data |
| discord-scraper | Scrape Discord messages, channels, members without API |
| easy-scrape-zillow-agents-free | Free tool to scrape Zillow real estate agents listings |
| ebay-price-scraper | eBay price scraper - track prices and extract sold item hist |
| ebay-web-scraper | eBay web scraper - extract product listings, prices, seller |
| facebook-marketplace-scraper | Facebook Marketplace scraper - extract listings, prices, sel |
| facebook-page-scraper | Facebook page scraper - extract page posts, reviews, insight |
| facebook-post-scraper | Facebook post scraper - extract post data, reactions, commen |
| facebook-profile-scraper | Facebook profile scraper - extract profiles, friends, photos |
| facebook-scrape-website | Facebook scrape website - full Facebook data extraction tool |
| fcc-license-search | Scrape fcc license search data |
| fmcsa-dot-crawler | Scrape fmcsa dot crawler data |
| glassdoor-scraper | Scrape Glassdoor job listings, salaries, company reviews |
| google-business-scraper | Scrape Google Business Profiles - reviews, hours, contact in |
| google-map-scraper-api- | Production-ready Google Maps Scraper API for extracting busi |
| google-maps-data-scraper | Extract Google Maps business data, reviews, place IDs, email |
| google-place-id-api | Get Google Place IDs without API key - free alternative |
| google-reviews-scraper | Scrape Google Maps reviews - ratings, text, author, dates |
| google-shopping-scraper | Scrape Google Shopping results - prices, products, sellers |
| illinois-idfpr-license-scraper | Scrape illinois idfpr license scraper data |
| indeed-job-scraper | Free Indeed job scraper - extract job postings, salaries, co |
| instagram-account-scraper | A powerful Python-based Instagram account scraper that extra |
| instagram-comment-scraper | Instagram comment scraper - extract comments from posts and |
| instagram-email-scraper | Instagram email scraper - extract emails from Instagram bios |
| instagram-follower-scraper | Extract Instagram followers, public profiles, engagement met |
| instagram-profile-scraper | Extract public Instagram profile data, business accounts, bi |
| instagram-scraper | Extract Instagram profiles, posts, reels, comments, hashtags |
| insurance-license-search | Scrape insurance license search data |
| jooble-jobs-api | Scrape jooble jobs api data |
| linkedin-email-scraper | LinkedIn email scraper - extract emails from LinkedIn profil |
| linkedin-jobs-scraper | Scrape linkedin jobs scraper data |
| linkedin-post-scraper | LinkedIn post scraper - extract posts, likes, comments, anal |
| linkedin-post-search-scraper | Scrape linkedin post search scraper data |
| linkedin-profile-data-scraper | LinkedIn profile data scraper - extract profiles, experience |
| linkedin-scraper-api | LinkedIn scraper API - REST API for LinkedIn data extraction |
| nppes-npi-registry | Scrape nppes npi registry data |
| ny-biz-lookup | Scrape ny biz lookup data |
| nysed-professional-license-search | Scrape nysed professional license search data |
| or-biz-lookup | Scrape or biz lookup data |
| outscraper-google-maps-scraper | Compare Outscraper Google Maps Scraper with modern alternati |
| pinterest-scraper | Scrape Pinterest pins, boards, images without API |
| pitchbook-scraper | Scrape pitchbook scraper data |
| price-comparison | Scrape price comparison data |
| public-onchain-token-monitor | Scrape public onchain token monitor data |
| scrap-gold-ebay | Scrap gold eBay - extract gold and precious metal listings f |
| scrape-google-maps | Learn how to scrape Google Maps business listings, reviews, |
| scrape-indeed-job-postings | Python tool to scrape Indeed job postings with full details |
| scrape-instagram-followers | Learn how to scrape Instagram followers, public profiles, fo |
| scrape-instagram-photos | Scrape Instagram photos - download photos from any profile i |
| scrape-yelp-reviews | Free Yelp reviews scraper - extract ratings, text, dates |
| scrape-youtube-comments | Scrape YouTube comments - extract comments from any video |
| scrape-youtube-search-results | Scrape YouTube search results - extract videos, channels, pl |
| telegram-scraper | Scrape Telegram channels, messages, groups without API |
| threads-scraper | Scrape Meta Threads posts, profiles, replies without API |
| tiktok-comment-scraper | TikTok comment scraper - extract comments from TikTok videos |
| tiktok-comments-scraper | TikTok comments scraper - bulk extract comments and replies |
| tiktok-data-scraper-api | TikTok data scraper API - REST API for TikTok data extractio |
| tiktok-profile-scraper | TikTok profile scraper - extract profiles, followers, video |
| tiktok-video-scraper | TikTok video scraper - extract video data, hashtags, trendin |
| trustmrr-startup-scraper | Scrape trustmrr startup scraper data |
| twitch-scraper | Scrape Twitch channels, streams, chat without API |
| tx-biz-lookup | Scrape tx biz lookup data |
| wyoming-sos-registry | Scrape wyoming sos registry data |
| x-scraper | Scrape X/Twitter posts, profiles, followers without API |
| yellow-pages-scraper | Scrape Yellow Pages business listings - phone, address, revi |
| youtube-video-scraper-api | YouTube video scraper API - REST API for video data extracti |
| zenrows-alternative | Free open-source ZenRows alternative - anti-bot bypass scrap |
| zillow-data-scraper | Scrape Zillow property data - prices, addresses, Zestimate |
| zillow-scraper-api | Zillow scraper API - structured JSON output for property dat |
| Repository | Description |
|---|---|
| pinterest-pin-scraper | Scrape Pinterest pins, boards, and image data in bulk |
| Repository | Description |
|---|---|
| reddit-comment-scraper | Scrape Reddit comments, replies, and user discussions in bul |
| reddit-post-scraper | Scrape Reddit posts, subreddits, and karma data with filters |
| Repository | Description |
|---|---|
| quora-scraper | Scrape Quora questions, answers, and user profiles data |
| slack-scraper | Scrape Slack channels, messages, and workspace data |
| snapchat-scraper | Scrape Snapchat stories, profiles, and public content data |
| whatsapp-scraper | Scrape WhatsApp groups, contacts, and message data programma |
| x-tweet-scraper | Scrape X (Twitter) tweets, threads, and timeline data in bul |
| Repository | Description |
|---|---|
| telegram-channel-scraper | Scrape Telegram channels, messages, and subscriber data |
| Repository | Description |
|---|---|
| youtube-channel-scraper | Scrape YouTube channel data, stats, and video lists in bulk |
Web Data Infrastructure for AI Agents & Automation
Production-ready REST APIs · AI-ready structured data · MCP-compatible · Free credits
