Data Tools: clean web data for developers and AI agents
Ready-to-run Python examples for pay-per-use Apify Actors that turn search trends, news, competitor ads, documents, websites, YouTube, TikTok and Instagram videos and audio into clean JSON, Markdown, CSV and Excel.
🌐 Website: https://fernandoguiraud16-coder.github.io/data-tools/
Each example is a single short script plus a sample-output.json from a real cloud run, so you can see exactly what you get before running anything.
Examples
| Example | What it does | Actor |
|---|
| google-trends | Compare terms over time, export to CSV, see rising searches and what's trending now | Google Trends Scraper |
| google-news | Save news articles as Markdown files, or get alerts for new stories only | Google News Scraper |
| google-ads-transparency | Every Google Search, Display and YouTube ad of a competitor, longest-running first, and alerts for new ads | Google Ads Transparency Scraper |
| trends-to-news | Find the fastest rising searches on a topic and the news that explains them | Trends + News |
| pdf-to-markdown | PDF, Word, Excel, PowerPoint and scans to Markdown, or to RAG chunks in JSONL | PDF to Markdown Extractor |
| pdf-table-extractor | Every table in a PDF to an Excel workbook, one sheet per table | PDF Table Extractor |
| tech-stack-whois | Enrich a list of company domains: CMS, email provider, hosting, age, security grade | Tech Stack Detector & WHOIS |
| bulk-whois | Find available and soon-to-expire domains in a list | Bulk WHOIS Lookup |
| audio-transcription | Audio or video to text and SRT subtitles, 99 languages | Audio & Video Transcription |
| podcast-transcripts | Transcribe only the new episodes of your favourite podcasts | Podcast Transcript Scraper |
| youtube-transcripts | YouTube videos, Shorts, whole channels, playlists and keyword searches to Markdown with timestamps, SRT or text | YouTube Transcript Scraper |
| Google Hotels guide | Hotel prices per night and total stay for any city and dates, ratings, reviews, amenities; daily price monitor | Google Hotels Scraper |
| Google Jobs guide | Job listings from LinkedIn, Indeed and company sites with salary ranges and apply links; alerts for new jobs | Google Jobs Scraper |
| LinkedIn & Indeed jobs guide | Jobs listed on LinkedIn, Indeed, Monster and company career sites in one search, with every apply link | Job Postings Aggregator |
| Company contacts guide | Role emails, phones, address and social profiles of companies from their websites, one row per company | Website Contact Scraper |
| YouTube channel guide · YouTube search guide | Every video of a channel, or the top videos for a keyword, as transcripts | YouTube Channel Transcripts · YouTube Search Transcripts |
| mcp-agents | Use all of these as tools in Claude, Cursor or any MCP client | Apify MCP server |
Also in the family (same engine as Audio & Video Transcription, so the audio-transcription example works with them too):
For AI agents
- MCP: every tool is listed in the official MCP registry as
io.github.fernandoguiraud16-coder/<tool> and served at https://mcp.apify.com/?tools=fguiraud/<tool>. See examples/mcp-agents.
- Agent skills:
npx skills add fernandoguiraud16-coder/data-tools installs 6 skills for Claude Code, Codex, Cursor and other coding agents.
- llms.txt: a short index of all tools for LLMs.
Quick start
-
Create a free Apify account and copy your API token from Console → Settings → API & Integrations.
-
Install the client and set the token:
pip install -r requirements.txt
export APIFY_TOKEN=your_token # Windows PowerShell: $env:APIFY_TOKEN="your_token"
-
Run any example:
python examples/google-trends/compare_terms.py "chatgpt, gemini, claude" --geo US
Pricing
All Actors are pay per result: you pay a fraction of a cent per item (term, article, ad, document, domain, video or audio minute), and failed or empty items are not charged. Apify's free plan includes monthly credits, enough to try every example. Exact prices are on each Actor's page.
Support
Found a bug or need a feature? Open an issue on the Actor's page in the Apify Store (replies within 48 hours), or an issue in this repository for problems with the examples.
License
The example code is MIT licensed: copy it into your own projects.
