Domain Skills
Fresh 🌱Document IDdomain-skills/index
SectionDomain Skills
TypeSection overview
StatusGenerated overview
Updated2026-04-22
Workflow Map
flowchart TD A["Target website"] --> B["Check site-specific playbook"] B --> C["Execute documented pattern"] C --> D["Verify outcome"]
Key Takeaways
- Site-specific playbooks that tell the harness how to operate against real products and public websites.
- This section currently contains 69 wrapped reference pages.
Top Pages
Domain SkillsAmazon — Product Search & Data ExtractionField-tested against amazon.com on 2025-04-18 using a logged-in Chrome session. No CAPTCHA or bot detection was triggered during any test run.Domain SkillsInternet Archive / Wayback Machine — Scraping & Data Extractionhttps://archive.org / https://web.archive.org — all public data, no auth required. Every workflow here is pure httpget — no browser needed.Domain SkillsarXiv Bulk Harvest + Semantic Scholar — OAI-PMH & Citation EnrichmentCompanion to domain-skills/arxiv/scraping.md. Use the arxiv skill for search-and-fetch workflows. Use this skill when you need:Domain SkillsArXiv — Scraping & Data Extractionhttps://arxiv.org — open-access preprint server. Never use the browser for ArXiv. All data is reachable via httpget using the Atom API or HTML meta tags. No API key required.Domain SkillsAtlas — my.recruitwithatlas.com--- name: atlas-recruit description: Atlas recruitment platform (my.recruitwithatlas.com) — routes, filters, GraphQL bootstrap for authenticated UI probes. ---Domain SkillsBooking.com — Scraping & Data ExtractionField-tested against booking.com on 2026-04-18 using httpget and the dml/graphql JSON API. All tests run without a browser session.Domain SkillsCapterra — Scraping & Data ExtractionField-tested against capterra.com on 2026-04-18. All code blocks validated with live requests.Domain SkillsCentileBrain — Generate Normative Deviation ValuesURL: https://centilebrain.org/#/modelDomain SkillsCoinGecko — Data Extractionhttps://api.coingecko.com/api/v3 — no API key needed for free tier. Pure JSON REST API, no browser required.Domain SkillsCoinMarketCap — Data Extractionhttps://coinmarketcap.com — crypto market data. Three access paths tested: internal JSON API (fastest, no auth required), NEXTDATA from HTML pages, and browser DOM. All real-money price data confirmed accurate aDomain SkillsCoursera — Course & Catalog Data ExtractionField-tested against coursera.org and api.coursera.org on 2026-04-18. No authentication required for the public catalog API.Domain SkillsCraigslist — Scraping via http_getField-tested against sfbay.craigslist.org and multiple city subdomains on 2026-04-18. httpget works without any bot detection — no CAPTCHA, no block, no rate limit observed. Craigslist serves a full server-rendered HT
Full Directory
- Amazon — Product Search & Data Extraction
- Internet Archive / Wayback Machine — Scraping & Data Extraction
- arXiv Bulk Harvest + Semantic Scholar — OAI-PMH & Citation Enrichment
- ArXiv — Scraping & Data Extraction
- Atlas — my.recruitwithatlas.com
- Booking.com — Scraping & Data Extraction
- Capterra — Scraping & Data Extraction
- CentileBrain — Generate Normative Deviation Values
- CoinGecko — Data Extraction
- CoinMarketCap — Data Extraction
- Coursera — Course & Catalog Data Extraction
- Craigslist — Scraping via http_get
- CrossRef — Scraping & Data Extraction
- DEV Community (dev.to) — Data Extraction
- DuckDuckGo — Instant Answer API
- eBay — Scraping & Data Extraction
- Etsy — Scraping & Data Extraction
- Eventbrite — Scraping & Data Extraction
- Facebook Groups — mining feeds for posts + external URLs
- Facebook Pages — mining a public Page's feed for posts + external URLs
- Framer — web editor
- FRED — Federal Reserve Economic Data
- G2 — B2B Software Reviews
- Genius — Data Extraction
- GitHub — Repo actions (star, unstar, watch)
- GitHub — Scraping & Data Extraction
- Glassdoor — Company Data, Reviews, Jobs & Salaries
- Goodreads — Book Data Extraction
- Project Gutenberg — Scraping & Data Extraction
- Hacker News — Data Extraction
- HowLongToBeat — Scraping & Data Extraction
- itch.io — Scraping & Data Extraction
- Job Boards — Indeed, Glassdoor, Stepstone
- Letterboxd — Film Data Scraping
- LinkedIn — Invitation Manager
- Macrotrends — Data Extraction
- Medium — Article Body via DOM
- Medium — Data Extraction
- Metacritic — Scraping & Data Extraction
- MusicBrainz — Data Extraction
- NASA APIs — Scraping & Data Extraction
- News Aggregation — Multi-Source
- Open Library — Book Data Extraction
- OpenAlex — Scraping & Data Extraction
- OpenStreetMap — Nominatim Geocoding + Overpass API
- npm & PyPI — Package Registry Data Extraction
- Product Hunt Scraping Skills
- PubMed / NCBI — Scraping & Data Extraction
- Quora — Data Extraction
- RAWG — Scraping & Data Extraction
- Reddit — Scraping & Post Extraction
- REST Countries — Scraping & Data Extraction
- SEC EDGAR — Scraping & Data Extraction
- SoundCloud — Data Extraction
- Spotify — Data Extraction
- Stack Overflow — Scraping & Data Extraction
- Steam — Scraping & Data Extraction
- The Tech Geeks AU — Ubiquiti pricing
- TikTok Studio — Upload Video
- TradingView — Scraping & Data Extraction
- Trello — boards and lists
- Trustpilot — Company Reviews Scraping
- Walmart — Product Search & Data Extraction
- Wayback Machine — CDX API & Snapshot Retrieval
- Weather APIs — Data Extraction
- Wellfound (AngelList) — Startup Jobs & Company Profiles
- World Bank Open Data — Scraping & Data Extraction
- YouTube — Data Extraction
- Zillow — Scraping & Data Extraction