website-scraping

Seven-step web extraction playbook covering reconnaissance, tool selection, anti-bot handling, and JSONL output.

Parent repository GitHub

Type: skill
Repository: moonlight-lupin/agent-skills
Readiness: Usable for Claude Code with adaptation; individual dependencies, credentials, and host-tool mappings vary by skill.
Keywords: 7

Location

Repository path

web-scraping/website-scraping/SKILL.md

Invocation

Load/install the skill and request structured extraction; reconnaissance helper: scripts/recon.py <url>.

Setup

Installation / activation

Turning websites into structured records, including sites needing browser-driven navigation.

Keywords

web scrapingreconextractionanti-botPlaywrightJSONLbrowser

Repository context

moonlight-lupin/agent-skills

MIT-licensed collection of 29 self-contained Agent Skills built for Hermes Agent, plus a Hermes-only BM25 skill-retrieval plugin; Claude Code can install the SKILL.md packages, but workflows may require mapping Hermes tool names and the plugin itself is explicitly incompatible with Claude Code.

Research and fact-checkingCreative media generationProductivity and document automationAgent operationsMLOps and model evaluationWeb scrapingDevOpsRetrieval-augmented generationCompliance-support research

Open full repository research