Documentation website workflows

Docusaurus-based local documentation build, serving, linting, formatting, and image optimization.

Parent repository GitHub

Type: developer workflow
Repository: apify/crawlee-python
Readiness: Production-oriented library with documented examples, type hints, tests, CI badges, packaged releases, and optional integrations, although deployment-specific validation remains necessary.
Keywords: 5

Location

Repository path

CONTRIBUTING.md; website/package.json

Invocation

`uv run poe run-docs`; website tasks include `pnpm lint`, `pnpm format`, and `pnpm opt:images <path-to-image>`.

Setup

Installation / activation

Run from the documented repository location with the stated Node.js and pnpm prerequisites.

Keywords

docusaurusdocumentationpnpmlintformat

Repository context

apify/crawlee-python

Apache-2.0 Python 3.10+ library and CLI for building asynchronous HTTP and browser-based crawlers with routing, retries, proxy and session management, persistent queues, pluggable storage, templates, and optional parsing, Playwright, database, Redis, observability, and AI-related integrations; no native Claude Code integration is evidenced.

web scrapingweb crawlingbrowser automationdata extractiondata collectionHTTP automationAI data preparationRAG ingestiondeveloper tooling

Open full repository research