Tony Li 0c91f0068e feat(parser): add Firecrawl fallback for paywalled and bot-protected content ...

Integrates the Firecrawl API into GenericParser. If native HTTP requests fail
(e.g., 403 Forbidden) or returning nothing due to paywalls, we automatically
fallback to Firecrawl to extract Markdown content using pseudosearch engine features.

Requires FIRECRAWL_API_KEY environment variable to activate.

2026-02-22 15:41:34 +01:00

..

__init__.py

🦞 Initial release: OpenClaw DeepReeder v1.0.0

2026-02-16 13:58:54 +01:00

base.py

🦞 Initial release: OpenClaw DeepReeder v1.0.0

2026-02-16 13:58:54 +01:00

generic.py

feat(parser): add Firecrawl fallback for paywalled and bot-protected content

2026-02-22 15:41:34 +01:00

reddit.py

🟠 Add Reddit parser + update all READMEs

2026-02-16 14:22:31 +01:00

twitter.py

fix(security): resolve security issues reported by bot

2026-02-21 20:53:28 +01:00

youtube.py

security: harden URL fetches and frontmatter serialization

2026-02-21 16:00:53 +01:00