Layer	Sources	What
📡 RSS	49 feeds	OpenAI, Anthropic, Ben's Bites, HN, 36氪, CoinDesk…
🐦 Twitter/X	48 KOLs	@karpathy, @VitalikButerin, @sama, @elonmusk…
🔍 Web Search	4 topics	Tavily or Brave Search API with freshness filters
🐙 GitHub	28 repos	Releases from key projects (LangChain, vLLM, DeepSeek, Llama…)
🗣️ Reddit	13 subs	r/MachineLearning, r/LocalLLaMA, r/CryptoCurrency…

Pipeline

       run-pipeline.py (~30s)
              ↓
  RSS ────────┐
  Twitter ────┤
  Web ────────┤── parallel fetch ──→ merge-sources.py
  GitHub ─────┤                          ↓
  GitHub Tr. ─┤              enrich-articles.py (opt-in)
  Reddit ─────┘                          ↓
              Quality Scoring → Dedup → Topic Grouping
                             ↓
               Discord / Email / PDF output

Quality scoring: priority source (+3), multi-source cross-ref (+5), recency (+2), engagement (+1), Reddit score bonus (+1/+3/+5), already reported (-5).

⚙️ Configuration

config/defaults/sources.json — 151 built-in sources (62 RSS, 48 Twitter, 28 GitHub, 13 Reddit)
config/defaults/topics.json — 4 topics with search queries & Twitter queries
User overrides in workspace/config/ take priority

🎨 Customize Your Sources

Works out of the box with 151 built-in sources (62 RSS, 48 Twitter, 28 GitHub, 13 Reddit) — but fully customizable. Copy the defaults to your workspace config and override:

# Copy and customize
cp config/defaults/sources.json workspace/config/tech-news-digest-sources.json
cp config/defaults/topics.json workspace/config/tech-news-digest-topics.json

Your overlay file merges with defaults:

Override a source by matching its id — your version replaces the default
Add new sources with a unique id — appended to the list
Disable a built-in source — set "enabled": false on the matching id

{
  "sources": [
    {"id": "my-blog", "type": "rss", "enabled": true, "url": "https://myblog.com/feed", "topics": ["llm"]},
    {"id": "openai-blog", "enabled": false}
  ]
}

No need to copy the entire file — just include what you want to change.

🔧 Environment Variables

All environment variables are optional. The pipeline runs with whatever sources are available.

# Twitter/X Backend (auto priority: getxapi > twitterapiio > official)
export GETX_API_KEY="..."        # GetXAPI
export TWITTERAPI_IO_KEY="..."   # twitterapi.io
export X_BEARER_TOKEN="..."      # Official X API v2
export TWITTER_API_BACKEND="auto"  # auto|getxapi|twitterapiio|official
# Web Search
export TAVILY_API_KEY="tvly-xxx"   # Tavily Search API
export BRAVE_API_KEYS="k1,k2,k3"   # Brave Search API keys (comma-separated for rotation)
export BRAVE_API_KEY="..."         # Single Brave key
export WEB_SEARCH_BACKEND="auto"   # auto|brave|tavily
# GitHub
export GITHUB_TOKEN="..."          # GitHub API
# Other
export BRAVE_PLAN="free"           # Override Brave rate limit: free|pro

📦 Dependencies

Core (required)

The skill requires Python 3.8+ and two optional dependencies for enhanced functionality:

pip install -r requirements.txt
# or
pip install feedparser>=6.0.0 jsonschema>=4.0.0

feedparser — RSS/Atom feed parsing (fallback to regex if not installed)
jsonschema — JSON Schema validation for config files

Optional

pip install weasyprint

weasyprint — Enables PDF report generation

📂 Repository

GitHub: github.com/draco-agent/tech-news-digest

🌟 Featured In

Awesome OpenClaw Use Cases — Community-curated collection of OpenClaw agent use cases

📄 License

MIT License — see LICENSE for details.