Infrastructure

Search APIs

The Tech Ledger aggregates signals from three specialized APIs. Each serves a different purpose in the news-gathering pipeline.

Firecrawl

Web scraping and crawling API that extracts structured data from any website. Used to scrape GitHub Trending for the latest hot repositories.

firecrawl.dev

Tavily

AI-powered search API optimized for LLMs. Used to search Hacker News and engineering blogs for breaking tech stories.

tavily.com

Exa

Semantic search API that understands meaning, not just keywords. Used to discover the latest AI research papers on arXiv.

exa.ai

Developer API

Access the aggregated trending data programmatically at /api/trending. Source health status available at /api/sources.

← Back to the Ledger