BeeCrawl is open source. Inspect the code on GitHub

Product / Search

Search the web. Bring back useful pages.

Find relevant pages through a single API and optionally return the page content your agent needs next.

POST /searchREADY
curl -X POST https://api.beecrawl.dev/search \
  -H "X-Web-Extract-Api-Key: YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"query":"web scraping API","limit":5}'

Features // Product / Search

Search the live web and return ranked pages that are ready for your next step.

01 / Ranked retrieval

Results with context.

Get titles, URLs, descriptions, and provider metadata in a predictable response.

02 / Search + scrape

Skip the second pipeline.

Add scrapeOptions when you want matching pages returned as clean markdown in the same request.

03 / Tunable requests

Search on your terms.

Control result count, language, country, and the rendering settings used for follow-up content.

How it works //

From request
to ready data.

01

Send a focused query.

02

Rank and normalize matching pages.

03

Return links or scrape-ready content.

response.json200 OK
{
  "requestId": "req_01H...",
  "status": "ready",
  "data": "useful web content",
  "metadata": { "provider": "beecrawl" }
}

FAQ //

Everything you need
to get moving.

What does Search return?

Each result includes a URL, title, description, and optional markdown content when scrapeOptions are included.

Can I search and scrape in one request?

Yes. Add scrapeOptions with one or more formats to fetch page content for each search result.

Build with BeeCrawl //

Make the web
agent-ready.

Read the API docs