OpenAdapterOpenAdapter
Tools

Crawl Site

Crawl multiple pages on a site. Depth control, URL patterns, and domain filtering.

Base URL & authentication

Base URL: https://api.openadapter.in

All requests need an Authorization: Bearer sk-cv-... header. Generate or copy your API key from the Dashboard → API Keys page.

Endpoint: POST /v1/tools/crawl Cost per call: 0.15 credits Minimum plan: free

Crawl multiple pages on a site. Depth control, URL patterns, and domain filtering.

Request

curl https://api.openadapter.in/v1/tools/crawl \
  -H "Authorization: Bearer $OPENADAPTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com","max_pages":5,"max_depth":2}'
import requests

resp = requests.post(
    "https://api.openadapter.in/v1/tools/crawl",
    headers={"Authorization": f"Bearer {API_KEY}"},
    json={
    "url": "https://example.com",
    "max_pages": 5,
    "max_depth": 2,
},
)
print(resp.json())
const res = await fetch('https://api.openadapter.in/v1/tools/crawl', {
  method: 'POST',
  headers: {
    Authorization: `Bearer ${process.env.OPENADAPTER_API_KEY}`,
    'Content-Type': 'application/json',
  },
  body: JSON.stringify({
  "url": "https://example.com",
  "max_pages": 5,
  "max_depth": 2
}),
});
console.log(await res.json());

Pricing

Each call costs 0.15 credits. Available on the free plan and above.

On this page