{"schema_version":"1.0","total":6,"filters":{"category":"scraping-api","output":"markdown"},"records":[{"id":"api:firecrawl-api","slug":"firecrawl-api","name":"Firecrawl API","category":"scraping-api","canonical_url":"https://workingproxysites.info/tools/firecrawl-api","provider_url":null,"capabilities":["async-jobs","batch-requests","javascript-rendering","screenshots","structured-extraction"],"outputs":["html","json","markdown","screenshot"],"connections":["http-api"],"checked_at":"2026-10-26","review_due_at":"2026-11-25","review_overdue":false,"sources":[{"id":"scrape","url":"https://docs.firecrawl.dev/features/scrape","label":"Firecrawl Scrape: formats, response status and caching","checkedAt":"2026-09-28"},{"id":"extraction","url":"https://docs.firecrawl.dev/developer-guides/usage-guides/choosing-the-data-extractor","label":"Choosing the Firecrawl data extractor","checkedAt":"2026-09-28"},{"id":"billing","url":"https://docs.firecrawl.dev/billing","label":"Firecrawl credit billing and failure exceptions","checkedAt":"2026-09-28"},{"id":"limits","url":"https://docs.firecrawl.dev/rate-limits","label":"Firecrawl rate limits and keyless availability","checkedAt":"2026-09-28"},{"id":"crawl","url":"https://docs.firecrawl.dev/features/crawl","label":"Firecrawl Crawl: scope and asynchronous results","checkedAt":"2026-09-28"},{"id":"errors","url":"https://docs.firecrawl.dev/api-reference/errors","label":"Firecrawl API error handling","checkedAt":"2026-09-28"},{"id":"screenshot-reference","url":"https://docs.firecrawl.dev/api-reference/endpoint/scrape","label":"Scrape API screenshot request and response reference","checkedAt":"2026-09-29"},{"id":"batch","url":"https://docs.firecrawl.dev/features/batch-scrape","label":"Batch scrape jobs, results and retention","checkedAt":"2026-09-29"}],"record":{"name":"Firecrawl API","slug":"firecrawl-api","facts":[{"label":"Known page or whole site","value":"POST /v2/scrape reads one URL. For a site traversal, /v2/crawl starts an asynchronous job. Give crawl an explicit page limit and path scope before starting.","source_ids":["scrape","crawl"]},{"label":"Markdown response","value":"Request formats: [\"markdown\"]. Raw HTTP returns content in data.markdown inside a success/data envelope; SDKs return the data object directly.","source_ids":["scrape"]},{"label":"HTML choices","value":"Use formats: [\"html\"] for cleaned page HTML at data.html. Use formats: [\"rawHtml\"] for unmodified page HTML at data.rawHtml. These formats preserve markup; Markdown is the text-oriented choice.","source_ids":["scrape"]},{"label":"Structured fields","value":"Use a formats object with type: \"json\" and a prompt or JSON Schema for fields from a known page. Raw HTTP returns the extracted object at data.json. A JSON response envelope alone does not request extraction. Agent is a separate choice when source URLs must be discovered.","source_ids":["scrape","extraction"]},{"label":"Freshness","value":"The documented cache default permits data up to two days old. Set maxAge: 0 when the task needs a fresh fetch; this does not guarantee that the target returns the desired page.","source_ids":["scrape"]},{"label":"Accepting the response","value":"An API HTTP 200 or success: true is not sufficient. Inspect data.metadata.statusCode and the requested content: a captured target 403 or 404 can be returned and billed.","source_ids":["scrape","billing"]},{"label":"Credit decision","value":"For an ordinary returned page, Markdown uses the 1-credit base. JSON extraction totals 5 credits before other options. Extra modifiers stack; optional browser sessions have a separate billing basis.","source_ids":["billing","extraction"]},{"label":"No-document exceptions","value":"Ordinary scrapes that return no document generally cost 0 credits. Paid guards, threat scans and other documented options have exceptions; a returned error page is still a document.","source_ids":["billing"]},{"label":"Authentication and capacity","value":"Anonymous Scrape has daily per-IP limits. An account API key uses the team plan and shared request limits. Crawl, Map and batch requests require authentication.","source_ids":["limits"]},{"label":"Rate limits versus target errors","value":"A Firecrawl 429 can mean request-rate or concurrency limits. Inspect the response, respect Retry-After when provided and reduce load; repeating a captured target error is a separate decision.","source_ids":["limits","errors"]}],"setup":["Choose a public URL you are permitted to retrieve and the fields the application actually needs. Use Scrape for a known page; keep discovery or a bounded Crawl separate.","Send an application/json POST to https://api.firecrawl.dev/v2/scrape with url and formats. Start with formats: [\"markdown\"]. Add Authorization: Bearer YOUR_FIRECRAWL_API_KEY in your HTTP client when using an account; keep the populated key out of shared files.","Choose maxAge intentionally. For extracted fields, use the JSON format object shown in the example and supply a prompt or schema. Read data.json; the outer success/data response wrapper is not an extraction result.","Check the API outcome, data.metadata.statusCode and the requested fields before storing the result or retrying. Estimate option charges separately, and bound any later Crawl request."],"tools":["http-api"],"outputs":["markdown","html","json","screenshot"],"sources":[{"id":"scrape","url":"https://docs.firecrawl.dev/features/scrape","label":"Firecrawl Scrape: formats, response status and caching","checked_at":"2026-09-28"},{"id":"extraction","url":"https://docs.firecrawl.dev/developer-guides/usage-guides/choosing-the-data-extractor","label":"Choosing the Firecrawl data extractor","checked_at":"2026-09-28"},{"id":"billing","url":"https://docs.firecrawl.dev/billing","label":"Firecrawl credit billing and failure exceptions","checked_at":"2026-09-28"},{"id":"limits","url":"https://docs.firecrawl.dev/rate-limits","label":"Firecrawl rate limits and keyless availability","checked_at":"2026-09-28"},{"id":"crawl","url":"https://docs.firecrawl.dev/features/crawl","label":"Firecrawl Crawl: scope and asynchronous results","checked_at":"2026-09-28"},{"id":"errors","url":"https://docs.firecrawl.dev/api-reference/errors","label":"Firecrawl API error handling","checked_at":"2026-09-28"},{"id":"screenshot-reference","url":"https://docs.firecrawl.dev/api-reference/endpoint/scrape","label":"Scrape API screenshot request and response reference","checked_at":"2026-09-29"},{"id":"batch","url":"https://docs.firecrawl.dev/features/batch-scrape","label":"Batch scrape jobs, results and retention","checked_at":"2026-09-29"}],"summary":"Compare Firecrawl Markdown, HTML and JSON extraction, cache settings and credit charges. Choose a request format and check target status before accepting data.","website":"https://docs.firecrawl.dev/features/scrape","category":"scraping-api","evidence":"documented","publisher":"Firecrawl","checked_at":"2026-10-26","connection":"http-api","review_due":"2026-11-25","limitations":["This record covers the hosted HTTP scraping interface. Self-hosted Firecrawl and local MCP deployment have different dependencies and available services.","JavaScript rendering and returned fields are documented capabilities, not a measured success rate or a guarantee for every target.","Anonymous daily caps differ from the authenticated Free account plan. The reviewed rate-limit page does not publish a numeric keyless allowance.","Cached responses can remain billable. Optional extraction, guards, documents and browser operations can change credit usage; do not assume every failed call is free."],"capabilities":["javascript-rendering","structured-extraction","async-jobs","screenshots","batch-requests"],"billing_basis":"Credits per returned page, with option charges. An ordinary scrape is 1 credit; schema-guided JSON adds 4. Account plans and anonymous limits are separate. Check detailed billing before enabling extra options.","provider_slug":null,"publisher_type":"official","request_examples":[{"code":"{\n  \"url\": \"https://example.com\",\n  \"formats\": [\n    \"markdown\"\n  ],\n  \"maxAge\": 0\n}","label":"Markdown body — POST /v2/scrape","source_ids":["scrape"]},{"code":"{\n  \"url\": \"https://example.com\",\n  \"formats\": [\n    {\n      \"type\": \"json\",\n      \"schema\": {\n        \"type\": \"object\",\n        \"properties\": {\n          \"title\": {\n            \"type\": \"string\"\n          }\n        },\n        \"required\": [\n          \"title\"\n        ]\n      }\n    }\n  ]\n}","label":"Extract a page title — POST /v2/scrape","source_ids":["scrape","extraction"]}]}},{"id":"api:jina-reader-api","slug":"jina-reader-api","name":"Jina Reader API","category":"scraping-api","canonical_url":"https://workingproxysites.info/tools/jina-reader-api","provider_url":null,"capabilities":["css-selectors","javascript-rendering","web-scraping"],"outputs":["html","json","markdown","text"],"connections":["http-api"],"checked_at":"2026-10-26","review_due_at":"2026-11-25","review_overdue":false,"sources":[{"id":"reader","url":"https://jina.ai/reader/","label":"Jina Reader: product options, rates and billing FAQ","checkedAt":"2026-09-28"},{"id":"repository","url":"https://github.com/jina-ai/reader","label":"Official Reader guide: formats, selectors and URL fragments","checkedAt":"2026-09-28"},{"id":"spec","url":"https://r.jina.ai/openapi.json","label":"Live Reader OpenAPI: headers and request schema","checkedAt":"2026-09-28"}],"record":{"name":"Jina Reader API","slug":"jina-reader-api","facts":[{"label":"Known URL first","value":"Prefix a complete URL with https://r.jina.ai/ to read that page, for example https://r.jina.ai/https://example.com. The separately authenticated s.jina.ai search endpoint has its own terms.","source_ids":["reader","repository"]},{"label":"Main content or full page","value":"The default content mode extracts readable page content as Markdown. X-Respond-With: markdown returns full-page Markdown without the readability filter. Use the default for an article body; choose full-page mode when surrounding page text matters.","source_ids":["repository","spec"]},{"label":"JSON wrapper versus fields","value":"Accept: application/json requests a JSON response with page URL, title and content. It does not ask Reader to extract your own JSON Schema fields. X-Respond-With selects the content representation inside the response.","source_ids":["reader","repository","spec"]},{"label":"HTML and text choices","value":"Set X-Respond-With: html for HTML or X-Respond-With: text for plain text. Select the representation your application will process before comparing output size or token usage.","source_ids":["repository","spec"]},{"label":"Freshness","value":"Use X-No-Cache: true or X-Cache-Tolerance: 0 when cached output is unsuitable. Published sources give different cache lifetimes, so do not rely on one universal default TTL.","source_ids":["reader","repository","spec"]},{"label":"Missing dynamic content","value":"For a page that needs browser rendering, explicitly choose X-Engine: browser. X-Wait-For-Selector waits for an expected element; X-Target-Selector limits returned content and X-Remove-Selector removes unwanted elements.","source_ids":["reader","repository","spec"]},{"label":"Hash-based routes","value":"A URL fragment after # is normally kept by the HTTP client. For a route such as https://example.com/#/route, POST the full URL in the request body to https://r.jina.ai/ so Reader receives the fragment.","source_ids":["repository","spec"]},{"label":"Reject or truncate","value":"X-Token-Budget rejects a request when the resulting token cost would exceed the limit. X-Max-Tokens truncates returned content. Choose rejection when completeness matters; use truncation only when partial output is acceptable.","source_ids":["repository","spec"]},{"label":"Authentication and limits","value":"Basic Reader requests can omit credentials. Send Authorization: Bearer YOUR_JINA_API_KEY for the supplied key’s token balance and rate limits. Anonymous limits are tracked by IP; keyed requests use the key’s limits.","source_ids":["reader","spec"]}],"setup":["Choose a known public URL and whether the application needs main-content Markdown, full-page Markdown, HTML or plain text.","Start with the simple GET example. Add Accept: application/json for a machine-readable wrapper; add Authorization: Bearer YOUR_JINA_API_KEY in your private client if using that key’s quota.","Use the POST example for hash-based routes. If content is missing, check the target and cache first, then choose browser rendering or an appropriate wait/target selector.","Inspect the returned URL, content and any error before storing the response. Set a token budget when oversized output should be rejected; do not treat truncated text as a complete page."],"tools":["http-api"],"outputs":["markdown","text","html","json"],"sources":[{"id":"reader","url":"https://jina.ai/reader/","label":"Jina Reader: product options, rates and billing FAQ","checked_at":"2026-09-28"},{"id":"repository","url":"https://github.com/jina-ai/reader","label":"Official Reader guide: formats, selectors and URL fragments","checked_at":"2026-09-28"},{"id":"spec","url":"https://r.jina.ai/openapi.json","label":"Live Reader OpenAPI: headers and request schema","checked_at":"2026-09-28"}],"summary":"Choose Jina Reader’s main-content or full-page Markdown, JSON response wrapper and cache controls. Check URL fragments, selectors and output-token billing.","website":"https://jina.ai/reader/","category":"scraping-api","evidence":"documented","publisher":"Jina AI","checked_at":"2026-10-26","connection":"http-api","review_due":"2026-11-25","limitations":["This record covers known-URL reading through hosted r.jina.ai. Jina’s search, embeddings, self-hosted Reader and specialized OCR paths have different requirements.","A JSON response wrapper or CSS content selection does not establish arbitrary schema-guided field extraction.","Rendering and selection controls are documented capabilities, not a measured success rate for protected or dynamic pages. A paid key does not guarantee access to a blocked target.","The request examples were checked against documentation and parsed locally; no target-page fetch, paid API request or performance test was run."],"capabilities":["javascript-rendering","css-selectors","web-scraping"],"billing_basis":"Basic anonymous URL reading is rate-limited. Keyed Reader usage draws from the supplied API key’s output-token balance; optional modes can change token usage. Jina documents no token deduction for failed requests. Check the current key quota and rate table.","provider_slug":null,"publisher_type":"official","request_examples":[{"code":"curl --fail-with-body 'https://r.jina.ai/https://example.com'","label":"Read a known page — curl","source_ids":["repository"]},{"code":"curl --fail-with-body 'https://r.jina.ai/https://example.com' \\\n  -H 'Accept: application/json' \\\n  -H 'X-Respond-With: markdown' \\\n  -H 'X-No-Cache: true'","label":"Fresh full-page Markdown in JSON — curl","source_ids":["repository","spec"]},{"code":"curl --fail-with-body 'https://r.jina.ai/' \\\n  --data-urlencode 'url=https://example.com/#/route'","label":"Preserve a hash route — curl","source_ids":["repository","spec"]}]}},{"id":"api:nimble-extract","slug":"nimble-extract","name":"Nimble Extract API","category":"scraping-api","canonical_url":"https://workingproxysites.info/tools/nimble-extract","provider_url":"https://workingproxysites.info/t/18-nimble-proxies","capabilities":["async-jobs","batch-requests","browser-actions","javascript-rendering","network-capture","screenshots","structured-extraction"],"outputs":["html","json","markdown","png"],"connections":["http-api"],"checked_at":"2026-10-26","review_due_at":"2026-11-25","review_overdue":false,"sources":[{"id":"docs","url":"https://docs.nimbleway.com/nimble-sdk/web-tools/extract/quickstart","label":"Extract API quickstart and parameters","checkedAt":"2026-09-27"},{"id":"async","url":"https://docs.nimbleway.com/nimble-sdk/web-tools/extract/features/async","label":"Asynchronous and batch extraction","checkedAt":"2026-09-27"},{"id":"pricing","url":"https://docs.nimbleway.com/nimble-sdk/admin/pricing","label":"Nimble SDK pricing","checkedAt":"2026-09-27"},{"id":"formats","url":"https://docs.nimbleway.com/nimble-sdk/web-tools/extract/features/formats","label":"Nimble Extract output formats","checkedAt":"2026-09-27"}],"record":{"name":"Nimble Extract API","slug":"nimble-extract","facts":[{"label":"Formats","value":"The formats array selects HTML, Markdown, Base64 PNG screenshots and response headers.","source_ids":["docs"]},{"label":"Rendering","value":"render defaults to false; true enables JavaScript and auto lets Nimble select the configuration.","source_ids":["docs"]},{"label":"Parsing and actions","value":"CSS parsing schemas, browser actions and network-capture rules are supported.","source_ids":["docs"]},{"label":"Async processing","value":"Async and batch submissions return before processing finishes; poll task or batch progress for completion.","source_ids":["async"]},{"label":"Billing","value":"Extraction Tools are listed at USD 1 per 1,000 URLs, with charges only for successful requests.","source_ids":["pricing"]}],"setup":["Create an API key and authenticate requests to sdk.nimbleway.com with a Bearer token.","POST a URL and selected formats to /v2/extract; enable rendering or a parsing schema as needed.","Use the async or batch endpoints and poll progress for larger jobs."],"tools":["python","nodejs","go","curl"],"outputs":["html","json","markdown","png"],"sources":[{"id":"docs","url":"https://docs.nimbleway.com/nimble-sdk/web-tools/extract/quickstart","label":"Extract API quickstart and parameters","checked_at":"2026-09-27"},{"id":"async","url":"https://docs.nimbleway.com/nimble-sdk/web-tools/extract/features/async","label":"Asynchronous and batch extraction","checked_at":"2026-09-27"},{"id":"pricing","url":"https://docs.nimbleway.com/nimble-sdk/admin/pricing","label":"Nimble SDK pricing","checked_at":"2026-09-27"},{"id":"formats","url":"https://docs.nimbleway.com/nimble-sdk/web-tools/extract/features/formats","label":"Nimble Extract output formats","checked_at":"2026-09-27"}],"summary":"Fetch HTML, Markdown and screenshots with configurable rendering, CSS parsing, browser actions and asynchronous batches.","website":"https://docs.nimbleway.com/nimble-sdk/web-tools/extract/quickstart","category":"scraping-api","evidence":"documented","publisher":"Nimble","checked_at":"2026-10-26","connection":"http-api","review_due":"2026-11-25","limitations":["The Extraction Tools price is distinct from paid Extraction Templates, Search and Web Search Agent products.","Exact concurrency limits and all driver-specific constraints were not verified in this pilot."],"capabilities":["javascript-rendering","structured-extraction","browser-actions","async-jobs","batch-requests","network-capture","screenshots"],"billing_basis":"Successful URL extractions; public API pricing lists USD 1 per 1,000 URLs for Extraction Tools.","provider_slug":"nimble","publisher_type":"official"}},{"id":"api:scrapeops-proxy-api-aggregator","slug":"scrapeops-proxy-api-aggregator","name":"ScrapeOps Proxy API Aggregator","category":"scraping-api","canonical_url":"https://workingproxysites.info/tools/scrapeops-proxy-api-aggregator","provider_url":"https://workingproxysites.info/t/98-scrapeops-proxies","capabilities":["javascript-rendering","screenshots","structured-extraction"],"outputs":["html","json","markdown","screenshot"],"connections":["http-api"],"checked_at":"2026-10-26","review_due_at":"2026-11-25","review_overdue":false,"sources":[{"id":"costs","url":"https://scrapeops.io/docs/web-scraping-proxy-api-aggregator/account/request-costs/","label":"Request costs and billable status codes","checkedAt":"2026-09-27"},{"id":"cheap","url":"https://scrapeops.io/docs/web-scraping-proxy-api-aggregator/advanced-functionality/render-js-cheap/","label":"Lower-cost rendering constraints","checkedAt":"2026-09-27"},{"id":"features","url":"https://scrapeops.io/docs/web-scraping-proxy-api-aggregator/advanced-functionality/functionality-list/","label":"Supported request and extraction options","checkedAt":"2026-09-27"},{"id":"llm-extract","url":"https://scrapeops.io/docs/web-scraping-proxy-api-aggregator/advanced-functionality/llm-extract/","label":"ScrapeOps LLM extraction options","checkedAt":"2026-09-27"}],"record":{"name":"ScrapeOps Proxy API Aggregator","slug":"scrapeops-proxy-api-aggregator","facts":[{"label":"Billing outcomes","value":"The credit policy counts both HTTP 200 and 404 responses as successful, billable requests.","source_ids":["costs"]},{"label":"Rendering costs","value":"Standard rendering costs 10 credits; residential plus rendering costs 25; render_js_cheap costs 5 using a limited provider set.","source_ids":["costs"]},{"label":"Extraction add-on","value":"llm_extract adds 25 credits on top of base proxy costs.","source_ids":["costs"]},{"label":"Cheaper rendering tradeoff","value":"render_js_cheap is intended for simpler sites and does not provide the full upstream provider pool.","source_ids":["cheap"]},{"label":"Response options","value":"The feature list documents screenshot capture and JSON or Markdown LLM extraction responses.","source_ids":["features"]}],"setup":["Obtain a ScrapeOps API key.","Send the target URL and API key to the aggregator endpoint.","Choose rendering and pool options, then check the domain-specific cost table before increasing volume."],"tools":["curl"],"outputs":["html","json","markdown","screenshot"],"sources":[{"id":"costs","url":"https://scrapeops.io/docs/web-scraping-proxy-api-aggregator/account/request-costs/","label":"Request costs and billable status codes","checked_at":"2026-09-27"},{"id":"cheap","url":"https://scrapeops.io/docs/web-scraping-proxy-api-aggregator/advanced-functionality/render-js-cheap/","label":"Lower-cost rendering constraints","checked_at":"2026-09-27"},{"id":"features","url":"https://scrapeops.io/docs/web-scraping-proxy-api-aggregator/advanced-functionality/functionality-list/","label":"Supported request and extraction options","checked_at":"2026-09-27"},{"id":"llm-extract","url":"https://scrapeops.io/docs/web-scraping-proxy-api-aggregator/advanced-functionality/llm-extract/","label":"ScrapeOps LLM extraction options","checked_at":"2026-09-27"}],"summary":"Route scraping requests across upstream services, with rendering, proxy-pool and extraction options.","website":"https://scrapeops.io/proxy-aggregator/","category":"scraping-api","evidence":"documented","publisher":"ScrapeOps","checked_at":"2026-10-26","connection":"http-api","review_due":"2026-11-25","limitations":["Certain domains and premium configurations use different credit schedules.","Unused credits do not transfer into the next subscription period.","A target 404 can still consume quota."],"capabilities":["javascript-rendering","structured-extraction","screenshots"],"billing_basis":"Monthly API credits determined by target and options; HTTP 200 and 404 responses consume credits.","provider_slug":"scrapeops","publisher_type":"official"}},{"id":"api:scrapingbee-html-api","slug":"scrapingbee-html-api","name":"ScrapingBee HTML API","category":"scraping-api","canonical_url":"https://workingproxysites.info/tools/scrapingbee-html-api","provider_url":"https://workingproxysites.info/t/167-scrapingbee-proxies","capabilities":["bring-your-own-proxy","browser-actions","javascript-rendering","screenshots","structured-extraction"],"outputs":["html","json","markdown","screenshot","text"],"connections":["http-api"],"checked_at":"2026-10-26","review_due_at":"2026-11-25","review_overdue":false,"sources":[{"id":"docs","url":"https://www.scrapingbee.com/documentation/","label":"HTML API parameters, outputs and credit costs","checkedAt":"2026-09-27"}],"record":{"name":"ScrapingBee HTML API","slug":"scrapingbee-html-api","facts":[{"label":"Rendering default","value":"render_js defaults to true. HTML, page text, Markdown and screenshots are documented output options.","source_ids":["docs"]},{"label":"Request credits","value":"Classic requests cost 1 credit without rendering or 5 with it; premium with rendering costs 25 and stealth with rendering costs 75.","source_ids":["docs"]},{"label":"Extraction and interaction","value":"CSS extract_rules and js_scenario support structured extraction and page interactions.","source_ids":["docs"]},{"label":"Custom proxy","value":"The own_proxy parameter supports a user-supplied proxy provider.","source_ids":["docs"]},{"label":"Automatic cost control","value":"GET-only mode=auto chooses a successful rendering/proxy tier; max_cost caps eligible tiers and all-failed auto attempts cost zero.","source_ids":["docs"]}],"setup":["Obtain an API key and send the encoded target URL to the HTML API.","Set output and extraction options; disable rendering when the required content is present in the server response.","For auto mode, set max_cost and omit manually selected rendering/proxy-tier parameters."],"tools":["python-requests","nodejs","curl"],"outputs":["html","json","markdown","text","screenshot"],"sources":[{"id":"docs","url":"https://www.scrapingbee.com/documentation/","label":"HTML API parameters, outputs and credit costs","checked_at":"2026-09-27"}],"summary":"Fetch rendered pages, apply CSS extraction rules or run browser scenarios through an HTTP API.","website":"https://www.scrapingbee.com/","category":"scraping-api","evidence":"documented","publisher":"ScrapingBee","checked_at":"2026-10-26","connection":"http-api","review_due":"2026-11-25","limitations":["AI extraction adds credits beyond base fetch costs.","Auto mode does not supply page-specific waits or browser scenarios.","The service returns extracted content through HTTP; this record does not claim a remotely controllable CDP browser."],"capabilities":["javascript-rendering","structured-extraction","screenshots","bring-your-own-proxy","browser-actions"],"billing_basis":"Monthly API credits; rendering and proxy tier determine base credits, with AI extraction add-ons.","provider_slug":"scrapingbee","publisher_type":"official"}},{"id":"api:tavily-api","slug":"tavily-api","name":"Tavily API","category":"scraping-api","canonical_url":"https://workingproxysites.info/tools/tavily-api","provider_url":null,"capabilities":["web-scraping","web-search"],"outputs":["json","markdown","text"],"connections":["http-api"],"checked_at":"2026-10-26","review_due_at":"2026-11-25","review_overdue":false,"sources":[{"id":"search","url":"https://docs.tavily.com/documentation/api-reference/endpoint/search","label":"Tavily Search endpoint, request parameters and response","checkedAt":"2026-09-29"},{"id":"extract","url":"https://docs.tavily.com/documentation/api-reference/endpoint/extract","label":"Tavily Extract endpoint, Markdown and partial failures","checkedAt":"2026-09-29"},{"id":"credits","url":"https://docs.tavily.com/documentation/api-credits","label":"Tavily account credits and per-operation cost","checkedAt":"2026-09-29"},{"id":"keyless","url":"https://docs.tavily.com/documentation/keyless","label":"Tavily keyless direct HTTP access and account upgrade","checkedAt":"2026-09-29"}],"record":{"name":"Tavily API","slug":"tavily-api","facts":[{"label":"Unknown source URL","value":"POST /search with a query. Set search_depth: basic and max_results deliberately; results include source URLs and content snippets. A result snippet is a lead to inspect, not the complete source page.","source_ids":["search"]},{"label":"Known source URL","value":"POST /extract directly with urls (one URL or up to 20). Request format: markdown or text. The JSON response wraps each successful page in results with raw_content. Search is unnecessary when the URL is already known.","source_ids":["extract"]},{"label":"Content choice","value":"Search returns results[].content snippets; request include_raw_content for cleaned and parsed page content when available, without a guarantee of complete target coverage. Extract format: markdown returns Markdown inside results[].raw_content; format: text selects plain text.","source_ids":["search","extract"]},{"label":"Partial result check","value":"An Extract HTTP 200 can include both results and failed_results, or an empty results array if every valid URL fails. Match each returned item to its URL; output order is not guaranteed.","source_ids":["extract"]},{"label":"Search credit unit","value":"Basic Search costs 1 account credit per request and advanced costs 2. auto_parameters may select advanced; set search_depth: basic explicitly when the lower unit matters.","source_ids":["credits","search"]},{"label":"Extract credit unit","value":"With an account key, basic Extract costs 1 credit per 5 successful URL extractions and advanced costs 2 per 5. Failed URL extractions are not charged. With include_usage: true, usage may show 0 before the total reaches five successful extractions.","source_ids":["credits","extract"]},{"label":"Direct HTTP access","value":"POST /search and /extract can use X-Tavily-Access-Mode: keyless without an account or API key, subject to rate limits. Alternatively send Authorization: Bearer YOUR_TAVILY_API_KEY for account limits; if both headers are sent, the key takes precedence. The MCP connection has its own client setup.","source_ids":["keyless","credits"]}],"setup":["If you know the source URL, call Extract directly. If you need to discover a URL, call Search and inspect a selected result before extracting its page.","Send a JSON POST to https://api.tavily.com/search or https://api.tavily.com/extract with Content-Type: application/json. For free, rate-limited direct HTTP access send X-Tavily-Access-Mode: keyless. For account limits and credits, send Authorization: Bearer YOUR_TAVILY_API_KEY instead.","Start with basic depth and a small result count or known-URL batch. The examples are JSON request bodies for those paths. Set include_usage: true when you need a returned account-usage field.","On Extract, inspect results and failed_results by URL even after HTTP 200. Read failed_results[].error, and treat usage of 0 before five successful extractions as a reporting detail, not proof of unlimited free account use."],"tools":["http-api"],"outputs":["json","markdown","text"],"sources":[{"id":"search","url":"https://docs.tavily.com/documentation/api-reference/endpoint/search","label":"Tavily Search endpoint, request parameters and response","checked_at":"2026-09-29"},{"id":"extract","url":"https://docs.tavily.com/documentation/api-reference/endpoint/extract","label":"Tavily Extract endpoint, Markdown and partial failures","checked_at":"2026-09-29"},{"id":"credits","url":"https://docs.tavily.com/documentation/api-credits","label":"Tavily account credits and per-operation cost","checked_at":"2026-09-29"},{"id":"keyless","url":"https://docs.tavily.com/documentation/keyless","label":"Tavily keyless direct HTTP access and account upgrade","checked_at":"2026-09-29"}],"summary":"Choose direct HTTP Search when the source URL is unknown or Extract when it is known. Compare keyless and account access, JSON-wrapped Markdown, partial failures and billing units.","website":"https://docs.tavily.com/documentation/api-reference/endpoint/search","category":"scraping-api","evidence":"documented","publisher":"Tavily","checked_at":"2026-10-26","connection":"http-api","review_due":"2026-11-25","limitations":["This page covers direct HTTP Search and Extract. The paired MCP page covers client connection and available tools; the same keyless access mode can be used with either interface.","Keyless HTTP requests need the X-Tavily-Access-Mode: keyless header and are rate-limited. Map, Crawl and Research require an account API key.","Search results are Tavily web discovery results, not a positional Google SERP snapshot. This record does not claim that Tavily is a dedicated SERP API.","Extract Markdown is page content in results[].raw_content within a JSON response, not schema-guided field extraction. Protected targets and source accuracy were not tested.","Examples were parsed against the current documented request schema locally. No Tavily account request, target fetch, performance test or observed supplier bill is claimed."],"capabilities":["web-search","web-scraping"],"billing_basis":"Search and Extract offer free, rate-limited keyless direct HTTP access with X-Tavily-Access-Mode: keyless. With an account key, basic Search costs 1 credit/request and advanced costs 2; basic Extract costs 1 credit per 5 successful URL extractions and advanced costs 2 per 5. Failed URL extractions are not charged. Extract usage can report 0 before five successful URL extractions.","decision_rows":[{"when":"Source URL unknown","check":"Read results[].url and content snippets; choose a source URL, then inspect its page content. A snippet is not the full page.","billing":"Keyless is free and rate-limited. With an account key, basic Search is 1 credit per request.","request":"POST /search with a query, basic depth and a small max_results.","source_ids":["search","credits","keyless"]},{"when":"Source URL known","check":"Match results[].url and raw_content to failed_results[].url and error, even after HTTP 200.","billing":"Keyless is free and rate-limited. With an account key, basic Extract is 1 credit per 5 successful URL extractions; usage can show 0 before five.","request":"POST /extract with urls and format: markdown or text; skip source discovery.","source_ids":["extract","credits","keyless"]}],"provider_slug":null,"publisher_type":"official","request_examples":[{"code":"{\n  \"query\": \"official API documentation for a library\",\n  \"search_depth\": \"basic\",\n  \"max_results\": 3,\n  \"include_raw_content\": false,\n  \"auto_parameters\": false,\n  \"include_usage\": true\n}","label":"Discover a source — POST /search JSON body","source_ids":["search","credits","keyless"]},{"code":"{\n  \"urls\": [\n    \"https://example.com/docs\"\n  ],\n  \"extract_depth\": \"basic\",\n  \"format\": \"markdown\",\n  \"include_usage\": true\n}","label":"Read a known page — POST /extract JSON body","source_ids":["extract","credits","keyless"]}],"response_examples":[{"code":"{\n  \"results\": [\n    {\n      \"url\": \"https://example.com/article\",\n      \"raw_content\": \"Example extracted article content.\",\n      \"images\": []\n    }\n  ],\n  \"failed_results\": [\n    {\n      \"url\": \"https://example.com/unavailable\",\n      \"error\": \"Failed to retrieve content\"\n    }\n  ],\n  \"response_time\": 0.5,\n  \"request_id\": \"123e4567-e89b-12d3-a456-426614174111\"\n}","label":"Documented mixed-success Extract response (example shape, not a live result)","source_ids":["extract","credits"],"interpretation":"Treat results[].raw_content as content only for successful URLs. Match failed_results[].url and error to the input before accepting a batch; HTTP 200 alone does not mean every URL succeeded. The optional usage field appears when requested and can show 0 before five successful extractions."}]}}]}