API directory
Web Data API Directory: Scraping, Search, Browsers & IP Intelligence
Compare documented scraping APIs, search-result APIs, hosted browsers and IP intelligence services by interface, output, capabilities and billing basis.
Select the service interface and output needed for a web-data workload.
- Need returned HTML or extracted data? Compare HTTP APIs.
- Need an interactive browser session? Compare CDP services and session terms.
- Need search-engine results? Check the dedicated SERP records and supported parsers.
- Need to classify an IP address? Compare location, ASN and privacy data with their plan requirements.
This collection covers our reviewed proxy and web-data catalog. It is not an exhaustive market survey or a performance ranking.
Category reviewed . Review due .
Compare documented requirements
39 of 39 listingsSwipe or scroll horizontally to compare requirements. Scroll back to the first column to see listing names.
| API / service | Interface & output | Billing & restrictions | Evidence |
|---|---|---|---|
| Abstract IP Geolocation APIAbstract API Inc · official publisher Evaluate location and ASN enrichment, with company and security fields shown in higher-tier product examples. A free allowance supports evaluation; reconcile response-version and rate-limit differences before committing to a paid integration. Abstract IP Geolocation API details & setup →Abstract IP Geolocation API JSON record | HTTP API JSON IP intelligence | Each Abstract API has its own request subscription. Free IP Geolocation documents 1,000 monthly requests at 1 request per second. Paid pricing depends on the selected plan, volume and billing period; confirm the applicable rate limit. | Documentation checkedReview due 4 source references
|
| BigDataCloudBigDataCloud Pty Ltd · official publisher Compare a key-based geolocation package whose free Base tier includes the documented hazard fields. Confidence polygons and BGP/ASN context add detail for applications that need to retain uncertainty and network information. BigDataCloud details & setup →BigDataCloud JSON record | HTTP API JSON IP intelligence | The IP Geolocation package uses monthly request quotas. Base includes 10,000 free requests; Bronze includes 100,000 for USD 29.95/month, with optional overage pricing. All package fields are available at each tier. | Documentation checkedReview due 4 source references
|
| Bright Data Browser APIBright Data · official publisher Hosted browsers for multi-step automation with built-in proxy management and unblocking. Bright Data Browser API details & setup →Bright Data provider profileBright Data Browser API JSON record | CDP / WebSocket browser session Hosted browser | Transferred traffic in GB on paid plans; built-in proxy management and unblocking included. | Documentation checkedReview due 3 source references
|
| Bright Data SERP APIBright Data · official publisher Collect localized search results as parsed JSON or raw HTML, with synchronous and asynchronous delivery. Bright Data SERP API details & setup →Bright Data provider profileBright Data SERP API JSON record | HTTP API JSON, HTML SERP API | Successful requests; asynchronous result collection is not separately billed. | Documentation checkedReview due 2 source references
|
| Browserbase Browser SessionsBrowserbase · official publisher Hosted browser sessions with custom proxies, plan-based concurrency and reconnection through keep-alive. Browserbase Browser Sessions details & setup →Browserbase Browser Sessions JSON record | CDP / WebSocket browser session Hosted browser | Browser time plus built-in proxy traffic, with plan allowances and overages. | Documentation checkedReview due 4 source references
|
| Browserless Browser as a ServiceBrowserless · official publisher Connect Playwright or Puppeteer to hosted browsers with optional built-in or third-party proxies. Browserless Browser as a Service details & setup →Browserless Browser as a Service JSON record | CDP / WebSocket browser session Hosted browser | Units for browser time, built-in proxy bandwidth and successful CAPTCHA solves. | Documentation checkedReview due 2 source references
|
| Crawlbase Crawling APICrawlbase · official publisher Fetch page content with normal or JavaScript tokens, optional geo-routing and browser interaction controls. Crawlbase Crawling API details & setup →Crawlbase provider profileCrawlbase Crawling API JSON record | HTTP API HTML, JSON Scraping API | Successful requests; JavaScript request configuration and extended scrolling affect billed usage. | Documentation checkedReview due 1 source references
|
| DB-IPDB-IP · official publisher Choose Basic for location, Core for ASN and ISP data, or Extended for proxy and threat fields. Free API access and free Lite downloads have different limits and licensing conditions. DB-IP details & setup →DB-IP JSON record | HTTP API JSON, csv, mmdb IP intelligence | Paid API subscriptions combine a feature tier with a daily query allowance. Local databases have separate licenses; a daily API allowance is not a monthly lookup pool. | Documentation checkedReview due 9 source references
|
| Decodo Web Scraping APIDecodo · official publisher An HTTP API for rendered web content, with request-level choices for proxy pool and JavaScript execution. Decodo Web Scraping API details & setup →Decodo provider profileDecodo Web Scraping API JSON record | HTTP API HTML, JSON Scraping API | Request credits vary by request complexity, including proxy pool and JavaScript rendering. | Documentation checkedReview due 3 source references
|
| Exa APIExa · official publisher Use direct HTTP Search to discover source URLs or Contents when URLs or document IDs are known. Choose returned text deliberately, inspect per-item statuses and compare request versus content-type charges. Exa API details & setup →Exa API JSON record | HTTP API JSON, text, highlights Scraping API | Current account pricing: /search lite (and legacy instant) is $4 per 1,000 requests; auto (and legacy fast) is $7 per 1,000, including up to 10 results, with extra results at $1 per 1,000 results. /contents is $1 per 1,000 returned pages per content type: requesting text and highlights for one page counts as two. AI page summaries have a separately listed $1 per 1,000 pages charge. Rates and account terms can change. | Documentation checkedReview due 4 source references
|
| Firecrawl APIFirecrawl · official publisher Compare Firecrawl Markdown, HTML and JSON extraction, cache settings and credit charges. Choose a request format and check target status before accepting data. Firecrawl API details & setup →Firecrawl API JSON record | HTTP API markdown, HTML, JSON, screenshot Scraping API | Credits per returned page, with option charges. An ordinary scrape is 1 credit; schema-guided JSON adds 4. Account plans and anonymous limits are separate. Check detailed billing before enabling extra options. | Documentation checkedReview due 8 source references
|
| ip-api.comip-api.com · official publisher Use the no-key HTTP endpoint for eligible non-commercial projects, or Pro for commercial HTTPS access. Proxy, VPN and Tor exits share one response flag, while hosting is identified separately. ip-api.com details & setup →ip-api.com JSON record | HTTP API JSON, jsonp, xml, csv, text, php IP intelligence | Pro is a fixed-term subscription advertised with unlimited queries subject to acceptable-use rules. The displayed €13.3 monthly equivalent requires payment for 12 months and excludes VAT. | Documentation checkedReview due 3 source references
|
| IP2Location and IP2ProxyIP2Location · official publisher Choose local IP2Location geolocation databases, related IP2Proxy detection databases or the current IP2Location.io API. Detection fields and license rights depend on the selected product and plan. IP2Location and IP2Proxy details & setup →IP2Location and IP2Proxy JSON record | HTTP API JSON, xml, csv, bin, cidr IP intelligence | IP2Location.io has monthly API query allowances with paid overage blocks. Local database prices are annual and vary by data package and license; API access and database licenses are separate choices. | Documentation checkedReview due 7 source references
|
| ipapi.coKloudend Inc. · official publisher Kloudend's location and ASN API supports JSON, XML, CSV, YAML and plain-text field lookups. Its free trial is for development; production use and response-retention terms need a separate check. ipapi.co details & setup →ipapi.co JSON record | HTTP API JSON, jsonp, xml, csv, yaml, plaintext IP intelligence | Paid plans provide monthly lookup allowances with monthly or annual billing. Repeated queries for the same IP count separately; the free trial is for testing and development. | Documentation checkedReview due 4 source references
|
| ipapi.comAPILayer · official publisher APILayer's ipapi.com separates location, connection, bulk and security features by plan. Check the non-commercial Free allowance, the Business Pro security requirement and per-call overages before selecting access. ipapi.com details & setup →ipapi.com JSON record | HTTP API JSON, xml, jsonp IP intelligence | Paid subscriptions have monthly lookup allowances and plan-specific per-call overage charges. Annual billing is available; optional Platinum Support adds a separate annual charge. | Documentation checkedReview due 5 source references
|
| ipdataipdata · official publisher Use one API for location, ASN and documented threat fields. Check the daily request budget, the free tier's attribution requirement and per-IP city-level cap, and the Business/Enterprise requirement for VPN detection before choosing a plan. ipdata details & setup →ipdata JSON record | HTTP API JSON IP intelligence | Subscription plans have daily request quotas. Each IP in a bulk request consumes quota. The free tier gives 1,000 city-level lookups a day with no key, then country and ASN data without limit. Commercial use is allowed with attribution. | Documentation checkedReview due 6 source references
|
| IPGeolocation.ioIPGeolocation.io · official publisher Choose core location data, a separate IP Security lookup or a combined response. Free is described for evaluation and prototypes and excludes security. Paid modules change the credit cost of each lookup; local databases are licensed separately. IPGeolocation.io details & setup →IPGeolocation.io JSON record | HTTP API JSON, xml, csv, mmdb IP intelligence | API usage is charged in module credits: a base lookup costs 1, security alone 2, and location with security 3 per valid IP. Monthly plans have monthly allowances; annual plans have annual allowances. Paid overages require enablement, and database licenses are separate. | Documentation checkedReview due 7 source references
|
| IPinfoIPinfo · official publisher Choose between free country/ASN lookup, Core city data with a combined anonymity flag, and Max with separate privacy signals. Database access is a separate product decision. IPinfo details & setup →IPinfo JSON record | HTTP API JSON, plaintext, csv, mmdb, parquet IP intelligence | Paid APIs have monthly request allowances and optional metered overages. Lite has no request quota; paid database delivery is separate from self-service API plans. | Documentation checkedReview due 5 source references
|
| IPQualityScoreIPQualityScore LLC · official publisher Use proxy and VPN detection with network/location enrichment and contextual fraud scoring. Distinguish suspected from active VPN/Tor signals, check Enterprise-only fields, and arrange downloadable database access separately. IPQualityScore details & setup →IPQualityScore JSON record | HTTP API JSON, xml IP intelligence | API lookups consume one query credit except documented exclusions. Subscriptions and prepaid query packs are offered; the product advertises 1,000 free monthly IP lookups. Current paid prices were not verified. | Documentation checkedReview due 6 source references
|
| IpregistryIpregistry · official publisher Get location, ASN and separate proxy, VPN, Tor and relay signals in every API plan. Choose credits for hosted lookups or separately licensed datasets for local processing. Ipregistry details & setup →Ipregistry JSON record | HTTP API JSON, csv, mmdb IP intelligence | API subscriptions supply monthly credits; one-time credit packs do not expire. Single lookups cost one credit, while batches cost one per lookup plus one. Offline datasets have separate subscriptions. | Documentation checkedReview due 4 source references
|
| IPWHOIS.io (ipwho.is)IPWHOIS.io · official publisher Use the no-key ipwho.is endpoint for commercial geolocation within its daily allowance. Move to Business or Unlimited on ipwhois.pro for security flags or bulk requests; Basic adds volume without those capabilities. IPWHOIS.io (ipwho.is) details & setup →IPWHOIS.io (ipwho.is) JSON record | HTTP API JSON, xml, csv, mmdb IP intelligence | Free has a daily request limit. Paid API plans have monthly allowances; bulk consumes one credit per IP. Enterprise database downloads require a separate sales arrangement. | Documentation checkedReview due 4 source references
|
| Jina Reader APIJina AI · official publisher Choose Jina Reader’s main-content or full-page Markdown, JSON response wrapper and cache controls. Check URL fragments, selectors and output-token billing. Jina Reader API details & setup →Jina Reader API JSON record | HTTP API markdown, text, HTML, JSON Scraping API | Basic anonymous URL reading is rate-limited. Keyed Reader usage draws from the supplied API key’s output-token balance; optional modes can change token usage. Jina documents no token deduction for failed requests. Check the current key quota and rate table. | Documentation checkedReview due 3 source references
|
| MaxMind GeoIP and GeoLiteMaxMind · official publisher Compare free GeoLite geolocation, paid GeoIP web services and local databases. Choose Insights or an Anonymous IP database when anonymizer signals are required, and plan database updates as part of the integration. MaxMind GeoIP and GeoLite details & setup →MaxMind GeoIP and GeoLite JSON record | HTTP API JSON, mmdb, csv IP intelligence | Paid GeoIP web services require service credit. GeoLite has daily free limits; Anonymous IP database purchasing is arranged separately with MaxMind. | Documentation checkedReview due 5 source references
|
| Nimble Extract APINimble · official publisher Fetch HTML, Markdown and screenshots with configurable rendering, CSS parsing, browser actions and asynchronous batches. Nimble Extract API details & setup →Nimble provider profileNimble Extract API JSON record | HTTP API HTML, JSON, markdown, PNG Scraping API | Successful URL extractions; public API pricing lists USD 1 per 1,000 URLs for Extraction Tools. | Documentation checkedReview due 4 source references
|
| Oxylabs Web Scraper APIOxylabs · official publisher Fetch public pages or use dedicated target parsers, with rendered HTML and asynchronous batch delivery. Oxylabs Web Scraper API details & setup →Oxylabs provider profileOxylabs Web Scraper API JSON record | HTTP API HTML, JSON, PNG Scraping API | Product-specific plan and target rates; exact costs and failed-request rules were not verified in this pilot. | Documentation checkedReview due 5 source references
|
| proxycheck.ioproxycheck.io · official publisher Compare daily address allowances for proxy, VPN, Tor and hosting classification. The v3 reference separates risk from detection confidence and recency; free access includes the core detection features, with lower usage and customization limits. proxycheck.io details & setup →proxycheck.io JSON record | HTTP API JSON IP intelligence | Subscriptions buy daily query allowances even when billed monthly or yearly. Every checked address consumes quota, including addresses sent in bulk. Registered free access permits 1,000 queries per day. | Documentation checkedReview due 4 source references
|
| Scrapeless Agent BrowserScrapeless · official publisher Connect browser automation frameworks to managed sessions with optional recording, profiles and custom proxies. Scrapeless Agent Browser details & setup →Scrapeless Agent Browser JSON record | CDP / WebSocket browser session Hosted browser | Browser runtime and proxy bandwidth; exact plan-specific rates were not verified. | Documentation checkedReview due 3 source references
|
| ScrapeOps Proxy API AggregatorScrapeOps · official publisher Route scraping requests across upstream services, with rendering, proxy-pool and extraction options. ScrapeOps Proxy API Aggregator details & setup →ScrapeOps provider profileScrapeOps Proxy API Aggregator JSON record | HTTP API HTML, JSON, markdown, screenshot Scraping API | Monthly API credits determined by target and options; HTTP 200 and 404 responses consume credits. | Documentation checkedReview due 4 source references
|
| ScraperAPIScraperAPI · official publisher A scraping HTTP API with optional rendering, premium proxy pools and asynchronous requests. ScraperAPI details & setup →ScraperAPI provider profileScraperAPI JSON record | HTTP API HTML, JSON Scraping API | API credits determined by target domain and request options. | Documentation checkedReview due 8 source references
|
| Scrapfly Scrape APIScrapfly · official publisher A scraping API with managed rendering, JavaScript scenarios and configurable anti-blocking options. Scrapfly Scrape API details & setup →Scrapfly provider profileScrapfly Scrape API JSON record | HTTP API HTML, JSON, screenshot Scraping API | API credits per scrape; proxy network, rendering and protection settings affect consumption. | Documentation checkedReview due 4 source references
|
| ScrapingAnt Web Scraping APIScrapingAnt · official publisher Return page HTML through an API with optional browser rendering, selector waits and proxy location controls. ScrapingAnt Web Scraping API details & setup →ScrapingAnt provider profileScrapingAnt Web Scraping API JSON record | HTTP API HTML Scraping API | API credits based on browser use and proxy network. | Documentation checkedReview due 3 source references
|
| ScrapingBee Google Search APIScrapingBee · official publisher Fetch Google search results with device, geography and search-type controls. ScrapingBee Google Search API details & setup →ScrapingBee provider profileScrapingBee Google Search API JSON record | HTTP API JSON, HTML SERP API | Documentation distinguishes light requests at 10 credits from regular requests at 15 credits. Confirm the selected mode; credits are not USD. | Documentation checkedReview due 1 source references
|
| ScrapingBee HTML APIScrapingBee · official publisher Fetch rendered pages, apply CSS extraction rules or run browser scenarios through an HTTP API. ScrapingBee HTML API details & setup →ScrapingBee provider profileScrapingBee HTML API JSON record | HTTP API HTML, JSON, markdown, text, screenshot Scraping API | Monthly API credits; rendering and proxy tier determine base credits, with AI extraction add-ons. | Documentation checkedReview due 1 source references
|
| Steel Browser SessionsSteel · official publisher Create cloud browser sessions with custom proxies, stored browser state and configurable idle release. Steel Browser Sessions details & setup →Steel Browser Sessions JSON record | CDP / WebSocket browser session Hosted browser | Session time; exact plan rates and proxy add-on prices were not verified. | Documentation checkedReview due 3 source references
|
| Tavily APITavily · official publisher Choose direct HTTP Search when the source URL is unknown or Extract when it is known. Compare keyless and account access, JSON-wrapped Markdown, partial failures and billing units. Tavily API details & setup →Tavily API JSON record | HTTP API JSON, markdown, text Scraping API | Search and Extract offer free, rate-limited keyless direct HTTP access with X-Tavily-Access-Mode: keyless. With an account key, basic Search costs 1 credit/request and advanced costs 2; basic Extract costs 1 credit per 5 successful URL extractions and advanced costs 2 per 5. Failed URL extractions are not charged. Extract usage can report 0 before five successful URL extractions. | Documentation checkedReview due 4 source references
|
| Thordata Universal Scraping APIThordata · official publisher An HTTP endpoint for HTML or PNG results with optional JavaScript rendering and resource controls. Thordata Universal Scraping API details & setup →Thordata provider profileThordata Universal Scraping API JSON record | HTTP API HTML, PNG Scraping API | Not verified; request multipliers, failed-request billing and plan pricing require further evidence. | Documentation checkedReview due 1 source references
|
| Zyte APIZyte · official publisher Choose HTTP response bodies, rendered HTML, screenshots or supported structured extraction in one API. Zyte API details & setup →Zyte provider profileZyte API JSON record | HTTP API HTML, JSON, screenshot Scraping API | Successful responses, priced by target and HTTP/browser tier, with feature add-ons. | Documentation checkedReview due 4 source references
|
| Zyte CDP Headless BrowserZyte · official publisher Drive a live Zyte browser with Playwright or Puppeteer, with session pricing tied to navigation count and time. Zyte CDP Headless Browser details & setup →Zyte provider profileZyte CDP Headless Browser JSON record | CDP / WebSocket browser session Hosted browser | Target-tier units: the greater of page.goto calls or started 15-second session intervals; residential overages can add charges. | Documentation checkedReview due 1 source references
|
| Zyte Search APIZyte · official publisher Request parsed search results or rendered result-page HTML through a dedicated search endpoint. Zyte Search API details & setup →Zyte provider profileZyte Search API JSON record | HTTP API JSON, HTML SERP API | Request weight increases with maxResults: max(1, maxResults / 10). A USD rate was not established from the reviewed search documentation. | Documentation checkedReview due 3 source references
|
How to use this comparison
Prepared by WPS directory editorial from the linked primary documentation.
Compare the documented request interface, output and account product before checking price. A JSON response can contain raw HTML; it does not by itself establish structured extraction. A browser action in one request does not by itself establish a reusable browser session.
Each row keeps the publisher’s billing basis and restrictions alongside its sources. Unknown prices or limits remain unknown. These are documentation reviews; no live connection, purchase or comparative performance test is claimed.
Review dates show when the documentation was checked. Overdue records remain visible with a label; recheck those sources before choosing a service.
The collection JSON link covers the whole category before filters. Each listing’s page has its full documented behavior, limitations and examples.
Suggest a correction · Affiliate disclosure · Collection JSON records