Skip to main content

How Much Does Web Scraping Cost in 2026? A Worked Estimation Model

HT

Hinata Tomoda

Web engineer & independent reviewer

13 min read

This article contains affiliate links. If you purchase through them, we may earn a commission at no extra cost to you. Our tests and rankings are independent and never influenced by partners.

At published list prices (July 2026), web scraping costs anywhere from $7.50-$81.25 a month for a 30,000-page side project to $125-$2,500 for a 500,000-page price-intelligence pipeline — each range running from the cheapest documented route to the costliest listed one — and into five figures plus negotiation for multi-terabyte AI data collection. The spread is that wide because the bill hangs on three numbers most estimates skip: pages per month, bytes per successful page, and how many attempts each success costs you. This guide gives you the formula — pages x page weight x retry factor, converted to gigabytes — and walks three personas through it against documented per-GB proxy rates ($2.00-$7.35/GB) and per-request API rates ($0.25-$1.50 per 1K).

Key takeaways

  • Estimate traffic first: monthly GB = pages per month x average page weight in MB x retry factor, divided by 1,000 — then price that volume against both per-GB proxy tiers and per-request API rates and take the cheaper route.
  • Small jobs favor APIs: 30,000 pages a month (~15.6 GB in our model) costs $7.50-$37.50 at documented per-request rates versus $62.40-$81.25 on a residential proxy route.
  • Mid-size is a coin flip decided by page weight: 500,000 pages at 0.6 MB is ~420 GB, roughly $1,050-$1,260 at the $2.50-$3.00/GB tier rates versus $250-$750 at documented per-request rates ($0.50 standard to $1.50 premium per 1K; Oxylabs quotes from $125) — the ranking flips if your pages are lighter than ~0.2 MB.
  • Break-even rule of thumb: at $2.50/GB with a 1.4x retry factor, per-GB proxies only beat a $0.50-per-1K API when a successful page transfers less than about 0.14 MB, and lose to a $1.50-per-1K API above about 0.43 MB.
  • Our page weights (0.4-1.2 MB) and retry factors (1.3x-1.4x) are modeling assumptions, not measurements — no provider publishes them, and a 0.2 MB error in page weight moves a 500,000-page bill by hundreds of dollars a month.
  • Watch the billing asymmetry: per-GB plans charge for failed attempts and retries, while Oxylabs' Web Scraper API, Bright Data's Web Unlocker, and IPRoyal's Web Unblocker document success-only billing (the Decodo and IPRoyal Web Scraping APIs publish no failed-request policy); Decodo adds VAT to every listed price, and Bright Data's $4.00/GB is a 50%-off promo.

The five numbers that drive your scraping bill

Every scraping budget is the product of the same handful of drivers. Three of them are properties of your workload that only you can measure; two are published prices you can look up. The table separates our modeling assumptions from documented rates.

Web scraping cost drivers (rates as published July 2026; workload figures are our modeling assumptions)
Cost driverWhat moves itRange used in this article
Pages per monthCrawl scope and how often you re-crawl the same URLs30,000 to 5,000,000 (persona assumption)
Average page weightJS-heavy HTML versus lean endpoints; whether images and media get fetched0.4-1.2 MB per page (our modeling assumption)
Retry factorTarget difficulty, block rates, geo restrictions1.3x-1.4x (our modeling assumption)
Per-GB proxy rateVolume tier and provider$2.00-$7.35/GB (documented, July 2026)
Per-request API rateProvider, JS rendering, premium proxy routing$0.25-$1.50 per 1K (documented, July 2026)

Sources: Oxylabs residential pricing and Web Scraper API, Bright Data residential pricing and Web Unlocker pricing, Decodo residential pricing and Web Scraping API, IPRoyal residential pricing and Web Scraping API (as displayed/fetched July 17, 2026).

Engineer’s take (Hinata): The retry factor is where these estimates die — pages and prices are knowable up front, but nobody knows their block rate until real traffic flows, and on a per-GB plan every failed attempt still bills bandwidth. Before committing to any tier, I would run 100 representative URLs through a pay-as-you-go gigabyte and measure bytes per successful page, retries included; that single number decides whether per-GB or per-request wins your workload. If it lands anywhere near the 0.14-0.43 MB break-even band below, price both routes before signing anything.

The formula

Here is the whole model. It uses decimal units (1 GB = 1,000 MB), which matches how the arithmetic in provider tiers works out.

  1. Traffic: monthly GB = pages per month x average page weight (MB) x retry factor ÷ 1,000. The retry factor sits inside the bandwidth term because failed and retried attempts transfer bytes you pay for on per-GB plans.
  2. Proxy route: monthly cost = monthly GB x the per-GB rate of the tier your volume lands in. Full plan-by-plan tiers are in our residential proxy pricing comparison.
  3. API route: monthly cost = pages per month ÷ 1,000 x the per-1K request rate. No retry factor where success-only billing is documented: Oxylabs' Web Scraper API, Bright Data's Web Unlocker, and IPRoyal's Web Unblocker bill only successful results; the failed-request policies of the Decodo and IPRoyal Web Scraping APIs are unverified.
  4. Break-even page weight (MB) = per-1K API rate ÷ (retry factor x per-GB rate).

That last line is the decision rule. At a $2.50/GB proxy rate with a 1.4x retry factor, the break-even against Decodo's $0.50-per-1K standard API rate is 0.50 ÷ 3.50 ≈ 0.14 MB, and against the $1.50-per-1K rates (Bright Data Web Unlocker pay-as-you-go, Decodo premium with JS rendering) it is 1.50 ÷ 3.50 ≈ 0.43 MB. Lean JSON-like responses under 0.14 MB favor raw per-GB bandwidth; anything heavier than about 0.43 MB per successful page favors per-request pricing at those rates. Now the personas.

Persona 1: the side-project SEO tracker (30,000 pages a month)

Our modeling assumptions: 30,000 pages a month, 0.4 MB per page of lean rank-tracking HTML, and a 1.3x retry factor for lightly defended targets. Traffic: 30,000 x 0.4 x 1.3 ÷ 1,000 = 15.6 GB a month.

RouteArithmetic (July 2026 rates)Monthly cost
Oxylabs Web Scraper API30K results x from $0.25 per 1Kfrom $7.50
Decodo Web Scraping API (Core plan)$19 plan includes 38,000 standard requests$19 plus VAT
IPRoyal Web Scraping API30K x from $1.00 per 1K (early access)from $30
Bright Data Web Unlocker(30K − 5K free) x $1.50 per 1K$37.50
Decodo residential, pay-as-you-go15.6 GB x $4.00/GB$62.40 plus VAT
Decodo residential, 25 GB plan$81.25 flat, 15.6 of 25 GB used$81.25 plus VAT

The verdict at this scale is not close: every documented per-request route undercuts the cheapest per-GB route, and the gap runs from roughly 1.7x to 8x. That follows directly from the break-even math — 0.4 MB x 1.3 = 0.52 MB billed per successful page, well above the 0.14-0.43 MB band. The subscription trap makes it worse: 15.6 GB does not fit Decodo's $35 10 GB plan, so the proxy route means either pay-as-you-go or paying $81.25 for a 25 GB tier you use 62% of. A side project also rarely has spare hours for retry logic, which tilts the field further toward APIs.

Persona 2: mid-size price intelligence (500,000 pages a month)

Our modeling assumptions: 500,000 product pages a month at 0.6 MB each — e-commerce pages with some client-side rendering — and a 1.4x retry factor for moderately defended targets. Traffic: 500,000 x 0.6 x 1.4 ÷ 1,000 = 420 GB a month. At the $2.50-$3.00/GB rates mid-size volume tiers land in (Bright Data's 332 GB tier is $3.00/GB; its 798 GB tier and the entry of Decodo's enterprise range are $2.50/GB), that is $1,050-$1,260 a month. Here are the actually purchasable routes:

Per-GB routeArithmeticMonthly cost
Decodo enterprise (250-1,000 GB range)420 GB x $2.00-$2.50/GB (published range endpoints)$840-$1,050 plus VAT
Bright Data $1,999/mo plan (798 GB)flat; 420 of 798 GB used$1,999
IPRoyal subscription (50 GB-tier rate)420 GB x $4.90/GB$2,058
Oxylabs Corporate (1 TB)$2,500 flat; 420 GB of 1 TB used$2,500
Per-request routeArithmeticMonthly cost
Oxylabs Web Scraper API500K x from $0.25 per 1Kfrom $125
Decodo standard requests500K x $0.50 per 1K$250 plus VAT
IPRoyal Web Scraping API500K x from $1.00 per 1Kfrom $500
Bright Data Web Unlocker (Scale plan)$499 + 117K x $1.30 per 1K~$651
Decodo premium + JS rendering500K x $1.50 per 1K$750 plus VAT

On these assumptions the API column still wins — but this is exactly the band where the answer flips with page weight, so treat both tables as live options. Cut the average page to 0.2 MB (blocking images and media, hitting lighter endpoints) and traffic falls to 140 GB: $560 at Decodo's $4.00/GB pay-as-you-go, inside the API quotes' range. Push it to 1.0 MB and traffic hits 700 GB, about $1,750 even at $2.50/GB. Mixed difficulty moves the API column the same way: if half your targets need Decodo's premium routing, the blended bill is $500 (250K x $0.50 plus 250K x $1.50, per 1K). Measure first, then pick — and if per-GB wins, our cheapest residential proxies ranking shows where each tier boundary sits.

Persona 3: the AI training data pipeline (5 million pages a month)

Our modeling assumptions: 5 million pages a month at 1.2 MB each — article and media-heavy pages kept for training corpora — and a 1.4x retry factor. Traffic: 5,000,000 x 1.2 x 1.4 ÷ 1,000 = 8,400 GB, or 8.4 TB a month. That is beyond every published tier: the largest listed plans are Oxylabs' 1 TB Corporate at $2,500 ($2.50/GB, top-ups to 2 TB at unpublished rates) and Decodo's enterprise range topping out at 1,000 GB ($2.00/GB). Extrapolating those best published rates to 8.4 TB gives $16,800-$21,000 a month — an anchor for negotiation, not a quote. IPRoyal's marketing cites bulk rates down to $1.75/GB (vendor marketing claim), which would put the same volume at $14,700.

The per-request column decouples cost from bytes, which is exactly what you want when pages are heavy: 5M requests a month costs about $6,501 on Bright Data's Web Unlocker Scale plan ($499 for the included 383K plus 4,617K x $1.30 per 1K) or $7,500 at Decodo's $1.50-per-1K premium-plus-JS rate — roughly half to a third of the per-GB extrapolation. If a large share of your corpus is easy targets, the standard rates ($0.25-$1.00 per 1K, "from" pricing) pull that down further. At this scale everything is negotiable, and Proxyway's Proxy Market Research 2026 argues against waiting for better list prices: residential pricing has stabilized after declines of up to 75% across 2023-2025, and Bright Data is cited at roughly $300M annualized revenue growing 50% year over year on AI demand. Get written quotes from at least two providers and let them bid; our guide to proxies for AI training data covers the sourcing and compliance side of these pipelines.

The hidden costs the formula misses

  1. Engineering time for retry and unblock logic. Per-GB bandwidth is a raw material: you build and maintain the retry policy, session rotation, failure classification, and target-specific unblocking yourself, and you keep fixing it as targets change. Per-request products bundle that work into the rate. We cannot put a documented dollar figure on your engineering hours, but for small teams this line item routinely decides the build-versus-buy question before the bandwidth math does.
  2. Failed-request billing asymmetry. Oxylabs' Web Scraper API charges only for successful results, Bright Data's Web Unlocker bills only successful requests, and IPRoyal documents per-successful-request billing in its help center for its Web Unblocker specifically. Decodo's Web Scraping API and IPRoyal's Web Scraping API both list per-request pricing without an explicit failed-request policy on the pages we fetched July 17, 2026 — unverified, so ask before assuming. On per-GB plans, every failed attempt bills its bytes; that is the retry factor working against you.
  3. VAT. Decodo lists every price excluding VAT: the $81.25 plan from Persona 1 becomes $97.50 for a buyer with 20% VAT. Oxylabs, Bright Data, and IPRoyal show USD prices without a VAT annotation, but your invoice may still add tax depending on billing country.
  4. Promotional fragility. Bright Data's $4.00/GB pay-as-you-go rate is displayed as a 50%-off promo from an $8.00/GB list price, and Oxylabs' Web Unblocker page carried a 40%-off-for-six-months code (WU40) when we checked. Budget at list rates and treat the discount as upside — Proxyway's 2026 research notes Oxylabs and IPRoyal already retired long-running discount codes in favor of permanent plans revised down about 25%.

When to use a scraping API instead of proxies

The short version: buy per-request when your pages are heavier than the ~0.43 MB break-even, when targets need JS rendering or active unblocking, or when you have no engineering budget for retry infrastructure — and buy per-GB when pages are lean, volume is high, and you already operate a crawler. There is also a middle ground worth knowing about: per-GB unblockers, which bundle unblocking into bandwidth pricing — Oxylabs Web Unblocker runs $7.50-$9.40/GB and Decodo's Site Unblocker $6.75-$10.00/GB plus VAT, versus the per-request unblockers from Bright Data ($1.50 per 1K, 5,000 free monthly) and IPRoyal ($0.70-$1.00 per 1K). We compare the two product shapes head-to-head in scraping API vs proxy and rank the unblocker products in our web unblocker comparison.

Our methodology

This is a document-based estimation model, not a benchmark. Every dollar figure comes from the four providers' published pricing pages and help-center documents fetched on July 17, 2026, with vendor performance and marketing figures labeled as claims. The page weights (0.4, 0.6, and 1.2 MB) and retry factors (1.3x-1.4x) are our modeling assumptions, chosen to make the arithmetic concrete — substitute your own measurements before making a purchasing decision. ProxyFacts has not yet run first-hand benchmarks; every figure above comes from the cited provider pages and dated third-party research. ProxyFacts earns disclosed affiliate commissions when readers purchase through the CTA buttons in this article, and links to providers carry sponsored attributes; commissions never change the numbers we publish.

Verdict

There is no single price for web scraping — there is a formula: pages per month x average page weight in MB x retry factor ÷ 1,000 gives your gigabytes, and the break-even page weight (per-1K API rate ÷ (retry factor x per-GB rate)) tells you which product shape to buy. At July 2026 list prices that means per-request APIs win under about 30,000-500,000 pages of ordinary HTML ($7.50-$750 a month at documented rates), per-GB proxies win on lean sub-0.14 MB responses at volume, and multi-terabyte pipelines ($16,800-$21,000 by extrapolation from the best published per-GB rates) belong in negotiation with written quotes from at least two vendors. Measure bytes per successful page on 100 real URLs before believing any estimate — including ours.

Decodo

Cheapest documented per-GB baseline of the four ($3.25/GB at 25 GB down to $2.00-$2.50/GB enterprise) plus a $0.50-per-1K API with a 2,000-request free plan; all prices exclude VAT

Check Decodo pricing

This article contains affiliate links. If you purchase through them, we may earn a commission at no extra cost to you. Our tests and rankings are independent and never influenced by partners.

Bright Data

5,000 free unblocker requests every month with no card is the cheapest way to test hard targets; $1.50 per 1K after that, and residential network access requires company-level KYC

Check Bright Data Web Unlocker

This article contains affiliate links. If you purchase through them, we may earn a commission at no extra cost to you. Our tests and rankings are independent and never influenced by partners.

Frequently asked questions

What retry factor should I plug into my own estimate? No provider publishes one, so measure it: run 100 representative URLs and divide total requests by successful pages. Our 1.3x-1.4x band is a modeling assumption for lightly-to-moderately defended targets; hard targets can run worse, which is precisely when success-billed per-request pricing protects you.

Can I test my cost model without spending anything? On the API side, yes: Decodo's free plan includes 2,000 requests a month, Bright Data's Web Unlocker includes 5,000 free requests monthly with no card, and Oxylabs' Web Scraper API trial covers up to 2,000 results. On the per-GB side, Decodo offers a 3-day trial, Oxylabs a once-per-client trial on request, and IPRoyal has no standard trial — its FAQ points to the $7.35 1 GB minimum purchase.

Why did my real bill come in above the estimate? Almost always page weight or retries: unblocked images and media, heavier JS payloads, or a block rate above the assumed 1.3x-1.4x all inflate the bandwidth term. Promo lapses matter too — Bright Data's $4.00/GB is a 50%-off promotional rate — and Decodo invoices add VAT on top of every listed price.

Does per-GB always win at very high volume? No. At our Persona 3 assumptions (1.2 MB pages), 5 million pages a month costs $16,800-$21,000 extrapolated from the best published per-GB rates ($14,700 if you credit IPRoyal's marketing-cited $1.75/GB bulk rate) but $6,501-$7,500 at documented $1.30-$1.50 per-1K rates, because per-request pricing ignores page weight. Above the published tiers, both routes end in a negotiated contract anyway.

For the full playbook — tooling choices, block avoidance, and compliance — read our complete web scraping guide.

Frequently asked questions

At published July 2026 rates, a 30,000-page monthly job costs about $7.50-$81.25 depending on route, a 500,000-page pipeline runs roughly $125-$2,500 (cheapest documented route to costliest listed route), and a 5-million-page AI data pipeline extrapolates to $16,800-$21,000 per month at the best published per-GB rates before negotiation — $14,700 if you credit IPRoyal's marketing-cited $1.75/GB bulk rate — or $6,501-$7,500 on per-request API rates.
Back to the full guide

Related articles