Short answer: price scraping means automatically reading the price from competitor product pages instead of copying it by hand. A small shop can do it with a spreadsheet formula, a home-made scraper, a scraping API, or a tool that does the fetching for you. Building it yourself is cheap to start and expensive to keep working; buying it costs money but moves the maintenance to someone else.
This guide covers the ways to get competitor price data, what breaks, what is and is not acceptable, and what “price intelligence” adds on top of raw scraped numbers.
What is price scraping?
A program loads a product page, finds the price in the page, and stores it with a date. Run that on a schedule across the competitor pages you care about and you have competitor price data: who charges what, and when it changed. Everything else — alerts, charts, repricing rules — is built on top of that one step.
Ways to get competitor price data
1. By hand
Open the tabs, write the prices in a sheet. Fine for five products. It stops happening the week you get busy, which is usually the week prices move.
2. A spreadsheet formula
Google Sheets’ IMPORTXML can pull a value from a page with an XPath expression. It is free and works on simple pages. It breaks on pages that load the price with JavaScript, on stores that block automated requests, and whenever the page layout changes. There is no history unless you copy values out yourself.
3. A DIY scraper
A short script (Python with requests and BeautifulSoup, or a headless browser for JavaScript pages) run on a schedule. You control everything. You also own every failure: blocked requests, captchas, changed markup, sale prices shown in a different element, prices that depend on location or currency.
4. A scraping API
Services that handle proxies, browsers, and blocks for you and return the page or the extracted data. You still write the extraction, storage, and alerting, and you pay per request.
5. A price intelligence tool
Software built for retailers and brands: product matching across stores, dashboards, reports, sometimes automatic repricing. Powerful for large catalogs, usually priced for them too. We compared the options in competitor price monitoring tools.
6. A simple price tracker
You paste the competitor URLs, the tool fetches the price on a schedule and tells you when it changed. Less control than a script, far less upkeep. This is what PriceSense is.
Build vs buy: what actually breaks
| Problem | If you build it | If you buy it |
|---|---|---|
| Store blocks the request | You add proxies, headers, slower schedules | The vendor’s problem; some pages still fail |
| Page layout changes | Your selector silently returns nothing or the wrong number | Handled by the tool, with varying success |
| Price loaded by JavaScript | You need a headless browser, which is slower and costlier | Usually handled |
| Sale vs regular price, variants | You decide which number counts, per store | The tool decides; check it matches your view |
| History and alerts | You build storage and notifications | Included |
The hidden cost of building is not the first script. It is noticing that the script has been returning an empty value for two weeks. Whatever you choose, make sure a failed read is reported as a failure, not stored as a price.
Is price scraping legal?
Reading prices that a store shows to the public is common practice and is generally accepted in most places. The lines people cross are elsewhere: logging into accounts or getting around a paywall, ignoring a site’s terms of use, hammering a site with requests, or copying content beyond the facts you need. Respect robots rules and rate limits, scrape only public pages, and store only what you use. Rules differ by country and by site, so this is a practical guide, not legal advice.
What price intelligence adds beyond scraping
- Product matching: knowing that two differently named listings are the same item.
- History: telling a weekend sale from a new regular price.
- Alerts that matter: a message when a competitor drops, not a spreadsheet to read.
- Context: your price position against the set, per product.
- Decisions: in bigger tools, rules that change your prices automatically.
Most small shops need the first four and are better off making the decision themselves. How to turn the data into a price is in competitive pricing analysis.
Where PriceSense fits
PriceSense fetches the public product pages you add — any store, not only Amazon — daily on paid plans and weekly on Free, and alerts you by email or app push when the advertised price changes. You group several competitor pages under one product. If a page blocks us or the price is missing, we mark it instead of guessing a number.
- Free: 1 product, 3 competitor pages, weekly, no history.
- Premium: 10 products, 2 pages each, daily, 30 days of history.
- Pro: 100 products, 5 pages each, daily, six months of history, Slack, and per-seller rules like “only alert on drops of 5% or more.”
No API, no export feed, no automatic repricing, no stock or shipping data. If you need raw data at scale for your own systems, a scraping API or a price intelligence platform is the better fit. See the plans or read the full guide to competitor price monitoring.
Watch a competitor page yourself
Free covers one product and three sellers. Email and app alerts when the price changes.
Questions we get
Can I scrape Amazon prices?
Amazon’s product pages are public, but Amazon actively blocks automated requests and its terms restrict scraping. Most sellers use a tool or an official data source rather than a home-made scraper.
How often should I scrape competitor prices?
Daily is enough for most small shops that change prices by hand. Scraping more often costs more, gets blocked more, and only pays off if you also reprice more often.
What is the difference between price scraping and price intelligence?
Scraping collects the raw price from a page. Price intelligence adds product matching, history, alerts, and your price position against competitors, so the data turns into decisions.
Do I need to know how to code to track competitor prices?
No. Spreadsheet formulas work for a few simple pages, and tools like PriceSense only need the product URLs.