Organic traffic research is the work of finding out which unpaid search results send visitors to a website, which pages receive them, and how that changes over time. For a site you own, the measured answer sits in Google Search Console, which reports clicks, impressions and positions query by query. For anyone else’s site, nobody outside holds measured data, so third-party tools publish estimates built from rankings, search volumes and assumed click-through rates. Good research uses both, and never confuses one with the other.

Woman in a grey cardigan sorting small stacks of blank white cards on a pale oak table, a pencil and a mug of tea beside her, soft morning window light, seen from slightly above

What is organic traffic research, and how is it different from keyword research?

Keyword research looks forward: it maps the demand that exists in a subject and decides which clusters deserve a page, the method set out in our guide to building a keyword map. Organic traffic research looks at what is already happening. It asks which queries a site is visible for today, which of those produce clicks, which pages carry the load, and where visibility is growing or slipping.

The two feed each other. Traffic research on your own site shows which clusters already work and which pages sit just outside the first page of results. Traffic research on a competitor shows which clusters they have claimed and how much of their visibility hangs on a handful of pages. Only then does a keyword map have a starting point grounded in evidence rather than in tool scores and hunches.

Where does reliable data on your own organic traffic come from?

From two places, and they answer different questions. Google Search Console records what happened on the results page. A click is counted when a searcher leaves Google for your page; an impression is counted when a link to your site appears on the page of results being viewed; position is the topmost spot your site held for a query, averaged across all the queries in the period. Google publishes its definitions of these metrics, and they are worth reading once, because most misreadings of the report start with a wrong idea of what an impression is. Read together per query and per page, those three numbers are the closest thing to ground truth that exists for organic search.

An analytics package records what happened after the click: which landing page the visitor reached, how long they stayed, whether they subscribed or bought. It cannot tell you the search term itself. Since Google began encrypting searches in 2011, analytics tools have gradually stopped receiving the query along with a search visit, which is why “(not provided)” became one of the most familiar phrases in the trade. Google Analytics 4 groups these visits under its Organic Search channel and, once a Search Console property is linked, adds a Queries report that brings the Search Console figures alongside. Google’s own help pages note that this data reaches Analytics about 48 hours after Search Console collects it, so yesterday is never in the report.

Why don’t the query rows add up to the total?

Because some searches are hidden on purpose. Google calls them anonymized queries: searches not issued by more than a few dozen users over a two-to-three month period. Their clicks and impressions still count in the chart totals, but they never appear as rows, so the table always sums to less than the headline figure. On a small or specialist site the gap can be wide, since long and rare phrasings are exactly what such a site attracts.

Three further limits shape any export. The Search Console interface exports at most 1,000 rows. The Search Analytics API raises the ceiling to 50,000 rows per day per site per search type, according to Google’s deep dive on performance data limits. And the data is kept for 16 months, after which it is gone unless you saved it yourself. The practical rule follows: export every month, keep the files, and treat any share-of-traffic calculation as a share of the visible rows, not of the whole.

How do tools estimate a competitor’s organic traffic?

Two open paper notebooks side by side on a walnut desk, each with a pencilled line climbing at a different pace, a brass magnifying glass resting between them, warm lamp light in the evening

By modelling it. Semrush, whose Organic Research report is one of the best known of these tools, describes the logic plainly in its knowledge base: take the keywords for which a domain ranks in the tool’s database, multiply each keyword’s monthly search volume by an average click-through rate for the position held, and add up the results. Ahrefs’ Site Explorer and Similarweb publish comparable figures from their own data. Every input carries error. The keyword database never holds every query; search volumes are themselves estimates; and a click-through curve built on averages cannot know that today’s results page carries a map, a video row or a generated answer above the first link.

So the absolute number is the weakest part of the estimate. What survives the error is the shape: which pages of a competitor collect most of their estimated visibility, which clusters they rank for that you do not, and whether their curve has been rising or falling over a year. One calibration step makes the rest far more useful. Run your own domain through the same tool and set its estimate beside your Search Console clicks for the same month. The ratio between the two tells you how far to trust that tool in your subject, before you read anything into someone else’s figure.

Measured or estimated: which source answers which question

Each source is reliable for one job and misleading when asked to do another. The table below is the short version we keep next to the desk.

Sources for organic traffic research, compared
SourceWhat it recordsMain blind spotBest used for
Search Console, Performance reportClicks, impressions, CTR and average position by query, page, country and deviceAnonymized queries; 1,000-row interface export; 16 months of historyYour own visibility, query by query
Analytics, Organic Search channelSessions, landing pages and what visitors did nextThe search term itselfWhat an organic visit is worth after the click
Third-party estimates (Semrush, Ahrefs, Similarweb)Modelled traffic from rankings, volumes and assumed click-through ratesAbsolute numbers; queries missing from the tool’s databaseCompetitor share, cluster gaps, long trends
Reading the results page yourselfWhat a searcher actually sees todayOne place, one momentChecking an estimate against reality

A research routine in five steps

  1. Export your own data twice. Pull queries and pages from Search Console for the last three months and for the same three months a year earlier, so that seasonality does not pass for a trend.
  2. Group the queries by intent, not by wording. A dozen phrasings of one need belong to one page, as the intent guide explains; counting them separately inflates some topics and hides others.
  3. Mark the near misses and the strays. Clusters averaging positions five to fifteen are what our refresh guide calls sleepers, usually the cheapest gain on the list. Queries far beyond the first page that still collect impressions are a different signal: no page on the site truly answers them yet.
  4. Estimate two or three competitors with one tool. Run your own domain alongside them to calibrate, and note the clusters they hold that you do not.
  5. Search the important queries by hand. Look at what the results page actually shows, snippets, maps, videos, generated answers, before deciding what any number means.

The routine takes an afternoon the first time and about an hour each month afterwards. Its output is deliberately short: clusters to defend, pages to refresh, gaps to fill. That list is the honest input a keyword map needs, and it is built from what searchers already do rather than from what a tool guesses they might.

Questions readers ask

Can I see exactly how much organic traffic a competitor gets?

No. Only the site owner holds measured figures, through Search Console and their own analytics. Every public number for someone else’s site is an estimate: useful for comparison and for trends, unreliable as an absolute count.

Why does Search Console show fewer clicks than my analytics shows organic sessions?

The two count different things. Search Console counts clicks from Google Search results only, while an analytics channel labelled organic usually includes other search engines and depends on its own session rules, consent settings and tracking coverage. A steady difference between the two is normal; a sudden change in the gap is worth investigating.

How often should organic traffic research be repeated?

Monthly for your own site, because Search Console keeps only 16 months of data and a saved export is the only way to compare one year with the next. Quarterly is enough for competitor estimates, since their week-to-week movements mostly reflect noise in the model rather than real change.