Internal Search As Keyword Source
Keyword tools report what a market searches; your site search reports what people who already chose you cannot find. Those queries carry higher purchase intent and often use vocabulary the tools have no volume data for. The trap is treating the raw query log as a keyword list - most of the value is in the zero-result and high-exit queries, which is the opposite of what a volume sort surfaces.
Use when you need category and content ideas grounded in what your actual buyers ask for rather than what a keyword tool estimates.
The skill file
What you need first
- 12 months of internal site search logs with result counts and exit rates
- your current category and facet URL structure
- conversion data by search term where available
Method
- 01 Normalize the log first - lowercase, strip punctuation, collapse plurals and obvious misspellings. Unnormalised logs fragment the same demand across dozens of rows and hide the real volume.
- 02 Sort by searches with zero results descending. These are demands you have no page for and often no product for, and they are the clearest gap in the catalog.
- 03 Separately sort by searches with results but high exit rate. Those mean you match the words but not the intent, which is usually a category or facet definition problem rather than a stock problem.
- 04 Cross-reference the top normalized terms against your existing URLs. Any term with volume and no dedicated landing page is a category or indexable facet candidate.
- 05 Check whether the vocabulary differs from your site taxonomy - customers searching for a term your navigation never uses is a naming problem that also costs you organic rankings.
- 06 Feed the surviving terms back into a volume check to size them, but let the internal data decide priority. Internal frequency beats external volume for terms your buyers actually use.
What this produces
A ranked gap list of internal search terms with no matching landing page, split into catalog gaps and taxonomy gaps.
Where this goes wrong
- sorting the raw log by volume and finding only your own brand and bestseller names, which you already rank for
- ignoring zero-result queries because they have no traffic value on site, when they are the strongest demand signal you own
- treating every internal term as a page candidate and building thin category pages for one-off queries
Use this skill in your own AI
The download is a plain markdown file with the name and trigger in its frontmatter. Where an assistant supports skills it can load itself, that frontmatter is what it reads to decide this one applies.
Questions about this skill
When should I mine site search rather than use a keyword tool?
When you want demand from people who already chose you rather than from the market, and for vocabulary the tools carry no volume for. The honest limit is traffic: below a few thousand internal searches a month the log is too sparse to cluster, and a keyword tool remains the better starting point for a category you do not stock yet.
What does the search log need to contain to be usable?
Twelve months of internal search logs carrying result counts and exit rates, your current category and facet URLs, and conversion by term where available. The result counts are the point, since without them you cannot isolate zero result queries, which is where most of the value sits. Skip normalisation and one demand fragments across dozens of rows and disappears.
What comes out of it, and which part gets acted on?
A ranked gap list split into catalogue gaps and taxonomy gaps. The zero result set is acted on first, because it names demand you have no page and often no product for. The taxonomy half is quieter and worth as much: terms your buyers use that your navigation never uses cost you rankings as well as on-site conversions.
How does mining the log usually go wrong?
Sorting the raw log by volume, which returns your own brand and bestseller names, all of which you already rank for, and hides the zero result and high exit queries that carry the signal. The opposite error is treating every surviving term as a page candidate and building thin categories for one off queries nobody repeats.
More in Ecommerce SEO
Faceted Navigation Crawl Control
Use when a category with a few hundred products has generated tens of thousands of crawlable fil...
Category Page Copy That Ranks
Use when category pages sit in positions 8 to 20 for their head term and the page is a bare grid...
Product Descriptions At Scale
Use when you have thousands of SKUs on manufacturer-supplied copy and product pages get impressi...
Out Of Stock And Discontinued Products
Use when products go out of stock or get discontinued and you need to decide what happens to the...