Marketing
How to Do Keyword Research With AI - Find What Your Customers Actually Search
How to do keyword research with AI without guessing: the Demand-Intent-Gap method for finding phrases real customers type, judging whether you can win them, and turning the list into pages that bring in business.

Founder, AI Tools and Training Club · August 18, 2026 · 9 min read

The short version
- Keyword research with AI is fastest at the part humans are slowest at: generating hundreds of realistic ways a customer might phrase the same need, then grouping them by what the person actually wants.
- AI is worst at the part that decides whether the work pays off: real search volume and real difficulty. It does not know those numbers, and if you ask it for them it will produce confident guesses. Get those from a tool that measures, not from a chat window.
- Run the Demand-Intent-Gap method: use AI to expand and group, use a measuring tool to confirm demand, then keep only the phrases where someone is close to buying and nobody on page one is answering properly.
What AI is genuinely good at in keyword research
Keyword research has always had one brutal bottleneck: you can only think of the phrases you would use. Your customers are not you. A plumber searches one way, a homeowner with a leaking pipe searches another, and an office manager with a flooded storeroom searches a third way. AI closes that gap in seconds because it has read an enormous amount of how ordinary people write when they are stuck. Ask it to list fifty ways a frustrated customer might describe your problem in a search box and you get a list you would not have produced in an afternoon.
The second thing it is good at is sorting. A raw list of two hundred phrases is useless. AI can group them into clusters that mean the same thing, separate the people who are researching from the people who are ready to pay, and tell you which phrases imply a local business, a comparison, or a how-to. That grouping step is what turns a list into a content plan.
The Demand-Intent-Gap method
This is the loop I run for our own sites and the one I teach in the club. Three filters, in this order. Each one kills phrases the next one would waste your time on, which is why the order matters more than the tools you use.
- Demand: does anyone actually search this? AI expands your seed idea into a wide list of real-sounding phrasings. Then you take that list to a tool that measures search volume and drop everything with no measurable demand. A brilliant phrase nobody types is worth nothing.
- Intent: what does the person want at the moment they type it? Someone searching what is invoice automation wants to learn. Someone searching invoice automation for small business pricing is close to spending. Sort every surviving phrase into learn, compare, or buy, and treat those as three different kinds of page.
- Gap: is anyone already answering this properly? Open the current results yourself and read the top pages. If the answer is thin, outdated, or written for a different audience than yours, that is your opening. If three excellent pages already own it, spend your effort somewhere else.
How to run each step, in practice
You do not need a research team. You need one clear starting point and a willingness to throw most of your list away. Here is the sequence I use from a blank page to a shortlist worth writing.
- Start with the problem, not the product. Write one sentence describing the situation a customer is in right before they need you. Not our software does X - more like my team spends every Friday retyping invoices. That sentence is your seed.
- Expand with AI. Ask for fifty to a hundred ways different kinds of people might search that situation, and tell it who those people are: the owner, the office manager, the person doing the task. Different roles use different words and you want all of them.
- Group by what the searcher wants. Ask AI to cluster the list into learn, compare, and buy, and to name each cluster. You should end up with a handful of themes rather than a hundred loose strings.
- Measure the demand. Put the surviving phrases through a tool that reports real search volume. Cut anything with no measurable searches. This is the only step where you need actual data and there is no substitute for it.
- Read the current page one. For each phrase you still like, open the results and read what is winning. Note what is missing: no real example, no pricing, written for enterprises when your buyer is a five-person business.
- Shortlist and commit. Keep the phrases where demand is real, intent is close to buying, and the gap is obvious. Ten of those beat a spreadsheet of five hundred.
Judging intent so you write the right kind of page
The most expensive keyword mistake is not picking a hard phrase. It is picking a fine phrase and writing the wrong page for it. Someone in learning mode who lands on a pricing page bounces. Someone ready to buy who lands on a definition article goes back and clicks a competitor. Intent decides the format before you write a word.
| What they type | What they want | What you should publish |
|---|---|---|
| what is / how does X work | To understand the idea | A plain-English explainer that defines the thing and shows one concrete example |
| how to do X | To get it done today | A step-by-step guide with the actual steps, not a pitch |
| X vs Y | To choose between options | An honest comparison that names where each one wins, including where you lose |
| best X for [situation] | A shortlist they can trust | A recommendation with reasoning, aimed at that exact situation |
| X pricing / X cost | To know if they can afford it | Real numbers and what changes them, with no gate in front |
| X near me / X for [industry] | Someone who serves them specifically | A page that names their industry or area and proves you work with them |
Matching search intent to the page you should build
Once you match format to intent, the writing gets easier and the results get better, because you stopped arguing with what the person came for. Our guide on [how to create content for your business with AI](/blog/how-to-create-content-for-your-business-with-ai) covers turning a shortlist like this into actual published pages.
The mistakes that waste the most time
- Trusting AI-generated search volumes. They are invented. This is the single most common way a keyword plan goes wrong before it starts.
- Chasing big head terms. A phrase everyone wants is a phrase you will not win as a small business. Longer, more specific phrases have less competition and far more buying intent.
- Ignoring the words your customers use. If they say bookkeeping help and you write financial reconciliation services, you are optimising for language nobody types.
- Writing one page per phrase. Five phrases that mean the same thing belong on one strong page, not five thin ones competing with each other.
- Publishing and walking away. Check after a couple of months which pages are getting found, then improve those rather than starting new ones.
- Picking topics with no connection to money. Traffic that will never buy from you costs the same to produce as traffic that will.
Turning the shortlist into a plan you will actually finish
A shortlist is not a plan until it has an order and a rhythm. Rank your surviving phrases by how close the searcher is to buying, then work from the closest outward. It feels backwards because the buying phrases usually have the lowest volume, but those are the pages that pay for the rest.
- Publish your buying-intent pages first, even though few people search them. They convert, so the work justifies itself immediately.
- Then publish the comparison pages. People comparing options are close behind buyers and comparisons are often badly served.
- Then build out the learning content. This is where the volume lives, and it feeds people into the pages you already published.
- Link them together deliberately. Every learning page should point to the comparison or buying page it naturally leads to.
- Revisit quarterly. Keep the pages getting found, rewrite the ones that are not, and add the new phrasings your customers have started using.
If you want the automation side of this - AI drafting, scheduling, and repurposing the pages you plan here - start with [how to automate your business with AI](/blog/ai-automation-for-small-business) and build the publishing loop after the research loop is working.
Frequently asked questions
Can AI replace a keyword research tool?
No, and treating it like one is the main way people get burned. AI is excellent at generating phrasings and grouping them by intent, which is the creative half of the job. It has no access to live search volume or competition data, so any number it gives you for those is a guess presented confidently. Use AI for the expansion and sorting, and a measuring tool for the demand check.
How many keywords should I target as a small business?
Far fewer than most people think. Ten to twenty phrases you genuinely have a shot at, covered properly, will outperform a spreadsheet of five hundred you never write for. Group phrases that mean the same thing onto one page rather than splitting them, because two thin pages competing for the same idea beat each other rather than the competition.
How long does it take to see results from keyword research?
Longer than you want, and it varies enormously by how competitive your area is and how established your site already is. Anyone quoting you a specific number of weeks is guessing. What you can control is checking after a couple of months which pages are getting found at all, and putting your effort into improving those rather than continuously starting new ones.
Should I write for keywords or for people?
For people, using the words they actually use. That is what keyword research is for - it tells you the language your customers speak so you can write in it. The failure mode is treating the phrase as something to repeat rather than something to answer. If the page genuinely resolves what the searcher came for, in their words, you have done both jobs at once.
What is the difference between search volume and search intent?
Volume is how many people type a phrase. Intent is what they want when they type it. Volume tells you the size of the opportunity and intent tells you whether it is worth anything to you. A low-volume phrase where the searcher is ready to spend is usually worth more to a small business than a high-volume phrase where they are idly curious.