I Asked Google’s AI the Same Question Two Days in a Row. It Changed Its Mind.
On Monday I asked Google’s AI the same question a homeowner would ask: who’s the best [AC company / plumber / roofer / electrician / pest control / pool service / garage door company] in seven Florida cities. Then I wrote down 52 local businesses that had great reviews (4.7 stars or better) and still didn’t get named.
On Tuesday morning I asked the exact same seven questions again. Same wording, same searches, just 24 hours later.
The answers changed. Not a little. Enough that I had to rewrite part of my to-do list.
What changed in 24 hours
- 3 of the 52 left-out businesses got named overnight. One AC company, one electrician, one roofer. Nothing about them changed that I could see. The AI just… changed its mind.
- The shortlists got shorter. In 5 of the 7 searches, the AI named fewer companies on Tuesday than on Monday. Plumbing in St. Pete went from 8 names to 6. Pest control, pool service and garage doors each dropped one.
- One list got longer. Electricians in Clearwater went from 6 names to 7.
(Counts are the companies the AI named with a star rating in its answer, by my count. I’m not naming any businesses here, because this isn’t about calling anyone out.)
Why this matters if you own a business
Here’s the plain-English version: an AI answer isn’t a ranking. It’s more like a conversation. Ask it twice and you can get two slightly different answers, the same way two friends might give you two different plumber recommendations.
That cuts both ways:
- The bad news: showing up once doesn’t mean you’ll show up tomorrow. If you checked ChatGPT or Google’s AI one time and saw your name, congrats, but that’s a snapshot, not a guarantee.
- The good news: being left out isn’t permanent either. The shortlist is decided fresh, over and over. Which means the businesses that give AI the clearest, most consistent, most credible information about themselves get more chances to make the cut.
So what actually moves the needle?
Nobody can promise you a spot in an AI answer. Anyone who does is selling something. But the businesses that show up most often tend to have a few things in common:
- A complete Google Business Profile. Categories, services, hours, photos, and a description that says what you do and where, in normal human words.
- Reviews that mention specifics. “Fixed our AC in August, same day, fair price” tells AI way more than “Great service!”
- The same info everywhere. Your name, phone, address and services should match on your website, Google, Yelp, Bing and the directories. Mixed signals make AI less confident.
- A website that answers real questions. Pages for each service and each city you cover, plus the questions customers actually ask.
None of this is magic. It’s the boring stuff done consistently, which, honestly, is most of marketing.
The takeaway
Don’t check AI once and call it a day. Check it a few times, on a few different days, the way I just did. If you’re never in the answer, that’s a pattern worth fixing. If you’re in it sometimes, you’re closer than you think.
Want me to check for you? I’ll run your searches, show you what AI says about your business, and tell you the first three things I’d fix. Book a free AI Visibility Audit. You can also see the full Monday results in the Florida AI Visibility Index and my write-up of the 19-city test.