Playbooks
8 min readHow to check AI agency reviews before you hire
Reviews are easy to fake in AI services. Here is where honest ones live, what red flags look like and the five questions to ask a reference.

How to check AI agency reviews is a fair question when anyone can launch an agency in a weekend and write their own praise. You want proof that real clients got real results, not a polished sales pitch. This guide shows you where honest reviews live, how to read them and what to ask before you sign.
Where honest AI agency reviews actually live
The agency's own website is the weakest source. A "wall of love" is chosen by the people selling to you. One Reddit buyer's checklist in r/findaiagencies says to look beyond that wall, at the agency's Google Business Profile, social media comments and Reddit, and to ask for a proof-of-concept sample.
Here is how the main sources compare.
| Source | What it tells you | Main weakness |
|---|---|---|
| Agency website testimonials | How the agency wants to be seen | Hand-picked, often unnamed |
| Case studies with numbers | What changed and by how much | Can be vague or unverifiable |
| Trustpilot and similar | Pattern of customer experience | Few reviews, one-sided samples |
| Google Business Profile | Local, named reviewers | Easy to ask friends |
| Reddit and LinkedIn threads | Unprompted opinions | Small sample, some bias |
| A client reference you call | The real story, live | The agency picks who you speak to |
No single source is enough. Trust a view when three or four of them point the same way.
Where the reviews come from
Curated
Agency website and its wall of loveIndependent
Google Business ProfileSocial media commentsReddit threadsYour decision
Shortlist checked against both layersTrustpilot and review platforms: how to read the ratings
A score on its own tells you very little. Trustpilot rates Start Your AI Agency at 4.4 out of 5 and Aiagencyinstitute at 4.8 out of 5, both labelled "Excellent". Both are fine headline numbers. Neither tells you whether the people who left them got results for their own business.

So read past the score. Do this:
- Sort by lowest first. Read the one-star and two-star reviews, then see whether the agency replied calmly and specifically.
- Look at the dates. A burst of five-star reviews in one week is worth a question.
- Check who is reviewing. Is this someone who bought a service, or someone who joined the agency's course or affiliate scheme? A course student praising the course tells you nothing about client delivery.
- Look for detail. Real reviews mention what was built, how long it took and what went wrong.
One Trustpilot reviewer of Start Your AI Agency said a presentation's script was 'about everything and specifically nothing' and that the video could not be skipped through, which raised their suspicion. That is a useful note for buyers: if you cannot get a straight answer without sitting through a locked video, treat that as information.
Reddit and LinkedIn threads: what to search for
Reddit is useful because nobody is paid to be polite. Search the agency name plus words like "review", "scam", "worth it" and "experience". Then search the category, such as "how to shortlist an AI agency", and see what practitioners say to look for. Our small business AI forum tour covers what owners are asking in these places.
A few useful lines from real threads:
- A practitioner in r/SEO_LLM says reviews are easy to fake in this space. Their advice is to ask what the agency changed on the site and whether the brand started appearing in AI answers, not whether they "do AI SEO".
- A practitioner in r/agency says a green flag for AI visibility agencies is that they show raw scans with timestamps, prompt sets and scan IDs, not just a quarterly PDF.
On LinkedIn, look at the people who comment on the agency's posts. Do they have real roles at real companies, or are they all agency owners and course sellers praising each other? Click through to two or three. Message a past client directly and ask for ten minutes. Most people will say yes if you are polite and specific.
Case studies with numbers: what counts as proof
A case study is only proof if you could, in principle, check it. "We grew leads massively" is a sentence.
A good case study names:
- The client, or at least the sector and size, and whether they agreed to be contacted.
- The starting point, with a number.
- What the agency actually built or changed.
- The time it took.
- The result, and how it was measured.
- What did not work.
That last one matters. Every project has a wobble. A case study with none reads like an advert.
For AI work, ask for the raw material. The r/agency practitioner above wants timestamps, prompt sets and scan IDs. If the agency claims it got a brand into AI answers, ask to see the prompts, the dates and the outputs. If it built an automation, ask for a screen recording of it running on live data, with the client's details hidden. See how to measure AI automation ROI for what a sensible before-and-after looks like.
Red flags that suggest fake or weak reviews
None of these proves anything alone. Two or three together should slow you down.
- Every review is five stars and says roughly the same thing.
- Reviewers have no photo, no company and no other reviews.
- Praise is about the agency's personality or "energy", with nothing about the work.
- The case studies have no numbers, no dates and no named client.
- The reviewers turn out to be course students, affiliates or partners.
- The sales process runs on a long video funnel that says a lot and commits to nothing, and you cannot reach a human until you have watched it.
- Pressure to sign this week for a "special" rate.
- The agency will not let you speak to any client.
- The agency cannot explain in plain words what it will do in the first 30 days.
If you have been burned before by a smooth pitch, the video funnel and the refusal to put you in touch with a client are the two to weigh most. Both are about control of the story.
How to spot AI-written or fake testimonials
AI-written reviews are a real problem. Pangram says ChatGPT-written reviews are widespread on Amazon, and that top-selling products often have review sections rife with AI. There is no reason to think agency testimonials are immune.

Detection tools exist, but you do not need one to start. Try these checks:
- Read three together. If they share the same structure, the same adjectives and the same neat closing line, be suspicious.
- Look for specifics a stranger would not invent. A real client mentions an awkward moment, a delay, a particular tool or a person's name.
- Check the reviewer exists. Search their name and company. Is there a real profile, a real website, a real role?
- Reverse-search a sentence. Paste a distinctive line into a search engine in quotation marks. Copied testimonials turn up on other agencies' sites.
- Check the timing. Several glowing reviews posted within hours of each other is a pattern.
- Ask the reviewer. A short message asking "did you write this, and would you speak for ten minutes?" settles it faster than any tool.
Polished, generic praise is not proof of AI. Plenty of people write blandly. What you are testing is whether a real, reachable person stands behind the words.
about everything and specifically nothing
The five questions to ask a client reference
Ask the agency for two or three clients, and pick at least one yourself from a case study or a LinkedIn thread. Then ask:
- What did they actually build or change, and what was it before? You want a concrete answer, such as a new lead follow-up flow or a rebuilt service page, not "they did AI".
- Did it hit the timeline and the price you agreed? Ask what changed along the way and who paid for it.
- What number moved, and how do you know? Hours saved, enquiries, cost per lead, response time. Ask whether they measured it or the agency did.
- What went wrong, and how did they handle it? Every project has a problem. How the agency behaved when it appeared tells you more than the outcome.
- Would you hire them again, and who should not? The second half invites honesty. A good reference will say where the agency is weaker.
Also ask whether the reference was paid, discounted or given anything for taking your call. And ask who owns the work at the end: the accounts, the prompts, the workflows and the data. Our guide to how to hire an app agency without getting burned covers ownership clauses in more depth.
Proof tests to run before you sign
Reviews tell you about the past. A small test tells you about your own project.
- Ask for a proof-of-concept sample. The r/findaiagencies checklist recommends this. Even one small automation or one rewritten page, paid for at a fair rate, shows how they work.
- Write your own measurement first. A Reddit user in r/SaaS suggests writing about 30 buying-intent prompts yourself before any engagement starts, saving the file, and not letting it be revised mid-engagement. That way you own the measurement and the agency cannot move the goalposts.
- Ask for raw evidence on any claim. Timestamps, scan IDs, screenshots, exported reports.
- Check the contract. Scope, deliverables, ownership, exit terms and what happens to your data. See AI data protection for UK small businesses before you share customer information.
- Check the price logic. Know whether you are paying a retainer, a project fee or a per-workflow rate. Our piece on AI automation agency pricing explains the trade-offs.
For a wider framework, read how to choose an AI agency and our list of AI automation mistakes to avoid.
Where to start
- List your shortlist of agencies and read their lowest-rated reviews first.
- Search each name on Reddit and LinkedIn, plus their Google Business Profile.
- Pick one case study per agency and ask for the raw evidence behind the headline number.
- Ask for one client reference you chose and one they chose, and use the five questions above.
- Write your own success measures in a file before the first call.
- Buy a small paid test before a long contract.
If you would like a second opinion on a shortlist, or want to see where AI fits in your business before you talk to any agency, you can get a free AI plan from us or book a call. We will say plainly what we would do, and you can check us the same way.
Sources
See it in practice

Built by Pensact
Go Way · A ride-hailing app for Egypt where riders pick the offer that suits them, across car, scooter or tuk-tuk. We built its systems and CRM.
Questions people ask
How do I check an agency's reviews?
Read beyond the agency's own site. Check Trustpilot (lowest ratings first), the Google Business Profile, LinkedIn comments and Reddit threads. Then speak to a real client, ideally one you picked rather than one the agency chose.
How do I detect AI-generated reviews?
Read several together and look for the same structure, vague praise and no specific detail. Search the reviewer's name and company, and paste a distinctive sentence into a search engine to see if it is copied. The most reliable test is asking the reviewer for a short call.
What questions should I ask an agency's references?
Ask what the agency built and what it replaced, whether it hit the timeline and price, which number moved and how it was measured, what went wrong, and whether they would hire the agency again. Also ask whether they were paid or discounted for the reference.
Are AI automation agencies legit?
Many are, and some are not. The category is new, so reviews are easy to fake and credentials are thin. Judge each agency on verifiable case studies, a reachable client reference, clear contract terms and a small paid test before you commit.
Keep reading

When to Build a Custom App: Three Tests Before You Spend
A custom app is worth it only if it saves money monthly, touches customers, and no existing tool does the job. Here is how to test each and work out payback.
Noah Hany · 7 Nov 2026

How to Hire an App Agency Without Getting Burned
A step-by-step guide to choosing and contracting an app agency: budget, vetting, first-call questions, fixed-scope quotes, contracts and red flags.
Noah Hany · 2 Nov 2026

Small business AI forum tour: what owners are asking
The U.S. Chamber's small business AI forum, the questions owners are asking, and a practical plan for choosing AI tools and checking whether they pay.
Noah Hany · 7 Nov 2026