One procedure per category · evidence published with every review
Every grade here was earned on the bench.
I use each tool myself, on a real account, and put it through a fixed procedure for its category: the same tests, the same prompts, the same scale for every tool. Then I publish the measurements, so you never have to take my word for it.
Tested and written by Miles Foster, Owner and tester, RankDude.
Real accountUsed, not describedEvery gradeEvidence attached
PriceMaking your ownReply speedMemoryStaying in characterPhotosVideosCall speedVoice qualityChoice of charactersAI girlfriend shown; every category has its own tests
PriceMaking your ownReply speedMemoryStaying in characterPhotosVideosCall speedVoice qualityChoice of charactersAI girlfriend shown; every category has its own tests
Four things you can count on
Used, not described
Every grade comes from a tool I used myself, on a real account, for as long as the test takes. Nothing is scored from a feature list, a press kit or a demo video.
The same bench for everyone
Each category has one written procedure: the same tests, the same prompts, the same sample sizes and the same scale for every tool in it. It is published before the first review.
Proof behind every number
Every grade links to its evidence: timings, counts, screenshots, recordings, tables. The full test results are published with each review so anyone can check a number against what was seen.
Money never touches a grade
Some links are affiliate links, disclosed on the page. They never change a grade, a ranking or a sentence of a review.
How a review happens
Seven steps, in the same order, for every tool. Nothing is skipped silently: a test that cannot be run is marked as such in the review, and nothing is scored from memory.
Step 1
Get the account
I buy the plan, sign up for the free tier, or use an account the vendor provides. Every review says which. A vendor-provided account never changes a grade, and no vendor sees a review before it is published.
Step 2
Run the procedure
The category's fixed tests, in the same order, with the same prompts, files, calls or tasks and the same sample sizes as every other tool on that bench.
Step 3
Measure everything
Outputs are timed, counted, checked against an answer key, compared side by side and recorded; prices are read at the checkout. Nothing is estimated.
Step 4
Grade against the scale
Each test gets a grade from 1 to 5 on a threshold written into the methodology, so a 4 for reply speed means the same thing for every tool.
Step 5
Add the verdict
The score starts as the average of the test grades. My verdict covers what the tests cannot measure, such as how the tool holds up after the test weeks, how billing and cancelling work in practice and how it compares with its rivals, and can move the score by up to one point either way. The review shows exactly how much, and why.
Step 6
Publish, with the evidence
The review goes live with its full test results on a separate page: every measurement, screenshot and recording behind every grade.
Step 7
Retest when things change
A grade changes only when a retest produces new evidence. The review records the date and the reason, and nothing is silently rewritten.
How the score is built
One score out of 5 per tool. It starts from measurement and ends with judgement, and the review shows both parts separately.
Part one
The test average
Every test in the category is graded 1 to 5 on its written threshold. The average of the graded tests, to one decimal place, is the starting score. These grades never change after publication unless I test again.
4543244323
+
Part two
My verdict, up to one point
What the tests cannot measure, such as how the tool holds up after the test weeks, how billing and cancelling work in practice, and how it compares with its rivals. It can move the score by up to one point either way, and the review says how much and why.
-1.00+1.0
=
The result
One score, shown with its parts
Rankings use the final score. The scores table on every review shows the test average, the verdict and the result side by side, so you always know where a number came from.
3.4 + 0.4 = 3.8/5
Example only
If a test could not be finished properly it gets no grade, and the review says how many tests the score is based on. When a test had to run on fewer messages, images or calls than usual, the review says so, and I run it again on a fuller account when I can.
What a grade means
The words are the same in every category. The thresholds behind them are written into each category’s methodology.
5
Excellent
Best in class on this test. Hard to improve.
4
Good
Does the job well, with small gaps.
3
Average
Works, but nothing stands out.
2
Below average
Noticeable problems that get in the way.
1
Poor
Fails the test or barely passes it.
The tests, by category
Each category has its own bench. The procedure, the sample sizes and the thresholds are published before the first review in that category goes live.
Ten tests, the same for every platform, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, and the measurements, screenshots and recordings behind each grade go in the full test results published with the review.
Ten tests, the same for every editor, from one-click web tools to the raw editors photographers use, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account or licence I use, and the before and after files, measurements, screenshots and timings behind each grade go in the full test results published with the review.
Ten tests, the same for every generator, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, and the prompts, the images, the counts, screenshots and timings behind each grade go in the full test results published with the review.
Ten tests, the same for every generator, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, and the photos, counts, panel results and correspondence behind each grade go in the full test results published with the review.
Ten tests, the same for every tool, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, and the decks, exports, counts and screenshots behind each grade go in the full test results published with the review.
Ten tests, the same for every generator, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, and the logos, files, searches and screenshots behind each grade go in the full test results published with the review.
Ten tests, the same for every app, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, and the photos, renders, overlays, timings and screenshots behind each grade go in the full test results published with the review.
Ten tests, the same for every generator, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, and the ads, exports, counts, recordings and screenshots behind each grade go in the full test results published with the review.
Ten tests, the same for every builder, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, the sites are published for real, and the measurements, screenshots and reports behind each grade go in the full test results published with the review.
Nine tests, the same for every tool, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, the designs are made for real and exported for real, and the timings, screenshots and checklists behind each grade go in the full test results published with the review.
Nine tests, the same for every agent, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, the agent is installed on real test sites and asked real questions, and the transcripts, timings and screenshots behind each grade go in the full test results published with the review.
Nine tests, the same for every platform, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, the campaigns are sent for real to a test list, and the timings, seed-inbox results, screenshots and checklists behind each grade go in the full test results published with the review.
Nine tests, the same for every tool, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, the outreach goes to inboxes and contacts I control, and the timings, seed-inbox results, transcripts and checklists behind each grade go in the full test results published with the review.
Ten tests, the same for every tool, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, the same stack of documents goes through every tool, and the accuracy tables, timings, screenshots and checklists behind each grade go in the full test results published with the review.
Nine tests, the same for every tool, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, the posts are published for real to test accounts, and the timings, counts, screenshots and exports behind each grade go in the full test results published with the review.
Nine tests, the same for every tool, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, against a real website I control, and the counts, cross-checks, screenshots and exports behind each grade go in the full test results published with the review.
Nine tests, the same for every tool, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, against two applications I control, and the counts, run logs, screenshots and reports behind each grade go in the full test results published with the review.
Eight tests, the same for every platform, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, with the same five workflows running for real on the same test data for two weeks, and the timings, counts, run logs, screenshots and exports behind each grade go in the full test results published with the review.
Nine tests, the same for every service, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, with real calls to a real number, and the recordings, transcripts, timings and screenshots behind each grade go in the full test results published with the review.
Nine tests, the same for every tool, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, with real calls, texts and web chats to a real business profile over a working week, and the recordings, screenshots, timings and records behind each grade go in the full test results published with the review.
Eight tests, the same for every service, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, with real calls to a real number at the hours a business is least able to answer, and the recordings, transcripts, timings and screenshots behind each grade go in the full test results published with the review.
Nine tests, the same for every platform, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an agency account I use, building the same receptionist for the same test client, and the recordings, screenshots, invoices, timings and exports behind each grade go in the full test results published with the review.
Nine tests, the same for every agent, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, the tasks are real tasks with real deliverables, and the timings, transcripts, screenshots and files behind each grade go in the full test results published with the review.
Nine tests, the same for every builder, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, the agents are built and deployed for real, and the timings, logs, screenshots and cost sheets behind each grade go in the full test results published with the review.
Nine tests, the same for every agent, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, against real repositories with real test suites, and the diffs, test logs, timings, transcripts and cost sheets behind each grade go in the full test results published with the review.
Nine tests, the same for every agent, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, against the same set of support tickets on a real help desk, and the transcripts, timings, screenshots and cost sheets behind each grade go in the full test results published with the review.
Nine tests, the same for every agent, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, over real phone calls from a real number, and the recordings, latency measurements, transcripts and cost sheets behind each grade go in the full test results published with the review.
Nine tests, the same for every agent, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, with a real outbound campaign to real inboxes I control, and the lead lists, emails, reply logs, CRM records and cost sheets behind each grade go in the full test results published with the review.
Ten tests, the same for every agent, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, against real social, advertising and analytics accounts that belong to a test business, and the timings, counts, screenshots and transcripts behind each grade go in the full test results published with the review.
Ten tests, the same for every agent, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, on a real test store with real products, test orders and real customer channels, and the timings, counts, screenshots and transcripts behind each grade go in the full test results published with the review. Agents that talk to customers, whether support agents or shopping assistants, take all ten tests. Tools built for the merchant rather than the shopper (store analytics, catalogue enrichment) and checkout services that other AI agents buy through take the tests that apply to that kind of tool; the rest are marked not graded and left out of the average.
Ten tests, the same for every platform, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, on the same three business workflows with the same documents, apps and people, and the timings, counts, screenshots and logs behind each grade go in the full test results published with the review.
Ten tests, the same for every agent, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on the same two machines I own, with the network watched, and the timings, counts, captures, screenshots and transcripts behind each grade go in the full test results published with the review.
Ten tests, the same for every agent, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, on a fixed pack of real tasks from the agent's own field, checked against an answer key written with a practitioner in that field, and the timings, counts, screenshots and transcripts behind each grade go in the full test results published with the review.
Nine tests, the same for every assistant, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, with real products, real prices and real orders, and the timings, screenshots and transcripts behind each grade go in the full test results published with the review.
Ten tests, the same for every assistant, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, through one real week of personal admin, and the timings, screenshots and transcripts behind each grade go in the full test results published with the review.
Ten tests, the same for every assistant, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, against the same set of sales calls, emails and CRM records, and the timings, screenshots and transcripts behind each grade go in the full test results published with the review.
Nine tests, the same for every assistant, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, through one real week of executive admin, and the timings, screenshots and transcripts behind each grade go in the full test results published with the review.
Nine tests, the same for every assistant, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, with real meetings booked by real people in real time zones, and the calendar screenshots, email threads, timings and tables behind each grade go in the full test results published with the review.
Nine tests, the same for every assistant, each graded from 1 to 5 on a fixed scale. The overall grade is their average plus my verdict, which can move it by up to one point. Every test is run by hand on an account I use, with real calls to a real number from handsets the assistant has never seen, and the recordings, transcripts, timings and screenshots behind each grade go in the full test results published with the review.
A new category gets its own procedure on this page before its first review goes live.
Rules that apply to every test
Real use of the product on a real account, never promotional descriptions.
Identical tests, thresholds and sample sizes for every tool in a category.
Authorised accounts only. No password sharing, no bypassing of age or bot checks.
Every grade has evidence: a measurement, a screenshot, a recording or a table.
A grade changes only when a retest produces new evidence, with the date and the reason on the record.
Think a grade is wrong? Show me.
A factual correction with evidence is always welcome, and a retest that produces new evidence changes the grade on the record. Makers can put their tool on the bench the same way everyone else gets there.