RankDude

Chatbot coding checks

Code counts only when it runs and passes, so a good explanation cannot hide a bug.

Checker · AI chatbot
When it runs
After the coding test of every chatbot review
Used in
10 reviews
Runs on
A Python script (coding-checks.py) on my PC

What the chatbot coding checks is

The ten tasks are four small functions with edge cases, two bug fixes, two data tasks, one script and one task that asks for tests. The checker runs each saved file against its cases.

The task that asks the chatbot to write tests is run against three deliberately broken versions, and its tests must fail each one.

How it works

  1. Save the code block of each first answer unchanged.
  2. Run the checker over the folder.
  3. Count the tasks that pass.

What it records

Per task
Pass or fail, and the case that failed.

What it cannot catch

  • Only the code is graded here; how well it is explained is noted separately.

Where it was used

Every published review that ran this checker, with the figure it produced there, read from the review’s own data. Each figure opens the test results behind it.

Review

The other checkers for ai chatbot

Written by Miles Foster, Owner and tester, RankDude. How RankDude tests and grades is on the methodology page.