Test log
Almanack test data
Raw results for the Almanack review. The verdict is in the review.
- Tested
- 7 November 2026
- Tester
- Miles Foster
- Account
- Free demo account, signed up by RankDude, nothing paid to the brand
- Tests
- 10
- Screenshots
- 9
- Method
- Published methodology
- Environment
- Google Chrome on desktop
Results
| ID | Test | Key measurement | Score |
|---|---|---|---|
| T01 | Answer & Explanation Accuracy | Questions asked: 60 of 60 | 5/5 |
| T02 | Flashcards & Quizzes From a Source | Items correct, answerable and on source: 20 of 20 | 5/5 |
| T03 | Summarising a Lecture or PDF | Lecture points kept: 8 of 10 | 4/5 |
| T04 | Step-by-Step Explanations | Problems with followable steps: 11 of 11 | 5/5 |
| T05 | Uploaded Document & Notes Handling | Checklist points that worked: 6 of 10 | 3/5 |
| T06 | Subject Coverage | Maths and science: 20 of 20 | 5/5 |
| T07 | Citations & Trustworthiness | Invented citations: 0 | 4/5 |
| T08 | Mobile & App Experience | Checklist points that worked: 4 of 10 | 2/5 |
| T09 | Free-Tier Limits | Chat messages sent: more than 80 | 3/5 |
| T10 | Pricing & Value | Pro, yearly: $7.50 a month ($90) | 4/5 |
| Overall (in the review) | 4/5 | ||
Answer & Explanation Accuracy
5/5Tested- Method
- All 60 questions of the fixed set were typed into Almanack's chat once each, in a new chat, and the first complete answer was marked against the answer key.
- Questions asked
- 60 of 60
- Correct
- 60 of 60
- Made up
- 0
- Remark
- Scale 5 is 54 or more of 60 correct with nothing made up. Sixty of 60 is the top band.
Raw notes
All 60 questions of the fixed set were typed into Almanack's chat once each, in a new chat, and the first complete answer was marked against the answer key.
All 60 answers were right and none was made up, across 20 maths and science, 20 humanities and 20 general knowledge questions. The average reply took 8.9 seconds, between 5.1 and 20.3.
Two answers (G6 and G15) carried a Web search preview label, and G15 named un.org.
- Each question was asked once; M5 was sent twice by a script overlap and the first answer counted.
Flashcards & Quizzes From a Source
5/5Tested- Method
- The 170-word Harrow Valley Canal text was pasted into the chat with a request for 10 flashcards and a 10-question quiz with an answer key.
- Items correct, answerable and on source
- 20 of 20
- Facts in the text covered
- 10 of 13
- Answer key wrong
- 0
- Remark
- Scale 5 is 18 or more of 20 usable items. Twenty of 20 is the top band.
Raw notes
The 170-word Harrow Valley Canal text was pasted into the chat with a request for 10 flashcards and a 10-question quiz with an answer key. Each of the 20 items was read against the text.
All 20 items were correct, answerable with one right option, and on the source. The answer key (B C B A B C C B B D) was right on every question.
The items covered the date, the length, the two towns, the engineer, the locks, the 164 feet, the limestone, the tunnel, the towpath and 2009. The dividend, the 30-ton barge and the 1921 closing were not covered.
- The chat asked a layout question twice before it made the set. The output is text in a chat reply, with no flashcard player.
Summarising a Lecture or PDF
4/5Tested- Method
- The 3,000-word lecture and the 12-page chapter text were each pasted once and summarised with no length set, and the summaries were read against ten key points each.
- Lecture points kept
- 8 of 10
- Chapter points kept
- 8 of 10
- Errors introduced
- 0
- Remark
- Scale 4 is 7 or 8 points kept with at most one error.
Raw notes
The 3,000-word lecture and the 12-page chapter text were each pasted once and summarised with no length set, and the summaries were read against ten key points each. The chapter was also attached as a PDF.
The lecture summary kept the 1774 start, the 64 km, the 2.1 metre channel, the 31 locks and the Hexby staircase, the coal and limestone and 310,000 tonnes in 1832, the 1849 railway, the 1912 bankruptcy and 1947 end, the 1971 volunteers, the 1975 to 2009 restoration at about 21 million pounds and the water voles. It left out the engineer, the 47 metre climb, the 1905 tonnage and the 9,000 boat movements.
The chapter summary kept the Orrin River dam, the 85,000 hectares, the lining from about 40 to 12 per cent, the cotton shift, the salinity, the 22,000 and 1,500 families, the 90 MW and the three lessons. It left out the 74 metre height, the 1.2 billion cubic metres, the 14 branches and the cooperative. No error was introduced on either.
- Summaries were of pasted text; a PDF summary of the chapter was five bullets and was not scored separately.
Step-by-Step Explanations
5/5Tested- Method
- The 11 problems with a method in the fixed set were each sent in a new chat with the words Explain step by step how to do this, showing each step.
- Problems with followable steps
- 11 of 11
- Average reply
- 9.1 s
- Remark
- Scale 5 is 17 or more of 20. The set has 11 method problems and all 11 passed.
Raw notes
The 11 problems with a method in the fixed set were each sent in a new chat with the words Explain step by step how to do this, showing each step.
All 11 replies showed correct working in numbered or labelled steps that reached the right answer: M1, M2, M3, M4, M5, M8, M11, M13, M15, M17 and M19. Several ended with a check or a boxed answer.
The chat solves the problem outright. It did not ask me to try a step or give a hint.
- Eleven problems, not 20. No teaching mode was seen.
Uploaded Document & Notes Handling
3/5Tested- Method
- Each input was tried in the chat, and a ten-point checklist was scored on what ran.
- Checklist points that worked
- 6 of 10
- Accepted file types
- Images, PDF, .txt, .md, .csv
- Remark
- Scale 3 is 6 or 7 of 10 points.
Raw notes
Each input was tried in the chat, and a ten-point checklist was scored on what ran.
Six points worked: pasted text, a PDF, a photo of notes, two files in one chat, export of a lesson to PDF, Google Docs or Word, and a 36-page PDF, from which the chat gave the clerk's name and the cupboard number from the last page, both right, with no question back.
Four did not: a Word file was refused with File(s) not supported: chapter.docx, slide files are not in the list of accepted types, a YouTube link could not be opened and the chat said so, and audio is not an accepted type, since the chat's own list is images, PDFs and text files.
- The long file was one 36-page PDF with one fact on the last page, tried once. The chat does not accept audio, so audio was not tried.
Subject Coverage
5/5Tested- Method
- The 60 answers were split by subject group and the weakest group sets the grade.
- Maths and science
- 20 of 20
- Humanities
- 20 of 20
- General knowledge
- 20 of 20
- Remark
- Scale 5 is every group at 90 per cent or more.
Raw notes
The 60 answers were split by subject group and the weakest group sets the grade.
Maths and science: 20 of 20. Humanities: 20 of 20. General knowledge: 20 of 20.
- Twenty questions a group is a small sample.
Citations & Trustworthiness
4/5Tested- Method
- A question that the attached PDF does not answer was asked with a request to quote the page, and a request for two real sources was sent to the chat.
- Invented citations
- 0
- Said it did not know
- 1 of 1
- Remark
- Scale 4 is an occasional weak reference with nothing fabricated. The sample is two requests and the links were not opened.
Raw notes
A question that the attached PDF does not answer was asked with a request to quote the page, and a request for two real sources was sent to the chat.
Asked how many tourists visit the Kessel Dam each year, the chat said the PDF does not say and quoted the dam's height and build years, which are on page 1. Nothing was invented.
Asked for two real sources for the Treaty of Versailles date, it named the US Department of State Office of the Historian and Encyclopaedia Britannica, both giving 28 June 1919. Links were shown but not opened.
- Two requests. Links were not opened.
Mobile & App Experience
2/5Tested- Method
- Five pages were opened in a 390 by 844 window with touch emulation, and a ten-point checklist was scored.
- Checklist points that worked
- 4 of 10
- Pages with sideways scroll
- 0 of 5
- Smallest text
- 9.75 px
- Remark
- Scale 2 is 4 or 5 of 10 points.
Raw notes
Five pages were opened in a 390 by 844 window with touch emulation, and a ten-point checklist was scored.
Four points worked: the site and dashboard fit with no sideways scroll on five pages, the chat is usable, the resources page fits, and the body text is readable.
Six did not: the lesson page squeezes step text into a one-word column, the smallest text was 9.75 pixels, no app store link was found, and offline use, reminders, sync and a quiz or card player were not found or not run.
- Device emulation only. Uploading from the phone was not tried and is counted as not working.
Free-Tier Limits
3/5Tested- Method
- The trial was used for two days, and the account page, the banner and the home page were read.
- Chat messages sent
- more than 80
- Limits hit
- 0
- Trial ends
- 21 November
- Remark
- Scale 3 is a tight free tier, enough to try but not to rely on. A trial is not a free plan, and the post-trial limits were not visible.
Raw notes
The trial was used for two days, and the account page, the banner and the home page were read.
The account page shows Almanack Pro Trial and a banner says it expires on 21 November, extendable by referring a friend. No card was asked for. More than 80 chat messages, a lesson with five resources and the study material were made with no limit and no meter.
What stays free after the trial was not shown.
- Two days of use.
Pricing & Value
4/5Tested- Method
- The Upgrade Your Subscription window was read in its Annual, Quarterly and Monthly views for Individual and Team, and closed without buying.
- Pro, yearly
- $7.50 a month ($90)
- Pro, monthly
- $11.99
- Remark
- The yearly price is under $10 but needs $90 at once, and the monthly price is $11.99, so I graded 4.
Raw notes
The Upgrade Your Subscription window was read in its Annual, Quarterly and Monthly views for Individual and Team, and closed without buying.
Individual Pro is $7.50 a month billed yearly at $90, $8.99 a month billed quarterly at $26.97, or $11.99 a month. Team is $11.99 a seat a month. The window says access is unlimited for one user and subject to fair use.
There is no public pricing page, so the prices are not tracked.
- No plan was bought.
Coverage
Tested
- 60 fixed questions in the chat, a new chat each
- Flashcards and a quiz from a 170-word text
- Summaries of a 3,000-word lecture and a 12-page PDF chapter
- Eleven method problems with steps
- PDF, Word, image and two files at once, and a video link
- The Upgrade window prices and the trial banner
- Saved pages in a phone-size window
Not tested or limited
- The kit has 11 method problems, not 20; all 11 were run
- M5 was sent twice because two of my scripts overlapped; the first answer, correct, was taken
- The lecture and chapter were pasted into the chat; the chapter was also attached as a PDF
- Audio, slide files, notes on a real phone, offline use and reminders were not run
- Citation links were read but not opened
- The phone check was by device emulation, not a real phone
- What stays free after the trial ends was not visible
Still to test
- Slide and audio inputs
- Opening the cited links
- A real phone and offline use
- What stays free after the trial