Software Gradebook

Home / Tests / AI assistants: 10 everyday tasks

AI assistants: 10 everyday tasks

Ten fixed everyday tasks, the same exact prompts and input files for every AI assistant, each with written pass/fail rules. Run on the free plan without a card.

Steps

  1. Use the tool's free plan only. Do not enter a card. If the free plan needs an account, sign up with a test email; if it needs a card or a phone number we cannot give, the tool is marked Not yet tested.
  2. Use a clean browser profile (Chrome, Windows 11, desktop size 1440 x 900). Write down the plan name and any model or version name the tool shows.
  3. Start a new chat for every task, so one answer cannot help with the next.
  4. Paste the exact prompt from the task. For the PDF task, attach the input file. Do not change the wording and do not ask follow-up questions.
  5. Where the browser allows, record the seconds from sending the prompt to the finished answer. Times are shown for information only and are not part of the score, because page timing in an automated browser is not exact.
  6. Save the full answer as text and take a screenshot of the answer.
  7. Mark the task passed only if every pass rule holds. The word, grade-level, JSON and formula checks are done by a published grading script (softwaregradebook.com/evidence/grading/sgb-grade-lib.ts), so two testers get the same result.
  8. If the tool cannot do a task on the free plan (for example, no file upload), the task fails with no time, and the reason is written down.

Score: tasks passed (of 10), scaled to 0-10. Nothing else counts.

The 10 tasks

T1. Summarize a PDF

Exact prompt, with the input file riverside-library-memo.pdf:

Summarize the attached PDF in no more than 100 words for a busy reader.

Passes only if:

  • The summary is 100 words or fewer.
  • It gives the total cost of $2.4 million.
  • It gives the planned reopening, June 2027.
  • It names the temporary location, the Oak Street Community Center.
  • It states nothing that the PDF contradicts.

T2. Draft an email from notes

Exact prompt:

Write a short email to my team from these notes:
- team lunch moved to Thursday 14 May
- 12:30 at Rosa's Kitchen, 18 Elm Road
- the company pays up to $25 per person
- reply by Monday 11 May if you can't come
- vegetarian options available

Passes only if:

  • It has a subject line (a line starting with Subject, with or without a colon).
  • It includes all five facts: Thursday 14 May; 12:30; Rosa's Kitchen, 18 Elm Road; up to $25 per person; reply by Monday 11 May if you can't come. It may also mention the vegetarian options.
  • The email body is 150 words or fewer.
  • It adds no date, time, place or amount that is not in the notes.

T3. Answer a factual question with a source

Exact prompt:

In what year was the Hubble Space Telescope launched? Give one source link.

Passes only if:

  • The answer says 1990.
  • It includes at least one web link.
  • A linked page, opened by the tester, states that Hubble launched in 1990.

T4. Convert a table to JSON

Exact prompt:

Convert this table to a JSON array of objects with the keys name, city, joined (as YYYY-MM-DD) and plan. Reply with the JSON only.

Name | City | Joined | Plan
Ana Ruiz | Austin | 3 Feb 2025 | Pro
Ben Okafor | Leeds | 17 Nov 2024 | Free
Chen Wei | Toronto | 9 Jan 2026 | Team
Dara Singh | Perth | 30 Jun 2025 | Pro

Passes only if:

  • The JSON parses with no errors (a code fence around it is allowed).
  • It has exactly 4 objects with exactly the keys name, city, joined and plan.
  • All 16 values match the table, with the dates 2025-02-03, 2024-11-17, 2026-01-09 and 2025-06-30.

T5. Write a spreadsheet formula

Exact prompt:

Cells A2:C7 of my spreadsheet hold Region, Date and Sales:
East, 2025-12-15, 400
West, 2026-01-05, 250
East, 2026-01-10, 300
East, 2026-02-01, 540
West, 2026-02-03, 610
East, 2026-03-12, 400
The dates are real date values. Write one Excel formula that adds up Sales for East on or after 1 January 2026, and tell me the result.

Passes only if:

  • The formula, entered in a sheet that holds this data, returns 1240 (checked with a spreadsheet engine).
  • The answer states the result as 1,240.

T6. Rewrite legal text in plain language

Exact prompt:

Rewrite this so a 12-year-old can understand it. Keep every deadline, date and amount.

Subscribers wishing to terminate their membership must furnish written notification to the Administrator no fewer than thirty (30) days prior to the commencement of the subsequent billing period; failure to provide such notification shall result in the automatic renewal of the membership and the assessment of the applicable annual fee of $45.00, which is non-refundable except as required by applicable law. Notwithstanding the foregoing, members who enrolled prior to 1 March 2026 shall be entitled to a pro-rata refund upon request.

Passes only if:

  • The rewrite scores a Flesch-Kincaid grade level of 8.0 or lower (computed by the grading script).
  • It keeps 30 days, $45 and 1 March 2026.
  • It says that members who joined before 1 March 2026 can get a partial refund.

T7. Translate a message into Spanish

Exact prompt:

Translate into Spanish: "The pharmacy is closed on Sunday. Your prescription will be ready on Monday at 10 a.m. Please bring your insurance card."

Passes only if:

  • The translation is in Spanish, with no English sentence left.
  • It contains farmacia, domingo (or domingos), lunes, 10 and seguro.
  • It keeps all three sentences' meaning: closed Sunday; ready Monday at 10 a.m.; bring the insurance card.

T8. Pull every date out of an email

Exact prompt:

List every date and deadline in this email as a bulleted list, one per line, with what it is for.

Hi all, quick update on the move. Packing boxes arrive on 2 June. Please label your desk by Friday 5 June. The movers come on Saturday 6 June from 8 a.m. The new office opens on Monday 8 June, and the old building keys must be returned by 12 June. Thanks, Priya

Passes only if:

  • The list has exactly 5 dates: 2, 5, 6, 8 and 12 June.
  • Each date has the right purpose: boxes arrive; label desks; movers come; new office opens; return keys.
  • No other date is listed.

T9. Follow strict writing rules

Exact prompt:

Write a product description for a steel water bottle in exactly 3 bullet points. Each bullet must be under 12 words. Do not use exclamation marks. Do not use the word "perfect".

Passes only if:

  • There are exactly 3 bullet points.
  • Each bullet has 11 words or fewer.
  • There is no exclamation mark.
  • The word perfect does not appear.

T10. Split a bill with a tip

Exact prompt:

Our restaurant bill is $84.50. We want to add an 18% tip and split the total evenly between 3 people. How much does each person pay? Round to the cent.

Passes only if:

  • The final answer is $33.24 per person.

Version history

  1. First version: 10 tasks, fixed prompts and inputs, written pass rules. Before the results were published: the score uses tasks passed only (answer time is shown but not scored), a Subject label on its own line counts as a subject line, domingos counts for domingo, and "thirty (30) days" counts as 30 days.