How can I compare AI tools fairly?

By Superpowers by Waymaker · Reviewed October 7, 2026

A real-work example

Two meeting assistants receive the same permitted practice recording. Compare the decisions, owner names and unanswered questions against a human-checked reference, then count the editing needed.

Try this next

1. Write a task brief and choose a few representative examples before opening either tool. Include a missing detail or ambiguous case.
2. Record the plan, model or version where available, date, settings and any extra help each tool received. Keep the inputs comparable.
3. Check factual accuracy, completeness and formatting against the reference. Count review time and setup as well as generation time.
4. Check export options, permissions and the full cost at your expected usage. Do not put credentials or private recordings in the comparison sheet.
5. Choose keep, revise or stop. Save the reasons and a review date; one successful example does not establish general reliability.

Put it into practice

This is Superpowers editorial guidance, not a claim that a particular tool has passed an evaluation.