← All AI news
GoogleProductivity

A new benchmark asks agents to work across complex files

MKA evaluates visual knowledge work and highlights why the finished document matters as much as the answer.

THE UPDATE

What changed

Google and Artificial Analysis introduced the Multimodal Knowledge Agent benchmark on November 10. It evaluates work involving visually complex files using a shared agent setup. The private evaluation has 200 tasks; ten separate public tasks are available for people to inspect and try. The evaluation checks deliverables, including rendered pages and spreadsheet formulas.

One useful next step

Pick a document or spreadsheet task you already understand. Define the checks before starting, then open the resulting file and verify them. Record the time spent fixing the output in your tool trial.

Compare finished work in the Tool Trial Lab ↗

Before you dive in

Google is both a model developer and an announcement source. Its model comparisons are attributed reporting, not AI Superpower test results. A benchmark result does not establish performance on your files or task.

GO TO THE ORIGINAL

Source & announcement date

Google ·

Google: Introducing the Multimodal Knowledge Agent benchmark ↗ (opens in a new tab)

This brief summarizes the linked announcement. “The AI Superpower take” and the next step are our editorial interpretation, not claims from the source.

KEEP YOUR CURIOSITY GOING

A few more worth knowing.

All AI news ↗