BUYING AI SERVICES

Before you hire an AI agency, give two teams the same test

Two polished demos can leave you with wildly different quotes and no way to choose. A one-page brief and three fictional requests make the proposals comparable.

Choose one handoff that already costs time

Imagine a small events business that receives inquiries by form. A coordinator reads each one, checks the date and drafts a reply. The owner wants help with that first response. Write the scope in one sentence: “Given an inquiry, prepare a draft reply and a record the coordinator can approve.” Booking an appointment, sending a message and taking payment are separate decisions.

Describe the current process in numbers you can actually collect. Time ten recent inquiries internally and record how many replies needed rework. Share the aggregate baseline and fictional examples with the bidders. Keep client details out of the pilot packet.

Give each bidder the same three requests

  • Complete request. A customer asks about a 12-person dinner on December 12. The draft should preserve the date and headcount, then ask the coordinator to confirm availability.
  • Missing detail. A customer asks for “a Saturday party” without a date. The draft should ask a single clarifying question and leave the date field empty.
  • Correction. The first customer submits a second message changing the headcount to 18. The coordinator should see one updated inquiry, its prior value and the unsent draft.

Tell bidders which outcomes earn a pass. An attractive reply that promises availability without confirmation needs rework even if it reads perfectly.

Ask for the same line items in both proposals

Request the pilot fee, recurring software charges, usage assumptions, integration access and the name of the person responsible for support. Ask what a coordinator can change without calling the agency. Have each bidder show how someone would retry a failed run and how the business would export records if the engagement ended.

Different specialties justify different quotes. A custom development studio might build the integration. An automation consultancy might configure your existing tools. A training provider may teach your coordinator to operate an internal version. Decide which outcome you are buying before comparing the totals.

Make the handoff part of the demo

Have your coordinator run the three requests while the bidder observes. Record which passed, how many edits each draft needed, whether duplicate records appeared, and what the coordinator could fix independently. Ask for a short operating guide, editable materials, estimated monthly cost at your volume and a named owner for exceptions.

We will consider expanding the pilot after our coordinator can run all three cases, identify an incomplete request, review a correction and recover a failed run using the delivered instructions.

If both teams pass, choose on the ongoing cost and support your business can sustain. If neither passes, use the failed case to narrow the next proposal.

Common questions

How many providers should receive the brief?

Two relevant providers can show where assumptions differ. A third is useful when the first two proposals include very different levels of implementation or support.

Should the pilot use real customer records?

Fictional records are enough to compare the proposed workflow. Decide what production access a selected provider needs separately.

Sources and review notes

Product information checked against publisher documentation on . Plans and features can change. The workflows and examples are editorial guidance; this article does not report hands-on product test results.

Keep learning

← All journal articles