Hiring help for AI automation is hard precisely because the market is new and everyone sounds convincing. The fastest way to tell a real partner from a slick vendor isn't to grill them on models, it's to ask a few pointed questions and listen to how they answer.
Here are the ones that matter, and what a good answer sounds like.
Do they lead with your problem or their tools?
The biggest tell is the first five minutes. Anyone who opens with the stack they use, GPT this, n8n that, before asking what's actually costing you time or money is selling technology, not solving a problem.
A strong partner starts with discovery: which workflows eat the most hours, how clean your data is, and what success would look like in numbers. Tools come after the problem is understood, not before.
Can they show proof for a business like yours?
Ask for a concrete example: a workflow they automated for a company your size, with a result attached. You're not looking for a famous logo, you're looking for specifics, what the problem was, what they built, and what changed.
Vague answers are a flag. Detailed ones, even anonymized, mean they have actually shipped.
Will they commit to a number and a date?
Good partners are comfortable being measured. Ask what success looks like in numbers and by when: hours saved per week, response time cut from X to Y, error rate down by a set amount. If they won't commit to anything measurable, they don't expect to be held to it.
Who owns what gets built?
This is the question most buyers forget. If the automation lives in the agency's accounts and disappears the day you stop paying, you don't own an asset, you're renting one. Insist that everything runs in your accounts, with documentation your team can change.
What are the real ongoing costs?
Beyond the build there are tool and API subscriptions that scale with usage, and sometimes a maintenance fee. A trustworthy partner tells you these upfront, not after you've signed. Ask them to itemize what you'll pay monthly once the project is live.
Who actually does the work?
A common trick: senior people sell the engagement, juniors deliver it. Ask who will actually build your automation and whether the person in the room will be involved. You want the expertise you're paying for on the keyboard, not just in the pitch.