How to vet an AI ad studio: nine questions and the answers to listen for

01What you are buying is the behavior on the bad day

Every project has one hour in it where something cannot be done. The location has no photograph of the west-facing balcony. The model's hands do the wrong thing in every take. The one product shot you have is 900 pixels wide. What a studio does in that hour is the entire difference between the two quotes on your desk, and none of it appears in a reel.

The volume evidence makes this sharper. Motion's benchmark set of more than 550,000 ads found that the best-performing accounts and the average ones win at roughly the same rate. The top account wins more often because it ships more genuinely different swings, not because its craft is better. What you are hiring is a rate of good decisions under pressure, repeated weekly. So ask about the pressure.

A studio with no refusals has no standard. Refusals are the cheapest evidence of a point of view that exists.

why question five is the one we would ask first

There is a second reason to ask rather than watch. A reel is assembled for you, and craft is far more visible to a buyer than it is to a customer. What your customer notices is whether the first second gave them a reason to stay, and no reel can show you the ones that failed that test.

02The nine questions, and what a good answer sounds like

Ask them in this order. The first four are about the machinery, the middle three are about failure, and the last two are about taste. You do not need to be a video person to hear the difference. In a good answer somebody names a thing. In a bad answer somebody names a category.

Say them out loud rather than emailing them, and let the silence after each one run. The pause is data. Somebody who has thought about the question answers inside three seconds, because the answer is a thing that happened to them. Somebody who has not will reach for a category, and you can hear the reaching.

03Which reassuring answers actually mean the opposite?

Four answers get accepted because they sound like generosity or rigor. Each one is a real sentence somebody said to a buyer we later spoke to. None of them is dishonest. All four describe an absence.

None of the four is disqualifying on its own. Good people say all four out of habit, because those are the sentences this industry taught them to say. What matters is the follow-up: who specifically, and what happens when they are wrong. Either a second, more specific answer exists underneath the first one or it does not, and you find out immediately.

04Why is the checking question worth two of the others?

No film leaves here until five separate verdicts come back: message, visibility, physics, story and commodity. Each one is run by a fresh reviewer who has seen only the delivered bundle, never the brief, never the build notes, never a previous verdict. A re-render voids all five, because a verdict belongs to the bytes that will actually ship.

Maker never checks maker, and the reason is a measurement rather than a principle. On the same films the build side's own scores ran between 36 and 76 points above the founder's. That gap is not dishonesty. It is what happens when the person who knows what a shot was meant to do watches the shot. There is a longer version of this in our deterministic pipeline write-up.

What the checks cannot do is tell you the ad is good. Fewer than half of our films that pass every automated gate survive the first human viewing, and that is what the gates are for. They clear the floors so the argument can be about whether the thing works, which is the only argument worth paying a studio to have. The money side of that is in what failed renders actually cost.

05Now ask us the same nine questions

A vetting post that cannot be pointed at its author is an advertisement. So here are our nine answers with the cost of each one written next to it. Three of these rows are reasons to hire somebody else, and those are the rows I would read first.

One more admission, because it belongs in a vetting post rather than in a footnote: not one film in our own reference library carries a click-through rate or a return on spend, so every ranking in it is a judgment about craft rather than a measurement of what converts. Put that question to us the same way you would put it to anybody else on your shortlist, and compare the answers.

The honest external evidence points the same way. CreativeX measured a ten point rise in creative quality score against roughly a two percent fall in media cost across about 822,000 observations. Real, statistically solid, and small. Craft is a floor most spenders fail, not the thing you win with. Anyone selling you craft as the performance lever is selling past their own evidence.

06So what do you do with the answers?

Do not score the call and pick a winner. Take the three vaguest answers and write them into the first scope as plain sentences. Who builds it. What counts as a round. Who checks it before it reaches you. A studio that meant its answer signs that paragraph without editing it. A studio that did not starts negotiating the wording, which is the whole test performed in one move and for free.

WHO BUILDS IT
  <name> reads the brief and cuts the film. If any part of the work
  is subcontracted, we are told which part, before it starts.

WHAT COUNTS AS A ROUND
  A change of mind is a round. A defect is not a round and is fixed
  at no cost, because it was not our instruction that produced it.

WHO CHECKS IT
  Before we see a cut it is checked by somebody who did not build it,
  against checks named here rather than described as a process.

A SHOT THAT CANNOT BE SOURCED
  We are told, and told what would unlock it, before any substitute
  is generated, sourced or shot.

The best vetting question is the one that costs the studio something to answer honestly, and the cheapest vetting method is a small paid project that you watch go wrong. Everything above is a way of getting to that faster. The rule sitting behind row seven, re-roll and never repair, is the single answer that most changes what a project costs you.