Running an A/B test through Atlas

There is no testing-matrix screen

Let me be straight with you up front: Pinnora has no visual testing-matrix UI. If you came looking for a grid where you drag variants into cells, it is not there. The only way to start a formal A/B test is to ask Atlas, which calls its create_ab_test tool. You describe the test in chat, and it sets it up.

What the tool sets up

You give it a control creative and one to five variants, the platforms to run on (Meta, Google, or TikTok), a split that adds up to 1.0, a duration of 3, 7, 14, or 30 days, and a winner rule. The winner rule is a metric (CTR, CVR, CPA, ROAS, or CAC), a direction, a required delta versus the control, and a minimum sample size. Once it is running, a cron job polls the metrics every six hours and can promote the winner for you if you asked it to.

The three things it needs to be real

A test only means something when three things are true. You need a connected ad account on the platform. You need the test's ads actually running and spending, so there are metrics to poll. And you need to accept that this path is unproven in production, because no A/B test has run here yet.

A test with no live spend is a taste test with no tasters in the room. The winner rule has nothing to read, so it never resolves. Treat this as a real feature with real prerequisites, not a button for day one. Connect an account, push a creative, get numbers flowing, and then come back and set up the test.