What is Rollouts?
Rollouts is Shopify's new native feature for scheduling, testing, and gradually deploying changes to your online store, all from inside the admin. No third-party app, no extra monthly fee, no external scripts injected into your storefront.
Shopify hinted at it late last year, and it's now properly available. The timing is deliberate: Q2 is when most brands start pushing changes ahead of summer campaigns, and historically that's also when things go wrong. A redesigned homepage goes live, conversion drops, and nobody's quite sure why. Rollouts is designed to remove that risk entirely.
How it works - The new native A/B testing
You access Rollouts under Markets in your store backend. From there, you create a rollout, give it a name, and set the percentage of visitors who will see the change. The default is 100%, but the smart move is to start at 10–25% and watch your numbers before scaling up. Rollouts is essential Shopify's new native A/B testing.
Every change you make inside a rollout is isolated, your live store is untouched until you're ready to commit. You can schedule a rollout to go live at a specific date and time, which is useful for coordinating launches with campaigns, email sends, or paid media. And crucially, if something looks off, you stop it. The majority of your customers never saw the change.
One thing worth being clear about: Rollouts is built for theme-level changes. Layouts, hero sections, navigation, banners, homepage structure. It's not a full conversion rate optimisation platform, granular element-level testing, advanced audience segmentation, or checkout experiments are still the territory of specialist tools. But for the majority of store changes most brands actually make, it covers the ground well.
There's also a technical advantage worth calling out. The traffic split happens server-side on Shopify's own infrastructure, meaning there's no JavaScript added to your storefront, no flicker effect as the page renders, and no page speed penalty. That's a genuine step up from how most third-party testing tools have historically worked.
This is what it looks like:
What you can test:
- Full theme changes (swapping to a different theme variant)
- Section layouts and visual design changes made through the theme editor
- Navigation structure and menu changes
- Promotional banners and seasonal content
- Homepage layout and collection page organisation
What you can't test yet:
- Global theme settings - colours, typography, anything configured outside the section editor
- Checkout flows or checkout page elements
- Product pricing or discount structures
- App embeds and third-party app content
- Liquid template changes
- Audience-segmented variants - so no "show version A to returning customers, version B to new visitors"
- Custom conversion goals beyond Shopify's standard analytics
- Deep reporting - the built-in analytics cover the basics, but there are no confidence intervals, no segmented breakdowns, and limited export options if you're used to a dedicated testing platform
Scheduled theme updates
One of the most practically useful parts of Rollouts is the ability to schedule theme changes in advance. You prepare your storefront update, a new seasonal look, a sale banner, a campaign landing page, and set an exact date and time for it to go live. No more being on call at midnight to push a Black Friday theme, no more last-minute stress when a launch coincides with your busiest trading hours.
This matters most when your storefront changes need to be coordinated with other activity: an email going out, paid media switching on, a product dropping at a specific time. Previously, getting all of those things to land simultaneously required careful manual timing or developer support. Now you set it, schedule it, and it happens. You can also set an end date, so a promotional theme reverts automatically without anyone needing to remember to switch it back.
SimGym: test before real customers see anything
Alongside Rollouts, Shopify has released SimGym; an app that uses AI agents to simulate shopper behaviour across your store before you go live. These aren't random bots; they're modelled on data from billions of real transactions, shaped into realistic buyer personas that navigate your store, add to cart, and flag where things fall apart.
The intended workflow pairs the two together: use SimGym to catch obvious friction points and quick optimisations with AI shoppers first, then use Rollouts to validate the direction with real traffic. It's a two-stage approach to de-risking changes that previously either didn't exist or cost serious money to put in place.
SimGym is still in early stages, so treat the outputs as useful signal rather than gospel. But the direction is exactly right, and it's only going to improve.
Our take
Rollouts is one of those features that sounds simple and turns out to matter quite a lot in practice. The brands we work with are often sitting on design changes or homepage updates they've been nervous to push — either because testing tools felt like overkill, or because the risk of breaking something live was too high. This removes that friction natively.
The Q2 timing is genuinely good. If you're planning any storefront changes before summer, this is the right moment to start using Rollouts properly rather than launching blind. We've been testing it, we know how it behaves, and we can help you get it set up in a way that actually tells you something useful.
We've created a handy step by step guide to started on Rollouts - here.
