Skip to main content

A/B Testing - Compare Themes and Track Conversions

· 2 min read
Jean-Benoît RICHEZ
CEO of JB Holdings and ship-faster specialist

We're excited to introduce A/B Testing, a data-driven way to compare your themes and find out which one converts better.

What is A/B Testing?Direct link to What is A/B Testing?

A/B Testing lets you run experiments between two themes over a defined period. The app automatically alternates between Theme A and Theme B at configurable intervals (6h, 12h, 24h, 48h, or 72h), giving each theme equal exposure to your visitors.

Perfect for:

  • Theme redesigns: Test your new design against the current one before fully committing
  • Seasonal variations: Compare different seasonal looks to maximize conversions
  • Landing page optimization: Find the theme that drives more sales

Key FeaturesDirect link to Key Features

Guided 6-Step CreationDirect link to Guided 6-Step Creation

Our step-by-step wizard walks you through:

  1. Name and description for your test
  2. Theme selection with automatic extension verification
  3. Start date and time (with timezone support)
  4. End date and time
  5. Switch interval configuration
  6. Summary review before launch

Visual TimelineDirect link to Visual Timeline

See exactly when each theme will be active with our timeline view. Track the status of each period: Scheduled, Active, or Completed.

Full ControlDirect link to Full Control

  • Pause/Resume: Temporarily halt your test and resume when ready
  • Cancel: Stop the test at any time
  • Real-time monitoring: Watch your metrics update as the test runs

Conversion Tracking with Web PixelDirect link to Conversion Tracking with Web Pixel

The real power of A/B Testing comes from our Web Pixel integration. Unlike theme extensions that can't run during checkout, our Web Pixel tracks the entire customer journey:

  • Unique visitors: Each visitor is tracked with a consistent ID across sessions
  • Page views: See how visitors engage with each theme
  • Add to cart: Track shopping behavior
  • Checkout completions: The ultimate conversion metric
  • Revenue: Know exactly how much each theme generates

Statistical ConfidenceDirect link to Statistical Confidence

Once you have enough data (30+ sessions per theme), the app calculates which theme is performing better and shows you the confidence level of the result.

PRO Plan ExclusiveDirect link to PRO Plan Exclusive

A/B Testing is available exclusively to PRO plan subscribers. This advanced feature is designed for merchants who want data-driven decisions about their store's appearance.

Ready to find your winning theme? Head to the A/B Tests page and start your first experiment!