CRO Case Study Documentation Framework | Adslytics

CRO Results Need to Be Told as Stories

A CRO test result is a data point. A CRO case study is a story — problem identified, solution hypothesized, test designed, result measured, revenue impact quantified. Stories build organizational confidence in the CRO program and justify continued investment.

Our CRO team documents significant winning tests in this case study format for every client, enabling them to share results with leadership and stakeholders.

The CRO Case Study Template

1. Executive Summary (2–3 sentences)

The complete story in brief. Should answer: what did we test, what happened, what did it mean for revenue?

Example: "We tested adding explicit shipping cost information to the product page before checkout. Conversion rate from product page to purchase increased by 22%. At current traffic levels, this improvement generates an estimated £8,400 additional monthly revenue."

2. The Problem

What did the data show before any changes were made?

Quantitative finding: "GA4 funnel data showed 68% of users who added to cart abandoned at the checkout information step. This was significantly higher than the industry benchmark of 55% for this category."
Qualitative finding: "Exit survey data (n=83 responses) showed 34% of checkout abandoners cited 'unexpected shipping cost' as their primary reason for not completing purchase."

3. The Research

What sources contributed to the hypothesis?

Session recordings: "In 47 of 80 checkout abandonment recordings reviewed, users reached the shipping cost display at checkout information step and immediately scrolled up or closed the tab."
Heatmaps: "Scroll map showed 72% of product page visitors never scrolled to the 'Shipping & Returns' section at the bottom of the page."

4. The Hypothesis

The specific, testable prediction derived from research:

"We believe that displaying free shipping threshold information and estimated shipping cost in the product page Add-to-Cart area will reduce checkout abandonment by 10%+, because users currently encounter shipping costs as a surprise at checkout. We'll measure success by checkout initiation rate from product pages."

5. The Test Design

Control: Product page without shipping information
Variant: Product page with "Free shipping on orders over £50 | Your order qualifies for free shipping" below the Add to Cart button
Primary metric: Checkout initiation rate from product pages
Test duration: 28 days (required for 95% significance at 80% power given traffic)
Tool: VWO

6. The Results

Control conversion rate: 4.2%
Variant conversion rate: 5.1%
Relative improvement: +21.4%
Statistical significance: 97%
Sample size: 8,420 visitors per variant
Secondary metrics: AOV unchanged (+0.3%, not significant). Mobile improvement (+18%) and desktop improvement (+24%) both significant.

7. Revenue Impact Calculation

Monthly visitors to product pages: 25,000
AOV: £64
Previous monthly transactions from product pages: 25,000 × 4.2% = 1,050
New monthly transactions: 25,000 × 5.1% = 1,275
Incremental transactions: 225
Incremental monthly revenue: 225 × £64 = £14,400
Annual revenue impact: £172,800

8. What We Learned

The transferable insight for future tests: "Transparent cost communication before checkout initiation significantly reduces abandonment caused by cost shock. This principle applies to any page where users may encounter unexpected costs downstream — consider testing similar information disclosure at category page and cart page level."

This case study format, when used consistently across your CRO program, builds a compelling evidence portfolio. Our CRO team produces case study documentation as standard deliverables. Contact us to start building your CRO evidence portfolio.