Guides · For shops and brands
How do I find out if creator sales are incremental or would have happened anyway?
Only a comparison with what would have happened without the campaign shows if creator sales are incremental. Affiliate attribution is not enough: it also counts purchases that would have happened anyway. So compare total sales of the promoted products with a baseline period or similar products, check each creator’s new-customer share as a hint, or start a randomly chosen group of creators later. Extra revenue divided by cost is your incremental ROAS (return on ad spend).
Last updated:
With wyrld Boost you put your budget behind creators who feature your products, starting today, and pay for results.
Why an attributed sale is not automatically an extra sale
An affiliate programme usually credits a purchase to the creator whose link was clicked last or whose code was used. That tells you who was involved in the sale. It does not tell you if the sale would have been lost without the creator. Two examples: a regular customer has already filled her basket, sees a story with a link sticker in the evening and orders through the link. Or someone looks for a discount code just before paying and finds a creator’s code on a coupon site. In both cases you pay commission on a purchase that would have happened anyway.
It works the other way round, too. Someone watches a video, later searches for your shop on Google and buys there without a link or a code. The creator triggered that sale, but your affiliate programme never sees it. Incremental therefore means revenue that would not have existed without the campaign, measured across all sales of the promoted products. Google researchers noted in a 2011 paper that clicks and conversions do not show how people would have behaved without the advertising.
Four test designs and when they fit
| Test design | How it works | Limit |
|---|---|---|
| Baseline period | promoted products against previous weeks and last year, similar products as a seasonal benchmark | discounts, ads and chance in the same weeks distort it |
| Comparison region | creators whose community is concentrated in one region, a similar region without the campaign as the benchmark | posts usually reach the whole community |
| New-customer share per creator | match attributed orders against your order history | an indication, not proof |
| Staggered start (holdout) | creators split by lot into two groups, one starts later | needs creators with fixed dates, enough orders and more time |
For ads, there are tests with a control group. In Google Ads Conversion Lift, which according to Google Ads Help isn’t available for every account, a treatment group sees the ads and a control group does not, and according to the same help page the difference in conversions is the lift. You can’t split a community like that: someone who follows a creator either sees the post or doesn’t. So you need a different comparison, over time, across products, across regions or across groups of creators.
A comparison region is the idea behind the geo experiments Google researchers described in 2011. Regions are randomly assigned to test or control, and before the test there is a period in which every region runs the same way. The precondition there is that ads can be served by region. Creator posts, by contrast, usually reach the whole community wherever it lives. This route only fits if a creator’s community is clearly concentrated in one region, such as one country, and you have separate sales figures for it.
The new-customer share shows how many attributed orders come from people who have never ordered from you, or not for a long time. If almost all orders through a creator come from your regular customers, a large part is probably sales you would have made regardless. The figure can’t prove it, though: a first order might also have happened without the creator. Two more signals work without a link: a question after checkout (“How did you hear about us?”) and searches for your brand name during the campaign. Both show effects that links miss, but neither proves anything on its own.
Staggered start: seven steps and what skews the result
In a staggered start, one group of creators is a holdout at first, meaning a group that does not take part yet. That takes more effort than a simple before and after comparison, but it gives you two measurements instead of one. A holiday week or a newsletter can then hardly explain both jumps in revenue. Google researchers described a similar idea for geo experiments in 2012: regions rotate between test and control across several test periods.
The test stands or falls on creators posting at a known time. An affiliate programme alone doesn’t make that happen. Many partners in a programme never become active, and the creators you want most rarely post without a reason. You can only steer the start through a reason you provide, such as samples, a brief, an agreed date or a paid campaign. So ask more creators than you need for two groups.
- Set the metric: net revenue after returns from all orders of the promoted products, across all channels. Not just revenue through creator links, because incremental sales only show up in total revenue. If you also sell through retailers or marketplaces, their sell-out belongs in it as far as you get the figures.
- Measure the baseline: weekly figures for the last eight weeks and the same weeks last year. Note how much the weeks vary without a campaign. If they range between €4,600 and €5,400, say, a campaign that adds €200 a week gets lost in the noise.
- Choose comparison products: similar products with the same seasonality that are not part of the campaign. They show how revenue would have developed without the campaign.
- Draw lots for the creators: take the creators who have agreed to take part in the campaign. Anyone who already features your products on their own stays out, because you can’t hold them back. Sort the rest by reach, form pairs and draw lots in each pair for who goes into group A. If you start the strongest creators first, you can’t tell later if a difference came from the timing or from the creators.
- Start at different times: group A gets samples and the brief in week 1, group B in week 4, for example. You control the start through shipping and an agreed date. If someone in group B still posts early, record when. Tell everyone in advance why there are two start dates.
- Keep everything else the same: no new discount campaigns, ad budgets for the products unchanged, enough stock in every variant. If anything else happens during the test, such as a newsletter, note it down with the date.
- Evaluate once returns are complete, and by the draw, not by who actually posted: a creator in group A who doesn’t post stays in group A. If total revenue rises at each start by roughly what is attributed to that group, the revenue was more likely incremental. If only attributed sales rise and total revenue stays flat, the links mostly picked up sales you would have made regardless.
- Season and dates: Black Friday, Christmas, school holidays or the start of the month, just after payday, can change revenue even without a campaign.
- Parallel discounts: a sale in your shop or a newsletter voucher in the same week makes the campaign look better than it is.
- Ads at the same time: if ad spend rises during the test, the two effects mix. The same goes for retargeting, meaning ads for people who have already visited your shop, for example through a creator link.
- Stock and price: sold-out variants push revenue down, and a lower price in other shops pulls purchases away.
- Follow-up period too short: in Germany, private buyers can usually withdraw from an online purchase within 14 days of receiving the goods and then have up to 14 days from the withdrawal to send them back (§ 312g(1), § 355(2) and (3), § 356(2), § 357(1) BGB). If you evaluate earlier, you count revenue that will partly be refunded. A longer return policy in your shop pushes the date back further.
Worked example: attributed versus incremental ROAS
| Figure | Calculation (assumed) | Result |
|---|---|---|
| Expected revenue without campaign | 4 weeks × €5,000 × 1.10 | €22,000 |
| Revenue in the test period | measured, all channels | €27,000 |
| Incremental revenue | €27,000 − €22,000 | €5,000 |
| Attributed to creators | links and codes | €12,000 |
| Campaign cost | 15% of €12,000 + €600 samples | €2,400 |
| Attributed ROAS | €12,000 ÷ €2,400 | 5.0 |
| Incremental ROAS | €5,000 ÷ €2,400 | 2.08 |
All values are made up, and the example uses the baseline period with comparison products. Assume the promoted products brought in an average of €5,000 net revenue after returns per week in the eight weeks before the test. The comparison products grew by 10% during the four-week test period, which is the season. Without the campaign you would therefore have expected around €22,000.
Incremental ROAS (iROAS) divides only the extra revenue by the cost. Google Ads calculates it the same way in Conversion Lift: incremental conversion value divided by total spend. With a ROAS of 5.0, the campaign in the example looks strong. But incremental revenue is only €5,000, equal to 42% of the attributed revenue.
Your break-even ROAS tells you if that pays off. It is the ROAS at which the campaign just covers its cost: 1 divided by your contribution margin ratio. That is the share of net revenue left after cost of goods, shipping and payment fees. At an assumed 40% the break-even ROAS is 2.5, and the iROAS of 2.08 is below it. The €5,000 of extra revenue brings €2,000 in contribution margin, while the campaign costs €2,400. At €50 per order, that is 100 extra orders at €24 each, although each one only brings in €20.
Rules that make you pay mainly for incremental sales
| Rule | Advantage | Drawback |
|---|---|---|
| New-customer commission: higher rate for first orders, lower for regular customers | commission goes mainly to winning new customers | needs a fixed definition and matching in your shop |
| Exclude channels, such as coupon sites or search ads on your brand name | catches purchases where someone only looked for a code | has to be monitored |
| Short attribution window for clicks | fewer late purchases that have little to do with the post | penalises creators whose community takes longer to decide |
| Bonus only on revenue above the comparison | pays for measured impact | hard for creators to verify, small numbers fluctuate |
Put every rule into your terms before the start, with a definition. For example: a first order is an order from an email address that has not been used to order in the last 12 months. Rules that only appear afterwards cost you the creators’ trust.
Run the numbers with the example above. Assume 40% of the €12,000 came from first orders. If you pay 20% on those and 5% on the rest, commission costs €960 + €360 = €1,320 instead of €1,800, or €1,920 with samples. If the extra revenue stays the same, the iROAS rises to €5,000 ÷ €1,920 = 2.60 and sits above the threshold of 2.5. Only the next test shows if creators take part just as much at these rates.
How it works on wyrld
With wyrld Boost, you put your budget behind creators who feature your products and give them a reason to post that an affiliate programme alone does not. You set the products, the time frame and the KPIs the payout is based on, such as purchases in a given week, and you decide where people buy, for example only in your online shop. For measurement, that means the campaign has a fixed start and end, and with that choice the purchases from the campaign show up in your own shop data. Leave enough comparison weeks before the time frame, and the baseline period with comparison products from above fits well. A campaign is meant for many creators at the same time. Taking part is up to each creator, so how many join is not fixed in advance. Creators label campaign videos as advertising, and after the campaign you see which creator delivered which results.
If you have an affiliate programme with one of the major affiliate networks, wyrld appears in it as a single partner, through which creators can usually already pick your products. Being available to pick doesn’t mean the creators you want will post, though. The brand and shop subscription shows you which creators behind it feature your products, who brings clicks and who sells. wyrld measures clicks through the links, and sales where the shops report them. Before a staggered start, that tells you whom to leave out of both groups: creators who already feature your products. With creators who sell, wyrld sets up individual terms, so you don’t have to pay everyone the same commission.
You pay for results on your terms: per click, per sale or both. Anyone who buys through a link to your shop orders from you, and the order, payment, shipping and customer relationship stay with you. Outside Boost, if other shops also stock your product, their offers and prices appear alongside and the shopper decides where to buy. Those purchases then won’t show up in your shop data, and for the comparison you need those shops’ sell-out figures, as far as you can get them. Prices for the subscription and Boost are available on request. If you are planning a test with creators, wyrld is happy to work out with you what fits first: the connection, the subscription or a Boost campaign.
Frequently asked questions.
Can I measure incrementality if retailers also sell my products?
Yes, if your retailers give you sell-out figures for both the promoted and the comparison products, ideally weekly. You then work with sales across all channels, just as in your own shop. Without those figures you only see orders placed with you, and you can’t tell if the campaign added purchases or just moved them from the retailer to your shop.
Can I pay creators commission on first orders only?
You can, as long as it is in your terms before the start and your affiliate programme can tell first orders from repeat orders. Define a first order, for example no order from the same email address in the last 12 months. With no commission on regular customers, creators with a loyal community earn little, and some won’t take part. A lower rate instead of zero is a compromise.
How long should a holdout test with creators run?
Until each group has enough orders for the difference to be larger than the normal fluctuation in your weekly revenue. With a staggered start you add the weeks until the second group begins, plus a follow-up period until returns are complete. There is no fixed minimum duration that suits every shop.
Why does my affiliate programme show more sales than the campaign actually added?
Because it counts purchases where a creator link was clicked within the attribution window or a code was used, even if the person would have bought anyway. On top of that come codes that end up on coupon sites and purchases that are attributed to an ad at the same time. You only see what was incremental in total revenue against a comparison.
What if the test shows no difference?
First check how many creators actually posted. No measurable difference does not mean the campaign had no effect. It may have been too small relative to total revenue to stand out from normal fluctuations. A larger test with more creators, or with products that otherwise sell little, can help. If that shows no extra revenue either, adjust commission and rules before you spend more budget.
Last updated:
Sources
All figures in the examples are assumptions, not industry or benchmark values. This page explains test design, the calculation and withdrawal periods in general terms and is not legal advice. Only your own measurement can show if a campaign adds revenue for you. For how to word commission rules in your terms, check with your legal adviser if in doubt. Accessed on :
- Google Ads Help: About Conversion Lift
- Vaver and Koehler: Measuring Ad Effectiveness Using Geo Experiments, Google, 2011
- Vaver and Koehler: Periodic Measurement of Advertising Effectiveness Using Multiple-Test-Period Geo Experiments, Google, 2012
- German Civil Code (BGB), § 312g (right of withdrawal for distance contracts, German)
- German Civil Code (BGB), § 355 (right of withdrawal, German)
- German Civil Code (BGB), § 356 (start of the withdrawal period, German)
- German Civil Code (BGB), § 357 (returning what was received, German)