By default, all campaigns have a global holdback group of 10% of visitors. This means that 10% of all site visitors will never receive a Made With Intent campaign.
Why does a holdback group exist?
Why does a holdback group exist?
The holdback group exists to allow you to confidently report on the success of your Made With Intent real-time campaigns, that you do not serve as experiments. It allows you to publish experiences live to the majority of your audience, and understand the results on your KPIs and Intent metrics, without the need for a testing period.
How does this affect campaign reporting?
How does this affect campaign reporting?
If you launch campaigns as experiences, you will see a 'Holdback' group within reporting.
You can look at campaign reporting at a global level, and an experience level.
Global Level; this will show you all experience results grouped together vs the holdback group (where the holdback group is those visitors who match the global rules of the campaign)
Individual Experience Level; this will show you the results of each individual experience separated. In this case, the holdback group are users who match the global rules of the campaign, and the experience segmentation
For example, on an individual experience level;
If your site has 100,000 visitors eligible, 10,000 of them will be in the holdback group (10%)
You run an experience on site targeting ‘Abandoning Visitors’
Of the 90,000 visitors (not in the holdback), if 20% of visitors matched this segment, 18,000 will be in the experience reporting
In the experience reporting for the holdback group (10,000 visitors), you will see the number of visitors who also matched the segment i.e. assuming a 20% match again, this would be 2,000 visitors.
Can I change the holdback group?
Can I change the holdback group?
Yes, the holdback group percentage can be changed, but it is not recommended. The holdback group compares the website's performance with the campaigns' performance. If the holdback group percentage is reduced, the campaign results may be more challenging to determine. Contact your Customer Success Manager if you would like to discuss this for your website