> For the complete documentation index, see [llms.txt](https://docs.digitalturbine.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.digitalturbine.com/dt-fairbid/advanced-configurations/placement-experiments.md).

# Placement Experiments

Experimenting with placements allows you to try out proposed placement settings on a subset of your traffic in order to understand the effects of configuration change. Once you analyze the results of your experiments, you can then decide to either save the variant settings as your official placement settings or stay with the original settings.

## What Can I Test? <a href="#h_01j88dewwfhnjcgdkcfc3sxr31" id="h_01j88dewwfhnjcgdkcfc3sxr31"></a>

Experiments can help you determine how the following changes might affect your placement performance:

* Introducing a new network instance to your waterfall.
* Using instances with Auto CPM versus Fixed CPM.
* Adding bidding instances versus traditional mediation instances.
* Setting different price floors.
* Changing the number of ads each user is receiving.
* Changing the frequency of ads each user receives.
* Changing country targeting.
* Changing different banner refresh rates.

For more information about how to set up experiments and analyze results, see [Experimenting with Placements](/dt-console/app-management/setting-up-an-existing-app/setting-up-placements/experimenting-with-placements.md).

## Multi-Testing Best Practices <a href="#h_01j88dewwfvpget44vh0g4ycq7" id="h_01j88dewwfvpget44vh0g4ycq7"></a>

#### Test one configuration change at a time <a href="#h_01jkh4d2rwbf6yvmstyfcyvbpm" id="h_01jkh4d2rwbf6yvmstyfcyvbpm"></a>

Although technically you can configure any placement change in a variant, it's a good idea stick to testing one configuration aspect at a time. Since some placement configurations could affect others, it is possible that some users will see the configurations for multiple variants, thereby affecting the results of the experiment.

For example, if you set up two variants: one to test the impact of introducing a new network to your interstitial placement, and one to test a higher ad pacing frequency, there may be difficulty in understanding which variant is responsible for the changes you observe in your results. Instead, run one experiment to test the new network, and a subsequent experiment to test the pacing change.

#### Consider your test sample size <a href="#h_01jkh4d2rw1af3a0cd0z0j2ypy" id="h_01jkh4d2rw1af3a0cd0z0j2ypy"></a>

If you do not perform your test on enough daily engaged users (DEUs), the experiment results are likely to be unreliable.

For example, if a variant receives 150% more average revenue per DEU (ARPDEU), but only 5 DEUs account for this change, then the results are statistically insignificant.

<br>


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://docs.digitalturbine.com/dt-fairbid/advanced-configurations/placement-experiments.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
