Configure your experiment's delivery

  • Updated

This article will help you:

  • Ensure your experiment is ready for testing

Now that you've designed your experiment, the next step is making sure it's ready to be tested and launched. You'll specify the evaluation mode and bucketing unit (if you haven't already), specify the deployments that will house this experiment, double-check your variants, and identify members of your team who will participate in QA testing.

This stage of the experiment process should be overseen by members of your engineering team.

NOTE: If you are launching a feature flag and not an experiment, you can skip the experiment design steps. However, you'll still need to complete the process described in this article.

To configure your experiment's delivery, follow these steps:

  1. On the Evaluation and Bucketing tab, specify the evaluation mode for your experiment—either Remote (i.e., it will be evaluated on Amplitude servers) or Local. Then specify the bucketing unit you want to use for this experiment.

    Most of the time, you should set the bucketing unit to User. However, sometimes you might want to use company ID or city as the bucketing unit, especially in certain B2B use cases. For example, bucketing by company ID ensures that all users in a particular company will have the same user experience. Be sure the Stable Unit Treatment Value Assumption holds for whichever unit you choose.

    When you’re ready, click Continue.

  2. In the Deployments tab, select the deployments you’d like to use for this experiment or flag. In Amplitude Experiment, a deployment is where you can serve a group of flags or experiments for code execution.

    NOTE: Learn more about deployments in our article on configuring your experiment.

    When you’ve selected all the deployments you need, click Continue.

  3. Next, check your variants.

    NOTE: For more information on variants in Amplitude Experiment, check out this article.

    Click Continue when you’re ready.

  4. The final step is adding the user or device IDs of your QA testers, so that you can ensure your implementation has been successful. Add the appropriate IDs for each variant. You’ll want to assign each tester to only one variant, just as if they were users who had been bucketed into your experiment.

When you’re done, click Save and Close. It's time to launch your experiment.