Skip to main content

I currently have one mutual exclusivity group setup divided 80/20 split between 2 experiments running on our site. Test currently being evaluated for 20% of traffic has shown leading indicators of a successful experience so we want to increase this to 50% of our traffic meaning that the MutEx split has to change from 80/20 to 50/50. 

What are the implications of doing this?

Do I need to restart both experiments?

What is the right order of operations to make this change?
 

Hi Christal,

Thank you for following up with additional details about your setup. I’m happy to clarify the implications of your changes and address your specific question regarding sticky bucketing.


### Implications of Your Changes
By ending Test A and creating a new mutual exclusivity group that splits traffic 50/50 between Test B (still running) and Test C, the following considerations apply:

- **Sticky Bucketing Behavior**: Since sticky bucketing is enabled, users who were previously assigned to Test B will remain in Test B. Sticky bucketing ensures that once a user is assigned to a variant, they continue to see that variant regardless of changes to the mutual exclusivity group or traffic allocation. This prevents reassignment and maintains consistency for those users.
- **New Users**: Any new users entering the mutual exclusivity group will be distributed according to the updated 50/50 split between Test B and Test C. This means the allocation change will only impact users who qualify for the experiments after the new group was created.
- **Data Integrity**: Adding Test B (already running) to a new mutual exclusivity group does not affect the users who were previously assigned to it, but it’s important to note that this approach can complicate analysis if you’re comparing data across different phases of the experiment. For example, the initial 80/20 split and the subsequent 50/50 split may introduce variability in the data.

###

Best,
Jake


P.S. Checkout upcoming events and user meetups on our events page.

Reply