Almost every test you record with PreFlight will be successful first time - that’s our secret sauce. However sometimes, especially when you’re running A/B tests, our system can’t replicate being a user - because our bots get a different experience every time they view your website. This is usually a very easy fix.
With PreFlight you can set a cookie to force yourself to the control or the test (or test variant, if you’re fancy).
Take an example website that changes color each time the page is refreshed.
Now let's create a test that has a checkpoint for the word/color pink.
Once a test is created it will pass or fail depending on which route of the AB Test was randomly assigned. Now we need to make sure it takes the correct path when we run the test.
Go to the test page and click Edit Steps.
Click on the first step. Usually Go To https://yourapp.... then enter your Cookie's name and value in the Set Cookies section.
Make sure to Save changes to this step!
Now run the test a few times to make sure it chooses the correct path every time. To do this quickly, select multiple browsers.
Didn't answer your question? Have other questions? We have answers - drop us a message in the chat, or email: [email protected].