Skip to content
This repository has been archived by the owner on Jan 1, 2024. It is now read-only.

Always put bots into the same experiment #276

Open
daniel-nelson opened this issue Oct 30, 2015 · 2 comments
Open

Always put bots into the same experiment #276

daniel-nelson opened this issue Oct 30, 2015 · 2 comments

Comments

@daniel-nelson
Copy link

I see tests for not counting bots as part of the experiment results, so that is good on the experimental integrity side of things. But it appears that Vanity still randomly assigns bots to different experiments, meaning that the bots get different content—or worse, get redirected—during different crawls.

While testing in Google Webmaster Tools, Google keeps getting redirected to different homepages.
screenshot 2015-10-29 21 09 01. The /home/c examples redirect to /home/e, and the /home/e example redirects to /home/c.

One solution to this would be to always put bots into the first variant of any experiment.

@phillbaker
Copy link
Collaborator

@daniel-nelson makes sense to me. Any chance you could take a stab at a PR to do this?

@phillbaker
Copy link
Collaborator

Looks like this would be solved by #290.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants