Experiments K & J completed

Assumption J:

Player signup will increase if shown a better signup prompt page after first 25 votes.

Metric:

signup conversions on prompt

Prediction:

30% increase

Results:

Decision:

Revert back to controlled.  Going to follow up with another experiment this week with a different call to action though.

 

Assumption K:

Players will signup to play more games (prompted after 3 games played, and cannot play more until signed up)

Metric:

-signup conversion on prompt

-# of games played/non signed up player (watching for decrease here since we are putting up a wall on accessing more than 3 games)

Prediction:

same as controlled conversion % from J

Results:

Expected around 4.5% conversion. Result was around 35%.

Decision: 

Users need to signup before playing more than 3 games.