1. index page now link to a solo dish page around users
2. user profile pages added
3. users can now follow bloggers and categories
Corresponding experiments are as follows:
1. index page now link to a solo dish page around users
2. user profile pages added
3. users can now follow bloggers and categories
Corresponding experiments are as follows:
Experiment O:
Assumption: Players will share if they got a perfect score.
Prediction: 15% conversion
Result: 7.5%
Decision: Keep anyways as the prompt is not intrusive.
Experiment P:
Assumption: Players will play more guess games if they are shown more details on how they are doing.
Prediction: 10% increase in games played
Result: 74% decrease! People get discouraged seeing a bad record
Decision: Removed and may try to only show record for people who are doing well
Experiment I part 2:
Assumption: Trying to optimize top 10 message
Prediction: 3% conversion
Result: 20% on prompt with date. Not that significant (7/35) but is quite better than the other 2 prompts.
Decision: Keeping prompt with date.
We’re now setup for facebook open graph that’s supposed to go live this wednesday. So far, there are two actions that would publish to our users ticker and timeline. On complete guess game, and on favouriting a recipe. We also added an individual recipe page to properly publish to the graph.
Experiment N:
Assumption: share win on hard game
Prediction: 5% conversion rate
Results: 41 subjects, 10 shares, 24% conversion
Decision: Keep prompt and doing a follow up experiment that prompts users to share when there’s a 65% failure rate on guess game (currently set at 75%)
Experiment I:
Assumption: share top ten
Prediction: 3% conversion rate
Results: 524 subjects, 10 shares, 2% conversion (*due to bug, # of subjects that were actually shown the share prompt is likely less than the # reported)
Decision: Doing a follow up experiment to try to increase this percentage. 2 new versions of share prompt with updated text. 2% determined acceptable though.
Experiment J:
Assumption: signup from duel 2
Prediction: 30% increase in signup Results: All versions had the same signup conversion
Decision: Reverting back to original call to action.
Experiment O:
Assumption: Players will share if they got a perfect score
Metrics: % of players who share
Prediction: 15% of players will share
Experiment P:
Assumption: Players will play more guess games if they are shown more details on how they are doing.
Summary of the player’s record on top
Details on games the player has played
Metrics:
# of guess games played per player
# of revisits to play more guess games per player
Prediction:
10% increase in # of guess games played
Experiment Q:
Assumption: Players will vote more if the pictures are matched on more detailed categories (currently matching on sweet & savoury, testing on more detailed categories such as chicken, beef, pie, etc)
Metric: # of votes per player
Prediction: 7.5% increase in votes per player
And that is all. Now onto open graph…
Added 2 new experiments to tries to increase sharing on our site.
Experiment N:
Assumption: Players will share a guess game if it was a hard game (75% incorrect) and they got it right.
Metrics:
# of tweets and likes
Prediction:
5% of displayed will share
Experiment I:
Assumption: Players will share if their vote got a recipe into the top ten (max 2 prompts/session)
Metrics:
# of tweets and fb shares
Prediction:
3% of players will share
Also, we finally added an about us page after many requests from our users. Those pics we took at Google were perfect for this!
Assumption J:
Player signup will increase if shown a better signup prompt page after first 25 votes.
Metric:
signup conversions on prompt
Prediction:
30% increase
Results:
Decision:
Revert back to controlled. Going to follow up with another experiment this week with a different call to action though.
Assumption K:
Players will signup to play more games (prompted after 3 games played, and cannot play more until signed up)
Metric:
-signup conversion on prompt
-# of games played/non signed up player (watching for decrease here since we are putting up a wall on accessing more than 3 games)
Prediction:
same as controlled conversion % from J
Results:
Expected around 4.5% conversion. Result was around 35%.
Decision:
Users need to signup before playing more than 3 games.