Seven Experiments : 3 validated hypotheses and 4 invalidated hypotheses

Experiment A (Growth Engine):

3bb

Assumption:

  • Foodblogger will invite their friends if they can create a guess game.

Prediction: 

  • 1 foodblogger will bring in 7 people

Result:

  • 1 foodblogger brought in 2 people
  • 2 facebook shares + 2 twitter shares for 9 foodbloggers
  • ran experiment for 12 days October 16 – 27

Conclusion:

  • Invalidated Hypothesis
  • 2 people/blogger < 7 people/blogger

Follow up: 

  • Don’t allow bloggers to create their own games
  • too time consuming
  • not enough value

 

 

Experiment B (Value Engine):

4

Assumption:

  • Adding skip button on guess game will result in more games played

Prediction: 

  • 5% in games played

Result:

  • very few people clicked on skip button
  • ran experiment for 7 days October 14 – 20

Conclusion:

  • InvalidateHypothesis

Follow up: 

  • Remove skip button from guess game

 

 

Experiment C (Value Engine):

5

Assumption:

  • Players will add comments to recipes

Prediction: 

  • 1.0 comment/player

Result:

  • 23 comments / 140 user = 0.16 comments/user
  • ran experiment for 14 days October 18 – 31

Conclusion:

  • InvalidateHypothesis
  • 0.16 < 1.0 comment/player

Follow up: 

  • Remove comment box or
  • Run another experiment (maybe list # of comment and redirect to blog post for comment) This may help us create more blogger value with increased outbound links.

 

 

Experiment D (Value Engine):

8

Assumption:

  • Adding blog pics will increase comments

Prediction: 

  • 5% increase

Result:

  • 4 comments / 77 users = 5.2% (control group, with no pictures)
  • 9 comments / 64 users = 14.0% (1 week experiment)
  • 14%/5.2% = 170%
  • ran experiment for 12 days October 20 – 31

Conclusion:

  • Validated Hypothesis 🙂
  • 170% > 5%

Follow up:

  • Add blog pictures for all

 

 

Experiment E (Value Engine):

6c

Assumption:

  • Word cloud will increase the number of pageviews on popular page.
  • 204 pages with “cat=” / 529 Unique visitor = 0.38 pages/ unique visitor (Oct 17 – 23)

Prediction:

  • 50% increase
  • 0.57 pages/unique visitor

Result:

  • 515 pages with “cat=” / 601 Unique visitor = 0.86 pages/ unique visitor (Oct 24 – 30)
  • 226%
  • ran experiment for 9 days October 23 – 31

Conclusion:

  • Validated Hypothesis 🙂
  • 226% > 50%

Follow up:

  • none. Leave word cloud. 

 

Experiment F (Value Engine):

7

Assumption:

  • Adding guess game buttons on popular page will increase average # of games played per player

Prediction:

  • 20%

Result:

  • 769/92 = 8.35 games/player (previous 2 week average)
  • 504/31 = 16.25 games/player (1 week experiment)
  • 16.25/8.35 = 95% 
  • ran experiment for 9 days October 23 – 31

Conclusion:

  • Validated Hypothesis 🙂
  • 95% > 20%

Follow up:

  • Add guess game buttons for all recipes on popular page

 

 

Experiment G (Value Engine)

9

Assumption: 

  • Guess games are too hard.

Prediction:

  • 0% too easy
  • 50% just right
  • 50% too hard

Result:

  • 19% too easy
  • 58% just right
  • 23% too hard
  • ran experiment for 8 days October 24 – 31

Conclusion:

  • InvalidateHypothesis 
  • 23% < 50%

Follow up:

  • What should the balance of difficulty be?
  • Experiment: Showing the difficulty of the game will increase the number of games played
  • Experiment: Call to action “Feedback” vs. “Play another game”

 

Experiments on our Erase DryWall

(Thanks to the Work Republic for the idea of painting our wall)

Img_2007

 

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s