0

Guess Game gaining momentum

With all the excitement happening with Guess Game lately, we’ve added an auto email for new guess games whenever one gets created (similar to our auto email when new dish has been added).

Screen_shot_2011-11-03_at_8

 

Long overdue, but we’ve also added a quick communication settings to the app so our users can select what and when to receive emails from us.

Screen_shot_2011-11-03_at_8

 

We decided to drop our leaderboard hypothesis for now. The initial assumption was that having a leaderboard and displaying relevant parts of it in the vote page and guess game page will drive our users to perform more actions as they can see in real time what actions they need to do to get into the next spot. However, there were challenges with screen real estate and implementation complexities that we decided against the experiment for now. We definitely need to do more work on the community/gamification side of things as our system doesnt really make much sense right now without the community stuff in place.

0

Increasing conversion, experiment dashboard updated

Added two experiments that tries to increase signups.

Assumption J:

Player signup will increase if shown a better signup prompt page after first 25 votes.

Metric:

signup conversions on prompt

Prediction:

30% increase

 

Split testing the following:

Community Call to action

Screen_shot_2011-11-01_at_4

Discovery call to action (screen is pulled from localhost, hence the shortage of pics)

Screen_shot_2011-11-01_at_4

Controlled call to action

Screen_shot_2011-11-01_at_4

Assumption K:

Players will signup to play more games (prompted after 3 games played, and cannot play more until signed up)

Metric:

-signup conversion on prompt

-# of games played/non signed up player (watching for decrease here since we are putting up a wall on accessing more than 3 games)

Prediction:

same as controlled conversion % from J

 

Also updated our experiment dashboard. Added some key metrics data in addition to just having conversions. Hopefully this will reduce the amount of manual reporting needed to validate our experiments.

Screen_shot_2011-11-02_at_9

0

Seven Experiments : 3 validated hypotheses and 4 invalidated hypotheses

Experiment A (Growth Engine):

3bb

Assumption:

  • Foodblogger will invite their friends if they can create a guess game.

Prediction: 

  • 1 foodblogger will bring in 7 people

Result:

  • 1 foodblogger brought in 2 people
  • 2 facebook shares + 2 twitter shares for 9 foodbloggers
  • ran experiment for 12 days October 16 – 27

Conclusion:

  • Invalidated Hypothesis
  • 2 people/blogger < 7 people/blogger

Follow up: 

  • Don’t allow bloggers to create their own games
  • too time consuming
  • not enough value

 

 

Experiment B (Value Engine):

4

Assumption:

  • Adding skip button on guess game will result in more games played

Prediction: 

  • 5% in games played

Result:

  • very few people clicked on skip button
  • ran experiment for 7 days October 14 – 20

Conclusion:

  • InvalidateHypothesis

Follow up: 

  • Remove skip button from guess game

 

 

Experiment C (Value Engine):

5

Assumption:

  • Players will add comments to recipes

Prediction: 

  • 1.0 comment/player

Result:

  • 23 comments / 140 user = 0.16 comments/user
  • ran experiment for 14 days October 18 – 31

Conclusion:

  • InvalidateHypothesis
  • 0.16 < 1.0 comment/player

Follow up: 

  • Remove comment box or
  • Run another experiment (maybe list # of comment and redirect to blog post for comment) This may help us create more blogger value with increased outbound links.

 

 

Experiment D (Value Engine):

8

Assumption:

  • Adding blog pics will increase comments

Prediction: 

  • 5% increase

Result:

  • 4 comments / 77 users = 5.2% (control group, with no pictures)
  • 9 comments / 64 users = 14.0% (1 week experiment)
  • 14%/5.2% = 170%
  • ran experiment for 12 days October 20 – 31

Conclusion:

  • Validated Hypothesis 🙂
  • 170% > 5%

Follow up:

  • Add blog pictures for all

 

 

Experiment E (Value Engine):

6c

Assumption:

  • Word cloud will increase the number of pageviews on popular page.
  • 204 pages with “cat=” / 529 Unique visitor = 0.38 pages/ unique visitor (Oct 17 – 23)

Prediction:

  • 50% increase
  • 0.57 pages/unique visitor

Result:

  • 515 pages with “cat=” / 601 Unique visitor = 0.86 pages/ unique visitor (Oct 24 – 30)
  • 226%
  • ran experiment for 9 days October 23 – 31

Conclusion:

  • Validated Hypothesis 🙂
  • 226% > 50%

Follow up:

  • none. Leave word cloud. 

 

Experiment F (Value Engine):

7

Assumption:

  • Adding guess game buttons on popular page will increase average # of games played per player

Prediction:

  • 20%

Result:

  • 769/92 = 8.35 games/player (previous 2 week average)
  • 504/31 = 16.25 games/player (1 week experiment)
  • 16.25/8.35 = 95% 
  • ran experiment for 9 days October 23 – 31

Conclusion:

  • Validated Hypothesis 🙂
  • 95% > 20%

Follow up:

  • Add guess game buttons for all recipes on popular page

 

 

Experiment G (Value Engine)

9

Assumption: 

  • Guess games are too hard.

Prediction:

  • 0% too easy
  • 50% just right
  • 50% too hard

Result:

  • 19% too easy
  • 58% just right
  • 23% too hard
  • ran experiment for 8 days October 24 – 31

Conclusion:

  • InvalidateHypothesis 
  • 23% < 50%

Follow up:

  • What should the balance of difficulty be?
  • Experiment: Showing the difficulty of the game will increase the number of games played
  • Experiment: Call to action “Feedback” vs. “Play another game”

 

Experiments on our Erase DryWall

(Thanks to the Work Republic for the idea of painting our wall)

Img_2007

 

 

0

Growth Engine Hypothesis

We started our experiment with having bloggers create guess games this week. Our assumption is that bloggers will not only help us generate content, but more importantly, bring their friends and fans to Knapkins to play their own games. This is the first step in building social right into our app. The next iteration would be to have people create games solely for the purpose of challenging their friends. Kind of like Zynga’s Hanging With Friends for recipe guessing.  We also started being more rigorous in defining our experiments. So far we’ve just been shipping and looking at data after the fact to make sense of things. Now we are making sure that we have the right cause and effect metrics (or measuring of metrics) nailed before launch, along with our assumptions and predictions of course. Will go into more details on our process next week. For now, here are some screen shots of our guess game create process.

 

step #1: Select a recipe

Screen_shot_2011-10-17_at_6

step #2: Select 5 correct ingredients

Screen_shot_2011-10-17_at_6

step #3: Select 7 incorrect ingredients

Screen_shot_2011-10-17_at_6

step #4: Challenge your friends (split tested)

Screen_shot_2011-10-17_at_6Screen_shot_2011-10-17_at_6

0

Twitter Conversation – Knapkin-itis

ItsYummiliciousSep 29, 11:18pm via Web

@fujimama @CreativCulinary@PinchMySalt @knapkins_com Hmmm… click or snack? Calories lose EVERY time! #ClickClickYou’reAWinner

Show Conversation

fujimamaSep 29, 11:17pm via TweetDeck

@ItsYummilicious @CreativCulinary@PinchMySalt @knapkins_com Right now I feel like the choice is that, or snacking… I prefer the clicks…

CreativCulinarySep 29, 11:16pm via TweetDeck

@fujimama when you get help for your problems on @knapkins_com ; please send them my way too, OK?

Show Conversation

ItsYummiliciousSep 29, 11:16pm via Web

@fujimama ahhh….you have a bad case of @knapkins_com-itis. The only cure is to run far FAR away from your keyboard!#JustSayNoToClicks

Show Conversation

fujimamaSep 29, 11:13pm via TweetDeck

I keep getting sucked in by @knapkins_com… I keep clicking that vote button…it’s like a compulsion… #sendhelp

0

Product update: recipe guessing game

Shipped our first version of the recipe guessing game this past weekend. We’re pretty excited since we’ve been talking about this game for a while now, and its the first major addition to Knapkins that’s not tied to our voting feature. The game is a good addition to help us carry forward the vision to make recipe discover more fun and social. The next couple of iterations will be to make this more into a social game where our players create their own games and challenge their friends, taking inspiration from Hanging With Friends. So far the response has been great. One player emailed us saying that their “drunk husband loves the game and wants more”. Hehe. Its good to see that we’ve made someone happy. Total dev time around 4 days? Here are some screenshots.

Screen_shot_2011-09-26_at_1
Screen_shot_2011-09-26_at_1