by Roy Galet https://padlet.com/roygalet/Week10 en-us 2016-05-10 06:41:05 UTC 2017-05-17 10:49:49 UTC hello@padlet.com Week 10 WebScale Experiments roygalet https://padlet.com/roygalet/Week10/wish/110023835 Methods
Results
Errors
Hypothesis
Controlled Environment

]]> 2016-05-10 06:50:05 UTC https://padlet.com/roygalet/Week10/wish/110023835 Base Rate roygalet https://padlet.com/roygalet/Week10/wish/110027525 Time it takes to finish
TIme it actually took ]]> 2016-05-10 07:18:35 UTC https://padlet.com/roygalet/Week10/wish/110027525 Hypothesis roygalet https://padlet.com/roygalet/Week10/wish/110029301
User performance will be better for the more aesthetically pleasing product than for the less pleasing one.

Perceived usability will be higher for the aesthetically more pleasing product than for the less pleasing one.

The difference in perceived usability between the two conditions will be less pronounced after the usability test than prior to it, due to the diminishing influence of aesthetic after the user had actual experience with the product

]]> 2016-05-10 07:32:42 UTC https://padlet.com/roygalet/Week10/wish/110029301 Measurements (Reliable) roygalet https://padlet.com/roygalet/Week10/wish/110030197 Task completion time
Interaction efficiency
number of error messages]]> 2016-05-10 07:39:16 UTC https://padlet.com/roygalet/Week10/wish/110030197 What other ways can we get feedback on user test results roygalet https://padlet.com/roygalet/Week10/wish/110031013
  • Review the videos
  • Measure the time it takes to perform each tasks
  • Tabulate the questionnaires and get the 
    • year level, gender, activities they do all day & how often they finish assignment (to determine level of organizational skills, motivation)
    • number of hours they spend on each device
    • number of hours they spend online
    • type of websites they visit 
    • type of apps they use (layout and interaction comparison to the app)

    • ]]>     2016-05-10 07:44:43 UTC https://padlet.com/roygalet/Week10/wish/110031013     HIPPO roygalet https://padlet.com/roygalet/Week10/wish/110033066 Highest paid person's opinion]]> 2016-05-10 07:58:34 UTC https://padlet.com/roygalet/Week10/wish/110033066 Importance of Experimenting roygalet https://padlet.com/roygalet/Week10/wish/110035406 Causality not simply correlations
    What is something you want to make better]]>     2016-05-10 08:15:35 UTC https://padlet.com/roygalet/Week10/wish/110035406     UsabilityHub roygalet https://padlet.com/roygalet/Week10/wish/110036492 2016-05-10 08:23:07 UTC https://padlet.com/roygalet/Week10/wish/110036492 Kohavi A/B Tests roygalet https://padlet.com/roygalet/Week10/wish/110218309  
    In a controlled experiment, users are randomly split between the variants (e.g., the two different ads layouts) in a persistent manner (a user receives the same experience in multiple visits). Their interactions with the site are instrumented and key metrics computed. In this experiment, the Overall Evaluation Criterion (OEC) was simple: increasing average revenue per user to Bing without degrading key user engagement metrics. Results showed that the newly added site links increased revenue, but also degraded user metrics and Page-Load-Time, likely because of increased vertical space usage. Even offsetting the space by lowering the average number of mainline ads shown per query, this feature improved revenue by tens of millions of dollars per year with neutral user impact, resulting in extremely high ROI (Return-On- Investment).  ]]>     2016-05-10 23:50:30 UTC https://padlet.com/roygalet/Week10/wish/110218309     Single Factor roygalet https://padlet.com/roygalet/Week10/wish/110219055
  • statistically and structurally elegant
  • easy to control
  • simple, robust statistics can be performed on the data

    •  not very efficient
    • it is desirable to examine more variables in one experiment to conserve resources
     
    ]]>     2016-05-11 00:02:39 UTC https://padlet.com/roygalet/Week10/wish/110219055     Multi Factor  roygalet https://padlet.com/roygalet/Week10/wish/110219285 2016-05-11 00:05:52 UTC https://padlet.com/roygalet/Week10/wish/110219285 Online tests roygalet https://padlet.com/roygalet/Week10/wish/110220537 Optimizely
    Usabilityhub 5 second test
    Facebook]]>     2016-05-11 00:22:21 UTC https://padlet.com/roygalet/Week10/wish/110220537     Part A roygalet https://padlet.com/roygalet/Week10/wish/110220776 how to analyze
    present the results
    present your findings]]>     2016-05-11 00:25:41 UTC https://padlet.com/roygalet/Week10/wish/110220776