# data[].attributes.body
how to analyze
present the results
present your findings

# data[].attributes.body
Optimizely
Usabilityhub 5 second test
Facebook

# data[].attributes.headline
		
	
	
		
			
				
					Multi Factor 
				
			
		

# data[].attributes.subject
		
	
	
		
			
				
					Multi Factor 
				
			
		

# data[].attributes.body
statistically and structurally elegant

easy to control

simple, robust statistics can be performed on the data

not very efficient

it is desirable to examine more variables in one experiment to conserve resources

# data[].attributes.body
In a controlled experiment, users are randomly split between the variants (e.g., the two different ads layouts) in a persistent manner (a user receives the same experience in multiple visits). Their interactions with the site are instrumented and key metrics computed. In this experiment, the Overall Evaluation Criterion (OEC) was simple: increasing average revenue per user to Bing without degrading key user engagement metrics. Results showed that the newly added site links increased revenue, but also degraded user metrics and Page-Load-Time, likely because of increased vertical space usage. Even offsetting the space by lowering the average number of mainline ads shown per query, this feature improved revenue by tens of millions of dollars per year with neutral user impact, resulting in extremely high ROI (Return-On- Investment).

# data[].attributes.body
Causality not simply correlations
What is something you want to make better

# data[].attributes.body
Highest paid person's opinion

# data[].attributes.headline
What other ways can we get feedback on user test results

# data[].attributes.subject
What other ways can we get feedback on user test results

# data[].attributes.body
Review the videos

Measure the time it takes to perform each tasks

Tabulate the questionnaires and get the

year level, gender, activities they do all day & how often they finish assignment (to determine level of organizational skills, motivation)

number of hours they spend on each device

number of hours they spend online

type of websites they visit

type of apps they use (layout and interaction comparison to the app)

# data[].attributes.body
Task completion time
Interaction efficiency
number of error messages

# data[].attributes.body
User performance will be better for the more aesthetically pleasing product than for the less pleasing one.

Perceived usability will be higher for the aesthetically more pleasing product than for the less pleasing one.

The difference in perceived usability between the two conditions will be less pronounced after the usability test than prior to it, due to the diminishing influence of aesthetic after the user had actual experience with the product

# data[].attributes.body
Time it takes to finish
TIme it actually took

# data[].attributes.body
Methods
Results
Errors
Hypothesis
Controlled Environment