# data[].attributes.body
Interrater reliability compares the consistency of raters, not measures. To determine interrater reliability, individual raters are trained to score responses according to a rubric or scoring guide. After the training, two raters are given a sample of written responses to score with the rubric. In some cases, the correlation coefficient is calculated to examine the agreement between the two raters’ scores; in other cases, a simple percentage of agreement is used.

Beaudry/Miller. Research Literacy (Page 113). The Guilford Press. Kindle Edition.

# data[].attributes.body
Split-half/internal consistency reliability compares the pattern of scores on two halves of the same selected response measure. The developer administers a measure to a sample. The developer then compares the responses of the sample on one half of the measure to the sample’s responses on the other half of the measure, the two halves having been randomly assigned.

Beaudry/Miller. Research Literacy (Page 113). The Guilford Press. Kindle Edition.

Beaudry/Miller. Research Literacy (Page 112). The Guilford Press. Kindle Edition.

# data[].attributes.body
Equivalent/alternate forms reliability compares the pattern of scores on two selected response measures that purport to measure the same thing. The developer randomly assigns one half of a sample to one group and the other half to another group, and then administers a different version of the same measure to each group.

Beaudry/Miller. Research Literacy (Page 112). The Guilford Press. Kindle Edition.

# data[].attributes.body
Test– retest reliability compares the pattern of scores on the same selected response measure given twice. It is conducted when the developer of the measure administers a measure to a sample. After a sufficient time interval, the developer administers the same measure to the same sample and computes r to determine whether there is a similar pattern of responses.

Beaudry/Miller. Research Literacy (Page 112). The Guilford Press. Kindle Edition.

# data[].attributes.body
Reliability answers these questions: “Can I trust the scores or values that are reported? Are they consistent and stable?”

Beaudry/Miller. Research Literacy (Page 112). The Guilford Press. Kindle Edition.

# data[].attributes.body
Predictive validity is a statistical determination of how well a measure will be able to predict an outcome on another measure that it theoretically should be able to predict.

Beaudry/Miller. Research Literacy (Page 111). The Guilford Press. Kindle Edition.

# data[].attributes.body
Concurrent validity is a statistical determination of how well an instrument or measure matches another measure that is administered to a sample at or near the same time, and that purports to measure the same thing.

Beaudry/Miller. Research Literacy (Page 111). The Guilford Press. Kindle Edition.

# data[].attributes.body
Construct validity is a statistical determination of how well an instrument or measure matches an already validated instrument that measures the same thing. Construct validity is often used with constructs that are not observable, such as compassion or working memory.

Beaudry/Miller. Research Literacy (Page 111). The Guilford Press. Kindle Edition.

# data[].attributes.body
Content validity is a nonstatistical determination of how well an instrument matches what is being measured.

Beaudry/Miller. Research Literacy (Page 110). The Guilford Press. Kindle Edition.

# data[].attributes.body
Validity answers this question: “Can I trust this instrument to measure what it purports to measure?”

Beaudry/Miller. Research Literacy (Page 110). The Guilford Press. Kindle Edition.

# data[].attributes.body
A scale assigns numerical values to attitudes, values, and interests.

Beaudry/Miller. Research Literacy (Page 108). The Guilford Press. Kindle Edition.

# data[].attributes.body
Constructed-response (also called open-response) questions provide spaces for writing original answers. Each response is assigned a quantitative score that is aligned with a rubric, as in the assessments used for meeting No Child Left Behind requirements. Selected-response (also known as closed-response) questions provide a given set of responses from which to choose. These questions may be presented as dichotomous or multiple-choice questions.

Beaudry/Miller. Research Literacy (Page 108). The Guilford Press. Kindle Edition.

# data[].attributes.body
quantitative observation relies on instruments that identify discrete behaviors specifically enough to enable researchers to observe and measure quantitative observation relies on instruments that identify discrete behaviors specifically enough to enable researchers to observe and measure

Beaudry/Miller. Research Literacy (Page 107). The Guilford Press. Kindle Edition.

Beaudry/Miller. Research Literacy (Page 107). The Guilford Press. Kindle Edition.

# data[].attributes.body
Surveys and questionnaires are familiar instruments for gathering data. They measure the characteristics, perceptions, interpretations, attitudes, preferences, and/or dispositions of a group of subjects.

Beaudry/Miller. Research Literacy (Page 107). The Guilford Press. Kindle Edition.

# data[].attributes.body
Assessments measure academic aptitude and achievement, vocational interests, personality, and emotional or mental states.

Beaudry/Miller. Research Literacy (Page 106). The Guilford Press. Kindle Edition.

# data[].attributes.body
Assessments, Surveys and Questionnaires, and Observation Protocols

# data[].attributes.body
Random sampling is a set of procedures that use statistical techniques for selecting members of a sample; such techniques ensure that all members of the population will have equal chances of being chosen.

Beaudry/Miller. Research Literacy (Page 102). The Guilford Press. Kindle Edition.

# data[].attributes.body
Nonrandom sampling uses nonstatistical processes, which do not ensure that all members of the population will have equal chances of being chosen for the sample.

Beaudry/Miller. Research Literacy (Page 102). The Guilford Press. Kindle Edition.

# data[].attributes.body
Sample size refers to the number of subjects in a sample. In large-scale studies that use samples to represent a larger population, researchers use a table like Table 6.1 as a guide. In reading the table, note that N is population size and S is sample size. Although it may seem counterintuitive, the rule of thumb for sample size is this: As the population size increases, the proportion of sample to population decreases.

Beaudry/Miller. Research Literacy (Page 101). The Guilford Press. Kindle Edition.

# data[].attributes.body
A sample is a subset of a population of interest that is meant to represent this population.

Beaudry/Miller. Research Literacy (Page 99). The Guilford Press. Kindle Edition.

# data[].attributes.body
Studies that use descriptive statistics include test reports and surveys. Studies that use inferential statistics investigate relationships between and among variables. Experiments investigate causal relationships between and among variables; experiments are highly controlled and investigate the effect of an intervention on subjects. Nonexperiments investigate noncausal relationships between and among variables.

Beaudry/Miller. Research Literacy (Page 99). The Guilford Press. Kindle Edition.

# data[].attributes.body
mathematical calculations and algorithms, to analyze and interpret data.

Beaudry/Miller. Research Literacy (Page 98). The Guilford Press. Kindle Edition.

# data[].attributes.body
Variables are those characteristics, attributes, conditions, or qualities of subjects that can be observed and/or measured.

Beaudry/Miller. Research Literacy (Page 98). The Guilford Press. Kindle Edition.

# data[].attributes.body
Introduction to Quantitative Research (Yeehaw!)