This explores the question "how do I know that the test, scale, instrument, etc. works every time I use it?"
This explores the question "how do I know that the test, scale, instrument, etc. measures what it is supposed to?"
If data are not reliable or not valid, the results of any test or hypothesis
are not valid
Reliability and validity specifically relate to
the quality of the data themselves
The outcome variable in an analysis is called...
the dependent variable
The predictor variable in an analysis is called
the independent variable
This is the least precise level of measurement.
This is the most precise level of measurement.
This is the level of measurement where outcomes are based on some underlying continuum where it is possible to speak about how much more a higher performance is than a lower one:
interval level of measurement
This is the level of measurement where outcomes can only be placed into unranked categories
nominal level of measurement
This is the level of measurement where outcomes can be rank ordered.
ordinal level of measurement
This is the level of measurement where outcomes are based on some underlying continuum that also contains a true or absolute zero.
ratio level of measurement
Only this level of measurement has a true zero.
Moving from the nominal to the ratio levels of measurement, your data becomes...
more precise and detailed
Which of the following is concerned with monitoring estimates of present performance and predictions of future performance?
What type of validity is concerned with the adequate representation of test items?
If you want to know that a test measures some underlying psychological construct, what type of validity evidence would you want to collect?
If you correlate scores from your test with some other valid measure that assesses the same set of abilities, what type of validity evidence are your collecting?
If I can say that my weekly statistics quiz fairly assesses the material covered, what source of validity evidence should I have collected?
What is the key to establishing Criterion validity?
quality of criterion
Which of the following is NOT a measure of validity?
parallel forms validity
This type of validity is established by consultation with an expert on the topic focused upon by your instrument.
This type of validity is determined by determining the association between the test scores and some specified present or future criterion.
This type of validity is based on the judgment of how well a test reflects an underlying idea
High school class rank is highly correlated with college GPA. This is an example of what type of validity
The score that you would actually record is the...
A measure of how stable a test is over time is an example of which of the following types of reliability?
The correlation between scores from time 1 and time 2 is called:
test- re test reliability
The correlation between two forms of the same test is called:
parallel forms reliability
Cronbach'a Alpha is used to calculate the following
internal consistency reliaility
The number of agreements between your two raters divided by the total number of possible agreements is the way to calculate:
This is the type of validity that examines how well a test outcome is consistent with a criterion that occurs in the present.
concurrent criterion validity
This is the type of validity that examines how well a test outcome is consistent with a criterion that occurs in the future.
This is the score that you would receive if the test contained no error.
The actual or measured score is called:
the observed score
This is the difference between the observed and true scores:
the error score
Which coefficient reflects the occurrence of perfect reliability?
Two trained professionals observe the behavior of children in a classroom. They each rate observed behaviors using the same form and the number of items that were rated the same is calculated. This is an example of which type of reliability?
If the measures associated with a test are said to be consistent, you might conclude that the measure is ___________.
Which of the following is NOT a measure of reliability?
multiple forms reliability
When we calculate reliability, we know the observed score. What are the two unknown components of the reliability equation?