### This explores the question "how do I know that the test, scale, instrument, etc. works every time I use it?"

reliability

### This explores the question "how do I know that the test, scale, instrument, etc. measures what it is supposed to?"

validity

### This is the level of measurement where outcomes are based on some underlying continuum where it is possible to speak about how much more a higher performance is than a lower one:

interval level of measurement

### This is the level of measurement where outcomes can only be placed into unranked categories

nominal level of measurement

### This is the level of measurement where outcomes are based on some underlying continuum that also contains a true or absolute zero.

ratio level of measurement

### Moving from the nominal to the ratio levels of measurement, your data becomes...

more precise and detailed

### Which of the following is concerned with monitoring estimates of present performance and predictions of future performance?

predictive validity

### If you want to know that a test measures some underlying psychological construct, what type of validity evidence would you want to collect?

constrict validity

### If you correlate scores from your test with some other valid measure that assesses the same set of abilities, what type of validity evidence are your collecting?

criterion validity

### If I can say that my weekly statistics quiz fairly assesses the material covered, what source of validity evidence should I have collected?

content validity

### This type of validity is established by consultation with an expert on the topic focused upon by your instrument.

content validity

### This type of validity is determined by determining the association between the test scores and some specified present or future criterion.

criterion validity

### This type of validity is based on the judgment of how well a test reflects an underlying idea

construct validity

### High school class rank is highly correlated with college GPA. This is an example of what type of validity

predictive validity

### A measure of how stable a test is over time is an example of which of the following types of reliability?

test-re test

### The number of agreements between your two raters divided by the total number of possible agreements is the way to calculate:

interrater reliability

### This is the type of validity that examines how well a test outcome is consistent with a criterion that occurs in the present.

concurrent criterion validity

### This is the type of validity that examines how well a test outcome is consistent with a criterion that occurs in the future.

predictive validity

### Two trained professionals observe the behavior of children in a classroom. They each rate observed behaviors using the same form and the number of items that were rated the same is calculated. This is an example of which type of reliability?

inter ratee

### If the measures associated with a test are said to be consistent, you might conclude that the measure is ___________.

reliable

### When we calculate reliability, we know the observed score. What are the two unknown components of the reliability equation?

true and error scores

### Which of the following is the Greek letter associated with Cronbach's Alpha, sometimes known as coefficient alpha?

A.

### What would the inter-rater reliability be for a 50 item measure in which the number of agreements between Rater 1 and Rater 2 was 45?

0.90

### Which level of measurement is concerned only with the characteristics of an outcome that fits into a category?

nominal level of measurement

### If you are interested in describing the order of variables along a continuum, what level of measurement would you use?

ordinal level of measurement

### If the underlying continuum we are measuring assumed equal intervals, at what level of measurement is the associated variable being measured?

interval level of measurement

### Which of the following levels of measurement provides the most information about a variable?

ratio level of measurement

### What is the difference between the true score and the observed score?

observed score: what you actually get on the test

true score: the true , 100% accurate reflection of what you really know.

page 106