How can we help?

You can also find more resources in our Help Center.

Study sets matching "coleman research evaluation"

Study sets
Classes
Users

Study sets matching "coleman research evaluation"

90 terms
Research & Evaluations - Coleman
Differences of Ad (vs. PR)
differences of pr
• Target audiences/publics... • Concerned…
What are the goals of research?
• Customers/prospective customers... • Copy testing ... • Focuses o…
• Publics... • Normally doing research for our message... • Content…
Similarities of Ad and PR
exploration, description, and explanation
Differences of Ad (vs. PR)
• Customers/prospective customers... • Copy testing ... • Focuses o…
differences of pr
• Publics... • Normally doing research for our message... • Content…
216 terms
Research and Evaluation Exam 1 coleman
Marketing research
Advertising and PR research
Basic Research
Applied Research
the systematic gathering, recording, and interpretation of in…
specialized forms of marketing research that focus on the pla…
research carried out to increase understanding of fundamental…
systematic inquiry accessing and using some part of the resea…
Marketing research
the systematic gathering, recording, and interpretation of in…
Advertising and PR research
specialized forms of marketing research that focus on the pla…
46 terms
Introduction to Quantitative Research: Measurement and Sampling (coleman research and evaluation exam 1)
What is a population?
Example of a population
What are 2 types of populations?
accessible population
the group whom you want to learn facts about ... or about whom y…
you want to make a new line of jeans for YOUNG females ... you m…
entire (theoretical)... accessible
the population that will actually be accessible or available…
What is a population?
the group whom you want to learn facts about ... or about whom y…
Example of a population
you want to make a new line of jeans for YOUNG females ... you m…
148 terms
Research and Eval (Coleman TCU)
Secondary Data
Internal Secondary Data
Proprietary
External Secondary Data
- Data previously collected for any purpose other than the on…
- Data comprised of information available within the firm... - P…
not accessible to others
data collected from sources outside of the firm
Secondary Data
- Data previously collected for any purpose other than the on…
Internal Secondary Data
- Data comprised of information available within the firm... - P…
148 terms
Research and Eval (Coleman TCU)
Secondary Data
Internal Secondary Data
Proprietary
External Secondary Data
- Data previously collected for any purpose other than the on…
- Data comprised of information available within the firm... - P…
not accessible to others
data collected from sources outside of the firm
Secondary Data
- Data previously collected for any purpose other than the on…
Internal Secondary Data
- Data comprised of information available within the firm... - P…
15 terms
Research Methods: Evaluating Research
Descriptive Statistics
Measures of Central Tendency
Mode
Mean
Sum up data to make it more understandable
A measurement of data that indicates where the middle of the…
The most frequently occurring score(s) in a distribution.
The arithmetic average of a distribution, obtained by adding…
Descriptive Statistics
Sum up data to make it more understandable
Measures of Central Tendency
A measurement of data that indicates where the middle of the…
19 terms
Evaluation Research
Evaluation Research
Formative Evaluation
Why is formative evaluation used?
Examples of formative evaluation
Systematic process of collecting and analyzing data about qua…
(Process evaluation)... Assesses program implementation, deliver…
Provides information so revisions can be made for the program
1. Needs assessment... 2. Program implementation... 3. Program deli…
Evaluation Research
Systematic process of collecting and analyzing data about qua…
Formative Evaluation
(Process evaluation)... Assesses program implementation, deliver…
14 terms
Evaluation of Research
Internal Validity
Threats to Internal Validity
External Validity
Hawthorne Effect
Degree to which data in a study reflect a true cause-effect r…
-Instrumentation... -History... -Statistical Regression... -Maturation…
Refers to the generalizability: to what settings, populations…
Extent to which a study's results are affected by participant…
Internal Validity
Degree to which data in a study reflect a true cause-effect r…
Threats to Internal Validity
-Instrumentation... -History... -Statistical Regression... -Maturation…
12 terms
IL: Evaluation & Research
valid... good; based on facts
reliable... always good quality
purpose... reason
verify... to check something is true and…
Melissa has valid information about Native American history.
Government maps are reliable.
The purpose of this class is to learn English.
Priciliano needs to verify the population of Seattle is 640,5…
valid... good; based on facts
Melissa has valid information about Native American history.
reliable... always good quality
Government maps are reliable.
19 terms
evaluation research
evaluation research
4 aspects of evaluation research
program design and planning
program monitoring
the use of scientific research methods to provide valid relia…
1. program design and planning.... 2. program monitoring.... 3. out…
are the goals of the program clearly defined? is the program…
how well is the program run? do the services or resources of…
evaluation research
the use of scientific research methods to provide valid relia…
4 aspects of evaluation research
1. program design and planning.... 2. program monitoring.... 3. out…
72 terms
Research & Evaluation
Misperception of random events
The clustering illusion
Something out of nothing
Statistical regression
for example: hot hand in basketball... - "streak shooting" playe…
seeing clusters as more than random events. clustering illusi…
cementing our misperceptions with causal theories ... - people a…
it is a fact, when two values are related. When one value is…
Misperception of random events
for example: hot hand in basketball... - "streak shooting" playe…
The clustering illusion
seeing clusters as more than random events. clustering illusi…
16 terms
Evaluation Research
Scientific Methods
Empirical Data
Independent variable
Dependent varialbe
Good evaluations use scientific methods...... 1. Empirical Data…
Raw data on which research can be formulated
The constant, the variable that impacts the dependent variable
The variable we expect to see change in
Scientific Methods
Good evaluations use scientific methods...... 1. Empirical Data…
Empirical Data
Raw data on which research can be formulated
8 terms
Evaluation Research
Cost-Benefit Analysis
Cost-Effectiveness Analysis
Efficiency Analysis
Impact Analysis (Summative Evaluation)
a systematic approach to estimating the strengths and weaknes…
a form of economic analysis that compares the relative costs…
compares program costs with program effects
did the program work? did it have the intended result?
Cost-Benefit Analysis
a systematic approach to estimating the strengths and weaknes…
Cost-Effectiveness Analysis
a form of economic analysis that compares the relative costs…
18 terms
Research & Evaluation
concept
construct
theory
laws
representation of some aspect of reality, but not tangible. t…
describes a concept that has been adopted for scientific reas…
generalization on a theme with which we seek to explain somet…
universal generalizations about classes or groups of facts. m…
concept
representation of some aspect of reality, but not tangible. t…
construct
describes a concept that has been adopted for scientific reas…
42 terms
Research/Evaluation
Evaluation
Is it evaluation or research? ... Improve…
Theory
Whats the deal about theory
systematic collection and analysis of data to address criteri…
Improvement- both... tests objectives- Evaluation... not generalize…
Provides explanations... generalized beyond a single situation
Research based on theory (fit data to theory or generate theo…
Evaluation
systematic collection and analysis of data to address criteri…
Is it evaluation or research? ... Improve…
Improvement- both... tests objectives- Evaluation... not generalize…
Evaluation Research
Evaluation Research
Program evaluation/outcome assessment
Forms of Evaluation Research
Types of Evaluation Research Designs
-ALWAYS applied research with a purpose to examine the outc…
The determination of whether a social intervention is produci…
o Needs assessments are often carried out to determine the na…
Experimental designs ... Quasi Experimental designs... qualitative…
Evaluation Research
-ALWAYS applied research with a purpose to examine the outc…
Program evaluation/outcome assessment
The determination of whether a social intervention is produci…
Research&Evaluation
Belmont Report
Levels of Institutional Review Board
Informed Consent
Confidentiality
Treat individuals as autonomous agents... Do not use people a…
Exempt... Expedited... Full
permission granted in the knowledge of the possible consequen…
The researcher knows the identity of... subjects but does not di…
Belmont Report
Treat individuals as autonomous agents... Do not use people a…
Levels of Institutional Review Board
Exempt... Expedited... Full
9 terms
Evaluation Research
Need- Based Evaluation Research
Process- Based Evaluation Research
Outcome- Based Evaluation Research
Efficiency- Based Evaluation Research
Attempts to determine the needs of a population that could be…
Evaluates the process of service delivery in a program
Whether or not the program worked
Cost-Benefit Analysis:... compares program cost to economic val…
Need- Based Evaluation Research
Attempts to determine the needs of a population that could be…
Process- Based Evaluation Research
Evaluates the process of service delivery in a program
13 terms
Evaluation Research:
Evaluation Research is NOT:
Evaluation Research IS:
Stakeholders
Inputs
A method of data (like surveys or experiments)
Research that is conducted for a goal: to investigate social…
Individuals and groups who have some concern with the program…
Clients, customers, students, or some other persons or units—…
Evaluation Research is NOT:
A method of data (like surveys or experiments)
Evaluation Research IS:
Research that is conducted for a goal: to investigate social…
9 terms
evaluation research
evaluation research
examples of evaluation research
components of evaluation research
Program Stakeholders:
social research that is conducted for a distinctive purpose:…
Teaching Evaluations... Peer Evaluations... Rate My Professor... Custo…
Program Stakeholders, ... Inputs, ... Program process, ... outputs, ... o…
Individuals and groups who have some basis of concern with th…
evaluation research
social research that is conducted for a distinctive purpose:…
examples of evaluation research
Teaching Evaluations... Peer Evaluations... Rate My Professor... Custo…
18 terms
evaluation research
evaluation research
problem identification
policy planning
PP:social impact assessment:
a form of applied research that applied social research metho…
is certian issue a social problem and worthy of consideration
what should be done about the problem , action needed,
what are the cost and benefits , if we give them a shelter ,…
evaluation research
a form of applied research that applied social research metho…
problem identification
is certian issue a social problem and worthy of consideration
150 terms
Research & Evaluation
Reasons to Read Journal Articles
Primary Research Sources
Secondary Research Sources
Primary (Analytic) Studies
1. New health problems... 2. New presentations or manifestation…
Original study design
1. Databases... 2. Point of Care resources... *Up To Date... *MD Con…
Those that report original research:... *Experimental... *Observa…
Reasons to Read Journal Articles
1. New health problems... 2. New presentations or manifestation…
Primary Research Sources
Original study design
62 terms
research and evaluation
causality
bubbles
true experiment
quasi-experiment
correlation is NOT the same as
flaws in research
2+ groups are used. random sampling. placed with random assig…
when groups are not picked at random or the researcher cannot…
causality
correlation is NOT the same as
bubbles
flaws in research
Research / Evaluation
Asch (1956)
Stanford Prison Experiment (Haney et a…
BBC Prison Study (Reicher and Haslam,…
Obedience (Milgram, 1963)
Procedure:... - 3 lines of different length... - Compared to a sepa…
Procedure:... - Mock prison setup in basement of psychology depa…
Procedure:... - Set up similar to the SPE... - Participants with si…
Procedure:... - 40 Participants... - Participants told that the stu…
Asch (1956)
Procedure:... - 3 lines of different length... - Compared to a sepa…
Stanford Prison Experiment (Haney et a…
Procedure:... - Mock prison setup in basement of psychology depa…
10 terms
Evaluation Research
evaluation research
Quasi-experiments
Factors that make quasi-experimental d…
Factors which may make randomization i…
research undertaken for the purpose of determining the impact…
non-rigorous inquiries somewhat resembling controlled experim…
-absence of a comparison/control group... -necessary reliance up…
1. Experimental and control/comparison groups occur naturally…
evaluation research
research undertaken for the purpose of determining the impact…
Quasi-experiments
non-rigorous inquiries somewhat resembling controlled experim…
18 terms
Evaluation Research
Evaluation
Why conduct evaluations?
Impact Evaluation
Performance Evaluation
the systematic application of scientific methods to assess th…
-demonstrate program effectiveness to funders... -improve the im…
measures the change in a development outcome that is attribut…
focus on descriptive and normative questions: ... --what a parti…
Evaluation
the systematic application of scientific methods to assess th…
Why conduct evaluations?
-demonstrate program effectiveness to funders... -improve the im…
48 terms
Research and Evaluation
Primary Prevention
Secondary Prevention
Tertiary Prevention
Formative Evaluation
Stop the problem from occurring
Detect, Halt and slow the problem
Decrease the impact of the problem
Needs assessment, process evaluation
Primary Prevention
Stop the problem from occurring
Secondary Prevention
Detect, Halt and slow the problem
83 terms
Evaluation and Research
Research
Evaluation
participants
funders
implementation of reliable, valid, or credible methods to emp…
systematic collection and analysis of information about one o…
those from whom data is gathered to answer evaluation questio…
those that represent the source that is financing the interve…
Research
implementation of reliable, valid, or credible methods to emp…
Evaluation
systematic collection and analysis of information about one o…
evaluation research
eval research is used to determine a p…
Purposes of eval research
Steps of eval
Measurements... -meed to decide on ____ a…
goals and objectives have been achieved
management and admin reasons... ass appropriateness of program(c…
who is client... -what are the purposes of eval... -what is methodo…
type and amount of info needed
eval research is used to determine a p…
goals and objectives have been achieved
Purposes of eval research
management and admin reasons... ass appropriateness of program(c…
17 terms
Research Methods: Evaluation Research
Evaluation Research
Formative and Summative
Formative Evaluation
Examples of Formative Evaluation
Systematic Process of collecting and analyzing data about qua…
Two categories of evaluation
Category of Evaluation:... Assesses program implementation or ex…
Forms of Evaluation used when something:... -Needs assessment... -P…
Evaluation Research
Systematic Process of collecting and analyzing data about qua…
Formative and Summative
Two categories of evaluation
29 terms
evaluation research
why research evaluation is conducted
evaluation research studies
when evaluation research study is not…
rape reform legislation new laws
to determine whether a social intervention or program has pro…
high school abstinence program, "just say no" campaign, passi…
rape case study
redefine rape, eliminate requirement that victim resists her…
why research evaluation is conducted
to determine whether a social intervention or program has pro…
evaluation research studies
high school abstinence program, "just say no" campaign, passi…
33 terms
Research and evaluation
Advertising and Promotion Research
Reliability:
Validity:
Trustworthiness:
Used to assist in determining market segments... Plays a key ro…
The research method produces consistent findings over time.…
The information generated is relevant to the research questio…
Usually applied to qualitative data; does the data seem to ma…
Advertising and Promotion Research
Used to assist in determining market segments... Plays a key ro…
Reliability:
The research method produces consistent findings over time.…
184 terms
Research and Evaluation
The definition of science
What is the goal of research and scien…
What are the two primary functions of…
The definition of research
-an approach of gathering knowledge rather than a field of st…
to obtain knowledge useful in understanding how our world ope…
1. the development of theory... 2. the testing of substantive hy…
A process of steps used to collect and analyze information to…
The definition of science
-an approach of gathering knowledge rather than a field of st…
What is the goal of research and scien…
to obtain knowledge useful in understanding how our world ope…
10 terms
Research and Evaluation
parsimony
meta-analysis
parameter
statistic
interpreting the results in the simplest way
a study that analyzes the finding of numerous studies
a value obtained from a population
a value drawn from a sample
parsimony
interpreting the results in the simplest way
meta-analysis
a study that analyzes the finding of numerous studies
21 terms
Research and Evaluation
Internal
External
Intuition
Revelation
Refers to the trustworthiness or honesty of statements found…
Refers to the form/appearance of the document (usually histor…
Something we feel
Devine experiences, prayer, spiritual encounters
Internal
Refers to the trustworthiness or honesty of statements found…
External
Refers to the form/appearance of the document (usually histor…
16 terms
Research and Evaluation
A.)
B.)
C.)
D.)
Monitor and evaluate policies, implement programs and practic…
Promote and facilitate, contribute to the development of know…
Examine and keep current with relevant knowledge to social wo…
Remember consequences and follow guidelines for protection. I…
A.)
Monitor and evaluate policies, implement programs and practic…
B.)
Promote and facilitate, contribute to the development of know…
39 terms
Research and Evaluation
What is Research?
The Research Process
What does determining the problem incl…
What drives research?
-A process for examining ... -the reality of a circumstance ... -Es…
-Determining the Problem to be Addressed... -Writing Objectives,…
-Analysis... -Prioritization ... -Justification
-Organizational mission... -National funding streams ... -Shared de…
What is Research?
-A process for examining ... -the reality of a circumstance ... -Es…
The Research Process
-Determining the Problem to be Addressed... -Writing Objectives,…
9 terms
Evaluating Research, Types of Research
Reliability
Validity
Internal Validity
External Validity
the degree to which a measure is free of measurement error
the confidence you can have in making certain conclusions
the confidence you can have in making cause-and-effect conclu…
the confidence you can have in generalizing the findings of y…
Reliability
the degree to which a measure is free of measurement error
Validity
the confidence you can have in making certain conclusions
35 terms
evaluation of research
• Review measures of central tendency…
• Understand the difference between Ty…
What is meant by written consent? (Or…
What is the difference between inclusi…
o Nominal - Names, two or more categories... o Ordinal - ranking…
o T1 + when -... o T2 - when +
• Document that has all the information of the study explaine…
• Inclusion is what they used to find people (has to meet all…
• Review measures of central tendency…
o Nominal - Names, two or more categories... o Ordinal - ranking…
• Understand the difference between Ty…
o T1 + when -... o T2 - when +
5 terms
IL: Evaluation & Research (REVIEW)
research
cite
citation
author
research
cite
27 terms
Evaluating Research
criteria for evaluating social scienti…
precision
power
parsimony
a. Precision ... b. Power ... c. Parsimony ... d. Reliability ... e. Meas…
How accurate are you at measuring your variables. ... i. Ex. Time
How representative is the data of your population; how powerf…
The combination of power and precision
criteria for evaluating social scienti…
a. Precision ... b. Power ... c. Parsimony ... d. Reliability ... e. Meas…
precision
How accurate are you at measuring your variables. ... i. Ex. Time
59 terms
Evaluating Research
In statistics, a __________ is a kind…
In statistics, an______ is a measure o…
An effect size calculated from data is…
Effect sizes complement inferential st…
Confidence interval
Effect size
descriptive statistic
p-values
In statistics, a __________ is a kind…
Confidence interval
In statistics, an______ is a measure o…
Effect size
18 terms
Evaluating research
research
systematic inquiry
roles of research
evidence based practice
an organized way to ask questions and find answers, a way of…
asking questions and engaging in process to answer questions.…
to satisfy curiosity by understanding causes, implications... p…
3 factors:... recognize needs, abilities, values, preferences,…
research
an organized way to ask questions and find answers, a way of…
systematic inquiry
asking questions and engaging in process to answer questions.…
21 terms
Evaluations research
Raine Effectiveness
Raine Effectiveness
Raine Effectiveness
Raine Ethical
Quasi experiment
Research technique
Sample R
Valid consent R
Raine Effectiveness
Quasi experiment
Raine Effectiveness
Research technique
29 terms
Research Evaluations
Types of arguments
Fallacies of reason
Fallacies of distraction
Fallacies of Induction
arguments by example, arguments from authority, arguments by…
fallacy which appeals to belief, emotions and popularity
Inclusion of irrelevant information, arguing from ignorance
Hasty generalizations, poor analogy, omitting negative evidence
Types of arguments
arguments by example, arguments from authority, arguments by…
Fallacies of reason
fallacy which appeals to belief, emotions and popularity
69 terms
CPCE Research & Program Evaluation
Quasiexperimental
Stratified sampling (Probability sample)
Proportional stratified sampling (Prob…
Cluster sampling (Probability sample)
In tact group studies
Persons from subgroups (strata) selected
Sample mimics general population
Randomly choose from naturally existing group (neighborhood,…
Quasiexperimental
In tact group studies
Stratified sampling (Probability sample)
Persons from subgroups (strata) selected
49 terms
Program Evaluation Research methods
Program evaluation has to do with what…
WHat is the purpose of program evaluat…
What is a program ?
What is an example of a program ?
IMPLEMENTATION
is th eprogram reaching its objective?
Strategy aimed to only improve body function ... Intervention i…
Combination of OT, PT, psychologists and physicians like offe…
Program evaluation has to do with what…
IMPLEMENTATION
WHat is the purpose of program evaluat…
is th eprogram reaching its objective?
22 terms
Research and Program Evaluation
Correlation
Positive Correlation
Negative Correlation
Quantitative Research
NOT the same as causality. Simply an association.... Go from ne…
When X goes up, Y goes up. ... For example, when you study more…
When X goes up Y goes down.... For example, the more you brush…
Yields numbers
Correlation
NOT the same as causality. Simply an association.... Go from ne…
Positive Correlation
When X goes up, Y goes up. ... For example, when you study more…
29 terms
(JC) Research and Program Evaluation
*Correlation
-5 is not higher
-8 is stronger
Positive correlation
An association goes from -1 to 0 to +1
than +5
than 5
X goes up, Y goes up.... (Studying goes up, grade goes up)
*Correlation
An association goes from -1 to 0 to +1
-5 is not higher
than +5
63 terms
Research and Program Evaluation A
Research
Evidence-based inquiry
Quantitative Research
Qualitative Research
is the systematic process of collecting and analyzing data fo…
is the search for knowledge using empirical data which has be…
a. assumes social facts have a single objective reality.... b. t…
a. assumes multiple realities socially constructed by individ…
Research
is the systematic process of collecting and analyzing data fo…
Evidence-based inquiry
is the search for knowledge using empirical data which has be…
1 of 10