Study sets matching "coleman research evaluation"

Study sets
Classes
Users

Study sets matching "coleman research evaluation"

Research & Evaluations - Coleman
Differences of Ad (vs. PR)
differences of pr
• Target audiences/publics... • Concerned…
What are the goals of research?
• Customers/prospective customers... • Copy testing ... • Focuses o…
• Publics... • Normally doing research for our message... • Content…
Similarities of Ad and PR
exploration, description, and explanation
Differences of Ad (vs. PR)
• Customers/prospective customers... • Copy testing ... • Focuses o…
differences of pr
• Publics... • Normally doing research for our message... • Content…
216 terms
Research and Evaluation Exam 1 coleman
Marketing research
Advertising and PR research
Basic Research
Applied Research
the systematic gathering, recording, and interpretation of in…
specialized forms of marketing research that focus on the pla…
research carried out to increase understanding of fundamental…
systematic inquiry accessing and using some part of the resea…
Marketing research
the systematic gathering, recording, and interpretation of in…
Advertising and PR research
specialized forms of marketing research that focus on the pla…
Introduction to Quantitative Research: Measurement and Sampling (coleman research and evaluation exam 1)
What is a population?
Example of a population
What are 2 types of populations?
accessible population
the group whom you want to learn facts about ... or about whom y…
you want to make a new line of jeans for YOUNG females ... you m…
entire (theoretical)... accessible
the population that will actually be accessible or available…
What is a population?
the group whom you want to learn facts about ... or about whom y…
Example of a population
you want to make a new line of jeans for YOUNG females ... you m…
Research and Eval (Coleman TCU)
Secondary Data
Internal Secondary Data
Proprietary
External Secondary Data
- Data previously collected for any purpose other than the on…
- Data comprised of information available within the firm... - P…
not accessible to others
data collected from sources outside of the firm
Secondary Data
- Data previously collected for any purpose other than the on…
Internal Secondary Data
- Data comprised of information available within the firm... - P…
148 terms
Research and Eval (Coleman TCU)
Secondary Data
Internal Secondary Data
Proprietary
External Secondary Data
- Data previously collected for any purpose other than the on…
- Data comprised of information available within the firm... - P…
not accessible to others
data collected from sources outside of the firm
Secondary Data
- Data previously collected for any purpose other than the on…
Internal Secondary Data
- Data comprised of information available within the firm... - P…
19 terms
Evaluation Research
Evaluation Research
Formative Evaluation
Why is formative evaluation used?
Examples of formative evaluation
Systematic process of collecting and analyzing data about qua…
(Process evaluation)... Assesses program implementation, deliver…
Provides information so revisions can be made for the program
1. Needs assessment... 2. Program implementation... 3. Program deli…
Evaluation Research
Systematic process of collecting and analyzing data about qua…
Formative Evaluation
(Process evaluation)... Assesses program implementation, deliver…
14 terms
Evaluation of Research
Internal Validity
Threats to Internal Validity
External Validity
Hawthorne Effect
Degree to which data in a study reflect a true cause-effect r…
-Instrumentation... -History... -Statistical Regression... -Maturation…
Refers to the generalizability: to what settings, populations…
Extent to which a study's results are affected by participant…
Internal Validity
Degree to which data in a study reflect a true cause-effect r…
Threats to Internal Validity
-Instrumentation... -History... -Statistical Regression... -Maturation…
Research Methods: Evaluating Research
Descriptive Statistics
Measures of Central Tendency
Mode
Mean
Sum up data to make it more understandable
A measurement of data that indicates where the middle of the…
The most frequently occurring score(s) in a distribution.
The arithmetic average of a distribution, obtained by adding…
Descriptive Statistics
Sum up data to make it more understandable
Measures of Central Tendency
A measurement of data that indicates where the middle of the…
Research&Evaluation
Belmont Report
Levels of Institutional Review Board
Informed Consent
Confidentiality
Treat individuals as autonomous agents... Do not use people a…
Exempt... Expedited... Full
permission granted in the knowledge of the possible consequen…
The researcher knows the identity of... subjects but does not di…
Belmont Report
Treat individuals as autonomous agents... Do not use people a…
Levels of Institutional Review Board
Exempt... Expedited... Full
Evaluation Research
Need- Based Evaluation Research
Process- Based Evaluation Research
Outcome- Based Evaluation Research
Efficiency- Based Evaluation Research
Attempts to determine the needs of a population that could be…
Evaluates the process of service delivery in a program
Whether or not the program worked
Cost-Benefit Analysis:... compares program cost to economic val…
Need- Based Evaluation Research
Attempts to determine the needs of a population that could be…
Process- Based Evaluation Research
Evaluates the process of service delivery in a program
13 terms
Evaluation Research:
Evaluation Research is NOT:
Evaluation Research IS:
Stakeholders
Inputs
A method of data (like surveys or experiments)
Research that is conducted for a goal: to investigate social…
Individuals and groups who have some concern with the program…
Clients, customers, students, or some other persons or units—…
Evaluation Research is NOT:
A method of data (like surveys or experiments)
Evaluation Research IS:
Research that is conducted for a goal: to investigate social…
72 terms
Research & Evaluation
Misperception of random events
The clustering illusion
Something out of nothing
Statistical regression
for example: hot hand in basketball... - "streak shooting" playe…
seeing clusters as more than random events. clustering illusi…
cementing our misperceptions with causal theories ... - people a…
it is a fact, when two values are related. When one value is…
Misperception of random events
for example: hot hand in basketball... - "streak shooting" playe…
The clustering illusion
seeing clusters as more than random events. clustering illusi…
6 terms
Evaluation research
Evaluation research
Appropriate topics
Needs assessment studies
Cost-benefit studies
Research undertaken for the purpose of determining the impact…
Those with practical significance: legalized marijuana
Studies that aim to determine the existence and extent of pro…
Studies that determine whether the results of a program can b…
Evaluation research
Research undertaken for the purpose of determining the impact…
Appropriate topics
Those with practical significance: legalized marijuana
16 terms
Evaluation Research
Scientific Methods
Empirical Data
Independent variable
Dependent varialbe
Good evaluations use scientific methods...... 1. Empirical Data…
Raw data on which research can be formulated
The constant, the variable that impacts the dependent variable
The variable we expect to see change in
Scientific Methods
Good evaluations use scientific methods...... 1. Empirical Data…
Empirical Data
Raw data on which research can be formulated
18 terms
Research & Evaluation
concept
construct
theory
laws
representation of some aspect of reality, but not tangible. t…
describes a concept that has been adopted for scientific reas…
generalization on a theme with which we seek to explain somet…
universal generalizations about classes or groups of facts. m…
concept
representation of some aspect of reality, but not tangible. t…
construct
describes a concept that has been adopted for scientific reas…
Evaluation Research
Cost-Benefit Analysis
Cost-Effectiveness Analysis
Efficiency Analysis
Impact Analysis (Summative Evaluation)
a systematic approach to estimating the strengths and weaknes…
a form of economic analysis that compares the relative costs…
compares program costs with program effects
did the program work? did it have the intended result?
Cost-Benefit Analysis
a systematic approach to estimating the strengths and weaknes…
Cost-Effectiveness Analysis
a form of economic analysis that compares the relative costs…
Research/Evaluation
Evaluation
Is it evaluation or research? ... Improve…
Theory
Whats the deal about theory
systematic collection and analysis of data to address criteri…
Improvement- both... tests objectives- Evaluation... not generalize…
Provides explanations... generalized beyond a single situation
Research based on theory (fit data to theory or generate theo…
Evaluation
systematic collection and analysis of data to address criteri…
Is it evaluation or research? ... Improve…
Improvement- both... tests objectives- Evaluation... not generalize…
Evaluation Research
Evaluation Research
Program evaluation/outcome assessment
Forms of Evaluation Research
Types of Evaluation Research Designs
-ALWAYS applied research with a purpose to examine the outc…
The determination of whether a social intervention is produci…
o Needs assessments are often carried out to determine the na…
Experimental designs ... Quasi Experimental designs... qualitative…
Evaluation Research
-ALWAYS applied research with a purpose to examine the outc…
Program evaluation/outcome assessment
The determination of whether a social intervention is produci…
17 terms
Research Methods: Evaluation Research
Evaluation Research
Formative and Summative
Formative Evaluation
Examples of Formative Evaluation
Systematic Process of collecting and analyzing data about qua…
Two categories of evaluation
Category of Evaluation:... Assesses program implementation or ex…
Forms of Evaluation used when something:... -Needs assessment... -P…
Evaluation Research
Systematic Process of collecting and analyzing data about qua…
Formative and Summative
Two categories of evaluation
150 terms
Research & Evaluation
Reasons to Read Journal Articles
Primary Research Sources
Secondary Research Sources
Primary (Analytic) Studies
1. New health problems... 2. New presentations or manifestation…
Original study design
1. Databases... 2. Point of Care resources... *Up To Date... *MD Con…
Those that report original research:... *Experimental... *Observa…
Reasons to Read Journal Articles
1. New health problems... 2. New presentations or manifestation…
Primary Research Sources
Original study design
Research / Evaluation
Asch (1956)
Stanford Prison Experiment (Haney et a…
BBC Prison Study (Reicher and Haslam,…
Obedience (Milgram, 1963)
Procedure:... - 3 lines of different length... - Compared to a sepa…
Procedure:... - Mock prison setup in basement of psychology depa…
Procedure:... - Set up similar to the SPE... - Participants with si…
Procedure:... - 40 Participants... - Participants told that the stu…
Asch (1956)
Procedure:... - 3 lines of different length... - Compared to a sepa…
Stanford Prison Experiment (Haney et a…
Procedure:... - Mock prison setup in basement of psychology depa…
9 terms
evaluation research
evaluation research
examples of evaluation research
components of evaluation research
Program Stakeholders:
social research that is conducted for a distinctive purpose:…
Teaching Evaluations... Peer Evaluations... Rate My Professor... Custo…
Program Stakeholders, ... Inputs, ... Program process, ... outputs, ... o…
Individuals and groups who have some basis of concern with th…
evaluation research
social research that is conducted for a distinctive purpose:…
examples of evaluation research
Teaching Evaluations... Peer Evaluations... Rate My Professor... Custo…
10 terms
Evaluation Research
evaluation research
Quasi-experiments
Factors that make quasi-experimental d…
Factors which may make randomization i…
research undertaken for the purpose of determining the impact…
non-rigorous inquiries somewhat resembling controlled experim…
-absence of a comparison/control group... -necessary reliance up…
1. Experimental and control/comparison groups occur naturally…
evaluation research
research undertaken for the purpose of determining the impact…
Quasi-experiments
non-rigorous inquiries somewhat resembling controlled experim…
18 terms
Evaluation Research
Evaluation
Why conduct evaluations?
Impact Evaluation
Performance Evaluation
the systematic application of scientific methods to assess th…
-demonstrate program effectiveness to funders... -improve the im…
measures the change in a development outcome that is attribut…
focus on descriptive and normative questions: ... --what a parti…
Evaluation
the systematic application of scientific methods to assess th…
Why conduct evaluations?
-demonstrate program effectiveness to funders... -improve the im…
18 terms
evaluation research
evaluation research
problem identification
policy planning
PP:social impact assessment:
a form of applied research that applied social research metho…
is certian issue a social problem and worthy of consideration
what should be done about the problem , action needed,
what are the cost and benefits , if we give them a shelter ,…
evaluation research
a form of applied research that applied social research metho…
problem identification
is certian issue a social problem and worthy of consideration
35 terms
Evaluation and Research
Categorical data
Continuous data
frequency distributions
measure of central tendency
Qualitative properties: Two Types: Nominal (names, labeling v…
Quantitative values each have equal space between each variab…
...
used to summarize data and make comparisons between data - in…
Categorical data
Qualitative properties: Two Types: Nominal (names, labeling v…
Continuous data
Quantitative values each have equal space between each variab…
Research and Evaluation
Primary Prevention
Secondary Prevention
Tertiary Prevention
Formative Evaluation
Stop the problem from occurring
Detect, Halt and slow the problem
Decrease the impact of the problem
Needs assessment, process evaluation
Primary Prevention
Stop the problem from occurring
Secondary Prevention
Detect, Halt and slow the problem
83 terms
Evaluation and Research
Research
Evaluation
participants
funders
implementation of reliable, valid, or credible methods to emp…
systematic collection and analysis of information about one o…
those from whom data is gathered to answer evaluation questio…
those that represent the source that is financing the interve…
Research
implementation of reliable, valid, or credible methods to emp…
Evaluation
systematic collection and analysis of information about one o…
evaluation research
eval research is used to determine a p…
Purposes of eval research
Steps of eval
Measurements... -meed to decide on ____ a…
goals and objectives have been achieved
management and admin reasons... ass appropriateness of program(c…
who is client... -what are the purposes of eval... -what is methodo…
type and amount of info needed
eval research is used to determine a p…
goals and objectives have been achieved
Purposes of eval research
management and admin reasons... ass appropriateness of program(c…
Research and evaluation
Advertising and Promotion Research
Reliability:
Validity:
Trustworthiness:
Used to assist in determining market segments... Plays a key ro…
The research method produces consistent findings over time.…
The information generated is relevant to the research questio…
Usually applied to qualitative data; does the data seem to ma…
Advertising and Promotion Research
Used to assist in determining market segments... Plays a key ro…
Reliability:
The research method produces consistent findings over time.…
184 terms
Research and Evaluation
The definition of science
What is the goal of research and scien…
What are the two primary functions of…
The definition of research
-an approach of gathering knowledge rather than a field of st…
to obtain knowledge useful in understanding how our world ope…
1. the development of theory... 2. the testing of substantive hy…
A process of steps used to collect and analyze information to…
The definition of science
-an approach of gathering knowledge rather than a field of st…
What is the goal of research and scien…
to obtain knowledge useful in understanding how our world ope…
62 terms
research and evaluation
causality
bubbles
true experiment
quasi-experiment
correlation is NOT the same as
flaws in research
2+ groups are used. random sampling. placed with random assig…
when groups are not picked at random or the researcher cannot…
causality
correlation is NOT the same as
bubbles
flaws in research
12 terms
IL: Evaluation & Research
valid... good; based on facts
reliable... always good quality
purpose... reason
verify... to check something is true and…
Melissa has valid information about Native American history.
Government maps are reliable.
The purpose of this class is to learn English.
Priciliano needs to verify the population of Seattle is 640,5…
valid... good; based on facts
Melissa has valid information about Native American history.
reliable... always good quality
Government maps are reliable.
29 terms
evaluation research
why research evaluation is conducted
evaluation research studies
when evaluation research study is not…
rape reform legislation new laws
to determine whether a social intervention or program has pro…
high school abstinence program, "just say no" campaign, passi…
rape case study
redefine rape, eliminate requirement that victim resists her…
why research evaluation is conducted
to determine whether a social intervention or program has pro…
evaluation research studies
high school abstinence program, "just say no" campaign, passi…
18 terms
Evaluation Research
Inputs
program process
outputs
outcomes
resources,raw materials,clients and staff that go into a prog…
the complete treatment or services delivered by the program
the services delivered or new products produced by the progra…
the impact of the program process on the cases processed
Inputs
resources,raw materials,clients and staff that go into a prog…
program process
the complete treatment or services delivered by the program
10 terms
Research and Evaluation
parsimony
meta-analysis
parameter
statistic
interpreting the results in the simplest way
a study that analyzes the finding of numerous studies
a value obtained from a population
a value drawn from a sample
parsimony
interpreting the results in the simplest way
meta-analysis
a study that analyzes the finding of numerous studies
Research and Evaluation
Internal
External
Intuition
Revelation
Refers to the trustworthiness or honesty of statements found…
Refers to the form/appearance of the document (usually histor…
Something we feel
Devine experiences, prayer, spiritual encounters
Internal
Refers to the trustworthiness or honesty of statements found…
External
Refers to the form/appearance of the document (usually histor…
16 terms
Research and Evaluation
A.)
B.)
C.)
D.)
Monitor and evaluate policies, implement programs and practic…
Promote and facilitate, contribute to the development of know…
Examine and keep current with relevant knowledge to social wo…
Remember consequences and follow guidelines for protection. I…
A.)
Monitor and evaluate policies, implement programs and practic…
B.)
Promote and facilitate, contribute to the development of know…
39 terms
Research and Evaluation
What is Research?
The Research Process
What does determining the problem incl…
What drives research?
-A process for examining ... -the reality of a circumstance ... -Es…
-Determining the Problem to be Addressed... -Writing Objectives,…
-Analysis... -Prioritization ... -Justification
-Organizational mission... -National funding streams ... -Shared de…
What is Research?
-A process for examining ... -the reality of a circumstance ... -Es…
The Research Process
-Determining the Problem to be Addressed... -Writing Objectives,…
evaluation research
evaluation research
4 aspects of evaluation research
program design and planning
program monitoring
the use of scientific research methods to provide valid relia…
1. program design and planning.... 2. program monitoring.... 3. out…
are the goals of the program clearly defined? is the program…
how well is the program run? do the services or resources of…
evaluation research
the use of scientific research methods to provide valid relia…
4 aspects of evaluation research
1. program design and planning.... 2. program monitoring.... 3. out…
9 terms
Evaluation Research
evaluation research
impact research
process research
measurement
look to see if something does what it is supposed to do
if a program achieves its goals
examining the passage of policy/rule/law
(a) multiple outcomes... (b) complementary variable: external to…
evaluation research
look to see if something does what it is supposed to do
impact research
if a program achieves its goals
18 terms
Evaluation Research
Evaluation Research
Program eval/outcome assessment
Quasi Experiments
Time series design
Research undertaken for the purpose of determining the impact…
The determination of whether a social intervention is produci…
Nonrigorous inquiries somewhat resembling controlled experime…
A research design that involves measurements made over some p…
Evaluation Research
Research undertaken for the purpose of determining the impact…
Program eval/outcome assessment
The determination of whether a social intervention is produci…
69 terms
CPCE Research & Program Evaluation
Quasiexperimental
Stratified sampling (Probability sample)
Proportional stratified sampling (Prob…
Cluster sampling (Probability sample)
In tact group studies
Persons from subgroups (strata) selected
Sample mimics general population
Randomly choose from naturally existing group (neighborhood,…
Quasiexperimental
In tact group studies
Stratified sampling (Probability sample)
Persons from subgroups (strata) selected
Evaluating Research
In statistics, a __________ is a kind…
In statistics, an______ is a measure o…
An effect size calculated from data is…
Effect sizes complement inferential st…
Confidence interval
Effect size
descriptive statistic
p-values
In statistics, a __________ is a kind…
Confidence interval
In statistics, an______ is a measure o…
Effect size
Evaluating research
research
systematic inquiry
roles of research
evidence based practice
an organized way to ask questions and find answers, a way of…
asking questions and engaging in process to answer questions.…
to satisfy curiosity by understanding causes, implications... p…
3 factors:... recognize needs, abilities, values, preferences,…
research
an organized way to ask questions and find answers, a way of…
systematic inquiry
asking questions and engaging in process to answer questions.…
Evaluating Research
Sampling Bias
Placebo Effects
Hawthorne Effect
Densitization
exists when a sample is not representative of the population…
when there is a change in peoples behavior because they think…
when you know someone is watching you the results change. ... -e…
researcher starts from far away and gets closer and closer to…
Sampling Bias
exists when a sample is not representative of the population…
Placebo Effects
when there is a change in peoples behavior because they think…
27 terms
Evaluating Research
criteria for evaluating social scienti…
precision
power
parsimony
a. Precision ... b. Power ... c. Parsimony ... d. Reliability ... e. Meas…
How accurate are you at measuring your variables. ... i. Ex. Time
How representative is the data of your population; how powerf…
The combination of power and precision
criteria for evaluating social scienti…
a. Precision ... b. Power ... c. Parsimony ... d. Reliability ... e. Meas…
precision
How accurate are you at measuring your variables. ... i. Ex. Time
5 terms
Evaluating Research
Significance of Study
Validity
Threats to External Validity
Internal Validity
-hypothesis or research question clearly presented... -feasibili…
extent to which results can be generalized
-testing sensitization... -participant selection... -experimental s…
consumed with how the study are a direct result of experiment…
Significance of Study
-hypothesis or research question clearly presented... -feasibili…
Validity
extent to which results can be generalized
29 terms
Research Evaluations
Types of arguments
Fallacies of reason
Fallacies of distraction
Fallacies of Induction
arguments by example, arguments from authority, arguments by…
fallacy which appeals to belief, emotions and popularity
Inclusion of irrelevant information, arguing from ignorance
Hasty generalizations, poor analogy, omitting negative evidence
Types of arguments
arguments by example, arguments from authority, arguments by…
Fallacies of reason
fallacy which appeals to belief, emotions and popularity
22 terms
Research and Program Evaluation
Correlation
Positive Correlation
Negative Correlation
Quantitative Research
NOT the same as causality. Simply an association.... Go from ne…
When X goes up, Y goes up. ... For example, when you study more…
When X goes up Y goes down.... For example, the more you brush…
Yields numbers
Correlation
NOT the same as causality. Simply an association.... Go from ne…
Positive Correlation
When X goes up, Y goes up. ... For example, when you study more…
1 of 10