Research Critique Posted: April 12th, 2014
Write your critique following the outline below exactly and include the section headings in you critique. Note that there is a three page limit that will be strictly enforced, so you should plan to write several drafts of your paper, editing it carefully to include all of the pertinent information. Use 1 inch margins on the top, bottom and sides, double spaced, and a font size of 12.
1.0 Synopsis
Briefly summarize the purpose of the study, its methods and its key findings. This should no more than half a page.
2.0 Internal Validity
Identify threats to the internal validity of the study, referring to specific aspects of the way this particular study was executed, not just a generalized list of internal validity threats. Include your critique of the reliability of the measures used (e.g. internal consistency, test-retest reliability) here. Internal Validity includes Single group threats: history, maturation, testing instrumentation, regression, mortality, Multiple group threats: selection, Social threats: diffusion, compensation,rivalry,demoralization. Always threats: demand, bias, apprehension, time order.
3.0 External Validity
Identify threats to external validity that are specific to the context of the study, indicate clearly exactly how they apply to the research in question. Include your critique of measurement validity issues such as predictive, concurrent and construct validity here. Note that the validity of the measures is a separate issue from the validity of the basic design. External validity includes randomization, heterogeneity& replication, representativeness, reactive treatments and reactive conditions.
4.0 Synthesis
Based on the specific flaws in this specific study, describe exactly how they may have affected the results. It is not sufficient to accuse the researchers of making errors. You must demonstrate how the flaws you found could specifically create alternative explanations for the observed results. For example, “a sample of college students does not represent the entire population and that could affect the results” is insufficient. You need to come up with a reason why the result is likely to be found only among college students or identify other populations that might yield different results.
5.0 Recommendations
How would you redesign the study to overcome its flaws and to resolve the issues you identified? Be very specific in terms of revised operational definitions, sampling frame and sample size, reliability and validity tests you would add or exact changes in the procedures of the study. For example, “I recommend a random sample” is too vague. You need to identify and justify the size of the sample, the population you would draw it from and exactly how you would draw it.
