Once you have collected your evidence, you will need to appraise the evidence for quality and for the level of evidence.
Evidence-Based Practice includes:
The best evidence is determined through evaluation and critical appraisal to determine the level of evidence and quality of the study. The highest level of evidence (level I) is the best evidence, but if there is no level I evidence, then the best evidence is level II, and so on.
These are the guidelines for appraising evidence for occupational therapy at BU.
Appraise the author's qualifications followed by the year of publication (e.g., Gish, Staplin, & Perel, 1999). Ideally, studies should be no more than 5 years old.
Briefly state the objective(s) of the study, using the focused question as a way to frame the study objectives. The objectives are usually stated briefly in the abstract of the article, and again in more detail in the introduction. They may be phrased as a research question, statement, or hypothesis.
Briefly describe the number and type of study participants. Include any available descriptive information (e.g., ages, mean age, age range, number of males and females). If the study has more than one group, list the descriptive information by group.
Levels of Evidence-
Level I: |
Systematic reviews, meta-analyses, randomized controlled trials |
Level II: |
Two groups, non-randomized studies (e.g., cohort, case-control) |
Level III: |
One group, non-randomized (e.g., before and after, pretest and post-test) |
Level IV: |
Descriptive studies that include analysis of outcomes (single-subject design, case series) |
Level V: |
Case reports and expert opinions that include narrative literature reviews and consensus statements |
If Qualitative studies are included in the review, a separate Evidence Table should be completed. Qualitative studies do not include a Level of Evidence.
Intervention
Setting:
Frequency:
Duration:
Outcomes
Briefly describe only those results of the study that are appropriate to answer the focused question. While p-values do not need to be included, make sure that significance has been achieved if one is reporting that one group is more likely to have a given outcome.
List the limitations of the study. These limitations may include design and sample selection issues (e.g., small sample size, lack of randomization, lack of control group), intervention biases (e.g., contamination or co-interventions), measurement biases (e.g. recall bias) or statistical issues (e.g., use of inappropriate statistical measures).
Copyright Information These guidelines are a product of AOTA’s Evidence-Based Practice Project and the American Journal of Occupational Therapy. Copyright© 2009 by the American Occupational Therapy Association. May be freely reproduced for personal use in clinical or educational settings as long as the source is cited. All other uses require written permission from the American Occupational Therapy Association. To apply, visit www.copyright.com
There are many varying models for EBP to appraise the evidence and determine levels of evidence. Other examples include:
The evidence pyramid highlighted by Walden University, along with many other universities, hospitals, and medical centers, has 7 levels of evidence.
Haynes, R. B. (2007). Of studies, syntheses, synopses, summaries, and systems: the 5S evolution of information services for evidence-based healthcare decisions. Evidence-Based Nursing, 10(1), 6-7. This pyramid of evidence has 5 levels: 1.) Systems; 2.) Summaries; 3.) Synopses; 4.) Syntheses and 5.) Studies. The Haynes 5S has been adapted and modified by many others.
Evidence Table
Evidence tables organize, describe, and present the strengths and rationale for the evidence you are including in a project.
For each piece of evidence you will include:
You will need to be familiar with research terms in able to evaluate the evidence.
You will need to know research terms like
You will also need to know study designs, such as
Use the glossaries below to (re)familiarize yourself with these terms and concepts.
Tip: The independent variable is the intervention. The dependent variable is the outcome.