how to read a research article and evaluate the research

Evaluating Information

• Understanding Primary and Secondary Sources
• Exploring and Evaluating Popular, Trade, and Scholarly Sources

Reading a Scholarly Article

Common components of original research articles, while you read, reading strategies, reading for citations, further reading, learning objectives.

This page was created to help you:

Identify the different parts of a scholarly article

Efficiently analyze and evaluate scholarly articles for usefulness

This page will focus on reading scholarly articles — published reports on original research in the social sciences, humanities, and STEM fields. Reading and understanding this type of article can be challenging. This guide will help you develop these skills, which can be learned and improved upon with practice.

We will go over:

There are many different types of articles that may be found in scholarly journals and other academic publications. For more, see:

• Types of Information Sources

Reading a scholarly article isn’t like reading a novel, website, or newspaper article. It’s likely you won’t read and absorb it from beginning to end, all at once.

Instead, think of scholarly reading as inquiry, i.e., asking a series of questions as you do your research or read for class. Your reading should be guided by your class topic or your own research question or thesis.

For example, as you read, you might ask yourself:

• What questions does it help to answer, or what topics does it address?
• Are these relevant or useful to me?
• Does the article offer a helpful framework for understanding my topic or question (theoretical framework)?
• Do the authors use interesting or innovative methods to conduct their research that might be relevant to me?
• Does the article contain references I might consult for further information?

In Practice

Scanning and skimming are essential when reading scholarly articles, especially at the beginning stages of your research or when you have a lot of material in front of you.

Many scholarly articles are organized to help you scan and skim efficiently. The next time you need to read an article, practice scanning the following sections (where available) and skim their contents:

• The abstract: This summary provides a birds’ eye view of the article contents.
• The introduction:  What is the topic(s) of the research article? What is its main idea or question?
• The list of keywords or descriptors
• Methods: How did the author(s) go about answering their question/collecting their data?
• Section headings:  Stop and skim those sections you may find relevant.
• Figures:  Offer lots of information in quick visual format.
• The conclusion:  What are the findings and/or conclusions of this article?

Mark Up Your Text

Read with purpose.

• Scanning and skimming with a pen in hand can help to focus your reading.
• Use color for quick reference. Try highlighters or some sticky notes. Use different colors to represent different topics.
• Write in the margins, putting down thoughts and questions about the content as you read.
• Use digital markup features available in eBook platforms or third-party solutions, like Adobe Reader or Hypothes.is.

Categorize Information

Create your own informal system of organization. It doesn’t have to be complicated — start basic, and be sure it works for you.

• Jot down a few of your own keywords for each article. These keywords may correspond with important topics being addressed in class or in your research paper.  
• Write keywords on print copies or use the built-in note taking features in reference management tools like Zotero and EndNote.  
• Your keywords and system of organization may grow more complex the deeper you get into your reading.

Highlight words, terms, phrases, acronyms, etc. that are unfamiliar to you. You can highlight on the text or make a list in a notetaking program.

• Decide if the term is essential to your understanding of the article or if you can look it up later and keep scanning.

You may scan an article and discover that it isn’t what you thought it was about. Before you close the tab or delete that PDF, consider scanning the article one more time, specifically to look for citations that might be more on-target for your topic.  

You don’t need to look at every citation in the bibliography — you can look to the literature review to identify the core references that relate to your topic. Literature reviews are typically organized by subtopic within a research question or thesis. Find the paragraph or two that are closely aligned with your topic, make note of the author names, then locate those citations in the bibliography or footnote.

See the Find Articles page for what to do next:

• Find Articles

See the Citation Searching page for more on following a citation trail:

• Citation Searching
• Taking notes effectively. [blog post] Raul Pacheco-Vega, PhD
• How to read an academic paper. [video] UBCiSchool. 2013
• How to (seriously) read a scientific paper. (2016, March 21). Science | AAAS.
• How to read a paper. S. Keshav. 2007. SIGCOMM Comput. Commun. Rev. 37, 3 (July 2007), 83–84.

This guide was designed to help you:

• << Previous: Exploring and Evaluating Popular, Trade, and Scholarly Sources
• Last Updated: Feb 16, 2024 3:55 PM
• URL: https://libguides.brown.edu/evaluate

Brown University Library  |  Providence, RI 02912  |  (401) 863-2165  |  Contact  |  Comments  |  Library Feedback  |  Site Map

Library Intranet

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• J Oral Maxillofac Pathol
• v.17(1); Jan-Apr 2013

Art of reading a journal article: Methodically and effectively

Rv subramanyam.

Department of Oral Pathology, Drs Sudha and Nageswara Rao Siddhartha Institute of Dental Sciences, Gannavaram, Andhra Pradesh, India

Background:

Reading scientific literature is mandatory for researchers and clinicians. With an overflow of medical and dental journals, it is essential to develop a method to choose and read the right articles.

To outline a logical and orderly approach to reading a scientific manuscript. By breaking down the task into smaller, step-by-step components, one should be able to attain the skills to read a scientific article with ease.

The reader should begin by reading the title, abstract and conclusions first. If a decision is made to read the entire article, the key elements of the article can be perused in a systematic manner effectively and efficiently. A cogent and organized method is presented to read articles published in scientific journals.

Conclusion:

One can read and appreciate a scientific manuscript if a systematic approach is followed in a simple and logical manner.

INTRODUCTION

“ We are drowning in information but starved for knowledge .” John Naisbitt

It has become essential for the clinicians, researchers, and students to read articles from scientific journals. This is not only to keep abreast of progress in the speciality concerned but also to be aware of current trends in providing optimum healthcare to the patients. Reading scientific literature is a must for students interested in research, for choosing their topics and carrying out their experiments. Scientific literature in that field will help one understand what has already been discovered and what questions remain unanswered and thus help in designing one's research project. Sackett (1981)[ 1 ] and Durbin (2009)[ 2 ] suggested various reasons why most of us read journal articles and some of these are listed in Table 1 .

Common reasons for reading journal articles

The scientific literature is burgeoning at an exponential rate. Between 1978 and 1985, nearly 272,344 articles were published annually and listed in Medline. Between 1986 and 1993, this number reached 344,303 articles per year, and between 1994 and 2001, the figure has grown to 398,778 articles per year.[ 3 ] To be updated with current knowledge, a physician practicing general medicine has to read 17 articles a day, 365 days a year.[ 4 ]

In spite of the internet rapidly gaining a strong foothold as a quick source of obtaining information, reading journal articles, whether from print or electronic media, still remains the most common way of acquiring new information for most of us.[ 2 ] Newspaper reports or novels can be read in an insouciant manner, but reading research reports and scientific articles requires concentration and meticulous approach. At present, there are 1312 dentistry journals listed in Pubmed.[ 5 ] How can one choose an article, read it purposefully, effectively, and systematically? The aim of this article is to provide an answer to this question by presenting an efficient and methodical approach to a scientific manuscript. However, the reader is informed that this paper is mainly intended for the amateur reader unaccustomed to scientific literature and not for the professional interested in critical appraisal of journal articles.

TYPES OF JOURNAL ARTICLES

Different types of papers are published in medical and dental journals. One should be aware of each kind; especially, when one is looking for a specific type of an article. Table 2 gives different categories of papers published in journals.

Types of articles published in a journal

In general, scientific literature can be primary or secondary. Reports of original research form the “primary literature”, the “core” of scientific publications. These are the articles written to present findings on new scientific discoveries or describe earlier work to acknowledge it and place new findings in the proper perspective. “Secondary literature” includes review articles, books, editorials, practice guidelines, and other forms of publication in which original research information is reviewed.[ 6 ] An article published in a peer-reviewed journal is more valued than one which is not.

An original research article should consist of the following headings: Structured abstract, introduction, methods, results, and discussion (IMRAD) and may be Randomized Control Trial (RCT), Controlled Clinical Trial (CCT), Experiment, Survey, and Case-control or Cohort study. Reviews could be non-systematic (narrative) or systematic. A narrative review is a broad overview of a topic without any specific question, more or less an update, and qualitative summary. On the other hand, a systematic review typically addresses a specific question about a topic, details the methods by which papers were identified in the literature, uses predetermined criteria for selection of papers to be included in the review, and qualitatively evaluates them. A meta-analysis is a type of systematic review in which numeric results of several separate studies are statistically combined to determine the outcome of a specific research question.[ 7 – 9 ] Some are invited reviews, requested by the Editor, from an expert in a particular field of study.

A case study is a report of a single clinical case, whereas, a case series is a description of a number of such cases. Case reports and case series are description of disease (s) generally considered rare or report of heretofore unknown or unusual findings in a well-recognized condition, unique procedure, imaging technique, diagnostic test, or treatment method. Technical notes are description of new, innovative techniques, or modifications to existing procedures. A pictorial essay is a teaching article with images and legends but has limited text. Commentary is a short article on an author's personal opinion of a specific topic and could be controversial. An editorial, written by the editor of the journal or invited, can be perspective (about articles published in that particular issue) or persuasive (arguing a specific point of view). Other articles published in a journal include letters to the editor, book reviews, conference proceedings and abstracts, and abstracts from other journals.[ 10 ]

WHAT TO READ IN A JOURNAL? – CHOOSING THE RIGHT ARTICLE

Not all research articles published are excellent, and it is pragmatic to decide if the quality of the study warrants reading of the manuscript. The first step for a reader is to choose a right article for reading, depending on one's individual requirement. The next step is to read the selected article methodically and efficiently.[ 2 ] A simple decision-making flowchart is depicted in [ Figure 1 ], which helps one to decide the type of article to select. This flowchart is meant for one who has a specific intent of choosing a particular type of article and not for one who intends to browse through a journal.

Schematic flowchart of the first step in choosing an article to read

HOW TO START READING AN ARTICLE?

“ There is an art of reading, as well as an art of thinking, and an art of writing .” Clarence Day

At first glance, a journal article might appear intimidating for some or confusing for others with its tables and graphs. Reading a research article can be a frustrating experience, especially for the one who has not mastered the art of reading scientific literature. Just like there is a method to extract a tooth or prepare a cavity, one can also learn to read research articles by following a systematic approach. Most scientific articles are organized as follows:[ 2 , 11 ]

• Title: Topic and information about the authors.
• Abstract: Brief overview of the article.
• Introduction: Background information and statement of the research hypothesis.
• Methods: Details of how the study was conducted, procedures followed, instruments used and variables measured.
• Results: All the data of the study along with figures, tables and/or graphs.
• Discussion: The interpretation of the results and implications of the study.
• References/Bibliography: Citations of sources from where the information was obtained.

Review articles do not usually follow the above pattern, unless they are systematic reviews or meta-analysis. The cardinal rule is: Never start reading an article from the beginning to the end. It is better to begin by identifying the conclusions of the study by reading the title and the abstract.[ 12 ] If the article does not have an abstract, read the conclusions or the summary at the end of the article first. After reading the abstract or conclusions, if the reader deems it is interesting or useful, then the entire article can be read [ Figure 2 ].

Decision-making flowchart to decide whether to read the chosen article or not

Like the title of a movie which attracts a filmgoer, the title of the article is the one which attracts a reader in the first place. A good title will inform the potential reader a great deal about the study to decide whether to go ahead with the paper or dismiss it. Most readers prefer titles that are descriptive and self-explanatory without having to look at the entire article to know what it is all about.[ 2 ] For example, the paper entitled “Microwave processing – A blessing for pathologists” gives an idea about the article in general to the reader. But there is no indication in the title whether it is a review article on microwave processing or an original research. If the title had been “Comparison of Microwave with Conventional Tissue Processing on quality of histological sections”, even the insouciant reader would have a better understanding of the content of the paper.

Abstract helps us determine whether we should read the entire article or not. In fact, most journals provide abstract free of cost online allowing us to decide whether we need to purchase the entire article. Most scientific journals now have a structured abstract with separate subheadings like introduction (background or hypothesis), methods, results and conclusions making it easy for a reader to identify important parts of the study quickly.[ 13 ] Moreover, there is usually a restriction about the number of words that can be included in an abstract. This makes the abstract concise enough for one to read rapidly.

The abstract can be read in a systematic way by answering certain fundamental questions like what was the study about, why and how was the study conducted, the results and their inferences. The reader should make a note of any questions that were raised while reading the abstract and be sure that answers have been found after reading the entire article.[ 12 ]

Reading the entire article

Once the reader has decided to read the entire article, one can begin with the introduction.

The purpose of the introduction is to provide the rationale for conducting the study. This section usually starts with existing knowledge and previous research of the topic under consideration. Typically, this section concludes with identification of gaps in the literature and how these gaps stimulated the researcher to design a new study.[ 12 ] A good introduction should provide proper background for the study. The aims and objectives are usually mentioned at the end of the introduction. The reader should also determine whether a research hypothesis (study hypothesis) was stated and later check whether it was answered under the discussion.

MATERIALS AND METHODS

This section gives the technical details of how the experiments were carried out. In most of the research articles, all details are rarely included but there should be enough information to understand how the study was carried out.[ 12 ] Information about the number of subjects included in the study and their categorization, sampling methods, the inclusion criteria (who can be in) and exclusion criteria (who cannot be in) and the variables chosen can be derived by reading this section. The reader should get acquainted with the procedures and equipment used for data collection and find out whether they were appropriate.

RESULTS OF THE STUDY

In this section, the researchers give details about the data collected, either in the form of figures, tables and/or graphs. Ideally, interpretation of data should not be reported in this section, though statistical analyses are presented. The reader should meticulously go through this segment of the manuscript and find out whether the results were reliable (same results over time) and valid (measure what it is supposed to measure). An important aspect is to check if all the subjects present in the beginning of the study were accounted for at the end of the study. If the answer is no, the reader should check whether any explanation was provided.

Results that were statistically significant and results that were not, must be identified. One should also observe whether a correct statistical test was employed for analysis and was the level of significance appropriate for the study. To appreciate the choice of a statistical test, one requires an understanding of the hypothesis being tested.[ 14 , 15 ] Table 3 provides a list of commonly used statistical tests used in scientific publications. Description and interpretation of these tests is beyond the scope of this paper. It is wise to remember the following advice: It is not only important to know whether a difference or association is statistically significant but also appreciate whether it is large or substantial enough to be useful clinically.[ 16 ] In other words, what is statistically significant may not be clinically significant.

Basic statistics commonly used in scientific publications

This is the most important section of the article where the research questions are answered and the meaning of analysis and interpretation of the data are presented. Usually the study results are compared with other studies, explaining in what aspects they were different or similar. Ideally, no new data should be presented under discussion and no information from other sections should be repeated.[ 2 ] In addition, this section also discusses the various strengths and limitations/shortcomings of the study, providing suggestions about areas that need additional research.

The meaning of results and their analyses, new theories or hypotheses, limitations of the study, explanation of differences and similarities with other comparable studies, and suggestions for future research are offered in this section. It is important to remember that the discussions are the authors’ interpretations and opinions and not necessarily facts.

READING THE CONCLUSION (AGAIN !)

Though conclusion part had been read at the beginning, it is prudent to read it again at the end to confirm whether what we had inferred initially is correct. If the conclusion had not made sense earlier, it may make sense after having perused through the entire article. Sometimes, the study conclusions are included in the discussion section and may not be easy to locate. The questions that can be asked under various sub-headings of an original research paper are presented as a simple questionnaire in Table 4 . It is assumed that one who is using this questionnaire has read and analyzed the abstract and then decided to read the entire article. This questionnaire does not critically analyze a scientific article. However, answers to these questions provide a systematic approach to obtain a broad overview of the manuscript, especially to a novice. If one who is new to reading articles, writing answers to these questions and taking notes will help in understanding most aspects of a research article.

Questionnaire for original research articles

“ Let us read with method, and propose to ourselves an end to which our studies may point. The use of reading is to aid us in thinking .” Edward Gibbon

It has become mandatory to read scientific literature to be well-informed of ever-expanding information and/or for better diagnosis, prognosis and therapy. Since there is an abundance of journals and articles, it is critical to develop a modus operandi for achieving a rapid, purposeful, effective and useful method to read these manuscripts. A simple but efficient and logical approach to scientific literature has been presented here for choosing articles and reading them systematically and effectively for a better understanding.

Source of Support: Nil.

Conflict of Interest: None declared.

Evaluating Sources: How to Read and Evaluate Articles

• Introduction
• Search Engines: Library Databases vs. Google

How to Read and Evaluate Articles

• Other Useful Resources

Evaluating Articles

Learning to read and evaluate articles is an important skill to develop in your academic career. These guidelines apply equally to evaluating scholarly and popular articles.

• Purpose of the article - why was it written? To inform, persuade, to present results of a study? Many journal articles will present results of original research and are peer-reviewed for quality.
• Scholarly journals often have the word journal in the title, for example Journal of the American Medical Association , Journal of Federalism . Some journals may not, such as Perspectives on Political Science and Cognitive Therapy and Research. Often, journals are published by professional organizations, such as the American Psychological Association or American Medical Association.
• Trade magazines and news magazines might be appropriate, depending on your topic. Trade magazines are often published by industry associations, such as the National Restaurant Association.
• Bias of the publisher - this is not really an issue with academic publishers, but is definitely something to be aware of when researching political, anthropological or controversial topics. Some publications will be left wing/liberal, right wing/conservative, centrist, or even alternative press. Ask a librarian or your instructor for help in determining bias.
• Date of publication - sometimes currency matters (as in health care or in news coverage). So look for date of publication. Databases allow you to easily limit results by date.
• Support an argument
• Refute an argument
• Provide background information
• Give examples (survey results, research results, case studies, etc.)

Based on excellent materials from Research Guides at Colorado State and Indiana University .

Reading a Scientific or Peer-reviewed Article

Indiana University has an excellent page on reading scientific articles (and includes a video). The information is summarized below.

Scholarly articles (especially peer-reviewed articles) have distinct sections that help you understand what is being presented:

• Title - the title of an article often has clues on the content and purpose of the article (i.e. study).
• Abstract - this is a summary of the article, and appears in library databases and as the Description in the library search system results. These should be closely read to determine the relevance of the article to your research.
• Introduction - this section informs the reader about the purpose of the article and presents the research questions  the authors are hoping to answer. A hypothesis may also be presented. Either the Introduction or a Literature Review will summarize the current state of knowledge and research about the topic of the article.
• Method(s) - this section will cover what tools and methods the authors used to conduct their research. Sample sizes are also often included here. Once you become familiar with common methodologies in a discipline, you can analyze how the methodologies used in this article compare with methods used in other articles about the same topic.
• Results - this section presents the results of the experiments and usually have tables or charts and dense details about statistical analysis. Often, the relationship of the hypothesis to the results can be found in this section.
• Discussion - this section is very helpful because it describes the findings in fairly simple English. New discoveries or interesting findings are usually included and often the authors will suggest future directions for research.
• Conclusion - the conclusion summarizes the findings of the research and may also suggest future directions for research.
• Bibliography or References - this section contains a list of sources that the authors consulted. If the article you read is helpful, you may want to track down some of these sources to save research time. Ask a librarian how to find these resources.

For more details and other tips, check out the How to Read a Scientific Paper page at Indiana University.

• << Previous: Search Engines: Library Databases vs. Google
• Next: Other Useful Resources >>
• Last Updated: Dec 6, 2022 10:12 AM
• URL: https://libguides.tmcc.edu/evaluating_sources

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base
• Working with sources
• Evaluating Sources | Methods & Examples

Evaluating Sources | Methods & Examples

Published on June 2, 2022 by Eoghan Ryan . Revised on May 31, 2023.

The sources you use are an important component of your research. It’s important to evaluate the sources you’re considering using, in order to:

• Ensure that they’re credible
• Determine whether they’re relevant to your topic
• Assess the quality of their arguments

Table of contents

Evaluating a source’s credibility, evaluating a source’s relevance, evaluating a source’s arguments, other interesting articles, frequently asked questions about evaluating sources.

Evaluating the credibility of a source is an important way of sifting out misinformation and determining whether you should use it in your research. Useful approaches include the CRAAP test and lateral reading .

One of the best ways to evaluate source credibility is the CRAAP test . This stands for:

• Currency: Does the source reflect recent research?
• Relevance: Is the source related to your research topic?
• Authority: Is it a respected publication? Is the author an expert in their field?
• Accuracy: Does the source support its arguments and conclusions with evidence?
• Purpose: What is the author’s intention?

How you evaluate a source using these criteria will depend on your subject and focus. It’s important to understand the types of sources and how you should use them in your field of research.

Lateral reading

Lateral reading is the act of evaluating the credibility of a source by comparing it to other sources. This allows you to:

• Verify evidence
• Contextualize information
• Find potential weaknesses

If a source is using methods or drawing conclusions that are incompatible with other research in its field, it may not be reliable.

Rather than taking these figures at face value, you decide to determine the accuracy of the source’s claims by cross-checking them with official statistics such as census reports and figures compiled by the Department of Homeland Security’s Office of Immigration Statistics.

The only proofreading tool specialized in correcting academic writing - try for free!

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

Try for free

How you evaluate the relevance of a source will depend on your topic, and on where you are in the research process . Preliminary evaluation helps you to pick out relevant sources in your search, while in-depth evaluation allows you to understand how they’re related.

Preliminary evaluation

As you cannot possibly read every source related to your topic, you can use preliminary evaluation to determine which sources might be relevant. This is especially important when you’re surveying a large number of sources (e.g., in a literature review or systematic review ).

One way to do this is to look at paratextual material, or the parts of a work other than the text itself.

• Look at the table of contents to determine the scope of the work.
• Consult the index for key terms or the names of important scholars.

You can also read abstracts , prefaces , introductions , and conclusions . These will give you a clear idea of the author’s intentions, the parameters of the research, and even the conclusions they draw.

Preliminary evaluation is useful as it allows you to:

• Determine whether a source is worth examining in more depth
• Quickly move on to more relevant sources
• Increase the quality of the information you consume

While this preliminary evaluation is an important step in the research process, you should engage with sources more deeply in order to adequately understand them.

In-depth evaluation

Begin your in-depth evaluation with any landmark studies in your field of research, or with sources that you’re sure are related to your research topic.

As you read, try to understand the connections between the sources. Look for:

• Key debates: What topics or questions are currently influencing research? How does the source respond to these key debates?
• Major publications or critics: Are there any specific texts or scholars that have greatly influenced the field? How does the source engage with them?
• Trends: Is the field currently dominated by particular theories or research methods ? How does the source respond to these?
• Gaps: Are there any oversights or weaknesses in the research?

Even sources whose conclusions you disagree with can be relevant, as they can strengthen your argument by offering alternative perspectives.

Every source should contribute to the debate about its topic by taking a clear position. This position and the conclusions the author comes to should be supported by evidence from direct observation or from other sources.

Most sources will use a mix of primary and secondary sources to form an argument . It is important to consider how the author uses these sources. A good argument should be based on analysis and critique, and there should be a logical relationship between evidence and conclusions.

To assess an argument’s strengths and weaknesses, ask:

• Does the evidence support the claim?
• How does the author use evidence? What theories, methods, or models do they use?
• Could the evidence be used to draw other conclusions? Can it be interpreted differently?
• How does the author situate their argument in the field? Do they agree or disagree with other scholars? Do they confirm or challenge established knowledge?

Situating a source in relation to other sources ( lateral reading ) can help you determine whether the author’s arguments and conclusions are reliable and how you will respond to them in your own writing.

If you want to know more about ChatGPT, AI tools , citation , and plagiarism , make sure to check out some of our other articles with explanations and examples.

• ChatGPT vs human editor
• ChatGPT citations
• Is ChatGPT trustworthy?
• Using ChatGPT for your studies
• What is ChatGPT?
• Chicago style
• Paraphrasing

 Plagiarism

• Types of plagiarism
• Self-plagiarism
• Avoiding plagiarism
• Academic integrity
• Consequences of plagiarism
• Common knowledge

Prevent plagiarism. Run a free check.

As you cannot possibly read every source related to your topic, it’s important to evaluate sources to assess their relevance. Use preliminary evaluation to determine whether a source is worth examining in more depth.

This involves:

• Reading abstracts , prefaces, introductions , and conclusions
• Looking at the table of contents to determine the scope of the work
• Consulting the index for key terms or the names of important scholars

Lateral reading is the act of evaluating the credibility of a source by comparing it with other sources. This allows you to:

A credible source should pass the CRAAP test  and follow these guidelines:

• The information should be up to date and current.
• The author and publication should be a trusted authority on the subject you are researching.
• The sources the author cited should be easy to find, clear, and unbiased.
• For a web source, the URL and layout should signify that it is trustworthy.

The CRAAP test is an acronym to help you evaluate the credibility of a source you are considering using. It is an important component of information literacy .

The CRAAP test has five main components:

• Currency: Is the source up to date?
• Relevance: Is the source relevant to your research?
• Authority: Where is the source published? Who is the author? Are they considered reputable and trustworthy in their field?
• Accuracy: Is the source supported by evidence? Are the claims cited correctly?
• Purpose: What was the motive behind publishing this source?

Scholarly sources are written by experts in their field and are typically subjected to peer review . They are intended for a scholarly audience, include a full bibliography, and use scholarly or technical language. For these reasons, they are typically considered credible sources .

Popular sources like magazines and news articles are typically written by journalists. These types of sources usually don’t include a bibliography and are written for a popular, rather than academic, audience. They are not always reliable and may be written from a biased or uninformed perspective, but they can still be cited in some contexts.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

Ryan, E. (2023, May 31). Evaluating Sources | Methods & Examples. Scribbr. Retrieved April 15, 2024, from https://www.scribbr.com/working-with-sources/evaluating-sources/

Is this article helpful?

Eoghan Ryan

Other students also liked, student guide: information literacy | meaning & examples, types of sources explained | examples & tips, what are credible sources & how to spot them | examples, unlimited academic ai-proofreading.

✔ Document error-free in 5minutes ✔ Unlimited document corrections ✔ Specialized in correcting academic texts

• USC Libraries
• Research Guides

Organizing Your Social Sciences Research Paper

• Reading Research Effectively
• Purpose of Guide
• Design Flaws to Avoid
• Independent and Dependent Variables
• Glossary of Research Terms
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Applying Critical Thinking
• Choosing a Title
• Making an Outline
• Paragraph Development
• Research Process Video Series
• Executive Summary
• The C.A.R.S. Model
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tiertiary Sources
• Scholarly vs. Popular Publications
• Qualitative Methods
• Quantitative Methods
• Insiderness
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Generative AI and Writing
• USC Libraries Tutorials and Other Guides
• Bibliography

Reading a Scholarly Article or Research Paper

Identifying a research problem to investigate usually requires a preliminary search for and critical review of the literature in order to gain an understanding about how scholars have examined a topic. Scholars rarely structure research studies in a way that can be followed like a story; they are complex and detail-intensive and often written in a descriptive and conclusive narrative form. However, in the social and behavioral sciences, journal articles and stand-alone research reports are generally organized in a consistent format that makes it easier to compare and contrast studies and to interpret their contents.

General Reading Strategies

W hen you first read an article or research paper, focus on asking specific questions about each section. This strategy can help with overall comprehension and with understanding how the content relates [or does not relate] to the problem you want to investigate. As you review more and more studies, the process of understanding and critically evaluating the research will become easier because the content of what you review will begin to coalescence around common themes and patterns of analysis. Below are recommendations on how to read each section of a research paper effectively. Note that the sections to read are out of order from how you will find them organized in a journal article or research paper.

1.  Abstract

The abstract summarizes the background, methods, results, discussion, and conclusions of a scholarly article or research paper. Use the abstract to filter out sources that may have appeared useful when you began searching for information but, in reality, are not relevant. Questions to consider when reading the abstract are:

• Is this study related to my question or area of research?
• What is this study about and why is it being done ?
• What is the working hypothesis or underlying thesis?
• What is the primary finding of the study?
• Are there words or terminology that I can use to either narrow or broaden the parameters of my search for more information?

2.  Introduction

If, after reading the abstract, you believe the paper may be useful, focus on examining the research problem and identifying the questions the author is trying to address. This information is usually located within the first few paragraphs of the introduction or in the concluding paragraph. Look for information about how and in what way this relates to what you are investigating. In addition to the research problem, the introduction should provide the main argument and theoretical framework of the study and, in the last paragraphs of the introduction, describe what the author(s) intend to accomplish. Questions to consider when reading the introduction include:

• What is this study trying to prove or disprove?
• What is the author(s) trying to test or demonstrate?
• What do we already know about this topic and what gaps does this study try to fill or contribute a new understanding to the research problem?
• Why should I care about what is being investigated?
• Will this study tell me anything new related to the research problem I am investigating?

3.  Literature Review

The literature review describes and critically evaluates what is already known about a topic. Read the literature review to obtain a big picture perspective about how the topic has been studied and to begin the process of seeing where your potential study fits within the domain of prior research. Questions to consider when reading the literature review include:

• W hat other research has been conducted about this topic and what are the main themes that have emerged?
• What does prior research reveal about what is already known about the topic and what remains to be discovered?
• What have been the most important past findings about the research problem?
• How has prior research led the author(s) to conduct this particular study?
• Is there any prior research that is unique or groundbreaking?
• Are there any studies I could use as a model for designing and organizing my own study?

4.  Discussion/Conclusion

The discussion and conclusion are usually the last two sections of text in a scholarly article or research report. They reveal how the author(s) interpreted the findings of their research and presented recommendations or courses of action based on those findings. Often in the conclusion, the author(s) highlight recommendations for further research that can be used to develop your own study. Questions to consider when reading the discussion and conclusion sections include:

• What is the overall meaning of the study and why is this important? [i.e., how have the author(s) addressed the " So What? " question].
• What do you find to be the most important ways that the findings have been interpreted?
• What are the weaknesses in their argument?
• Do you believe conclusions about the significance of the study and its findings are valid?
• What limitations of the study do the author(s) describe and how might this help formulate my own research?
• Does the conclusion contain any recommendations for future research?

5.  Methods/Methodology

The methods section describes the materials, techniques, and procedures for gathering information used to examine the research problem. If what you have read so far closely supports your understanding of the topic, then move on to examining how the author(s) gathered information during the research process. Questions to consider when reading the methods section include:

• Did the study use qualitative [based on interviews, observations, content analysis], quantitative [based on statistical analysis], or a mixed-methods approach to examining the research problem?
• What was the type of information or data used?
• Could this method of analysis be repeated and can I adopt the same approach?
• Is enough information available to repeat the study or should new data be found to expand or improve understanding of the research problem?

6.  Results

After reading the above sections, you should have a clear understanding of the general findings of the study. Therefore, read the results section to identify how key findings were discussed in relation to the research problem. If any non-textual elements [e.g., graphs, charts, tables, etc.] are confusing, focus on the explanations about them in the text. Questions to consider when reading the results section include:

• W hat did the author(s) find and how did they find it?
• Does the author(s) highlight any findings as most significant?
• Are the results presented in a factual and unbiased way?
• Does the analysis of results in the discussion section agree with how the results are presented?
• Is all the data present and did the author(s) adequately address gaps?
• What conclusions do you formulate from this data and does it match with the author's conclusions?

7.  References

The references list the sources used by the author(s) to document what prior research and information was used when conducting the study. After reviewing the article or research paper, use the references to identify additional sources of information on the topic and to examine critically how these sources supported the overall research agenda. Questions to consider when reading the references include:

• Do the sources cited by the author(s) reflect a diversity of disciplinary viewpoints, i.e., are the sources all from a particular field of study or do the sources reflect multiple areas of study?
• Are there any unique or interesting sources that could be incorporated into my study?
• What other authors are respected in this field, i.e., who has multiple works cited or is cited most often by others?
• What other research should I review to clarify any remaining issues or that I need more information about?

NOTE :  A final strategy in reviewing research is to copy and paste the title of the source [journal article, book, research report] into Google Scholar . If it appears, look for a "cited by" followed by a hyperlinked number [e.g., Cited by 45]. This number indicates how many times the study has been subsequently cited in other, more recently published works. This strategy, known as citation tracking, can be an effective means of expanding your review of pertinent literature based on a study you have found useful and how scholars have cited it. The same strategies described above can be applied to reading articles you find in the list of cited by references.

Reading Tip

Specific Reading Strategies

Effectively reading scholarly research is an acquired skill that involves attention to detail and an ability to comprehend complex ideas, data, and theoretical concepts in a way that applies logically to the research problem you are investigating. Here are some specific reading strategies to consider.

As You are Reading

• Focus on information that is most relevant to the research problem; skim over the other parts.
• As noted above, read content out of order! This isn't a novel; you want to start with the spoiler to quickly assess the relevance of the study.
• Think critically about what you read and seek to build your own arguments; not everything may be entirely valid, examined effectively, or thoroughly investigated.
• Look up the definitions of unfamiliar words, concepts, or terminology. A good scholarly source is Credo Reference .

Taking notes as you read will save time when you go back to examine your sources. Here are some suggestions:

• Mark or highlight important text as you read [e.g., you can use the highlight text  feature in a PDF document]
• Take notes in the margins [e.g., Adobe Reader offers pop-up sticky notes].
• Highlight important quotations; consider using different colors to differentiate between quotes and other types of important text.
• Summarize key points about the study at the end of the paper. To save time, these can be in the form of a concise bulleted list of statements [e.g., intro has provides historical background; lit review has important sources; good conclusions].

Write down thoughts that come to mind that may help clarify your understanding of the research problem. Here are some examples of questions to ask yourself:

• Do I understand all of the terminology and key concepts?
• Do I understand the parts of this study most relevant to my topic?
• What specific problem does the research address and why is it important?
• Are there any issues or perspectives the author(s) did not consider?
• Do I have any reason to question the validity or reliability of this research?
• How do the findings relate to my research interests and to other works which I have read?

Adapted from text originally created by Holly Burt, Behavioral Sciences Librarian, USC Libraries, April 2018.

Another Reading Tip

When is it Important to Read the Entire Article or Research Paper

Laubepin argues, "Very few articles in a field are so important that every word needs to be read carefully." However, this implies that some studies are worth reading carefully. As painful and time-consuming as it may seem, there are valid reasons for reading a study in its entirety from beginning to end. Here are some examples:

• Studies Published Very Recently .  The author(s) of a recent, well written study will provide a survey of the most important or impactful prior research in the literature review section. This can establish an understanding of how scholars in the past addressed the research problem. In addition, the most recently published sources will highlight what is currently known and what gaps in understanding currently exist about a topic, usually in the form of the need for further research in the conclusion .
• Surveys of the Research Problem .  Some papers provide a comprehensive analytical overview of the research problem. Reading this type of study can help you understand underlying issues and discover why scholars have chosen to investigate the topic. This is particularly important if the study was published very recently because the author(s) should cite all or most of the key prior research on the topic. Note that, if it is a long-standing problem, there may be studies that specifically review the literature to identify gaps that remain. These studies often include the word review in their title [e.g., Hügel, Stephan, and Anna R. Davies. "Public Participation, Engagement, and Climate Change Adaptation: A Review of the Research Literature." Wiley Interdisciplinary Reviews: Climate Change 11 (July-August 2020): https://doi.org/10.1002/ wcc.645].
• Highly Cited .  If you keep coming across the same citation to a study while you are reviewing the literature, this implies it was foundational in establishing an understanding of the research problem or the study had a significant impact within the literature [positive or negative]. Carefully reading a highly cited source can help you understand how the topic emerged and motivated scholars to further investigate the problem. It also could be a study you need to cite as foundational in your own paper to demonstrate to the reader that you understand the roots of the problem.
• Historical Overview .  Knowing the historical background of a research problem may not be the focus of your analysis. Nevertheless, carefully reading a study that provides a thorough description and analysis of the history behind an event, issue, or phenomenon can add important context to understanding the topic and what aspect of the problem you may want to examine further.
• Innovative Methodological Design .  Some studies are significant and worth reading in their entirety because the author(s) designed a unique or innovative approach to researching the problem. This may justify reading the entire study because it can motivate you to think creatively about pursuing an alternative or non-traditional approach to examining your topic of interest. These types of studies are generally easy to identify because they are often cited in others works because of their unique approach to studying the research problem.
• Cross-disciplinary Approach .  R eviewing studies produced outside of your discipline is an essential component of investigating research problems in the social and behavioral sciences. Consider reading a study that was conducted by author(s) based in a different discipline [e.g., an anthropologist studying political cultures; a study of hiring practices in companies published in a sociology journal]. This approach can generate a new understanding or a unique perspective about the topic . If you are not sure how to search for studies published in a discipline outside of your major or of the course you are taking, contact a librarian for assistance.

Laubepin, Frederique. How to Read (and Understand) a Social Science Journal Article . Inter-University Consortium for Political and Social Research (ISPSR), 2013; Shon, Phillip Chong Ho. How to Read Journal Articles in the Social Sciences: A Very Practical Guide for Students . 2nd edition. Thousand Oaks, CA: Sage, 2015; Lockhart, Tara, and Mary Soliday. "The Critical Place of Reading in Writing Transfer (and Beyond): A Report of Student Experiences." Pedagogy 16 (2016): 23-37; Maguire, Moira, Ann Everitt Reynolds, and Brid Delahunt. "Reading to Be: The Role of Academic Reading in Emergent Academic and Professional Student Identities." Journal of University Teaching and Learning Practice 17 (2020): 5-12.

• << Previous: 1. Choosing a Research Problem
• Next: Narrowing a Topic Idea >>
• Last Updated: Apr 16, 2024 10:20 AM
• URL: https://libguides.usc.edu/writingguide

Evaluating Research Articles

Understanding research statistics, critical appraisal.

Imagine for a moment that you are trying to answer a clinical (PICO) question regarding one of your patients/clients. Do you know how to determine if a research study is of high quality? Can you tell if it is applicable to your question? In evidence based practice, there are many things to look for in an article that will reveal its quality and relevance. This guide is a collection of resources and activities that will help you learn how to evaluate articles efficiently and accurately.

Is health research new to you? Or perhaps you're a little out of practice with reading it? The following questions will help illuminate an article's strengths or shortcomings. Ask them of yourself as you are reading an article:

• Is the article peer reviewed?
• Are there any conflicts of interest based on the author's affiliation or the funding source of the research?
• Are the research questions or objectives clearly defined?
• Is the study a systematic review or meta analysis?
• Is the study design appropriate for the research question?
• Is the sample size justified? Do the authors explain how it is representative of the wider population?
• Do the researchers describe the setting of data collection?
• Does the paper clearly describe the measurements used?
• Did the researchers use appropriate statistical measures?
• Are the research questions or objectives answered?
• Did the researchers account for confounding factors?
• Have the researchers only drawn conclusions about the groups represented in the research?
• Have the authors declared any conflicts of interest?

If the answer to these questions about an article you are reading are mostly YESes , then it's likely that the article is of decent quality. If the answers are most NOs , then it may be a good idea to move on to another article. If the YESes and NOs are roughly even, you'll have to decide for yourself if the article is good enough quality for you. Some factors, like a poor literature review, are not as important as the researchers neglecting to describe the measurements they used. As you read more research, you'll be able to more easily identify research that is well done vs. that which is not well done.

Determining if a research study has used appropriate statistical measures is one of the most critical and difficult steps in evaluating an article. The following links are great, quick resources for helping to better understand how to use statistics in health research.

• How to read a paper: Statistics for the non-statistician. II: “Significant” relations and their pitfalls This article continues the checklist of questions that will help you to appraise the statistical validity of a paper. Greenhalgh Trisha. How to read a paper: Statistics for the non-statistician. II: “Significant” relations and their pitfalls BMJ 1997; 315 :422 *On the PMC PDF, you need to scroll past the first article to get to this one.*
• A consumer's guide to subgroup analysis The extent to which a clinician should believe and act on the results of subgroup analyses of data from randomized trials or meta-analyses is controversial. Guidelines are provided in this paper for making these decisions.

Statistical Versus Clinical Significance

When appraising studies, it's important to consider both the clinical and statistical significance of the research. This video offers a quick explanation of why.

If you have a little more time, this video explores statistical and clinical significance in more detail, including examples of how to calculate an effect size.

• Statistical vs. Clinical Significance Transcript Transcript document for the Statistical vs. Clinical Significance video.
• Effect Size Transcript Transcript document for the Effect Size video.
• P Values, Statistical Significance & Clinical Significance This handout also explains clinical and statistical significance.
• Absolute versus relative risk – making sense of media stories Understanding the difference between relative and absolute risk is essential to understanding statistical tests commonly found in research articles.

Critical appraisal is the process of systematically evaluating research using established and transparent methods. In critical appraisal, health professionals use validated checklists/worksheets as tools to guide their assessment of the research. It is a more advanced way of evaluating research than the more basic method explained above. To learn more about critical appraisal or to access critical appraisal tools, visit the websites below.

• Last Updated: Mar 19, 2024 1:28 PM
• URL: https://libguides.massgeneral.org/evaluatingarticles

• Library databases
• Library website

Evaluating Resources: Research Articles

Research articles.

A research article is a journal article in which the authors report on the research they did. Research articles are always primary sources. Whether or not a research article is peer reviewed depends on the journal that publishes it.

Published research articles follow a predictable pattern and will contain most, if not all, of the sections listed below. However, the names for these sections may vary.

• Title & Author(s)
• Introduction
• Methodology

To learn about the different parts of a research article, please view this tutorial:

Short video: How to Read Scholarly Articles

Learn some tips on how to efficiently read scholarly articles.

Video: How to Read a Scholarly Article

(4 min 16 sec) Recorded August 2019 Transcript 

More information

The Academic Skills Center and the Writing Center both have helpful resources on critical and academic reading that can further help you understand and evaluate research articles.

• Academic Skills Center Guide: Developing Your Reading Skills
• Academic Skills Center Webinar Archive: Savvy Strategies for Academic Reading
• Writing Center Podcast: WriteCast Episode 5: Five Strategies for Critical Reading

If you'd like to learn how to find research articles in the Library, you can view this Quick Answer.

• Quick Answer: How do I find research articles?
• Previous Page: Primary & Secondary Sources
• Office of Student Disability Services

Walden Resources

Departments.

• Academic Residencies
• Academic Skills
• Career Planning and Development
• Customer Care Team
• Field Experience
• Military Services
• Student Success Advising
• Writing Skills

Centers and Offices

• Center for Social Change
• Office of Academic Support and Instructional Services
• Office of Degree Acceleration
• Office of Research and Doctoral Services
• Office of Student Affairs

Student Resources

• Doctoral Writing Assessment
• Form & Style Review
• Quick Answers
• ScholarWorks
• SKIL Courses and Workshops
• Walden Bookstore
• Walden Catalog & Student Handbook
• Student Safety/Title IX
• Legal & Consumer Information
• Website Terms and Conditions
• Cookie Policy
• Accessibility
• Accreditation
• State Authorization
• Net Price Calculator
• Contact Walden

Walden University is a member of Adtalem Global Education, Inc. www.adtalem.com Walden University is certified to operate by SCHEV © 2024 Walden University LLC. All rights reserved.

• Privacy Policy

Buy Me a Coffee

Home » Evaluating Research – Process, Examples and Methods

Evaluating Research – Process, Examples and Methods

Table of Contents

Evaluating Research

Definition:

Evaluating Research refers to the process of assessing the quality, credibility, and relevance of a research study or project. This involves examining the methods, data, and results of the research in order to determine its validity, reliability, and usefulness. Evaluating research can be done by both experts and non-experts in the field, and involves critical thinking, analysis, and interpretation of the research findings.

Research Evaluating Process

The process of evaluating research typically involves the following steps:

Identify the Research Question

The first step in evaluating research is to identify the research question or problem that the study is addressing. This will help you to determine whether the study is relevant to your needs.

Assess the Study Design

The study design refers to the methodology used to conduct the research. You should assess whether the study design is appropriate for the research question and whether it is likely to produce reliable and valid results.

Evaluate the Sample

The sample refers to the group of participants or subjects who are included in the study. You should evaluate whether the sample size is adequate and whether the participants are representative of the population under study.

Review the Data Collection Methods

You should review the data collection methods used in the study to ensure that they are valid and reliable. This includes assessing the measures used to collect data and the procedures used to collect data.

Examine the Statistical Analysis

Statistical analysis refers to the methods used to analyze the data. You should examine whether the statistical analysis is appropriate for the research question and whether it is likely to produce valid and reliable results.

Assess the Conclusions

You should evaluate whether the data support the conclusions drawn from the study and whether they are relevant to the research question.

Consider the Limitations

Finally, you should consider the limitations of the study, including any potential biases or confounding factors that may have influenced the results.

Evaluating Research Methods

Evaluating Research Methods are as follows:

• Peer review: Peer review is a process where experts in the field review a study before it is published. This helps ensure that the study is accurate, valid, and relevant to the field.
• Critical appraisal : Critical appraisal involves systematically evaluating a study based on specific criteria. This helps assess the quality of the study and the reliability of the findings.
• Replication : Replication involves repeating a study to test the validity and reliability of the findings. This can help identify any errors or biases in the original study.
• Meta-analysis : Meta-analysis is a statistical method that combines the results of multiple studies to provide a more comprehensive understanding of a particular topic. This can help identify patterns or inconsistencies across studies.
• Consultation with experts : Consulting with experts in the field can provide valuable insights into the quality and relevance of a study. Experts can also help identify potential limitations or biases in the study.
• Review of funding sources: Examining the funding sources of a study can help identify any potential conflicts of interest or biases that may have influenced the study design or interpretation of results.

Example of Evaluating Research

Example of Evaluating Research sample for students:

Title of the Study: The Effects of Social Media Use on Mental Health among College Students

Sample Size: 500 college students

Sampling Technique : Convenience sampling

• Sample Size: The sample size of 500 college students is a moderate sample size, which could be considered representative of the college student population. However, it would be more representative if the sample size was larger, or if a random sampling technique was used.
• Sampling Technique : Convenience sampling is a non-probability sampling technique, which means that the sample may not be representative of the population. This technique may introduce bias into the study since the participants are self-selected and may not be representative of the entire college student population. Therefore, the results of this study may not be generalizable to other populations.
• Participant Characteristics: The study does not provide any information about the demographic characteristics of the participants, such as age, gender, race, or socioeconomic status. This information is important because social media use and mental health may vary among different demographic groups.
• Data Collection Method: The study used a self-administered survey to collect data. Self-administered surveys may be subject to response bias and may not accurately reflect participants’ actual behaviors and experiences.
• Data Analysis: The study used descriptive statistics and regression analysis to analyze the data. Descriptive statistics provide a summary of the data, while regression analysis is used to examine the relationship between two or more variables. However, the study did not provide information about the statistical significance of the results or the effect sizes.

Overall, while the study provides some insights into the relationship between social media use and mental health among college students, the use of a convenience sampling technique and the lack of information about participant characteristics limit the generalizability of the findings. In addition, the use of self-administered surveys may introduce bias into the study, and the lack of information about the statistical significance of the results limits the interpretation of the findings.

Note*: Above mentioned example is just a sample for students. Do not copy and paste directly into your assignment. Kindly do your own research for academic purposes.

Applications of Evaluating Research

Here are some of the applications of evaluating research:

• Identifying reliable sources : By evaluating research, researchers, students, and other professionals can identify the most reliable sources of information to use in their work. They can determine the quality of research studies, including the methodology, sample size, data analysis, and conclusions.
• Validating findings: Evaluating research can help to validate findings from previous studies. By examining the methodology and results of a study, researchers can determine if the findings are reliable and if they can be used to inform future research.
• Identifying knowledge gaps: Evaluating research can also help to identify gaps in current knowledge. By examining the existing literature on a topic, researchers can determine areas where more research is needed, and they can design studies to address these gaps.
• Improving research quality : Evaluating research can help to improve the quality of future research. By examining the strengths and weaknesses of previous studies, researchers can design better studies and avoid common pitfalls.
• Informing policy and decision-making : Evaluating research is crucial in informing policy and decision-making in many fields. By examining the evidence base for a particular issue, policymakers can make informed decisions that are supported by the best available evidence.
• Enhancing education : Evaluating research is essential in enhancing education. Educators can use research findings to improve teaching methods, curriculum development, and student outcomes.

Purpose of Evaluating Research

Here are some of the key purposes of evaluating research:

• Determine the reliability and validity of research findings : By evaluating research, researchers can determine the quality of the study design, data collection, and analysis. They can determine whether the findings are reliable, valid, and generalizable to other populations.
• Identify the strengths and weaknesses of research studies: Evaluating research helps to identify the strengths and weaknesses of research studies, including potential biases, confounding factors, and limitations. This information can help researchers to design better studies in the future.
• Inform evidence-based decision-making: Evaluating research is crucial in informing evidence-based decision-making in many fields, including healthcare, education, and public policy. Policymakers, educators, and clinicians rely on research evidence to make informed decisions.
• Identify research gaps : By evaluating research, researchers can identify gaps in the existing literature and design studies to address these gaps. This process can help to advance knowledge and improve the quality of research in a particular field.
• Ensure research ethics and integrity : Evaluating research helps to ensure that research studies are conducted ethically and with integrity. Researchers must adhere to ethical guidelines to protect the welfare and rights of study participants and to maintain the trust of the public.

Characteristics Evaluating Research

Characteristics Evaluating Research are as follows:

• Research question/hypothesis: A good research question or hypothesis should be clear, concise, and well-defined. It should address a significant problem or issue in the field and be grounded in relevant theory or prior research.
• Study design: The research design should be appropriate for answering the research question and be clearly described in the study. The study design should also minimize bias and confounding variables.
• Sampling : The sample should be representative of the population of interest and the sampling method should be appropriate for the research question and study design.
• Data collection : The data collection methods should be reliable and valid, and the data should be accurately recorded and analyzed.
• Results : The results should be presented clearly and accurately, and the statistical analysis should be appropriate for the research question and study design.
• Interpretation of results : The interpretation of the results should be based on the data and not influenced by personal biases or preconceptions.
• Generalizability: The study findings should be generalizable to the population of interest and relevant to other settings or contexts.
• Contribution to the field : The study should make a significant contribution to the field and advance our understanding of the research question or issue.

Advantages of Evaluating Research

Evaluating research has several advantages, including:

• Ensuring accuracy and validity : By evaluating research, we can ensure that the research is accurate, valid, and reliable. This ensures that the findings are trustworthy and can be used to inform decision-making.
• Identifying gaps in knowledge : Evaluating research can help identify gaps in knowledge and areas where further research is needed. This can guide future research and help build a stronger evidence base.
• Promoting critical thinking: Evaluating research requires critical thinking skills, which can be applied in other areas of life. By evaluating research, individuals can develop their critical thinking skills and become more discerning consumers of information.
• Improving the quality of research : Evaluating research can help improve the quality of research by identifying areas where improvements can be made. This can lead to more rigorous research methods and better-quality research.
• Informing decision-making: By evaluating research, we can make informed decisions based on the evidence. This is particularly important in fields such as medicine and public health, where decisions can have significant consequences.
• Advancing the field : Evaluating research can help advance the field by identifying new research questions and areas of inquiry. This can lead to the development of new theories and the refinement of existing ones.

Limitations of Evaluating Research

Limitations of Evaluating Research are as follows:

• Time-consuming: Evaluating research can be time-consuming, particularly if the study is complex or requires specialized knowledge. This can be a barrier for individuals who are not experts in the field or who have limited time.
• Subjectivity : Evaluating research can be subjective, as different individuals may have different interpretations of the same study. This can lead to inconsistencies in the evaluation process and make it difficult to compare studies.
• Limited generalizability: The findings of a study may not be generalizable to other populations or contexts. This limits the usefulness of the study and may make it difficult to apply the findings to other settings.
• Publication bias: Research that does not find significant results may be less likely to be published, which can create a bias in the published literature. This can limit the amount of information available for evaluation.
• Lack of transparency: Some studies may not provide enough detail about their methods or results, making it difficult to evaluate their quality or validity.
• Funding bias : Research funded by particular organizations or industries may be biased towards the interests of the funder. This can influence the study design, methods, and interpretation of results.

About the author

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Data Collection – Methods Types and Examples

Delimitations in Research – Types, Examples and...

Research Process – Steps, Examples and Tips

Research Design – Types, Methods and Examples

Institutional Review Board – Application Sample...

Research Questions – Types, Examples and Writing...

How to Read a Research Article: How to Read a Research Article

How to read an original research article.

An "original research article" reports the results of an original research study. It is sometimes called a primary research article. The article also looks at how the study adds knowledge to what is already known. 

When you start reading a scientific research article it will help if you understand what is included in the different sections and what you should look for.

Read and Evaluate the Abstract

The abstract aims be a concise summary of the article. It should describe the focus, study results and conclusion(s) presented in the article. The abstract can help you decide if the article is relevant to your assignment.

Is the Article Current Enough for Your Assignment?

It is hard to set hard and fast rules on how recent your article needs to be. The lecturer will often expect you to find information from the last few years, but you might want to include an older landmark study in your assignment.  

You need to decide if the article is: up-to-date; out-of-date or timeless.

Journal Quality, Author Credential, Funding Bodies and Ethics

Before you read the rest of the article you might want to see if the article is peer-reviewed. You can use  Ulrichsweb Global Serials Directory to look up the title of the journal where the article is published. If the journal is peer-reviewed, then the articles within it will be peer-reviewed. 

At this stage you might also look at the authors of the article. What are the authors' qualifications, their work experience and affiliations? Are they employed by a university, government organisation, NGO or by an industry organisation? How do you think their employment can influence their research?

You should also think about who funded the research. Do you trust research conducted by industry or an interest group as much as research conducted by a university or a government organisation?

Another consideration is if the research has an ethics approval. If the study affects humans or animals the authors needs to examine the ethical impact of the research. A research article should include a statement about who granted the ethics approval. If the research involved humans the article also has to state that the participants gave informed consent to participate in the research. If the research didn't need an ethics approval it should include a statement that explains why it was not needed.

Introduction   and Literature Review

The introduction explains to you what the study is about and why it is important, unique or how it adds to existing knowledge in the field. The research question (the hypothesis) is also outlined in the introduction.

A research article also includes a literature review of previous research.  This review should help you understand what is already known about the topic and what is left to discover. It should also clarify why the research in this article is unique. 

Before you continue reading the article you need to think about how this article can help you with your own assignment or research.

Methodology / Materials and Methods

In this section the authors explain how they conducted the research. The methodology should include enough information so that the research could be repeated.

You should be able to find out if it was a qualitative or quantitative project, or if it was a combination of both. Do you understand the terminology or do you need to look the terms up? 

Another important question to ask is how large the study was? Small studies can give skewed results, but they can also give directions and ideas for further research. 

Did the study include a control group? Did it need to?

Results and Analysis

This section the authors explains the research findings. These findings are then analysed. 

You need to make sure you understand results. The data and statistical results are presented in tables, charts, or graphs. To help you understand the graphs and statistics read the explanations or labels carefully.

Questions to consider: 

• What did the study find?
• Are the results presented in a factual and unbiased way?
• Do you think some data are missing?
• Do you think their analysis reflects the research data?
• Do your conclusion match what the authors' conclusion?

Discussion / Analysis

In the discussion the authors analyse their data and explain what was significant about the results.

In the final section the authors discuss the strength and weaknesses of the study. They will discuss if the result was what they predicted when planning the research. Recommendations for future research are also included in this section.

The Bibliography or Reference List

An important part of writing a research article is to acknowledge our sources. You can use the reference list to find other articles on the topic.

Further readings:

Subramanyam, R. V. (2013). Art of reading a journal article: Methodically and effectively. Journal of Oral & Maxillofacial Pathology (0973029X), 17(1), 65-70. doi: 10.4103/0973-029X.110733

How to evaluate a review paper

Review papers summarise and evaluate the current knowledge on a selected topic. The three most common types of review articles are: Narrative reviews; systematic reviews or meta-analysis. The article below can help you read and evaluate a review article.

Callcut, R. A., & Branson, R. D. (2009). How to read a review paper. Respiratory Care, 54(10), 1379-1385. Retrieved from http://ezproxy.csu.edu.au/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=rzh&AN=105328053&site=ehost-live .  

Understanding health research

Understanding Health Research: A Tool for Making Sense of Health Studies 

This site from UK helps you interpret and evaluate a published health research paper.

The Review a Study module guides you through a series of questions about a piece of research you have found, and helps you to evaluate the quality of the research.

The Useful Information Page will help you understand the some of different terminology and concepts used in health research.

Evidence Based Practice Learning Modules from NSW Health

These Learning Modules have been developed to support NSW Health clinicians gain skills to integrate the best available evidence into practice. Each Learning Module covers a different aspects of Evidence-Based Practice (EBP).

Qualitative and quantitative research

The different types of academic articles

Original or Primary Research Article

These articles are reports of original research. They include hypothesis, a short literature review, methods, results, interpretation of findings, and a discussion of possible implications. 

Review Article

Review articles provide a summary and an evaluation of research on a topic. The review will also identify gaps in knowledge, which will help identify further research that needs to be done. 

A case study is a research method that involves an in-depth, detailed examination of an organisation, event, action, or person over a defined period of time.

Clinical Trial

Clinical trials are research investigations in which people volunteer to test new treatments, interventions or tests as a means to prevent, detect, treat or manage various diseases or medical conditions. 

Methodologies or Methods

These articles present an experimental method, test or procedure. 

Perspective, opinion, and commentary

These scholarly articles express a personal opinion or a new perspective about existing research on a particular topic. 

• Last Updated: Dec 19, 2023 12:07 PM
• URL: https://libguides.csu.edu.au/researcharticle

Charles Sturt University is an Australian University, TEQSA Provider Identification: PRV12018. CRICOS Provider: 00005F.

info This is a space for the teal alert bar.

notifications This is a space for the yellow alert bar.

Research Process

• Brainstorming
• Explore Google This link opens in a new window
• Explore Web Resources
• Explore Background Information
• Explore Books
• Explore Scholarly Articles
• Narrowing a Topic
• Primary and Secondary Resources
• Academic, Popular & Trade Publications
• Scholarly and Peer-Reviewed Journals
• Grey Literature
• Clinical Trials
• Evidence Based Treatment
• Scholarly Research
• Database Research Log
• Search Limits
• Keyword Searching
• Boolean Operators
• Phrase Searching
• Truncation & Wildcard Symbols
• Proximity Searching
• Field Codes
• Subject Terms and Database Thesauri

Reading a Scientific Article

• Website Evaluation
• Article Keywords and Subject Terms
• Cited References
• Citing Articles
• Related Results
• Search Within Publication
• Database Alerts & RSS Feeds
• Personal Database Accounts
• Persistent URLs
• Literature Gap and Future Research
• Web of Knowledge
• Annual Reviews
• Systematic Reviews & Meta-Analyses
• Finding Seminal Works
• Exhausting the Literature
• Finding Dissertations
• Researching Theoretical Frameworks
• Research Methodology & Design
• Tests and Measurements
• Organizing Research & Citations This link opens in a new window
• Scholarly Publication
• Learn the Library This link opens in a new window

Library Tutorial

• Reading a Scholarly Article Tutorial This interactive tutorial provides practice reading a scholarly or scientific article.

Additional Resources

• Anatomy of a Scholarly Article
• How to Read (and Understand) a Social Science Journal Article
• How to Read a Scientific Paper
• How to Read a Scientific Paper Interactive Tutorial
• How to Read Scientific Literature (YouTube Video)

General Dictionaries

• The American Heritage Dictionary of the English Language
• The American Heritage Student Science Dictionary
• The Chambers Dictionary
• Dictionary.com
• The Free Dictionary
• Merriam-Webster's Collegiate Dictionary
• Merriam-Webster Online
• The Penguin English Dictionary
• The Science Dictionary

Attempting to read a scientific or scholarly research article for the first time may seem overwhelming and confusing. This guide details how to read a scientific article step-by-step. First, you should not approach a scientific article like a textbook— reading from beginning to end of the chapter or book without pause for reflection or criticism. Additionally, it is highly recommended that you highlight and take notes as you move through the article. Taking notes will keep you focused on the task at hand and help you work towards comprehension of the entire article.

• Skim the article. This should only take you a few minutes. You are not trying to comprehend the entire article at this point, but just get a basic overview. You don’t have to read in order; the discussion/conclusions will help you to determine if the article is relevant to your research. You might then continue on to the Introduction. Pay attention to the structure of the article, headings, and figures.  
• Grasp the vocabulary. Begin to go through the article and highlight words and phrases you do not understand. Some words or phrases you may be able to get an understanding from the context in which it is used, but for others you may need the assistance of a medical or scientific dictionary. Subject-specific dictionaries available through our Library databases and online are listed below.  
• The abstract gives a quick overview of the article. It will usually contain four pieces of information: purpose or rationale of study (why they did it); methodology (how they did it); results (what they found); conclusion (what it means). Begin by reading the abstract to make sure this is what you are looking for and that it will be worth your time and effort.   
• The introduction gives background information about the topic and sets out specific questions to be addressed by the authors. You can skim through the introduction if you are already familiar with the paper’s topic.  
• The methods section gives technical details of how the experiments were carried out and serves as a “how-to” manual if you wanted to replicate the same experiments as the authors. This is another section you may want to only skim unless you wish to identify the methods used by the researchers or if you intend to replicate the research yourself.  
• The results are the meat of the scientific article and contain all of the data from the experiments. You should spend time looking at all the graphs, pictures, and tables as these figures will contain most of the data.  
• Lastly, the discussion is the authors’ opportunity to give their opinions. Keep in mind that the discussions are the authors’ interpretations and not necessarily facts. It is still a good place for you to get ideas about what kind of research questions are still unanswered in the field and what types of questions you might want your own research project to tackle. (See the Future Research Section of the Research Process for more information).  
•   Read the bibliography/references section. Reading the references or works cited may lead you to other useful resources. You might also get a better understanding of the basic terminology, main concepts, major researchers, and basic terminology in the area you are researching.  
• Have I taken time to understand all the terminology?
• Am I spending too much time on the less important parts of this article?
• Do I have any reason to question the credibility of this research?
• What specific problem does the research address and why is it important?
• How do these results relate to my research interests or to other works which I have read?  
• Read the article a second time in chronological order. Reading the article a second time will reinforce your overall understanding. You may even start to make connections to other articles that you have read on this topic.

Reading a Scholarly Article Workshop

This workshop presents effective techniques for reading and understanding a scholarly article, as well as locating definitions related to your research topic.

Subject-Specific Dictionaries

• Health Sciences
• Marriage & Family Science
• Research Methods
• Social Work

Was this resource helpful?

• << Previous: Subject Terms and Database Thesauri
• Next: Evaluating Information >>
• Last Updated: Apr 14, 2024 12:14 PM
• URL: https://resources.nu.edu/researchprocess

© Copyright 2024 National University. All Rights Reserved.

Privacy Policy | Consumer Information

• How To Find Articles with Databases
• How To Evaluate Articles
• How To Read A Scientific Paper
• How To Interpret Data
• How To Write A Lab Report
• How To Write A Scientific Paper
• Get More Help
• Reference: Encyclopedia, Handbooks & Dictionaries
• Research Tools: Databases, Protocols & Citation Locators
• E-Journal Lists by Subject
• Scholarly vs Popular
• Search Tips
• Open Resources
• E-Journal lists by subject
• Develop a Research Question

Useful Sources

• How to Critically Evaluate the Quality of a Research Article?
• How to Evaluate Journal Articles

Evaluating Articles

Not all articles are created equally. Evaluating sources for relevancy and usefulness is one the most important steps in research. This helps researchers in the STEM disciplines to gather the information they need. There are several tools to use when evaluating an article. 

• Purposes can include persuasion, informing, or proving something to the reader. Depending on the topic of your paper, you will want to evaluate the article's purpose to support your own position. 

Publication

• Most sources for college papers should come from scholarly journals. Scholarly journals are journals that are peer-reviewed before publication. This means that experts in the field read and approve the material in the article before it is published.
• The date of publication is especially relevant to those in the STEM disciplines. Research in science, technology, engineering, and mathematics moves very quickly, so have an article that was published recently will be more useful. 
• Many universities operate their own press, Indiana University included! Books and articles that are published by a reputable institution are generally accepted as valuable information. Other notable presses included Harvard University Press and The MIT Press. 
• Good sources of information come from experts in the field. This is called authority. Many times these individuals will be employed at research institutions such as universities, labs, or founded associations. 
• Many times, authors with authority have written more than one article about a topic in their field. Not only does this add support to their reputation, but can also be a great source for more articles. 
• Citation is a great indicator to the effectiveness of the article. If other experts are citing the article, it is a good sign this source is trusted and relevant. 

Bibliography

• Scholarly works will always contain a bibliography of the sources used. Trusted articles will have sources that are also scholarly in nature and authored by individuals with authority in their field. 
• Much like evaluating the publication of an article, the bibliography of the source should also contain sources that are up-to-date. 
• << Previous: How To Find Articles with Databases
• Next: How To Read A Scientific Paper >>
• Last Updated: Mar 8, 2024 2:26 PM
• URL: https://guides.libraries.indiana.edu/STEM

Social media

• Instagram for Herman B Wells Library
• Facebook for IU Libraries

Additional resources

Featured databases.

• Resource available to authorized IU Bloomington users (on or off campus) OneSearch@IU
• Resource available to authorized IU Bloomington users (on or off campus) Academic Search (EBSCO)
• Resource available to authorized IU Bloomington users (on or off campus) ERIC (EBSCO)
• Resource available to authorized IU Bloomington users (on or off campus) Nexis Uni
• Resource available without restriction HathiTrust Digital Library
• Databases A-Z
• Resource available to authorized IU Bloomington users (on or off campus) Google Scholar
• Resource available to authorized IU Bloomington users (on or off campus) JSTOR
• Resource available to authorized IU Bloomington users (on or off campus) Web of Science
• Resource available to authorized IU Bloomington users (on or off campus) Scopus
• Resource available to authorized IU Bloomington users (on or off campus) WorldCat

IU Libraries

• Diversity Resources
• About IU Libraries
• Alumni & Friends
• Departments & Staff
• Jobs & Libraries HR
• Intranet (Staff)
• IUL site admin

Loading metrics

Open Access

Ten simple rules for reading a scientific paper

* E-mail: [email protected]

Affiliation Division of Infectious Diseases and International Health, Department of Medicine, University of Virginia School of Medicine, Charlottesville, Virginia, United States of America

• Maureen A. Carey, 
• Kevin L. Steiner, 
• William A. Petri Jr

Published: July 30, 2020

• https://doi.org/10.1371/journal.pcbi.1008032
• Reader Comments

Citation: Carey MA, Steiner KL, Petri WA Jr (2020) Ten simple rules for reading a scientific paper. PLoS Comput Biol 16(7): e1008032. https://doi.org/10.1371/journal.pcbi.1008032

Editor: Scott Markel, Dassault Systemes BIOVIA, UNITED STATES

Copyright: © 2020 Carey et al. This is an open access article distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Funding: MAC was supported by the PhRMA Foundation's Postdoctoral Fellowship in Translational Medicine and Therapeutics and the University of Virginia's Engineering-in-Medicine seed grant, and KLS was supported by the NIH T32 Global Biothreats Training Program at the University of Virginia (AI055432). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

“There is no problem that a library card can't solve” according to author Eleanor Brown [ 1 ]. This advice is sound, probably for both life and science, but even the best tool (like the library) is most effective when accompanied by instructions and a basic understanding of how and when to use it.

For many budding scientists, the first day in a new lab setting often involves a stack of papers, an email full of links to pertinent articles, or some promise of a richer understanding so long as one reads enough of the scientific literature. However, the purpose and approach to reading a scientific article is unlike that of reading a news story, novel, or even a textbook and can initially seem unapproachable. Having good habits for reading scientific literature is key to setting oneself up for success, identifying new research questions, and filling in the gaps in one’s current understanding; developing these good habits is the first crucial step.

Advice typically centers around two main tips: read actively and read often. However, active reading, or reading with an intent to understand, is both a learned skill and a level of effort. Although there is no one best way to do this, we present 10 simple rules, relevant to novices and seasoned scientists alike, to teach our strategy for active reading based on our experience as readers and as mentors of undergraduate and graduate researchers, medical students, fellows, and early career faculty. Rules 1–5 are big picture recommendations. Rules 6–8 relate to philosophy of reading. Rules 9–10 guide the “now what?” questions one should ask after reading and how to integrate what was learned into one’s own science.

Rule 1: Pick your reading goal

What you want to get out of an article should influence your approach to reading it. Table 1 includes a handful of example intentions and how you might prioritize different parts of the same article differently based on your goals as a reader.

• PPT PowerPoint slide
• PNG larger image
• TIFF original image

https://doi.org/10.1371/journal.pcbi.1008032.t001

Rule 2: Understand the author’s goal

In written communication, the reader and the writer are equally important. Both influence the final outcome: in this case, your scientific understanding! After identifying your goal, think about the author’s goal for sharing this project. This will help you interpret the data and understand the author’s interpretation of the data. However, this requires some understanding of who the author(s) are (e.g., what are their scientific interests?), the scientific field in which they work (e.g., what techniques are available in this field?), and how this paper fits into the author’s research (e.g., is this work building on an author’s longstanding project or controversial idea?). This information may be hard to glean without experience and a history of reading. But don’t let this be a discouragement to starting the process; it is by the act of reading that this experience is gained!

A good step toward understanding the goal of the author(s) is to ask yourself: What kind of article is this? Journals publish different types of articles, including methods, review, commentary, resources, and research articles as well as other types that are specific to a particular journal or groups of journals. These article types have different formatting requirements and expectations for content. Knowing the article type will help guide your evaluation of the information presented. Is the article a methods paper, presenting a new technique? Is the article a review article, intended to summarize a field or problem? Is it a commentary, intended to take a stand on a controversy or give a big picture perspective on a problem? Is it a resource article, presenting a new tool or data set for others to use? Is it a research article, written to present new data and the authors’ interpretation of those data? The type of paper, and its intended purpose, will get you on your way to understanding the author’s goal.

Rule 3: Ask six questions

When reading, ask yourself: (1) What do the author(s) want to know (motivation)? (2) What did they do (approach/methods)? (3) Why was it done that way (context within the field)? (4) What do the results show (figures and data tables)? (5) How did the author(s) interpret the results (interpretation/discussion)? (6) What should be done next? (Regarding this last question, the author(s) may provide some suggestions in the discussion, but the key is to ask yourself what you think should come next.)

Each of these questions can and should be asked about the complete work as well as each table, figure, or experiment within the paper. Early on, it can take a long time to read one article front to back, and this can be intimidating. Break down your understanding of each section of the work with these questions to make the effort more manageable.

Rule 4: Unpack each figure and table

Scientists write original research papers primarily to present new data that may change or reinforce the collective knowledge of a field. Therefore, the most important parts of this type of scientific paper are the data. Some people like to scrutinize the figures and tables (including legends) before reading any of the “main text”: because all of the important information should be obtained through the data. Others prefer to read through the results section while sequentially examining the figures and tables as they are addressed in the text. There is no correct or incorrect approach: Try both to see what works best for you. The key is making sure that one understands the presented data and how it was obtained.

For each figure, work to understand each x- and y-axes, color scheme, statistical approach (if one was used), and why the particular plotting approach was used. For each table, identify what experimental groups and variables are presented. Identify what is shown and how the data were collected. This is typically summarized in the legend or caption but often requires digging deeper into the methods: Do not be afraid to refer back to the methods section frequently to ensure a full understanding of how the presented data were obtained. Again, ask the questions in Rule 3 for each figure or panel and conclude with articulating the “take home” message.

Rule 5: Understand the formatting intentions

Just like the overall intent of the article (discussed in Rule 2), the intent of each section within a research article can guide your interpretation. Some sections are intended to be written as objective descriptions of the data (i.e., the Results section), whereas other sections are intended to present the author’s interpretation of the data. Remember though that even “objective” sections are written by and, therefore, influenced by the authors interpretations. Check out Table 2 to understand the intent of each section of a research article. When reading a specific paper, you can also refer to the journal’s website to understand the formatting intentions. The “For Authors” section of a website will have some nitty gritty information that is less relevant for the reader (like word counts) but will also summarize what the journal editors expect in each section. This will help to familiarize you with the goal of each article section.

https://doi.org/10.1371/journal.pcbi.1008032.t002

Rule 6: Be critical

Published papers are not truths etched in stone. Published papers in high impact journals are not truths etched in stone. Published papers by bigwigs in the field are not truths etched in stone. Published papers that seem to agree with your own hypothesis or data are not etched in stone. Published papers that seem to refute your hypothesis or data are not etched in stone.

Science is a never-ending work in progress, and it is essential that the reader pushes back against the author’s interpretation to test the strength of their conclusions. Everyone has their own perspective and may interpret the same data in different ways. Mistakes are sometimes published, but more often these apparent errors are due to other factors such as limitations of a methodology and other limits to generalizability (selection bias, unaddressed, or unappreciated confounders). When reading a paper, it is important to consider if these factors are pertinent.

Critical thinking is a tough skill to learn but ultimately boils down to evaluating data while minimizing biases. Ask yourself: Are there other, equally likely, explanations for what is observed? In addition to paying close attention to potential biases of the study or author(s), a reader should also be alert to one’s own preceding perspective (and biases). Take time to ask oneself: Do I find this paper compelling because it affirms something I already think (or wish) is true? Or am I discounting their findings because it differs from what I expect or from my own work?

The phenomenon of a self-fulfilling prophecy, or expectancy, is well studied in the psychology literature [ 2 ] and is why many studies are conducted in a “blinded” manner [ 3 ]. It refers to the idea that a person may assume something to be true and their resultant behavior aligns to make it true. In other words, as humans and scientists, we often find exactly what we are looking for. A scientist may only test their hypotheses and fail to evaluate alternative hypotheses; perhaps, a scientist may not be aware of alternative, less biased ways to test her or his hypothesis that are typically used in different fields. Individuals with different life, academic, and work experiences may think of several alternative hypotheses, all equally supported by the data.

Rule 7: Be kind

The author(s) are human too. So, whenever possible, give them the benefit of the doubt. An author may write a phrase differently than you would, forcing you to reread the sentence to understand it. Someone in your field may neglect to cite your paper because of a reference count limit. A figure panel may be misreferenced as Supplemental Fig 3E when it is obviously Supplemental Fig 4E. While these things may be frustrating, none are an indication that the quality of work is poor. Try to avoid letting these minor things influence your evaluation and interpretation of the work.

Similarly, if you intend to share your critique with others, be extra kind. An author (especially the lead author) may invest years of their time into a single paper. Hearing a kindly phrased critique can be difficult but constructive. Hearing a rude, brusque, or mean-spirited critique can be heartbreaking, especially for young scientists or those seeking to establish their place within a field and who may worry that they do not belong.

Rule 8: Be ready to go the extra mile

To truly understand a scientific work, you often will need to look up a term, dig into the supplemental materials, or read one or more of the cited references. This process takes time. Some advisors recommend reading an article three times: The first time, simply read without the pressure of understanding or critiquing the work. For the second time, aim to understand the paper. For the third read through, take notes.

Some people engage with a paper by printing it out and writing all over it. The reader might write question marks in the margins to mark parts (s)he wants to return to, circle unfamiliar terms (and then actually look them up!), highlight or underline important statements, and draw arrows linking figures and the corresponding interpretation in the discussion. Not everyone needs a paper copy to engage in the reading process but, whatever your version of “printing it out” is, do it.

Rule 9: Talk about it

Talking about an article in a journal club or more informal environment forces active reading and participation with the material. Studies show that teaching is one of the best ways to learn and that teachers learn the material even better as the teaching task becomes more complex [ 4 – 5 ]; anecdotally, such observations inspired the phrase “to teach is to learn twice.”

Beyond formal settings such as journal clubs, lab meetings, and academic classes, discuss papers with your peers, mentors, and colleagues in person or electronically. Twitter and other social media platforms have become excellent resources for discussing papers with other scientists, the public or your nonscientist friends, or even the paper’s author(s). Describing a paper can be done at multiple levels and your description can contain all of the scientific details, only the big picture summary, or perhaps the implications for the average person in your community. All of these descriptions will solidify your understanding, while highlighting gaps in your knowledge and informing those around you.

Rule 10: Build on it

One approach we like to use for communicating how we build on the scientific literature is by starting research presentations with an image depicting a wall of Lego bricks. Each brick is labeled with the reference for a paper, and the wall highlights the body of literature on which the work is built. We describe the work and conclusions of each paper represented by a labeled brick and discuss each brick and the wall as a whole. The top brick on the wall is left blank: We aspire to build on this work and label this brick with our own work. We then delve into our own research, discoveries, and the conclusions it inspires. We finish our presentations with the image of the Legos and summarize our presentation on that empty brick.

Whether you are reading an article to understand a new topic area or to move a research project forward, effective learning requires that you integrate knowledge from multiple sources (“click” those Lego bricks together) and build upwards. Leveraging published work will enable you to build a stronger and taller structure. The first row of bricks is more stable once a second row is assembled on top of it and so on and so forth. Moreover, the Lego construction will become taller and larger if you build upon the work of others, rather than using only your own bricks.

Build on the article you read by thinking about how it connects to ideas described in other papers and within own work, implementing a technique in your own research, or attempting to challenge or support the hypothesis of the author(s) with a more extensive literature review. Integrate the techniques and scientific conclusions learned from an article into your own research or perspective in the classroom or research lab. You may find that this process strengthens your understanding, leads you toward new and unexpected interests or research questions, or returns you back to the original article with new questions and critiques of the work. All of these experiences are part of the “active reading”: process and are signs of a successful reading experience.

In summary, practice these rules to learn how to read a scientific article, keeping in mind that this process will get easier (and faster) with experience. We are firm believers that an hour in the library will save a week at the bench; this diligent practice will ultimately make you both a more knowledgeable and productive scientist. As you develop the skills to read an article, try to also foster good reading and learning habits for yourself (recommendations here: [ 6 ] and [ 7 ], respectively) and in others. Good luck and happy reading!

Acknowledgments

Thank you to the mentors, teachers, and students who have shaped our thoughts on reading, learning, and what science is all about.

• 1. Brown E. The Weird Sisters. G. P. Putnam’s Sons; 2011.
• View Article
• Google Scholar
• PubMed/NCBI

• Technical Support
• Find My Rep

You are here

Evaluating Research Articles From Start to Finish

• Ellen R. Girden
• Robert Kabacoff
• Description

See what’s new to this edition by selecting the Features tab on this page. Should you need additional information or have questions regarding the HEOA information provided for this title, including what is new to this edition, please email [email protected] . Please include your name, contact information, and the name of the title for which you would like more information. For information on the HEOA, please go to http://ed.gov/policy/highered/leg/hea08/index.html .

For assistance with your order: Please email us at [email protected] or connect with your SAGE representative.

SAGE 2455 Teller Road Thousand Oaks, CA 91320 www.sagepub.com

"Girden and Kabacoff provide readers with valuable suggestions for reading, evaluating, and assessing research articles in terms of the design employed and techniques used to carry out statistical analysis of the data collected... the well-written work provides guidance to students as well as professionals on how to examine research reports and articles with an inquisitive mind."

This book goes from step to step and is ideal for students who have not tackled this subject before.

Great resource for adult learners new to reading and reviewing research journals.

I felt it was too advanced for our undergraduate students, but a good resource for instructors of undergraduate students

May use as suggested text

too much detail for level of course

I will use this as a guide to reading research articles. this is a central part to the course.

This text will enable beginning researchers in my IST Research Methods course to understand how to evaluate secondary research and will be used as a supplement to the Research Methodology text.

I recommend this text for those students who plan on submitting manuscripts for journal publications.

• Shows students how to critically read an introduction
• Highlights how to "dissect" the method section to help decide whether precautions were taken to guard against threats to internal validity
• Familiarizes students with interpreting results, performing additional calculations, and checking a particular result
• Explains how to carefully evaluate the experimenter's discussion of the results

New to this Edition

• A review of the scientific method
• A new section on measurement and Psychometrics
• A consolidated overview of each chapter
• A new chapter on longitudinal research designs
• Updated references and suggested readings in every chapter
• Practical suggestions for reading research articles

Sample Materials & Chapters

Detailed Table of Contents

Chapter 1 - Introduction

Chapter 13 - Longitudinal Studies

For instructors

Please select a format:

Select a Purchasing Option

Related products.

We use cookies to understand how you use our site and to improve your experience. This includes personalizing content and advertising. To learn more, click here . By continuing to use our site, you accept our use of cookies, revised Privacy Policy and Terms of Service .

New to Zacks? Get started here.

Member Sign In

Don't Know Your Password?

• Zacks #1 Rank
• Zacks Industry Rank
• Zacks Sector Rank
• Equity Research
• Mutual Funds
• Mutual Fund Screener
• ETF Screener
• Earnings Calendar
• Earnings Releases
• Earnings ESP
• Earnings ESP Filter
• Stock Screener
• Premium Screens
• Basic Screens
• Research Wizard
• Personal Finance
• Money Managing
• Real Estate
• Retirement Planning
• Tax Information
• My Portfolio
• Create Portfolio
• Style Scores
• Testimonials
• Zacks.com Tutorial

Services Overview

• Zacks Ultimate
• Zacks Investor Collection
• Zacks Premium

Investor Services

• ETF Investor
• Home Run Investor
• Income Investor
• Stocks Under $10
• Value Investor
• Top 10 Stocks

Other Services

• Method for Trading
• Zacks Confidential

Trading Services

• Black Box Trader
• Counterstrike
• Headline Trader
• Insider Trader
• Large-Cap Trader
• Options Trader
• Short Sell List
• Surprise Trader
• Alternative Energy

You are being directed to ZacksTrade, a division of LBMZ Securities and licensed broker-dealer. ZacksTrade and Zacks.com are separate companies. The web link between the two companies is not a solicitation or offer to invest in a particular security or type of security. ZacksTrade does not endorse or adopt any particular investment strategy, any analyst opinion/rating/report or any approach to evaluating individual securities.

If you wish to go to ZacksTrade, click OK . If you do not, click Cancel.

Image: Bigstock

Unveiling Wintrust (WTFC) Q1 Outlook: Wall Street Estimates for Key Metrics

Analysts on Wall Street project that Wintrust Financial ( WTFC Quick Quote WTFC - Free Report ) will announce quarterly earnings of $2.42 per share in its forthcoming report, representing a decline of 13.6% year over year. Revenues are projected to reach $573.74 million, increasing 1.4% from the same quarter last year.

Over the last 30 days, there has been a downward revision of 0.1% in the consensus EPS estimate for the quarter, leading to its current level. This signifies the covering analysts' collective reconsideration of their initial forecasts over the course of this timeframe.

Before a company announces its earnings, it is essential to take into account any changes made to earnings estimates. This is a valuable factor in predicting the potential reactions of investors toward the stock. Empirical research has consistently shown a strong correlation between trends in earnings estimate revisions and the short-term price performance of a stock.

While it's common for investors to rely on consensus earnings and revenue estimates for assessing how the business may have performed during the quarter, exploring analysts' forecasts for key metrics can yield valuable insights.

Given this perspective, it's time to examine the average forecasts of specific Wintrust metrics that are routinely monitored and predicted by Wall Street analysts.

According to the collective judgment of analysts, 'Efficiency Ratio' should come in at 57.7%. Compared to the current estimate, the company reported 53% in the same quarter of the previous year.

Based on the collective assessment of analysts, 'Net Interest Margin' should arrive at 3.6%. The estimate compares to the year-ago value of 3.8%.

Analysts expect 'Average balance - Total earning assets' to come in at $52.41 billion. The estimate is in contrast to the year-ago figure of $48.81 billion.

Analysts forecast 'Leverage Ratio' to reach 9.4%. Compared to the present estimate, the company reported 9.1% in the same quarter last year.

The average prediction of analysts places 'Net interest income - FTE' at $469.57 million. The estimate is in contrast to the year-ago figure of $460.42 million.

Analysts predict that the 'Total Non-Interest Income' will reach $106.73 million. Compared to the present estimate, the company reported $107.77 million in the same quarter last year.

The consensus estimate for 'Net Interest Income' stands at $467.44 million. Compared to the current estimate, the company reported $458 million in the same quarter of the previous year.

The combined assessment of analysts suggests that 'Wealth management' will likely reach $33.78 million. The estimate is in contrast to the year-ago figure of $29.95 million.

The consensus among analysts is that 'Mortgage banking' will reach $19.25 million. The estimate compares to the year-ago value of $18.26 million.

Analysts' assessment points toward 'Operating lease income, net' reaching $14.52 million. The estimate compares to the year-ago value of $13.05 million.

It is projected by analysts that the 'Service charges on deposit accounts' will reach $14.10 million. The estimate is in contrast to the year-ago figure of $12.90 million.

The collective assessment of analysts points to an estimated 'Other Non-Interest Income' of $20.50 million. Compared to the current estimate, the company reported $21.01 million in the same quarter of the previous year. View all Key Company Metrics for Wintrust here>>> Shares of Wintrust have experienced a change of +1.3% in the past month compared to the +1.6% move of the Zacks S&P 500 composite. With a Zacks Rank #3 (Hold), WTFC is expected to mirror the overall market performance in the near future. You can see the complete list of today's Zacks Rank #1 (Strong Buy) stocks here >>>>

See More Zacks Research for These Tickers

Normally $25 each - click below to receive one report free:.

Wintrust Financial Corporation (WTFC) - free report >>

Published in

This file is used for Yahoo remarketing pixel add

Due to inactivity, you will be signed out in approximately: