C. Worrell (Eds.), (pp. 345–359). American Psychological Association.
Parenthetical citation: (Aron et al., 2019)
Narrative citation: Aron et al. (2019)
Merriam-Webster. (n.d.). Culture. In . Retrieved September 9, 2019, from |
Parenthetical citation: (Merriam-Webster, n.d.)
Narrative citation: Merriam-Webster (n.d.)
National Cancer Institute. (2019). (NIH Publication No. 18-2059). U.S. Department of Health and Human Services, National Institutes of Health. |
Parenthetical citation: (National Cancer Institute, 2019)
Narrative citation: National Cancer Institute (2019)
The specific agency responsible for the report appears as the author. The names of parent agencies not present in the group author name appear in the source element as the publisher. This creates concise in-text citations and complete reference list entries.
Harvard University. (2019, August 28). [Video]. YouTube. |
Parenthetical citation: (Harvard University, 2019)
Narrative citation: Harvard University (2019)
APA Databases [@APA_Databases]. (2019, September 5). [Tweet]. Twitter. Gates, B. [@BillGates]. (2019, September 7). [Thumbnail with link attached] [Tweet]. Twitter. |
Parenthetical citations: (APA Databases, 2019; Gates, 2019)
Narrative citations: APA Databases (2019) and Gates (2019)
News From Science. (2019, June 21). [Image attached] [Status update]. Facebook. |
Parenthetical citation: (News From Science, 2019)
Narrative citation: News From Science (2019)
Fagan, J. (2019, March 25). . OER Commons. Retrieved September 17, 2019, from National Institute of Mental Health. (2018, July). . U.S. Department of Health and Human Services, National Institutes of Health. Woodyatt, A. (2019, September 10). . CNN. World Health Organization. (2018, May 24). . |
Parenthetical citations: (Fagan, 2019; National Institute of Mental Health, 2018; Woodyatt, 2019; World Health Organization, 2018)
Narrative citations: Fagan (2019), National Institute of Mental Health (2018), Woodyatt (2019), and World Health Organization (2018)
The following supplemental example references are mention in the Publication Manual:
Archival document and collections are not presented in the APA Publication Manual, Seventh Edition . This content is available only on the APA Style website . This guidance has been expanded from the 6th edition.
Archival sources include letters, unpublished manuscripts, limited-circulation brochures and pamphlets, in-house institutional and corporate documents, clippings, and other documents, as well as such nontextual materials as photographs and apparatus, that are in the personal possession of an author, form part of an institutional collection, or are stored in an archive such as the Archives of the History of American Psychology at the University of Akron or the APA Archives. For any documents like these that are available on the open web or via a database (subscription or nonsubscription), follow the reference templates shown in Chapter 10 of the Publication Manual.
The general format for the reference for an archival work includes the author, date, title, and source. The reference examples shown on this page may be modified for collections requiring more or less specific information to locate materials, for different types of collections, or for additional descriptive information (e.g., a translation of a letter). Authors may choose to list correspondence from their own personal collections, but correspondence from other private collections should be listed only with the permission of the collector.
Keep in mind the following principles when creating references to archival documents and collections:
Frank, L. K. (1935, February 4). [Letter to Robert M. Ogden]. Rockefeller Archive Center (GEB Series 1.3, Box 371, Folder 3877), Tarrytown, NY, United States.
Zacharius, G. P. (1953, August 15). [Letter to William Rickel (W. Rickel, Trans.)]. Copy in possession of Hendrika Vande Kemp.
Allport, G. W. (1930–1967). Correspondence. Gordon W. Allport Papers (HUG 4118.10), Harvard University Archives, Cambridge, MA, United States.
To cite specific letters in the text, provide the author and range of years as shown in the reference list entry, plus details about who wrote the specific letter to whom and when the specific letter was written.
Berliner, A. (1959). Notes for a lecture on reminiscences of Wundt and Leipzig. Anna Berliner Memoirs (Box M50), Archives of the History of American Psychology, University of Akron, Akron, OH, United States.
Allport, A. (presumed). (ca. 1937). Marion Taylor today—by the biographer [Unpublished manuscript]. Marion Taylor Papers, Schlesinger Library, Radcliffe College, Cambridge, MA, United States.
Subcommittee on Mental Hygiene Personnel in School Programs. (1949, November 5–6). Meeting of Subcommittee on Mental Hygiene Personnel in School Programs. David Shakow Papers (M1360), Archives of the History of American Psychology, University of Akron, Akron, OH, United States.
Smith, M. B. (1989, August 12). Interview by C. A. Kiesler [Tape recording]. President’s Oral History Project, American Psychological Association, APA Archives, Washington, DC, United States.
Sparkman, C. F. (1973). An oral history with Dr. Colley F. Sparkman/Interviewer: Orley B. Caudill. Mississippi Oral History Program (Vol. 289), University of Southern Mississippi, Hattiesburg, MS, United States.
Psychoanalysis institute to open. (1948, September 18). [Clipping from an unidentified Dayton, OH, United States, newspaper]. Copy in possession of author.
Sci-Art Publishers. (1935). Sci-Art publications [Brochure]. Roback Papers (HUGFP 104.50, Box 2, Folder “Miscellaneous Psychological Materials”), Harvard University Archives, Cambridge, MA, United States.
[Photographs of Robert M. Yerkes]. (ca. 1917–1954). Robert Mearns Yerkes Papers (Box 137, Folder 2292), Manuscripts and Archives, Yale University Library, New Haven, CT, United States.
U.S. Census Bureau. (1880). 1880 U.S. census: Defective, dependent, and delinquent classes schedule: Virginia [Microfilm]. NARA Microfilm Publication T1132 (Rolls 33–34), National Archives and Records Administration, Washington, DC, United States.
Read the full APA guidelines on citing ChatGPT
OpenAI. (2023). ChatGPT (Mar 14 version) [Large language model]. https://chat.openai.com/chat
Author: The author of the model is OpenAI.
Date: The date is the year of the version you used. Following the template in Section 10.10, you need to include only the year, not the exact date. The version number provides the specific date information a reader might need.
Title: The name of the model is “ChatGPT,” so that serves as the title and is italicized in your reference, as shown in the template. Although OpenAI labels unique iterations (i.e., ChatGPT-3, ChatGPT-4), they are using “ChatGPT” as the general name of the model, with updates identified with version numbers.
The version number is included after the title in parentheses. The format for the version number in ChatGPT references includes the date because that is how OpenAI is labeling the versions. Different large language models or software might use different version numbering; use the version number in the format the author or publisher provides, which may be a numbering system (e.g., Version 2.0) or other methods.
Bracketed text is used in references for additional descriptions when they are needed to help a reader understand what’s being cited. References for a number of common sources, such as journal articles and books, do not include bracketed descriptions, but things outside of the typical peer-reviewed system often do. In the case of a reference for ChatGPT, provide the descriptor “Large language model” in square brackets. OpenAI describes ChatGPT-4 as a “large multimodal model,” so that description may be provided instead if you are using ChatGPT-4. Later versions and software or models from other companies may need different descriptions, based on how the publishers describe the model. The goal of the bracketed text is to briefly describe the kind of model to your reader.
Source: When the publisher name and the author name are the same, do not repeat the publisher name in the source element of the reference, and move directly to the URL. This is the case for ChatGPT. The URL for ChatGPT is https://chat.openai.com/chat . For other models or products for which you may create a reference, use the URL that links as directly as possible to the source (i.e., the page where you can access the model, not the publisher’s homepage).
Works included in a reference list.
The reference list provides a reliable way for readers to identify and locate the works cited in a paper. APA Style papers generally include reference lists, not bibliographies.
In general, each work cited in the text must appear in the reference list, and each work in the reference list must be cited in the text. Check your work carefully before submitting your manuscript or course assignment to ensure no works cited in the text are missing from the reference list and vice versa, with only the following exceptions.
There are a few kinds of works that are not included in a reference list. Usually a work is not included because readers cannot recover it or because the mention is so broad that readers do not need a reference list entry to understand the use.
Information on works included in a reference list is covered in Sections 2.12 and 8.4 of the APA Publication Manual, Seventh Edition
*This guidance has been expanded from the 6th edition.*
The DOI or URL is the final component of a reference list entry. Because so much scholarship is available and/or retrieved online, most reference list entries end with either a DOI or a URL.
Follow these guidelines for including DOIs and URLs in references:
Follow these guidelines to format DOIs and URLs:
https://doi.org/ xxxxx
When a DOI or URL is long or complex, you may use shortDOIs or shortened URLs if desired.
Last Updated: December 7, 2022 References
This article was co-authored by Diane Stubbs . Diane Stubbs is a Secondary English Teacher with over 22 years of experience teaching all high school grade levels and AP courses. She specializes in secondary education, classroom management, and educational technology. Diane earned a Bachelor of Arts in English from the University of Delaware and a Master of Education from Wesley College. There are 7 references cited in this article, which can be found at the bottom of the page. This article has been viewed 73,343 times.
Once you finish writing a paper, you'll also have to create a reference page that lists all of your sources, whether they are from books, journals, interviews or websites. This page makes it easy for your readers to find the documents you used to write your paper.
Susan Berescik
Feb 10, 2017
Mary Thomas
May 28, 2019
Welcome to the new OASIS website! We have academic skills, library skills, math and statistics support, and writing resources all together in one new home.
Article (with doi).
Alvarez. E., & Tippins, S. (2019). Socialization agents that Puerto Rican college students use to make financial decisions. Journal of Social Change , 11 (1), 75–85. https://doi.org/10.5590/JOSC.2019.11.1.07
Laplante, J. P., & Nolin, C. (2014). Consultas and socially responsible investing in Guatemala: A case study examining Maya perspectives on the Indigenous right to free, prior, and informed consent. Society & Natural Resources , 27 , 231–248. https://doi.org/10.1080/08941920.2013.861554
Provide a DOI number if there is one. DOI stands for "digital object identifier," a number specific to the article that can help others locate the source. Use CrossRef.org to locate DOI information. This rule applies regardless of how the source was accessed (e.g., online, paper, etc.; see APA 7, Section 9.34).
In APA 7, format the DOI as a web address. Active hyperlinks for DOIs and URLs should be used for documents meant for screen reading. Present these hyperlinks in blue and underlined text (the default formatting in Microsoft Word), although plain black text is also acceptable. Be consistent in the formatting choice for DOIs and URLs throughout the reference list. (Note that this guidance has changed from APA 6 where all hyperlink formatting was removed and no active links were included. In APA 6, the URLs appeared in plain, black type and did not link out from the document.)
Also see our Quick Answer FAQ, "Can I use the DOI format provided by library databases?"
Jerrentrup, A., Mueller, T., Glowalla, U., Herder, M., Henrichs, N., Neubauer, A., & Schaefer, J. R. (2018). Teaching medicine with the help of “Dr. House.” PLoS ONE , 13 (3), Article e0193972. https://doi.org/10.1371/journal.pone.0193972
For journal articles that are assigned article numbers rather than page ranges, include the article number in place of the page range.
For more on citing electronic resources, see Electronic Sources References .
Found in a common academic research database or in print.
Casler , T. (2020). Improving the graduate nursing experience through support on a social media platform. MEDSURG Nursing , 29 (2), 83–87.
If an article does not have a DOI and you retrieved it from a common academic research database through the university library, there is no need to include any additional electronic retrieval information. The reference list entry looks like the entry for a print copy of the article. (This format differs from APA 6 guidelines that recommended including the URL of a journal's homepage when the DOI was not available.)
Note that APA 7 has additional guidance on reference list entries for articles found only in specific databases or archives such as Cochrane Database of Systematic Reviews, UpToDate, ProQuest Dissertations and Theses Global, and university archives. See APA 7, Section 9.30 for more information.
Eaton, T. V., & Akers, M. D. (2007). Whistleblowing and good governance. CPA Journal , 77 (6), 66–71. http://archives.cpajournal.com/2007/607/essentials/p58.htm
Provide the direct web address/URL to a journal article found on the open web, often on an open access journal's website.
In APA 7, active hyperlinks for DOIs and URLs should be used for documents meant for screen reading. Present these hyperlinks in blue and underlined text (the default formatting in Microsoft Word), although plain black text is also acceptable. Be consistent in your formatting choice for DOIs and URLs throughout your reference list. (Note that this guidance has changed from APA 6 where all hyperlink formatting was removed and no active links were included. In APA 6, the URLs appeared in plain, black type and did not link out from the document.)
Weinstein, J. A. (2010). Social change (3rd ed.). Rowman & Littlefield.
If the book has an edition number, include it in parentheses after the title of the book. If the book does not list any edition information, do not include an edition number. The edition number is not italicized. (Note: In APA 6, the location of the publisher was included. This is no longer the case in APA 7; only the publisher name is provided.) Regarding publisher name, when a publisher is named after a person (as is the case with Lawrence Erlbaum or John Wiley), list only the surname (Erlbaum or Wiley). In addition, exclude “Publishers,” “Inc.,” and “Co.” from publisher names in reference entries.
American Nurses Association. (2010). Nursing: Scope and standards of practice (2nd ed.).
In APA 7, if the author and publisher are the same, only include the author in its regular place and omit the publisher. (Note that this is a change from APA 6, where the term “Author” was used for the publisher instead of repeating the name.)
Lencioni, P. (2012). The advantage: Why organizational health trumps everything else in business . Jossey-Bass. https://amzn.to/343XPSJ
As a change from APA 6 to APA 7, it is no longer necessary to include the ebook format in the title. However, if you listened to an audiobook and the content differs from the text version (e.g., abridged content) or your discussion highlights elements of the audiobook (e.g., narrator's performance), then note that it is an audiobook in the title element in brackets. For ebooks and online audiobooks, also include the DOI number (if available) or nondatabase URL but leave out the electronic retrieval element if the ebook was found in a common academic research database, as with journal articles. APA 7 allows for the shortening of long DOIs and URLs, as shown in this example. See APA 7, Section 9.36 for more information.
Poe, M. (2017). Reframing race in teaching writing across the curriculum. In F. Condon & V. A. Young (Eds.), Performing antiracist pedagogy in rhetoric, writing, and communication (pp. 87–105). University Press of Colorado.
Include the page numbers of the chapter in parentheses after the book title. The page range should not be italicized.
Christensen, L. (2001). For my people: Celebrating community through poetry. In B. Bigelow, B. Harvey, S. Karp, & L. Miller (Eds.), Rethinking our classrooms: Teaching for equity and justice (Vol. 2, pp. 16–17). Rethinking Schools.
Also include volume number and edition numbers in the parenthetical information after the book title where relevant.
Freud, S. (1961). The ego and the id. In J. Strachey (Ed.), The standard edition of the complete psychological works of Sigmund Freud (Vol. 19, pp. 3-66). Hogarth Press. (Original work published 1923)
When a text has been republished as part of an anthology collection, after the author’s name include the date of the version that was read. At the end of the entry, place the date of the original publication inside parenthesis along with the note “original work published.” For in-text citations of republished work, use both dates in the parenthetical citation, original date first with a slash separating the years, as in this example: Freud (1923/1961). For more information on reprinted or republished works, see APA 7, Sections 9.40-9.41.
Retrieved from a database
Nalumango, K. (2019). Perceptions about the asylum-seeking process in the United States after 9/11 (Publication No. 13879844) [Doctoral dissertation, Walden University]. ProQuest Dissertations and Theses.
Retrieved From an Institutional or Personal Website
Evener. J. (2018). Organizational learning in libraries at for-profit colleges and universities [Doctoral dissertation, Walden University]. ScholarWorks. https://scholarworks.waldenu.edu/cgi/viewcontent.cgi?article=6606&context=dissertations
Unpublished Dissertation or Thesis
Kirwan, J. G. (2005). An experimental study of the effects of small-group, face-to-face facilitated dialogues on the development of self-actualization levels: A movement towards fully functional persons [Unpublished doctoral dissertation]. Saybrook Graduate School and Research Center.
For further examples and information, see APA 7, Section 10.6.
For legal references, APA follows the recommendations of The Bluebook: A Uniform System of Citation , so if you have any questions beyond the examples provided in APA, seek out that resource as well.
Court Decisions
Reference format:
Name v. Name, Volume Reporter Page (Court Date). URL
Sample reference entry:
Brown v. Board of Education, 347 U.S. 483 (1954). https://www.oyez.org/cases/1940-1955/347us483
Sample citation:
In Brown v. Board of Education (1954), the Supreme Court ruled racial segregation in schools unconstitutional.
Note: Italicize the case name when it appears in the text of your paper rather than citing it—for example, “Cases such as Brown v. Board of Education and Parents Involved in Community Schools v. Seattle illustrate ...”
Name of Act, Title Source § Section Number (Year). URL
Sample reference entry for a federal statute:
Individuals With Disabilities Education Act, 20 U.S.C. § 1400 et seq. (2004). https://www.congress.gov/108/plaws/publ446/PLAW-108publ446.pdf
Sample reference entry for a state statute:
Minnesota Nurse Practice Act, Minn. Stat. §§ 148.171 et seq. (2019). https://www.revisor.mn.gov/statutes/cite/148.171
Sample citation: Minnesota nurses must maintain current registration in order to practice (Minnesota Nurse Practice Act, 2010).
Note: The § symbol stands for "section." Use §§ for sections (plural). To find this symbol in Microsoft Word, go to "Insert" and click on Symbol." Look in the Latin 1-Supplement subset.
Note: U.S.C. stands for "United States Code."
Note: The Latin abbreviation " et seq. " means "and what follows" and is used when the act includes the cited section and ones that follow.
Note: List the chapter first followed by the section or range of sections.
Unenacted Bills and Resolutions
(Those that did not pass and become law)
Title [if there is one], bill or resolution number, xxx Cong. (year). URL
Sample reference entry for Senate bill:
Anti-Phishing Act, S. 472, 109th Cong. (2005). https://www.congress.gov/bill/109th-congress/senate-bill/472
Sample reference entry for House of Representatives resolution:
Anti-Phishing Act, H.R. 1099, 109th Cong. (2005). https://www.congress.gov/bill/109th-congress/house-bill/1099
The Anti-Phishing Act (2005) proposed up to 5 years prison time for people running Internet scams.
These are the three legal areas you may be most apt to cite in your scholarly work. For more examples and explanation, see APA 7, Chapter 11.
Clay, R. (2008, June). Science vs. ideology: Psychologists fight back about the misuse of research. Monitor on Psychology , 39 (6). https://www.apa.org/monitor/2008/06/ideology
Note that for citations, include only the year: Clay (2008). For magazine articles retrieved from a common academic research database, leave out the URL. For magazine articles from an online news website that is not an online version of a print magazine, follow the format for a webpage reference list entry.
Baker, A. (2014, May 7). Connecticut students show gains in national tests. New York Times . http://www.nytimes.com/2014/05/08/nyregion/national-assessment-of-educational-progress-results-in-Connecticut-and-New-Jersey.html
Include the full date in the format Year, Month Day. Do not include a retrieval date for periodical sources found on websites. Note that for citations, include only the year: Baker (2014). For newspaper articles retrieved from a common academic research database, leave out the URL. For newspaper articles from an online news website that is not an online version of a print newspaper, follow the format for a webpage reference list entry.
The general structure for a technical or research report is as follows:
Author, A. A. (Publication Year). Title of work . Publisher Name. DOI or URL
Edwards, C. (2015). Lighting levels for isolated intersections: Leading to safety improvements (Report No. MnDOT 2015-05). Center for Transportation Studies. http://www.cts.umn.edu/Publications/ResearchReports/reportdetail.html?id=2402
Technical and research reports by governmental agencies and other research institutions usually follow a different publication process than scholarly, peer-reviewed journals. However, they present original research and are often useful for research papers. Sometimes, researchers refer to these types of reports as gray literature , and white papers are a type of this literature. See APA 7, Section 10.4 for more information.
American Federation of Teachers. (n.d.). Community schools . http://www.aft.org/issues/schoolreform/commschools/index.cfm
If there is no specified author, then use the organization’s name as the author. In such a case, there is no need to repeat the organization's name after the title.
Vartan, S. (2018, January 30). Why vacations matter for your health . CNN. https://www.cnn.com/travel/article/why-vacations-matter/index.html
For webpages from news websites, include the site name after the title and before the URL. If the source is an online newspaper or magazine, follow the models in the previous sections of this page. In APA 7, active hyperlinks for DOIs and URLs should be used for documents meant for screen reading. Present these hyperlinks in blue and underlined text (the default formatting in Microsoft Word), although plain black text is also acceptable. Be consistent in your formatting choice for DOIs and URLs throughout your reference list. (Note that this guidance has changed from APA 6 where all hyperlink formatting was removed, and no active links were included. In APA 6, the URLs appeared in plain, black type and did not link out from the document.)
Departments.
Walden University is a member of Adtalem Global Education, Inc. www.adtalem.com Walden University is certified to operate by SCHEV © 2024 Walden University LLC. All rights reserved.
Purdue Online Writing Lab Purdue OWL® College of Liberal Arts
This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.
Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.
Note: We have chosen to include the date of access for the online sources below. The latest MLA guidelines specify that this is optional, but strongly recommended for sources whose date of publication is unavailable.
Note also: The citation for An Inconvenient Truth below assumes the film has been cited by its title in the text. If it had been cited by the name of its director, the citation would need to begin with Guggenheim's surname. MLA guidelines specify that both styles are acceptable (see, e.g., this "Ask the MLA" page ).
Works Cited
Dean, Cornelia. "Executive on a Mission: Saving the Planet." The New York Times , 22 May 2007, www.nytimes.com/2007/05/22/science/earth/22ander.html?_r=0. Accessed 29 May 2019.
Ebert, Roger. Review of An Inconvenient Truth , directed by Davis Guggenheim. Ebert Digital LLC , 1 June 2006, www.rogerebert.com/reviews/an-inconvenient-truth-2006. Accessed 15 June 2019.
Gowdy, John. "Avoiding Self-Organized Extinction: Toward a Co-Evolutionary Economics of Sustainability." International Journal of Sustainable Development and World Ecology, vol. 14, no. 1, 2007, pp. 27-36.
Harris, Rob, and Andrew C. Revkin. “Clinton on Climate Change.” The New York Times , 17 May 2007, www.nytimes.com/video/world/americas/1194817109438/clinton-on-climate-change.html. Accessed 29 July 2016.
An Inconvenient Truth . Directed by Davis Guggenheim, Paramount, 2006.
Leroux, Marcel. Global Warming: Myth or Reality?: The Erring Ways of Climatology . Springer, 2005.
Milken, Michael, et al. "On Global Warming and Financial Imbalances." New Perspectives Quarterly , vol. 23, no. 4, 2006, p. 63.
Nordhaus, William D. "After Kyoto: Alternative Mechanisms to Control Global Warming." American Economic Review , vol. 96, no. 2, 2006, pp. 31-34.
---. "Global Warming Economics." Science, vol. 294, no. 5545, 9 Nov. 2001, pp. 1283-84, DOI: 10.1126/science.1065007.
Regas, Diane. “Three Key Energy Policies That Can Help Us Turn the Corner on Climate.” Environmental Defense Fund , 1 June 2016, www.edf.org/blog/2016/06/01/3-key-energy-policies-can-help-us-turn-corner-climate. Accessed 19 July 2016.
Revkin, Andrew C. “Clinton on Climate Change.” The New York Times , 17 May 2007, www.nytimes.com/video/world/americas/1194817109438/clinton-on-climate-change.html. Accessed 29 July 2016.
Shulte, Bret. "Putting a Price on Pollution." US News & World Report , vol. 142, no. 17, 14 May 2007, p. 37. Ebsco, Access no: 24984616.
Uzawa, Hirofumi. Economic Theory and Global Warming . Cambridge UP, 2003.
Run a free plagiarism check in 10 minutes, generate accurate citations for free.
Published on June 24, 2022 by Jack Caulfield . Revised on November 7, 2022.
A citation style is a set of guidelines on how to cite sources in your academic writing . You always need a citation whenever you quote , paraphrase , or summarize a source to avoid plagiarism . How you present these citations depends on the style you follow. Scribbr’s citation generator can help!
Different styles are set by different universities, academic associations, and publishers, often published in an official handbook with in-depth instructions and examples.
There are many different citation styles, but they typically use one of three basic approaches: parenthetical citations , numerical citations, or note citations.
Parenthetical citations
Numerical citations
Note citations
Upload your document to correct all your mistakes in minutes
Types of citation: parenthetical, note, numerical, which citation style should i use, parenthetical citation styles, numerical citation styles, note citation styles, frequently asked questions about citation styles.
The clearest identifying characteristic of any citation style is how the citations in the text are presented. There are three main approaches:
Citation styles also differ in terms of how you format the reference list or bibliography entries themselves (e.g., capitalization, order of information, use of italics). And many style guides also provide guidance on more general issues like text formatting, punctuation, and numbers.
The academic proofreading tool has been trained on 1000s of academic texts. Making it the most accurate and reliable proofreading tool for students. Free citation check included.
Try for free
In most cases, your university, department, or instructor will tell you which citation style you need to follow in your writing. If you’re not sure, it’s best to consult your institution’s guidelines or ask someone. If you’re submitting to a journal, they will usually require a specific style.
Sometimes, the choice of citation style may be left up to you. In those cases, you can base your decision on which citation styles are commonly used in your field. Try reading other articles from your discipline to see how they cite their sources, or consult the table below.
Discipline | Typical citation style(s) |
---|---|
Economics | |
Engineering & IT | |
Humanities | ; ; |
Law | ; |
Medicine | ; ; |
Political science | |
Psychology | |
Sciences | ; ; ; ; |
Social sciences | ; ; ; |
The American Anthropological Association (AAA) recommends citing your sources using Chicago author-date style . AAA style doesn’t have its own separate rules. This style is used in the field of anthropology.
AAA reference entry | Clarke, Kamari M. 2013. “Notes on Cultural Citizenship in the Black Atlantic World.” 28, no. 3 (August): 464–474. https://www.jstor.org/stable/43898483. |
AAA in-text citation | (Clarke 2013) |
APA Style is defined by the 7th edition of the Publication Manual of the American Psychological Association . It was designed for use in psychology, but today it’s widely used across various disciplines, especially in the social sciences.
Wagemann, J. & Weger, U. (2021). Perceiving the other self: An experimental first-person account of nonverbal social interaction. , (4), 441–461. https://doi.org/10.5406/amerjpsyc.134.4.0441 | |
(Wagemann & Weger, 2021) |
The citation style of the American Political Science Association (APSA) is used mainly in the field of political science.
APSA reference entry | Ward, Lee. 2020. “Equity and Political Economy in Thomas Hobbes.” , 64 (4): 823–35. doi: 10.1111/ajps.12507. |
APSA in-text citation | (Ward 2020) |
The citation style of the American Sociological Association (ASA) is used primarily in the discipline of sociology.
ASA reference entry | Kootstra, Anouk. 2016. “Deserving and Undeserving Welfare Claimants in Britain and the Netherlands: Examining the Role of Ethnicity and Migration Status Using a Vignette Experiment.” 32(3): 325–338. doi:10.1093/esr/jcw010. |
ASA in-text citation | (Kootstra 2016) |
Chicago author-date style is one of the two citation styles presented in the Chicago Manual of Style (17th edition). It’s used mainly in the sciences and social sciences.
Encarnação, João, and Gonçalo Calado. 2018. “Effects of Recreational Diving on Early Colonization Stages of an Artificial Reef in North-East Atlantic.” 22, no. 6 (December): 1209–1216. https://www.jstor.org/stable/45380397. | |
(Encarnação and Calado 2018) |
The citation style of the Council of Science Editors (CSE) is used in various scientific disciplines. It includes multiple options for citing your sources, including the name-year system.
CSE name-year reference entry | Graham JR. 2019. The structure and stratigraphical relations of the Lough Nafooey Group, South Mayo. Irish Journal of Earth Sciences. 37: 1–18. |
CSE name-year citation | (Graham 2019) |
Harvard style is often used in the field of economics. It is also very widely used across disciplines in UK universities. There are various versions of Harvard style defined by different universities—it’s not a style with one definitive style guide.
Hoffmann, M. (2016) ‘How is information valued? Evidence from framed field experiments’, , 126(595), pp. 1884–1911. doi:10.1111/ecoj.12401. | |
(Hoffmann, 2016) |
Check out Scribbr’s Harvard Reference Generator
MLA style is the official style of the Modern Language Association, defined in the MLA Handbook (9th edition). It’s widely used across various humanities disciplines. Unlike most parenthetical citation styles, it’s author-page rather than author-date.
Davidson, Clare. “Reading in Bed with .” , vol. 55, no. 2, Apr. 2020, pp. 147–170. https://doi.org/10.5325/chaucerrev.55.2.0147. | |
(Davidson 155) |
The American Chemical Society (ACS) provides guidelines for a citation style using numbers in superscript or italics in the text, corresponding to entries in a numbered reference list at the end. It is used in chemistry.
ACS reference entry | 1. Hutchinson, G.; Alamillo-Ferrer, C.; Fernández-Pascual, M.; Burés, J. Organocatalytic Enantioselective α-Bromination of Aldehydes with -Bromosuccinimide. , 87, 7968–7974. |
The American Medical Association ( AMA ) provides guidelines for a numerical citation style using superscript numbers in the text, which correspond to entries in a numbered reference list. It is used in the field of medicine.
1. Jabro JD. Predicting saturated hydraulic conductivity from percolation test results in layered silt loam soils. . 2009;72(5):22–27. |
CSE style includes multiple options for citing your sources, including the citation-name and citation-sequence systems. Your references are listed alphabetically in the citation-name system; in the citation-sequence system, they appear in the order in which you cited them.
CSE citation-sequence or citation-name reference entry | 1. Nell CS, Mooney KA. Plant structural complexity mediates trade-off in direct and indirect plant defense by birds. Ecology. 2019;100(10):1–7. |
The Institute of Electrical and Electronics Engineers ( IEEE ) provides guidelines for citing your sources with IEEE in-text citations that consist of numbers enclosed in brackets, corresponding to entries in a numbered reference list. This style is used in various engineering and IT disciplines.
IEEE reference entry | 1. J. Ive, A. Max, and F. Yvon, “Reassessing the proper place of man and machine in translation: A pre-translation scenario,” , vol. 32, no. 4, pp. 279–308, Dec. 2018, doi: 10.1007/s10590-018-9223-9. |
The National Library of Medicine (NLM) citation style is defined in Citing Medicine: The NLM Style Guide for Authors, Editors, and Publishers (2nd edition).
NLM reference entry | 1. Hage J, Valadez JJ. Institutionalizing and sustaining social change in health systems: the case of Uganda. Health Policy Plan. 2017 Nov;32(9):1248–55. doi:10.1093/heapol/czx066. |
Vancouver style is also used in various medical disciplines. As with Harvard style, a lot of institutions and publications have their own versions of Vancouver—it doesn’t have one fixed style guide.
Vancouver reference entry | 1. Bute M. A backstage sociologist: Autoethnography and a populist vision. Am Soc. 2016 Mar 23; 47(4):499–515. Available from: https://link.springer.com/article/10.1007/s12108-016-9307-z doi:10.1007/s12108-016-9307-z |
The Bluebook: A Uniform System of Citation is the main style guide for legal citations in the US. It’s widely used in law, and also when legal materials need to be cited in other disciplines.
Bluebook footnote citation | David E. Pozen, , 165, U. P🇦. L. R🇪🇻. 1097, 1115 (2017). |
Chicago notes and bibliography is one of the two citation styles presented in the Chicago Manual of Style (17th edition). It’s used mainly in the humanities.
Best, Jeremy. “Godly, International, and Independent: German Protestant Missionary Loyalties before World War I.” 47, no. 3 (September 2014): 585–611. https://doi.org/10.1017/S0008938914001654. | |
1. Jeremy Best, “Godly, International, and Independent: German Protestant Missionary Loyalties before World War I,” 47, no. 3 (September 2014): 599. https://doi.org/10.1017/S0008938914001654. |
The Oxford University Standard for the Citation of Legal Authorities ( OSCOLA ) is the main legal citation style in the UK (similar to Bluebook for the US).
OSCOLA footnote citation | 1. Chris Thornhill, ‘The Mutation of International Law in Contemporary Constitutions: Thinking Sociologically about Political Constitutionalism’ [2016] MLR 207. |
There are many different citation styles used across different academic disciplines, but they fall into three basic approaches to citation:
Check if your university or course guidelines specify which citation style to use. If the choice is left up to you, consider which style is most commonly used in your field.
Other more specialized styles exist for certain fields, such as Bluebook and OSCOLA for law.
The most important thing is to choose one style and use it consistently throughout your text.
A scientific citation style is a system of source citation that is used in scientific disciplines. Some commonly used scientific citation styles are:
APA format is widely used by professionals, researchers, and students in the social and behavioral sciences, including fields like education, psychology, and business.
Be sure to check the guidelines of your university or the journal you want to be published in to double-check which style you should be using.
MLA Style is the second most used citation style (after APA ). It is mainly used by students and researchers in humanities fields such as literature, languages, and philosophy.
If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.
Caulfield, J. (2022, November 07). Citation Styles Guide | Examples for All Major Styles. Scribbr. Retrieved September 9, 2024, from https://www.scribbr.com/citing-sources/citation-styles/
Other students also liked, apa vs. mla | the key differences in format & citation, the basics of in-text citation | apa & mla examples, how to avoid plagiarism | tips on citing sources, scribbr apa citation checker.
An innovative new tool that checks your APA citations with AI software. Say goodbye to inaccurate citations!
Peer Reviewed
Article metrics.
CrossRef Citations
Altmetric Score
PDF Downloads
Academic journals, archives, and repositories are seeing an increasing number of questionable research papers clearly produced using generative AI. They are often created with widely available, general-purpose AI applications, most likely ChatGPT, and mimic scientific writing. Google Scholar easily locates and lists these questionable papers alongside reputable, quality-controlled research. Our analysis of a selection of questionable GPT-fabricated scientific papers found in Google Scholar shows that many are about applied, often controversial topics susceptible to disinformation: the environment, health, and computing. The resulting enhanced potential for malicious manipulation of society’s evidence base, particularly in politically divisive domains, is a growing concern.
Swedish School of Library and Information Science, University of Borås, Sweden
Department of Arts and Cultural Sciences, Lund University, Sweden
Division of Environmental Communication, Swedish University of Agricultural Sciences, Sweden
The use of ChatGPT to generate text for academic papers has raised concerns about research integrity. Discussion of this phenomenon is ongoing in editorials, commentaries, opinion pieces, and on social media (Bom, 2023; Stokel-Walker, 2024; Thorp, 2023). There are now several lists of papers suspected of GPT misuse, and new papers are constantly being added. 1 See for example Academ-AI, https://www.academ-ai.info/ , and Retraction Watch, https://retractionwatch.com/papers-and-peer-reviews-with-evidence-of-chatgpt-writing/ . While many legitimate uses of GPT for research and academic writing exist (Huang & Tan, 2023; Kitamura, 2023; Lund et al., 2023), its undeclared use—beyond proofreading—has potentially far-reaching implications for both science and society, but especially for their relationship. It, therefore, seems important to extend the discussion to one of the most accessible and well-known intermediaries between science, but also certain types of misinformation, and the public, namely Google Scholar, also in response to the legitimate concerns that the discussion of generative AI and misinformation needs to be more nuanced and empirically substantiated (Simon et al., 2023).
Google Scholar, https://scholar.google.com , is an easy-to-use academic search engine. It is available for free, and its index is extensive (Gusenbauer & Haddaway, 2020). It is also often touted as a credible source for academic literature and even recommended in library guides, by media and information literacy initiatives, and fact checkers (Tripodi et al., 2023). However, Google Scholar lacks the transparency and adherence to standards that usually characterize citation databases. Instead, Google Scholar uses automated crawlers, like Google’s web search engine (Martín-Martín et al., 2021), and the inclusion criteria are based on primarily technical standards, allowing any individual author—with or without scientific affiliation—to upload papers to be indexed (Google Scholar Help, n.d.). It has been shown that Google Scholar is susceptible to manipulation through citation exploits (Antkare, 2020) and by providing access to fake scientific papers (Dadkhah et al., 2017). A large part of Google Scholar’s index consists of publications from established scientific journals or other forms of quality-controlled, scholarly literature. However, the index also contains a large amount of gray literature, including student papers, working papers, reports, preprint servers, and academic networking sites, as well as material from so-called “questionable” academic journals, including paper mills. The search interface does not offer the possibility to filter the results meaningfully by material type, publication status, or form of quality control, such as limiting the search to peer-reviewed material.
To understand the occurrence of ChatGPT (co-)authored work in Google Scholar’s index, we scraped it for publications, including one of two common ChatGPT responses (see Appendix A) that we encountered on social media and in media reports (DeGeurin, 2024). The results of our descriptive statistical analyses showed that around 62% did not declare the use of GPTs. Most of these GPT-fabricated papers were found in non-indexed journals and working papers, but some cases included research published in mainstream scientific journals and conference proceedings. 2 Indexed journals mean scholarly journals indexed by abstract and citation databases such as Scopus and Web of Science, where the indexation implies journals with high scientific quality. Non-indexed journals are journals that fall outside of this indexation. More than half (57%) of these GPT-fabricated papers concerned policy-relevant subject areas susceptible to influence operations. To avoid increasing the visibility of these publications, we abstained from referencing them in this research note. However, we have made the data available in the Harvard Dataverse repository.
The publications were related to three issue areas—health (14.5%), environment (19.5%) and computing (23%)—with key terms such “healthcare,” “COVID-19,” or “infection”for health-related papers, and “analysis,” “sustainable,” and “global” for environment-related papers. In several cases, the papers had titles that strung together general keywords and buzzwords, thus alluding to very broad and current research. These terms included “biology,” “telehealth,” “climate policy,” “diversity,” and “disrupting,” to name just a few. While the study’s scope and design did not include a detailed analysis of which parts of the articles included fabricated text, our dataset did contain the surrounding sentences for each occurrence of the suspicious phrases that formed the basis for our search and subsequent selection. Based on that, we can say that the phrases occurred in most sections typically found in scientific publications, including the literature review, methods, conceptual and theoretical frameworks, background, motivation or societal relevance, and even discussion. This was confirmed during the joint coding, where we read and discussed all articles. It became clear that not just the text related to the telltale phrases was created by GPT, but that almost all articles in our sample of questionable articles likely contained traces of GPT-fabricated text everywhere.
Evidence hacking and backfiring effects
Generative pre-trained transformers (GPTs) can be used to produce texts that mimic scientific writing. These texts, when made available online—as we demonstrate—leak into the databases of academic search engines and other parts of the research infrastructure for scholarly communication. This development exacerbates problems that were already present with less sophisticated text generators (Antkare, 2020; Cabanac & Labbé, 2021). Yet, the public release of ChatGPT in 2022, together with the way Google Scholar works, has increased the likelihood of lay people (e.g., media, politicians, patients, students) coming across questionable (or even entirely GPT-fabricated) papers and other problematic research findings. Previous research has emphasized that the ability to determine the value and status of scientific publications for lay people is at stake when misleading articles are passed off as reputable (Haider & Åström, 2017) and that systematic literature reviews risk being compromised (Dadkhah et al., 2017). It has also been highlighted that Google Scholar, in particular, can be and has been exploited for manipulating the evidence base for politically charged issues and to fuel conspiracy narratives (Tripodi et al., 2023). Both concerns are likely to be magnified in the future, increasing the risk of what we suggest calling evidence hacking —the strategic and coordinated malicious manipulation of society’s evidence base.
The authority of quality-controlled research as evidence to support legislation, policy, politics, and other forms of decision-making is undermined by the presence of undeclared GPT-fabricated content in publications professing to be scientific. Due to the large number of archives, repositories, mirror sites, and shadow libraries to which they spread, there is a clear risk that GPT-fabricated, questionable papers will reach audiences even after a possible retraction. There are considerable technical difficulties involved in identifying and tracing computer-fabricated papers (Cabanac & Labbé, 2021; Dadkhah et al., 2023; Jones, 2024), not to mention preventing and curbing their spread and uptake.
However, as the rise of the so-called anti-vaxx movement during the COVID-19 pandemic and the ongoing obstruction and denial of climate change show, retracting erroneous publications often fuels conspiracies and increases the following of these movements rather than stopping them. To illustrate this mechanism, climate deniers frequently question established scientific consensus by pointing to other, supposedly scientific, studies that support their claims. Usually, these are poorly executed, not peer-reviewed, based on obsolete data, or even fraudulent (Dunlap & Brulle, 2020). A similar strategy is successful in the alternative epistemic world of the global anti-vaccination movement (Carrion, 2018) and the persistence of flawed and questionable publications in the scientific record already poses significant problems for health research, policy, and lawmakers, and thus for society as a whole (Littell et al., 2024). Considering that a person’s support for “doing your own research” is associated with increased mistrust in scientific institutions (Chinn & Hasell, 2023), it will be of utmost importance to anticipate and consider such backfiring effects already when designing a technical solution, when suggesting industry or legal regulation, and in the planning of educational measures.
Recommendations
Solutions should be based on simultaneous considerations of technical, educational, and regulatory approaches, as well as incentives, including social ones, across the entire research infrastructure. Paying attention to how these approaches and incentives relate to each other can help identify points and mechanisms for disruption. Recognizing fraudulent academic papers must happen alongside understanding how they reach their audiences and what reasons there might be for some of these papers successfully “sticking around.” A possible way to mitigate some of the risks associated with GPT-fabricated scholarly texts finding their way into academic search engine results would be to provide filtering options for facets such as indexed journals, gray literature, peer-review, and similar on the interface of publicly available academic search engines. Furthermore, evaluation tools for indexed journals 3 Such as LiU Journal CheckUp, https://ep.liu.se/JournalCheckup/default.aspx?lang=eng . could be integrated into the graphical user interfaces and the crawlers of these academic search engines. To enable accountability, it is important that the index (database) of such a search engine is populated according to criteria that are transparent, open to scrutiny, and appropriate to the workings of science and other forms of academic research. Moreover, considering that Google Scholar has no real competitor, there is a strong case for establishing a freely accessible, non-specialized academic search engine that is not run for commercial reasons but for reasons of public interest. Such measures, together with educational initiatives aimed particularly at policymakers, science communicators, journalists, and other media workers, will be crucial to reducing the possibilities for and effects of malicious manipulation or evidence hacking. It is important not to present this as a technical problem that exists only because of AI text generators but to relate it to the wider concerns in which it is embedded. These range from a largely dysfunctional scholarly publishing system (Haider & Åström, 2017) and academia’s “publish or perish” paradigm to Google’s near-monopoly and ideological battles over the control of information and ultimately knowledge. Any intervention is likely to have systemic effects; these effects need to be considered and assessed in advance and, ideally, followed up on.
Our study focused on a selection of papers that were easily recognizable as fraudulent. We used this relatively small sample as a magnifying glass to examine, delineate, and understand a problem that goes beyond the scope of the sample itself, which however points towards larger concerns that require further investigation. The work of ongoing whistleblowing initiatives 4 Such as Academ-AI, https://www.academ-ai.info/ , and Retraction Watch, https://retractionwatch.com/papers-and-peer-reviews-with-evidence-of-chatgpt-writing/ . , recent media reports of journal closures (Subbaraman, 2024), or GPT-related changes in word use and writing style (Cabanac et al., 2021; Stokel-Walker, 2024) suggest that we only see the tip of the iceberg. There are already more sophisticated cases (Dadkhah et al., 2023) as well as cases involving fabricated images (Gu et al., 2022). Our analysis shows that questionable and potentially manipulative GPT-fabricated papers permeate the research infrastructure and are likely to become a widespread phenomenon. Our findings underline that the risk of fake scientific papers being used to maliciously manipulate evidence (see Dadkhah et al., 2017) must be taken seriously. Manipulation may involve undeclared automatic summaries of texts, inclusion in literature reviews, explicit scientific claims, or the concealment of errors in studies so that they are difficult to detect in peer review. However, the mere possibility of these things happening is a significant risk in its own right that can be strategically exploited and will have ramifications for trust in and perception of science. Society’s methods of evaluating sources and the foundations of media and information literacy are under threat and public trust in science is at risk of further erosion, with far-reaching consequences for society in dealing with information disorders. To address this multifaceted problem, we first need to understand why it exists and proliferates.
Finding 1: 139 GPT-fabricated, questionable papers were found and listed as regular results on the Google Scholar results page. Non-indexed journals dominate.
Most questionable papers we found were in non-indexed journals or were working papers, but we did also find some in established journals, publications, conferences, and repositories. We found a total of 139 papers with a suspected deceptive use of ChatGPT or similar LLM applications (see Table 1). Out of these, 19 were in indexed journals, 89 were in non-indexed journals, 19 were student papers found in university databases, and 12 were working papers (mostly in preprint databases). Table 1 divides these papers into categories. Health and environment papers made up around 34% (47) of the sample. Of these, 66% were present in non-indexed journals.
Indexed journals* | 5 | 3 | 4 | 7 | 19 |
Non-indexed journals | 18 | 18 | 13 | 40 | 89 |
Student papers | 4 | 3 | 1 | 11 | 19 |
Working papers | 5 | 3 | 2 | 2 | 12 |
Total | 32 | 27 | 20 | 60 | 139 |
Finding 2: GPT-fabricated, questionable papers are disseminated online, permeating the research infrastructure for scholarly communication, often in multiple copies. Applied topics with practical implications dominate.
The 20 papers concerning health-related issues are distributed across 20 unique domains, accounting for 46 URLs. The 27 papers dealing with environmental issues can be found across 26 unique domains, accounting for 56 URLs. Most of the identified papers exist in multiple copies and have already spread to several archives, repositories, and social media. It would be difficult, or impossible, to remove them from the scientific record.
As apparent from Table 2, GPT-fabricated, questionable papers are seeping into most parts of the online research infrastructure for scholarly communication. Platforms on which identified papers have appeared include ResearchGate, ORCiD, Journal of Population Therapeutics and Clinical Pharmacology (JPTCP), Easychair, Frontiers, the Institute of Electrical and Electronics Engineer (IEEE), and X/Twitter. Thus, even if they are retracted from their original source, it will prove very difficult to track, remove, or even just mark them up on other platforms. Moreover, unless regulated, Google Scholar will enable their continued and most likely unlabeled discoverability.
Environment | researchgate.net (13) | orcid.org (4) | easychair.org (3) | ijope.com* (3) | publikasiindonesia.id (3) |
Health | researchgate.net (15) | ieee.org (4) | twitter.com (3) | jptcp.com** (2) | frontiersin.org (2) |
A word rain visualization (Centre for Digital Humanities Uppsala, 2023), which combines word prominences through TF-IDF 5 Term frequency–inverse document frequency , a method for measuring the significance of a word in a document compared to its frequency across all documents in a collection. scores with semantic similarity of the full texts of our sample of GPT-generated articles that fall into the “Environment” and “Health” categories, reflects the two categories in question. However, as can be seen in Figure 1, it also reveals overlap and sub-areas. The y-axis shows word prominences through word positions and font sizes, while the x-axis indicates semantic similarity. In addition to a certain amount of overlap, this reveals sub-areas, which are best described as two distinct events within the word rain. The event on the left bundles terms related to the development and management of health and healthcare with “challenges,” “impact,” and “potential of artificial intelligence”emerging as semantically related terms. Terms related to research infrastructures, environmental, epistemic, and technological concepts are arranged further down in the same event (e.g., “system,” “climate,” “understanding,” “knowledge,” “learning,” “education,” “sustainable”). A second distinct event further to the right bundles terms associated with fish farming and aquatic medicinal plants, highlighting the presence of an aquaculture cluster. Here, the prominence of groups of terms such as “used,” “model,” “-based,” and “traditional” suggests the presence of applied research on these topics. The two events making up the word rain visualization, are linked by a less dominant but overlapping cluster of terms related to “energy” and “water.”
The bar chart of the terms in the paper subset (see Figure 2) complements the word rain visualization by depicting the most prominent terms in the full texts along the y-axis. Here, word prominences across health and environment papers are arranged descendingly, where values outside parentheses are TF-IDF values (relative frequencies) and values inside parentheses are raw term frequencies (absolute frequencies).
Finding 3: Google Scholar presents results from quality-controlled and non-controlled citation databases on the same interface, providing unfiltered access to GPT-fabricated questionable papers.
Google Scholar’s central position in the publicly accessible scholarly communication infrastructure, as well as its lack of standards, transparency, and accountability in terms of inclusion criteria, has potentially serious implications for public trust in science. This is likely to exacerbate the already-known potential to exploit Google Scholar for evidence hacking (Tripodi et al., 2023) and will have implications for any attempts to retract or remove fraudulent papers from their original publication venues. Any solution must consider the entirety of the research infrastructure for scholarly communication and the interplay of different actors, interests, and incentives.
We searched and scraped Google Scholar using the Python library Scholarly (Cholewiak et al., 2023) for papers that included specific phrases known to be common responses from ChatGPT and similar applications with the same underlying model (GPT3.5 or GPT4): “as of my last knowledge update” and/or “I don’t have access to real-time data” (see Appendix A). This facilitated the identification of papers that likely used generative AI to produce text, resulting in 227 retrieved papers. The papers’ bibliographic information was automatically added to a spreadsheet and downloaded into Zotero. 6 An open-source reference manager, https://zotero.org .
We employed multiple coding (Barbour, 2001) to classify the papers based on their content. First, we jointly assessed whether the paper was suspected of fraudulent use of ChatGPT (or similar) based on how the text was integrated into the papers and whether the paper was presented as original research output or the AI tool’s role was acknowledged. Second, in analyzing the content of the papers, we continued the multiple coding by classifying the fraudulent papers into four categories identified during an initial round of analysis—health, environment, computing, and others—and then determining which subjects were most affected by this issue (see Table 1). Out of the 227 retrieved papers, 88 papers were written with legitimate and/or declared use of GPTs (i.e., false positives, which were excluded from further analysis), and 139 papers were written with undeclared and/or fraudulent use (i.e., true positives, which were included in further analysis). The multiple coding was conducted jointly by all authors of the present article, who collaboratively coded and cross-checked each other’s interpretation of the data simultaneously in a shared spreadsheet file. This was done to single out coding discrepancies and settle coding disagreements, which in turn ensured methodological thoroughness and analytical consensus (see Barbour, 2001). Redoing the category coding later based on our established coding schedule, we achieved an intercoder reliability (Cohen’s kappa) of 0.806 after eradicating obvious differences.
The ranking algorithm of Google Scholar prioritizes highly cited and older publications (Martín-Martín et al., 2016). Therefore, the position of the articles on the search engine results pages was not particularly informative, considering the relatively small number of results in combination with the recency of the publications. Only the query “as of my last knowledge update” had more than two search engine result pages. On those, questionable articles with undeclared use of GPTs were evenly distributed across all result pages (min: 4, max: 9, mode: 8), with the proportion of undeclared use being slightly higher on average on later search result pages.
To understand how the papers making fraudulent use of generative AI were disseminated online, we programmatically searched for the paper titles (with exact string matching) in Google Search from our local IP address (see Appendix B) using the googlesearch – python library(Vikramaditya, 2020). We manually verified each search result to filter out false positives—results that were not related to the paper—and then compiled the most prominent URLs by field. This enabled the identification of other platforms through which the papers had been spread. We did not, however, investigate whether copies had spread into SciHub or other shadow libraries, or if they were referenced in Wikipedia.
We used descriptive statistics to count the prevalence of the number of GPT-fabricated papers across topics and venues and top domains by subject. The pandas software library for the Python programming language (The pandas development team, 2024) was used for this part of the analysis. Based on the multiple coding, paper occurrences were counted in relation to their categories, divided into indexed journals, non-indexed journals, student papers, and working papers. The schemes, subdomains, and subdirectories of the URL strings were filtered out while top-level domains and second-level domains were kept, which led to normalizing domain names. This, in turn, allowed the counting of domain frequencies in the environment and health categories. To distinguish word prominences and meanings in the environment and health-related GPT-fabricated questionable papers, a semantically-aware word cloud visualization was produced through the use of a word rain (Centre for Digital Humanities Uppsala, 2023) for full-text versions of the papers. Font size and y-axis positions indicate word prominences through TF-IDF scores for the environment and health papers (also visualized in a separate bar chart with raw term frequencies in parentheses), and words are positioned along the x-axis to reflect semantic similarity (Skeppstedt et al., 2024), with an English Word2vec skip gram model space (Fares et al., 2017). An English stop word list was used, along with a manually produced list including terms such as “https,” “volume,” or “years.”
Haider, J., Söderström, K. R., Ekström, B., & Rödl, M. (2024). GPT-fabricated scientific papers on Google Scholar: Key features, spread, and implications for preempting evidence manipulation. Harvard Kennedy School (HKS) Misinformation Review . https://doi.org/10.37016/mr-2020-156
Antkare, I. (2020). Ike Antkare, his publications, and those of his disciples. In M. Biagioli & A. Lippman (Eds.), Gaming the metrics (pp. 177–200). The MIT Press. https://doi.org/10.7551/mitpress/11087.003.0018
Barbour, R. S. (2001). Checklists for improving rigour in qualitative research: A case of the tail wagging the dog? BMJ , 322 (7294), 1115–1117. https://doi.org/10.1136/bmj.322.7294.1115
Bom, H.-S. H. (2023). Exploring the opportunities and challenges of ChatGPT in academic writing: A roundtable discussion. Nuclear Medicine and Molecular Imaging , 57 (4), 165–167. https://doi.org/10.1007/s13139-023-00809-2
Cabanac, G., & Labbé, C. (2021). Prevalence of nonsensical algorithmically generated papers in the scientific literature. Journal of the Association for Information Science and Technology , 72 (12), 1461–1476. https://doi.org/10.1002/asi.24495
Cabanac, G., Labbé, C., & Magazinov, A. (2021). Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals . arXiv. https://doi.org/10.48550/arXiv.2107.06751
Carrion, M. L. (2018). “You need to do your research”: Vaccines, contestable science, and maternal epistemology. Public Understanding of Science , 27 (3), 310–324. https://doi.org/10.1177/0963662517728024
Centre for Digital Humanities Uppsala (2023). CDHUppsala/word-rain [Computer software]. https://github.com/CDHUppsala/word-rain
Chinn, S., & Hasell, A. (2023). Support for “doing your own research” is associated with COVID-19 misperceptions and scientific mistrust. Harvard Kennedy School (HSK) Misinformation Review, 4 (3). https://doi.org/10.37016/mr-2020-117
Cholewiak, S. A., Ipeirotis, P., Silva, V., & Kannawadi, A. (2023). SCHOLARLY: Simple access to Google Scholar authors and citation using Python (1.5.0) [Computer software]. https://doi.org/10.5281/zenodo.5764801
Dadkhah, M., Lagzian, M., & Borchardt, G. (2017). Questionable papers in citation databases as an issue for literature review. Journal of Cell Communication and Signaling , 11 (2), 181–185. https://doi.org/10.1007/s12079-016-0370-6
Dadkhah, M., Oermann, M. H., Hegedüs, M., Raman, R., & Dávid, L. D. (2023). Detection of fake papers in the era of artificial intelligence. Diagnosis , 10 (4), 390–397. https://doi.org/10.1515/dx-2023-0090
DeGeurin, M. (2024, March 19). AI-generated nonsense is leaking into scientific journals. Popular Science. https://www.popsci.com/technology/ai-generated-text-scientific-journals/
Dunlap, R. E., & Brulle, R. J. (2020). Sources and amplifiers of climate change denial. In D.C. Holmes & L. M. Richardson (Eds.), Research handbook on communicating climate change (pp. 49–61). Edward Elgar Publishing. https://doi.org/10.4337/9781789900408.00013
Fares, M., Kutuzov, A., Oepen, S., & Velldal, E. (2017). Word vectors, reuse, and replicability: Towards a community repository of large-text resources. In J. Tiedemann & N. Tahmasebi (Eds.), Proceedings of the 21st Nordic Conference on Computational Linguistics (pp. 271–276). Association for Computational Linguistics. https://aclanthology.org/W17-0237
Google Scholar Help. (n.d.). Inclusion guidelines for webmasters . https://scholar.google.com/intl/en/scholar/inclusion.html
Gu, J., Wang, X., Li, C., Zhao, J., Fu, W., Liang, G., & Qiu, J. (2022). AI-enabled image fraud in scientific publications. Patterns , 3 (7), 100511. https://doi.org/10.1016/j.patter.2022.100511
Gusenbauer, M., & Haddaway, N. R. (2020). Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources. Research Synthesis Methods , 11 (2), 181–217. https://doi.org/10.1002/jrsm.1378
Haider, J., & Åström, F. (2017). Dimensions of trust in scholarly communication: Problematizing peer review in the aftermath of John Bohannon’s “Sting” in science. Journal of the Association for Information Science and Technology , 68 (2), 450–467. https://doi.org/10.1002/asi.23669
Huang, J., & Tan, M. (2023). The role of ChatGPT in scientific communication: Writing better scientific review articles. American Journal of Cancer Research , 13 (4), 1148–1154. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10164801/
Jones, N. (2024). How journals are fighting back against a wave of questionable images. Nature , 626 (8000), 697–698. https://doi.org/10.1038/d41586-024-00372-6
Kitamura, F. C. (2023). ChatGPT is shaping the future of medical writing but still requires human judgment. Radiology , 307 (2), e230171. https://doi.org/10.1148/radiol.230171
Littell, J. H., Abel, K. M., Biggs, M. A., Blum, R. W., Foster, D. G., Haddad, L. B., Major, B., Munk-Olsen, T., Polis, C. B., Robinson, G. E., Rocca, C. H., Russo, N. F., Steinberg, J. R., Stewart, D. E., Stotland, N. L., Upadhyay, U. D., & Ditzhuijzen, J. van. (2024). Correcting the scientific record on abortion and mental health outcomes. BMJ , 384 , e076518. https://doi.org/10.1136/bmj-2023-076518
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023). ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. Journal of the Association for Information Science and Technology, 74 (5), 570–581. https://doi.org/10.1002/asi.24750
Martín-Martín, A., Orduna-Malea, E., Ayllón, J. M., & Delgado López-Cózar, E. (2016). Back to the past: On the shoulders of an academic search engine giant. Scientometrics , 107 , 1477–1487. https://doi.org/10.1007/s11192-016-1917-2
Martín-Martín, A., Thelwall, M., Orduna-Malea, E., & Delgado López-Cózar, E. (2021). Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: A multidisciplinary comparison of coverage via citations. Scientometrics , 126 (1), 871–906. https://doi.org/10.1007/s11192-020-03690-4
Simon, F. M., Altay, S., & Mercier, H. (2023). Misinformation reloaded? Fears about the impact of generative AI on misinformation are overblown. Harvard Kennedy School (HKS) Misinformation Review, 4 (5). https://doi.org/10.37016/mr-2020-127
Skeppstedt, M., Ahltorp, M., Kucher, K., & Lindström, M. (2024). From word clouds to Word Rain: Revisiting the classic word cloud to visualize climate change texts. Information Visualization , 23 (3), 217–238. https://doi.org/10.1177/14738716241236188
Swedish Research Council. (2017). Good research practice. Vetenskapsrådet.
Stokel-Walker, C. (2024, May 1.). AI Chatbots Have Thoroughly Infiltrated Scientific Publishing . Scientific American. https://www.scientificamerican.com/article/chatbots-have-thoroughly-infiltrated-scientific-publishing/
Subbaraman, N. (2024, May 14). Flood of fake science forces multiple journal closures: Wiley to shutter 19 more journals, some tainted by fraud. The Wall Street Journal . https://www.wsj.com/science/academic-studies-research-paper-mills-journals-publishing-f5a3d4bc
The pandas development team. (2024). pandas-dev/pandas: Pandas (v2.2.2) [Computer software]. Zenodo. https://doi.org/10.5281/zenodo.10957263
Thorp, H. H. (2023). ChatGPT is fun, but not an author. Science , 379 (6630), 313–313. https://doi.org/10.1126/science.adg7879
Tripodi, F. B., Garcia, L. C., & Marwick, A. E. (2023). ‘Do your own research’: Affordance activation and disinformation spread. Information, Communication & Society , 27 (6), 1212–1228. https://doi.org/10.1080/1369118X.2023.2245869
Vikramaditya, N. (2020). Nv7-GitHub/googlesearch [Computer software]. https://github.com/Nv7-GitHub/googlesearch
This research has been supported by Mistra, the Swedish Foundation for Strategic Environmental Research, through the research program Mistra Environmental Communication (Haider, Ekström, Rödl) and the Marcus and Amalia Wallenberg Foundation [2020.0004] (Söderström).
The authors declare no competing interests.
The research described in this article was carried out under Swedish legislation. According to the relevant EU and Swedish legislation (2003:460) on the ethical review of research involving humans (“Ethical Review Act”), the research reported on here is not subject to authorization by the Swedish Ethical Review Authority (“etikprövningsmyndigheten”) (SRC, 2017).
This is an open access article distributed under the terms of the Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided that the original author and source are properly credited.
All data needed to replicate this study are available at the Harvard Dataverse: https://doi.org/10.7910/DVN/WUVD8X
The authors wish to thank two anonymous reviewers for their valuable comments on the article manuscript as well as the editorial group of Harvard Kennedy School (HKS) Misinformation Review for their thoughtful feedback and input.
In scholarly writing, it is essential to acknowledge how others contributed to your work. By following the principles of proper citation, writers ensure that readers understand their contribution in the context of the existing literature—how they are building on, critically examining, or otherwise engaging the work that has come before.
APA Style provides guidelines to help writers determine the appropriate level of citation and how to avoid plagiarism and self-plagiarism.
We also provide specific guidance for in-text citation, including formats for interviews, classroom and intranet sources, and personal communications; in-text citations in general; and paraphrases and direct quotations.
Academic Writer ®
Master academic writing with APA’s essential teaching and learning resource
Course Adoption
Teaching APA Style? Become a course adopter of the 7th edition Publication Manual
Instructional Aids
Guides, checklists, webinars, tutorials, and sample papers for anyone looking to improve their knowledge of APA Style
COMMENTS
On the APA reference page, you list all the sources that you've cited in your paper. The list starts on a new page right after the body text. Follow these instructions to set up your APA reference page: Place the section label "References" in bold at the top of the page (centered). Order the references alphabetically. Double-space all text.
What Is an APA Reference Page? An APA reference page is where you find all the references for the in-text citations included in your research. It provides the who, when, what, and where information for each different resource you used. Like the paper itself, the reference list includes similar elements to what is found in the body of the paper like an optional running header, title, double ...
References cited in text must appear in the reference list and vice versa (exception for personal communication which is not included in a Reference list). Make sure that all citation information (names of authors, titles, volume and issue numbers, edition number, page numbers, city and state name, publisher name and location information) is ...
Sample citation: In Brown v. Board of Education (1954), the Supreme Court ruled racial segregation in schools unconstitutional. Note: Italicize the case name when it appears in the text of your paper. Statutes. Reference format: Name of Act, Title Source § Section Number (Year). URL . Sample reference entry for a federal statute:
This guide contains examples of common types of APA Style references. Section numbers indicate where to find the examples in the Publication Manual of the American Psychological Association (7th ed.). More information on references and reference examples are in Chapters 9 and 10 of the Publication Manual as well as the Concise Guide to APA ...
Fillable Template and Sample Paper; Government Documents and Legal Materials; APA Style 7th ed. Tutorials; Additional APA 7th Resources ... Writing Skills This link opens in a new window; Brainfuse Online Tutoring; Help! On the left is a partial list of reference page examples. To see a more complete list, please click on the two pdfs below ...
3.6. (165) In APA, the "Works Cited" page is referred to as a "Reference List" or "Reference Page." "Bibliography" also may be used interchangeably, even though there are some differences between the two. If you are at the point in your article or research paper where you are looking up APA bibliography format, then congratulations!
More than 100 reference examples and their corresponding in-text citations are presented in the seventh edition Publication Manual.Examples of the most common works that writers cite are provided on this page; additional examples are available in the Publication Manual.. To find the reference example you need, first select a category (e.g., periodicals) and then choose the appropriate type of ...
APA References Page Formatting and Example. The APA reference page (also called the reference list) is the final page of your paper where all sources you cited in the main text are listed. It should include the full details of all sources you cited in the main text, arranged A-Z alphabetically by author's surname.
An APA reference page is a list of sources you've mentioned or used throughout your writing, formatted in the APA style, and should be included at the very end of your paper. The details of each source must be displayed in a specific way, depending on the type of the source (websites, books, journals, or other sources).The Basics . A Reference Page must:
Basic guidelines for formatting the reference list at the end of a standard APA research paper Author/Authors Rules for handling works by a single author or multiple authors that apply to all APA-style references in your reference list, regardless of the type of work (book, article, electronic resource, etc.) ... APA Sample Paper Tables and ...
References provide the information necessary for readers to identify and retrieve each work cited in the text. Check each reference carefully against the original publication to ensure information is accurate and complete. Accurately prepared references help establish your credibility as a careful researcher and writer. Consistency in reference ...
This guides shows how to reference with the APA 7th edition style. There are many different types of references (e.g. books, journal articles, websites). Click on the type you require below to see the components of the reference with an example. Books. Journal Articles. Web pages and social media. Newspaper articles. Dictionary or Encyclopaedia.
Media Files: APA Sample Student Paper , APA Sample Professional Paper This resource is enhanced by Acrobat PDF files. Download the free Acrobat Reader. Note: The APA Publication Manual, 7 th Edition specifies different formatting conventions for student and professional papers (i.e., papers written for credit in a course and papers intended for scholarly publication).
Examples. All of the following samples are taken from: American Psychological Association. (2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: American Psychological Association. (In the above sample, the name of the organization is the author. Note that only proper names are capitalized in the title ...
Throughout your paper, you need to apply the following APA format guidelines: Set page margins to 1 inch on all sides. Double-space all text, including headings. Indent the first line of every paragraph 0.5 inches. Use an accessible font (e.g., Times New Roman 12pt., Arial 11pt., or Georgia 11pt.). Include a page number on every page.
Works Included in a Reference List. The reference list provides a reliable way for readers to identify and locate the works cited in a paper. APA Style papers generally include reference lists, not bibliographies. In general, each work cited in the text must appear in the reference list, and each work in the reference list must be cited in the ...
Place the title "References" in bold and center-aligned at the top of the page. Reference pages are double-spaced, both within the entries and between them. Each entry uses a hanging indent: The first line is not indented, but every line after the first is. The standard indentation is half an inch.
1. Place your reference page at the end of your paper. Your reference page comes at the end of your paper, usually before any appendices or glossaries. Place the reference page on a new page directly after the end of your paper. [2] 2. Format each reference according to the appropriate style guide.
Example: Parenthetical citation (APA) Evolution is a gradual process that "can act only by very short and slow steps" (Darwin, 1859, p. 510). An alternative to this type of in-text citation is the system used in numerical citation styles , where a number is inserted into the text, corresponding to an entry in a numbered reference list.
At the end of the entry, place the date of the original publication inside parenthesis along with the note "original work published.". For in-text citations of republished work, use both dates in the parenthetical citation, original date first with a slash separating the years, as in this example: Freud (1923/1961).
Cambridge UP, 2003. MLA (Modern Language Association) style is most commonly used to write papers and cite sources within the liberal arts and humanities. This resource, updated to reflect the MLA Handbook (9th ed.), offers examples for the general format of MLA research papers, in-text citations, endnotes/footnotes, and the Works Cited page.
The Bluebook: A Uniform System of Citation is the main style guide for legal citations in the US. It's widely used in law, and also when legal materials need to be cited in other disciplines. Bluebook footnote citation. 1 David E. Pozen, Freedom of Information Beyond the Freedom of Information Act, 165, U. P🇦 . L.
Academic journals, archives, and repositories are seeing an increasing number of questionable research papers clearly produced using generative AI. They are often created with widely available, general-purpose AI applications, most likely ChatGPT, and mimic scientific writing. Google Scholar easily locates and lists these questionable papers alongside reputable, quality-controlled research.
APA Style provides guidelines to help writers determine the appropriate level of citation and how to avoid plagiarism and self-plagiarism. We also provide specific guidance for in-text citation, including formats for interviews, classroom and intranet sources, and personal communications; in-text citations in general; and paraphrases and direct quotations.