# data[].attributes.body
Provide links to at least 8 of your sources thus far.

The sources do not have to be in MLA.

Links should be active

Scholarly source links should be the DOI or permalink

May be a mix of scholarly and popular

# data[].attributes.body
Text should be concise yet specific and detailed enough to understand your thought process

Clearly convey the connections you have derived between the sources thus far

Nodes should move from general to more specific showing relationships between ideas

Add representative imagery, color code, and organize to show hierarchy, and relationship between ideas

Use in-text parenthetical citation e.g. (Schmidt) where appropriate

Include your research question

# data[].attributes.body
"3 ways to use ChatGPT to enhance students’ critical thinking." THE Campus Learn, Share, Connect, . Accessed 11 May 2024.

# data[].attributes.attachment_link.readable_text
The discussion evolves iteratively, with students engaging in a triangular dialogue involving themselves, ChatGPT and the teacher. This exercise is suitable for a flipped classroom and is ideal for problem-based learning where students prepare in advance.

Quality of ChatGPT responses depends on prompt quality and might need further clarification

2. Creative research brainstorming with ChatGPT

3. Debate and argumentation training with ChatGPT

Nikolas Dietis is an assistant professor of pharmacology at the Medical School of the University of Cyprus.
If you would like advice and insight from academics and university staff delivered direct to your inbox each week, sign up for the Campus newsletter.

# data[].attributes.attachment_link.title
Three ways to use ChatGPT to enhance students' critical thinking in the classroom

# data[].attributes.attachment_link.description
The balance between technology and traditional educational values, as well as ensuring that AI complements, rather than replaces, the human element in education, are the keys to maximising AI's benefits in the classroom, writes Nikolas Dietis

# data[].attributes.body
Terwiesch, Christian, and Lim, et al. "Impact of ChatGPT on Problem-Solving in Ill-Defined Problems." ResearchGate, 2 Mar. 2023, www.researchgate.net. Accessed 11 May 2024.

# data[].attributes.body
Trust, Torrey, et al. "ChatGPT: Challenges, Opportunities, and Implications for Teacher Education." CITE Journal, vol. 23, no. 1, Mar. 2023, Society for Information Technology & Teacher Education, Waynesville, NC, USA.

# data[].attributes.body
Integrating ChatGPT into university problem-solving activities enhances creative thinking skills by providing diverse perspectives, stimulating critical evaluation, and engaging students in iterative learning processes.

# data[].attributes.headline
ChatGPT as a Tool for Diverse Perspectives

# data[].attributes.subject
ChatGPT as a Tool for Diverse Perspectives

# data[].attributes.body
The need to refine and question AI responses promotes deeper cognitive engagement (Terwiesch and Lim).

Engaging in critical evaluation of AI-generated content fosters analytical skills, making students more adept at distinguishing valuable information from less relevant data, a crucial skill in academic research and professional environments.

# data[].attributes.body
ChatGPT introduces varied representations of problems, which fosters creative thinking by exposing students to multiple solutions (Zhai et al.; Terwiesch and Lim).

Implication for College Students: Exposure to diverse problem-solving approaches helps students develop a more flexible and innovative mindset, essential for success in dynamic and interdisciplinary fields.

# data[].attributes.body
Problem-solving sessions with ChatGPT encourage an iterative learning process where students continuously refine their solutions (THE Campus).

This iterative process helps in developing metacognitive skills and self-efficacy in solving complex problems (Zhai et al.).

# data[].attributes.body
Integrating ChatGPT into university problem-solving activities fosters creative thinking by exposing students to diverse perspectives and iterative learning processes (Zhai et al.; THE Campus). It also enhances critical evaluation skills, preparing students for complex real-world challenges with improved analytical abilities (Terwiesch and Lim). This approach not only boosts creativity but also equips students with the adaptability and perseverance needed for future careers.

# data[].attributes.body
Does integrating ChatGPT into problem-solving activities enhance creative thinking skills among university students?

# data[].attributes.body
Adeshola, Ibrahim, and Adeola Praise Adepoju. "The Opportunities and Challenges of ChatGPT in Education." Journal Name, vol. 00, no. 0, 2023, pp. 00-00. Received 23 Jan. 2023, Accepted 26 Aug. 2023, Published online: 04 Sep. 2023.

# data[].attributes.body
"Unpacking ChatGPT: The Pros and Cons of AI’s Hottest Language Model." IE Insights, IE University. Accessed 22 May 2024.

# data[].attributes.attachment_link.readable_text
Lately, ChatGPT has garnered widespread attention and admiration, with discussions centered on its benefits, drawbacks, and limitations, and involving a diverse range of stakeholders, including academics, politicians, students, business leaders, and policymakers.

A transformer-based language model developed by OpenAI - a research company founded in 2015 by Elon Musk, Sam Altman, Greg Brockman, Ilya Sutskever, Wojciech Zaremba, and John Schulman - ChatGPT has achieved state-of-the-art performance in various natural language processing tasks, such as question answering, text generation, and document classification. The model has a large capacity, with more than 175 billion parameters, and has been fine-tuned on a broad spectrum of Internet text sources and data, making it capable of handling a wide range of topics and generating coherent, informative, and congruent responses.

One of the most popular applications of ChatGPT is in conversational AI (Artificial Intelligence), since it is capable of building chatbots for different purposes, like customer service, virtual assistants, tutoring activities, document assessment, consulting, research, and other conversational interfaces.

Chatbots powered by ChatGPT can provide human-like responses to user queries, allowing companies to automate customer service and improve the overall user experience. Other uses include producing and curating relevant information for academic exercises, general queries, and even scientific investigation.

Another application of ChatGPT is in content generation, such as creating news articles, summaries, essays, product descriptions - and even poetry. The model can be fine-tuned on specific text genres and styles, making it possible to produce high-quality, coherent, and on-topic content. This can be useful for a diverse array of businesses or individuals looking to automate content creation, while freeing up time and resources for more creative tasks or philosophical endeavors.

ChatGPT is also great at text classification, for example with tasks such as sentiment analysis, topic grouping, and fake news detection, and the model can be fine-tuned on labeled text data to accurately categorize text into different classes and segments. This can come in handy in various industries such as finance, marketing, and politics, among others, to monitor, scrutinize, and understand public opinions and trends.

These AI systems are here to stay, so we best embrace them, optimize their potential, and try to get the best out of them.

The AI model is a fantastic productivity tool, that has an extensive variety of applications, and that certainly goes beyond text editing or note taking. It offers rigorous and fast options for text completion, including auto-finishing sentences, paragraphs, or even entire articles. It can generate text suggestions in real-time, allowing users to complete their writing faster and more efficiently as it reviews, and corrects spelling and grammar simultaneously.

ChatGPT and other machine-learning-based AI large language models (LLM) autonomously learn from online information, using a vastly immense pool of data, in order to produce seemingly intelligent original content. The more detailed the question or instruction, the more sophisticated and accurate the answer (or end product).

Naturally, these ground-breaking models have a variety of potential uses, including but not limited to:

Research on Natural Language Processing (NLP) and Machine Learning (ML): ChatGPT is a superb research tool to study NLP and ML tasks. It can be fine-tuned on specific duties, or used to evaluate the performance of other models and digital ecosystems.

Sentiment Analysis and Opinion Mining: ChatGPT can be used to study sentiment and opinion expressed in text data, such as product reviews, social media posts, and news articles. It works well at identifying positive, negative, or neutral expressions and at extracting insights about public opinion and trending topics.

Text Mining and Information Retrieval: ChatGPT can extract information from large amounts of text data, such as blogs, articles, scientific papers, and social media posts. The model is great at pinpointing key topics, summarizing specific information, and gathering ideas from online data.

Human-Computer Interaction: ChatGPT is capable of building conversational bots for human-computer interaction, such as chatbots and virtual assistants. It can also be used to study how users interact with conversational AI bots and how they can be improved.

Language Translation and Multilingual Applications: ChatGPT can build language translation models, making it possible to translate text between different languages, as well as to construct multilingual applications, such as chatbots that can handle multiple languages in different scenarios.

Even though ChatGPT is -for now- the best of its kind, there are other similar AI language models, such as Google's -soon-to-be-released Apprentice Bard (former Lambda), Meta's OPT (Open Pretrained Transformer), Jasper, Replika, Bloom, Character.ai, Palm, Sparrow (soon to be released), Chatsonic, Chinchilla, ELSA Speak, Megatron, DialoGPT, Playground and Perplexity (that lists the sources it draws from).

These AI systems have the ability to handle with high accuracy a wide range of NLP tasks and provide insights into language and human-computer interaction, making them valuable tools for research and development.

There are several interesting examples of the potential applications, great uses and advantages of ChatGPT in academia; some of these are:

Automated grading and feedback: ChatGPT can grade assignments, essays and test answers, providing personalized feedback to students.

Question-answering tool: Students can use ChatGPT to ask for clarification or information about course materials, saving time for instructors who might otherwise be answering the same questions.

Writing and language coaching: ChatGPT can provide suggestions for writing, grammar, and vocabulary, helping students improve their language and writing skills.

Study aid: ChatGPT can assist students in understanding and retaining information by providing explanations and answering questions at an incredible speed and significant accuracy.

Group projects: ChatGPT can facilitate group projects by helping students collaborate on brainstorming, researching, planning and organizing ideas.

Presentation tool: ChatGPT can generate slides and other aids for presentations, helping students to effectively communicate their ideas.

Virtual tutoring: ChatGPT can provide virtual one-on-one tutoring for students who need extra help, especially for those in remote or online learning environments.

It is important to note that despite its highly advanced, ChatGPT also has significant limitations and drawbacks that are crucial to acknowledge, understand and consider. Some of the challenges and caveats posed by these models (in an educational setting) are:

Accuracy and reliability: ChatGPT is not perfect and may sometimes provide incorrect or misleading. Students should be taught to critically evaluate its output and corroborate it with other sources.

Bias: As a machine-learning model, ChatGPT is trained on data that may contain bias. This can result in biased outputs and perpetuate harmful stereotypes.

Dependence: Over-reliance on ChatGPT can reduce students' critical thinking and problem-solving skills, as well as their motivation to actively engage with course materials.

Lack of creativity: Using ChatGPT for tasks such as writing assignments or generating presentation slides may discourage students from using their own creative thinking and problem-solving skills.

Privacy and security: Allowing students to use ChatGPT in the classroom raises concerns about data privacy and security, as sensitive information may be shared or leaked.

Cheating: ChatGPT could be used for academic dishonesty, such as plagiarism or copying answers from the model.

Technical issues: The use of ChatGPT may be impacted by technical issues, such as network connectivity or software compatibility, which could disrupt the classroom experience.

ChatGPT and other similar models have a wide range of applications in the field of natural language processing, including conversational AI, content generation, text classification, information curation, and narrative completion. Their large capacity and fine-tuning capabilities make it possible to build high-quality language-based applications for various industries and purposes. These AI systems are here to stay, so we best embrace them, optimize their potential, and try to get the best out of them.

© IE Insights.

# data[].attributes.attachment_link.title
Unpacking ChatGPT: The Pros and Cons of AI's Hottest Language Model | IE Insights

# data[].attributes.attachment_link.description
Lately, ChatGPT has garnered widespread attention and admiration, with discussions centered on its benefits, drawbacks, and limitations, and involving a diverse range of stakeholders, including academics, politicians, students, business leaders, and policymakers.

# data[].attributes.body
ChatGPT and the Decline of Critical Thinking. IE Insights, www.ie.edu/insights/articles/chatgpt-and-the-decline-of-critical-thinking/. Accessed 22 May 2024.

# data[].attributes.attachment_link.title
ChatGPT and the Decline of Critical Thinking | IE Insights

# data[].attributes.attachment_link.description
The use of ChatGPT as a search engine has made the need for critical thinking more pressing than ever, writes Enrique Dans.

# data[].attributes.body
Zhai, et al. "ChatGPT Improves Creative Problem-Solving Performance in University Students: An Experimental Study." ResearchGate, 27 Dec. 2022, Accessed 11 May 2024.

# data[].attributes.body
Lo, Chung Kwan. "What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature." Education Sciences, vol. 13, no. 4, 2023, article 410.

# data[].attributes.attachment_link.readable_text
by

Department of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong SAR 999077, China

1. Introduction

Artificial intelligence (AI) has developed rapidly in recent years, leading to various applications in different disciplines, such as healthcare [ 1] and education [ 2]. AI systems can be trained to simulate the human brain and carry out routine work using large amounts of data [ 3]. In healthcare, for example, AI can aid professionals in their work by synthesising patient records, interpreting diagnostic images, and highlighting health concerns [ 4]. AI applications have also been utilised in education to enhance administrative services and academic support [ 2]. One representative example is intelligent tutoring systems (ITS), which can be used to simulate one-to-one personal tutoring. The results of a meta-analysis indicated that ITS generally had a moderately positive effect on the academic achievement of college students [ 5]. However, the development of ITS can be challenging, as it involves not only content creation and design but also the refinement of feedback phrasing and dialogue strategies [ 6].

ChatGPT, a recently developed conversational chatbot created by OpenAI [ 7], may make it easier for instructors to apply AI in teaching and learning. ChatGPT uses natural language processing to generate human-like responses to user input. It has gained attention worldwide for its impressive performance in generating coherent, systematic, and informative responses [ 8]. In a surprising achievement, ChatGPT passed four separate examinations at the University of Minnesota Law School [ 9]. Although its scores were not (yet) very good, the results demonstrate that this AI application is capable of earning a university degree [ 10]. Since its release on 30 November 2022, ChatGPT has become the fastest-growing user application in history, reaching 100 million active users as of January 2023, just two months after its launch [ 11].

Despite its success, ChatGPT has introduced new challenges and threats to education. With its ability to provide specific answers to user questions, it can be used to complete written assignments and examinations on behalf of students, leading to concerns about AI-assisted cheating. In response, some schools have banned access to ChatGPT on campus [ 12]. The implications of GhatGPT in the field of education were explored in a review by Mhlanga [ 13]. He analysed eight articles on ChatGPT and revealed that educators had concerns regarding the use of ChatGPT in education. They expressed worries that students may outsource their work to ChatGPT because of its ability to rapidly generate acceptable texts. Therefore, Mhlanga [ 13] emphasised the importance of the responsible and ethical use of ChatGPT. Sallam [ 14] reviewed 60 articles on ChatGPT in the fields of healthcare, medical education, and academia. He found various concerns across the studies, ranging from plagiarism to incorrect responses and inaccurate citations. Therefore, the implications of ChatGPT-assisted learning require immediate attention to ensure that its benefits are optimised while its drawbacks are minimised.

Although Mhlanga [ 13] and Sallam [ 14] shed some light on the concerns regarding the use of ChatGPT, a more comprehensive review is needed to gain a deeper understanding of its potential benefits and threats to education. Furthermore, current knowledge about ChatGPT's capabilities comes mainly from media reports (e.g., [ 9, 15]). It is necessary to examine the results of research on ChatGPT to evaluate its true performance across different subject domains. Hence, the following research questions (RQ1 to RQ3) are posed to guide the review.

RQ1: How does ChatGPT perform in different subject domains?

RQ2: How can ChatGPT be used to enhance teaching and learning?

RQ3: What are the potential issues associated with ChatGPT, and how can they be addressed?

2. Methods

2.1. The Rapid Review Approach

As ChatGPT continues to receive great attention and is increasingly used by students, there is a pressing need to understand its impact on education and take immediate action in response to its possible threats. However, a comprehensive systematic review can take several months or even years to conduct [ 16, 17], which is not ideal for catching up with the rapidly evolving ChatGPT landscape. Therefore, a rapid review approach was used. According to Tricco et al. [ 17], "a rapid review is a type of knowledge synthesis in which components of the systematic review process are simplified or omitted to produce information in a short period of time" (p. 2). This approach enabled a timely synthesis and overview of recently published articles and their key findings. Accordingly, this review could provide valuable insights enabling researchers, practitioners, and policymakers to respond promptly to the influence of ChatGPT on the field of education.

2.2. Search Strategies

This rapid review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement when selecting relevant articles [ 18]. The final search was conducted on 28 February 2023 (i.e., three months after the release of ChatGPT). Therefore, the ChatGPT involved in these articles was its original release (dated 30 November 2022) based on Generative Pre-trained Transformer 3.5 (GPT-3.5). Seven electronic databases were used: (1) Academic Search Ultimate, (2) ACM Digital Library, (3) Education Research Complete, (4) ERIC, (5) IEEE Xplore, (6) Scopus, and (7) Web of Science. The search string "ChatGPT" was used in each database to search for relevant articles that included the term "ChatGPT" in their title, abstract, or keywords. The publication period was specified as 2022 to the present. Despite the use of multiple databases, only a limited number of relevant articles were found. Therefore, a title search for the term "ChatGPT" was conducted using Google Scholar within the same publication period. This approach enabled the retrieval of additional relevant articles that were not captured in the initial database search.

2.3. Inclusion and Exclusion Criteria

Academic articles published between 1 January 2022 and 28 February 2023 (the date of the final search) were reviewed, including advanced online publications and preprints. Non-academic articles (e.g., articles from mass and social media) were excluded. At the time of writing, this period covered all of the articles that had been published about ChatGPT, as it was released on 30 November 2022. To be included in this rapid review, articles had to discuss ChatGPT in the field of education, with no constraints on any specific educational contexts. Literature reviews, if retrieved, were used as background references. However, they were excluded from the synthesis to avoid duplicate findings. In addition, only English-language articles were included in this review. Table 1 summarises the inclusion and exclusion criteria for article selection.

2.4. Content Analysis

Guided by the research questions set forth above, a content analysis of the included articles was conducted. Creswell's [ 19] coding techniques were employed in the process of analysis and interpretation. His approach comprised of the following three main stages.

Open coding: Open coding is the initial stage of coding in which the researcher examines the data and generates codes to describe and categorise the data. It allows a deep exploration and understanding of the data without imposing preconceived ideas.

Axial coding: After the initial process of open coding, axial coding is used to analyse the relationships and connections between the codes generated during open coding. It involves organising the codes into broader categories or themes and establishing the relationships between them.

Selective coding: Selective coding is the final stage of coding. It involves further refining and integrating the categories or themes identified during open and axial coding to develop a comprehensive picture. It identifies the core category or central phenomenon that emerged from the data.

Following Creswell's [ 19] approach, codes were assigned to pieces of data without using predominant frameworks in the stage of open coding. After the completion of coding the first 15 articles, all the codes assigned were reviewed and grouped by similarity, thereby reducing redundant codes in the stage of axial coding. The preliminary list of codes was used to analyse the remaining articles. Hence, any new codes that emerged were added to the list. Specific quotes were identified to further support the codes. Finally, similar codes were organised into categories in the stage of selective coding. To enhance the consistency of classification, several exemplary quotes that clearly illustrated each category were identified. Multiple reviews of the data were performed to maintain consistency in coding.

3. Findings

3.1. General Description of the Literature

Figure 1 shows that 50 and 367 outcomes were retrieved through the database search and Google Scholar, respectively. Due to duplication across databases and Google Scholar, some of the articles were removed, yielding 363 unique records for screening. Notably, many records retrieved were outside the scope of this review, including articles from mass and social media found by Google Scholar. After reviewing the unique records' titles, abstracts, and publication sources, 55 full-text articles were assessed for eligibility. Five articles were then excluded: (1) two articles that were not related to education, (2) one preprint article that was incomplete, and (3) two articles that were literature reviews. However, some of the excluded articles were used as background references. Ultimately, 50 articles [ 8, 10, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67] were selected for synthesis. The list of the included articles is provided in the Supplementary Materials. Figure 1 provides an overview of the article selection process.

As shown in Figure 2, the majority of the included articles were written by researchers from the United States (N = 19), followed by the United Kingdom (N = 4) and Austria (N = 3). Figure 3 shows that 16 of the 50 included articles (32%) were published in journals, and two were published as an eBook (2%) and report (2%), respectively. The remaining 32 articles (64%) were preprints uploaded on SSRN [ 68] (N = 12), followed by arXiv [ 69] (N = 7) and ResearchGate [ 70] (N = 5), among others.

3.2. RQ1: How Does ChatGPT Perform in Different Subject Domains?

As shown in Table 2, ChatGPT-3.5′s performance was evaluated in 21 studies using tests, exams, or interviews. All of these studies, except for de Winter's [ 20] study that used high school exams, were conducted in the context of higher education. ChatGPT's performance varied across subject domains. It demonstrated outstanding results in critical and higher-order thinking [ 21] and economics [ 22]. However, its performance was not entirely satisfactory in other subject domains, such as law [ 10, 23], medical education [ 24, 25, 26, 27, 28, 29, 30, 31, 32], and mathematics [ 33]. These results are consistent with Newton's [ 34] study, which used multiple-choice questions-based exams to assess ChatGPT's performance in economics, medical education, law, and physics. In economics, ChatGPT outperformed average students, but in other subjects, it underperformed average students by 8 to 40 points (out of 100).

Notably, medical education was a subject domain for which there was relatively more evidence of ChatGPT's performance. These results came from multiple countries. Kung et al. [ 24] and Gilson et al. [ 25] evaluated ChatGPT's performance using the United States Medical Licensing Examination. Their results suggested that ChatGPT could yield moderate accuracy and, thus, a passing score. However, Fijačko [ 26] found that ChatGPT failed the exams of the American Heart Association. Han et al. [ 27] noted that ChatGPT provided incorrect and insufficient information about cardiovascular diseases. In the context of pharmacology education in Malaysia, Nisar and Aslam [ 28] found that although ChatGPT could provide relevant and accurate answers, these answers lacked references and sources. In China, Wang et al. [ 29] testified ChatGPT using the Chinese National Medical Licensing Examination. They reported that ChatGPT's performance was lower than medical students' average score. Similar results were reported by researchers in Korea [ 30], India [ 31], and Singapore [ 32]. The findings of these studies suggested that, in general, ChatGPT's performance was not entirely satisfactory in the domain of medical education.

3.3. RQ2: How Can ChatGPT Be Used to Enhance Teaching and Learning?

The findings of this review suggested that ChatGPT can serve as an assistant for both instructors and students. Concerning instructors, Table 3 categorises ChatGPT's five major functions into two main aspects, namely teaching preparation (i.e., generating course materials, providing suggestions, and performing language translation) and assessment (i.e., generating assessment tasks and evaluating student performance).

Concerning the teaching preparation aspect, ChatGPT can make suggestions that assist instructors. In the words of one instructor, "ChatGPT can be a useful tool for teachers and educators to remind them of what knowledge and skills should be included in their curriculum, by providing an outline" [ 40] (pp. 7-8). Megahed et al. [ 37] asked ChatGPT to generate a course syllabus for an undergraduate statistics course. They noted that its teaching suggestions could be adopted without the need for major changes. Zhai [ 41] found that ChatGPT was able to provide recommendations related to special education. He commented, "These recommendations are beneficial for students with special learning needs" (p. 4).

Concerning the assessment aspect, ChatGPT can help instructors generate exercises, quizzes, and scenarios for student assessment [ 29, 45]. However, Al-Worafi et al. [ 49] cautioned that the assessment tasks suggested by ChatGPT might not cover all targeted learning objectives. Therefore, they recommended using ChatGPT to guide instructors in their preparation of assessments rather than to completely replace their efforts. For example, Han et al. [ 27] instructed ChatGPT to create a multiple-choice question with a vignette and lab values for a medical topic. The question's outcome was "a reasonable basic question to assess students' knowledge" (p. 7). The instructors could refine the language of and information contained in the question to increase its relevancy to their course requirements.

For students, ChatGPT can serve as a virtual tutor to support their learning. Table 4 categorises its six major functions into two main aspects, namely learning (i.e., answering questions, summarising information, and facilitating collaboration) and assessment (i.e., concept checking and exam preparation, drafting assistance, and providing feedback).

Consider ChatGPT's ability to facilitate collaboration in the learning aspect. Rudolph et al. [ 52] suggested that ChatGPT can generate different scenarios for students to work collaboratively in group activities. It can then provide a discussion structure, real-time feedback, and personalised guidance to facilitate group discussions and debates [ 44]. As noted by Gilson et al. [ 25], the enhanced small-group discourse in problem-solving benefits student learning.

Concerning the assessment aspect, students can benefit from using ChatGPT as a scaffolding tool for their initial draft and then refining the draft by correcting errors and adding references to the final versions of their written assignments [ 10, 23]. Gilson et al. [ 25] noted that ChatGPT's initial answer could prompt further questioning and encourage students to apply their knowledge and reasoning skills. However, Rudolph et al. [ 52] cautioned that ChatGPT should not replace critical thinking and original work but should instead serve as an aid to improve writing and research skills.

3.4. RQ3: What Are the Potential Issues Associated with ChatGPT and How Can They Be Addressed?

This review identified five major issues associated with ChatGPT in education. Table 5 categorises these issues into two main aspects, namely accuracy and reliability (i.e., relying on biased data, having limited up-to-date knowledge, and generating incorrect or fake information) and plagiarism prevention (i.e., student plagiarism and bypassing plagiarism detectors).

Consider the issue of generating incorrect or fake information in the accuracy and reliability aspect. Mogali [ 32] raised concerns about ChatGPT's well-written but inaccurate information. It has commonly been observed that the bibliographic citations generated by ChatGPT can be fake [ 32, 39, 46, 56, 58]. Concerning subject knowledge, Megahed et al. [ 37] found that it generated incorrect programming codes and was unable to detect and resolve its errors. This concern was echoed by Jalil et al. [ 38], who commented that "ChatGPT is a poor judge of its own correctness" (p. 8). ChatGPT's accuracy and reliability have also been found to be questionable in other subject domains, such as mathematics [ 33], sports science and psychology [ 39], and health professions [ 26, 27, 32].

Concerning the plagiarism prevention aspect, ChatGPT-generated texts can bypass conventional plagiarism detectors. For example, Ventayen [ 62] asked ChatGPT to write an essay based on existing publications and checked its output for originality using Turnitin (a plagiarism detection application [ 71]). However, the application found a low similarity index between the document and existing work, and no plagiarism could be detected. Khalil and Er [ 61] asked ChatGPT to generate 50 essays based on different open-ended questions. Half of the essays were checked using Turnitin [ 71], which gave an average similarity score of 13.72%. The other half were checked using iThenticate [ 72], another plagiarism detection application, which gave an average similarity score of 8.76%. With these scores, the ChatGPT documents were considered highly original.

The included articles proposed several strategies to address the potential issues associated with ChatGPT in education. Table 6 categorises these strategies into three main aspects, namely task design (i.e., incorporating multimedia resources, adopting novel question types, and using digital-free assessment formats), the identification of AI writing (i.e., using AI-based writing detection tools and checking references), and institutional policy (i.e., establishing anti-plagiarism guidelines and providing student education).

Consider the issue of adopting novel question types in the task design aspect. Zhai [ 8] proposed exploring innovative formats that encourage students to be creative and engage in critical thinking. Choi et al. [ 10] emphasised the importance of requiring students to analyse cases rather than simply recalling knowledge. Similarly, Geerling et al. [ 22] suggested requiring students to apply the concepts that they learn in their courses and even to create new materials that AI cannot replicate. Stutz et al. [ 36] concluded that future assessments should focus on the higher levels of Bloom's taxonomy, such as application, analysis, and creation [ 73].

Other strategies concerned the identification of AI writing and institutional policy aspects. In the former aspect, the findings of this review suggested that using AI-based writing detection tools and checking references were the two major strategies. Szabo [ 39] reported that although conventional plagiarism detectors failed to identify ChatGPT-generated texts, AI detectors were (still) able to detect them. Moreover, ChatGPT's possible failure to generate a correct reference list (see Table 5) can be a telltale sign for instructors seeking to identify whether a student has used ChatGPT [ 50, 51, 56]. In addition to detecting student plagiarism, researchers have emphasised the importance of establishing anti-plagiarism guidelines and educating students about academic integrity [ 52, 56, 61].

4. Discussion

In this review, 50 articles published on or before 28 February 2023 were analysed. Therefore, the ChatGPT involved in these articles was its original version based on GPT-3.5, instead of GPT-4 [ 74]. The findings suggested that ChatGPT has the potential to enhance teaching and learning (see Table 3 and Table 4). However, its knowledge and performance were not entirely satisfactory across subject domains (see Table 2). The use of ChatGPT also presents various potential issues, such as generating incorrect or fake information and student plagiarism (see Table 5). Therefore, immediate action is needed to address these potential issues (see Table 6) and optimise the use of ChatGPT in education.

4.1. Leveraging ChatGPT in Teaching and Learning

ChatGPT can be a valuable tool for instructors, providing a starting point for creating course syllabi, teaching materials, and assessment tasks. However, concerns regarding the accuracy of its generated content must be addressed. One possible solution would be to use ChatGPT to generate raw materials to train course-specific chatbots. For example, Topsakal and Topsakal [ 42] used ChatGPT to create dialogues to aid students' English language learning. After verifying the accuracy of the materials, instructors can ask GhatGPT to convert them into a format suitable for use with AI-based chatbots, such as Google Dialogflow [ 75], providing students with an interactive and personalised learning environment.

ChatGPT can also enhance active learning approaches. For example, Rudolph et al. [ 52] suggested using flipped learning, in which students are required to prepare for lessons by studying pre-class materials. This instructional approach can free up class time for interactive learning activities, such as group discussions. In conventional flipped classes, however, students may encounter difficulties in pre-class learning [ 76]. In-class participation also needs to be improved [ 77]. This issue became apparent during the COVID-19 pandemic, during which fully online flipped learning led to poor in-class participation and disengagement from peer sharing [ 78, 79]. As a virtual tutor, ChatGPT can assist students in online independent study by answering their questions [ 28] and enhance group dynamics by suggesting a discussion structure and providing real-time feedback [ 44].

4.2. Challenges and Threats Posed by ChatGPT in Education

According to Sallam [ 14], the use of ChatGPT in education poses challenges related to its accuracy and reliability. Because ChatGPT is trained on a large corpus of data, it may be biased or contain inaccuracies. Mbakwe et al. [ 57] noted that bias may stem from the use of research primarily conducted in high-income countries or textbooks that are not universally applicable. As evidenced by Pavlik [ 54], for example, ChatGPT is not familiar with hedge fund ownership of news media. In addition, ChatGPT's knowledge is limited and has not (yet) been updated with data after 2021 [ 25, 45, 46]. Therefore, its responses may not always be accurate or reliable, particularly for specialised subject matters and recent events. Furthermore, ChatGPT may generate incorrect or even fake information [ 37, 46, 51]. This issue can be problematic for students who rely on ChatGPT to inform their learning.

Student plagiarism has become a significant concern in education. Plagiarism detection applications (e.g., Turnitin [ 71] and iThenticate [ 72]) are commonly used to identify copied content in student assignments. However, studies have found that ChatGPT can bypass these detectors by generating seemingly original content [ 61, 62]. Bašić et al. [ 59] provided evidence that students who used ChatGPT were more likely to commit plagiarism than those who did not use it. ChatGPT's ability to facilitate plagiarism not only impairs academic integrity but also defeats the purpose of assessment, which is to evaluate student learning fairly. According to Cotton et al. [ 50], students who use ChatGPT to generate high-quality work gain an unfair advantage over their peers who do not have access to it. More importantly, instructors cannot accurately evaluate student performance when ChatGPT is involved, making it difficult to follow up on students' learning problems.

4.3. Immediate Action in Response to the Impact of ChatGPT

Immediate action must be taken to mitigate the impact of ChatGPT on education. Assessment methods and institutional policies need to be updated to address the challenges posed by the emergence of AI-generated content in student assignments. Before the launch of GPT-4 (dated 14 March 2023), instructors could refine the design of their assessment tasks by incorporating multimedia resources to reduce the risk of plagiarism. The original release of ChatGPT could not process images and videos, which resulted in the missing context that increased barriers for students seeking to use it to cheat [ 21, 34, 52]. However, GPT-4, a large multimodal model created by OpenAI [ 74], is able to process images. Therefore, instructors have to consider other strategies, as shown in Table 6, such as incorporating digital-free components (e.g., oral presentations [ 40, 52, 58]) into their assessment tasks. These components require students to demonstrate their abilities in real-time and in person. At the institutional level, AI-based writing detection tools should be made available to instructors. Furthermore, anti-plagiarism guidelines should be established to clarify the boundaries of ChatGPT's involvement in student learning.

Instructor training and student education are also critical in responding to the impact of ChatGPT [ 64]. It is essential to train instructors on how to identify the use of ChatGPT in student assignments, which can be achieved by using AI detection tools. Instructors should also be trained on how to fully use ChatGPT in their teaching preparation and course assessment, as shown in Table 3. For students, it is crucial to introduce them to the limitations of ChatGPT, such as its reliance on biased data, limited up-to-date knowledge, and potential for generating incorrect or fake information. Therefore, instructors should teach students to use other authoritative sources (e.g., reference books) to verify, evaluate, and corroborate the factual correctness of information provided by ChatGPT [ 39, 44]. It is also important to increase students' awareness of academic integrity policies and their understanding of the consequences of academic misconduct [ 52, 60]. To achieve this goal, instructors should openly discuss ChatGPT in their courses and emphasise the importance of academic honesty.

4.4. Limitations and Recommendations for Future Research

4.4.1. Limitations of this Rapid Review

This rapid review has limitations that must be considered when interpreting the findings. First, similar to the reviews by Mhlanga [ 13] and Sallam [ 14], the majority of the included articles were preprints, meaning that they have not undergone rigorous peer review. The quality of their evidence is, therefore, questionable. Follow-up systematic reviews are needed once more peer-reviewed articles on ChatGPT are published.

Second, most of the included articles were written in the Western context, particularly in medical and higher education. Thus, the findings of this review may be biased towards these specific contexts. Further studies in other subject domains (e.g., mathematics and language education) and education contexts (e.g., primary and secondary education) are recommended.

Third, this review only focused on the original release of ChatGPT. As a result, the findings might not be applicable to other applications of GPT and GPT-4 [ 74] that have been launched beyond the time period of this review. Future research can test the performance of GPT-4, explore its possibilities in supporting teaching and learning, and discuss its potential threats and solutions. Furthermore, future reviews can expand their scope to include other applications of GPT in education. By conducting more in-depth research and comprehensive reviews, educators can better understand the capabilities and limitations of GPT technology, as well as develop appropriate guidelines and policies to ensure its responsible and ethical use.

4.4.2. Limitations of the Included Articles

In addition to the limitations of this review, there are three major limitations associated with the included articles. First, very few studies empirically examined the influence of ChatGPT on student performance and behaviour. From the study by Bašić et al. [ 59], for example, we learnt that using ChatGPT to support student writing might not improve performance but could instead lead to more plagiarism issues. However, these researchers acknowledged that the generalisability of their study was limited due to the small number of research participants (N = 18). Further research is needed to evaluate the benefits and potential problems of ChatGPT-assisted learning for students.

Second, some of the suggestions made in the included articles were based on the researchers' intuitive beliefs rather than empirical evidence. For example, some researchers [ 8, 52, 62] suggested designing assessment tasks that focus on creativity and critical thinking. However, specific strategies to achieve this goal were not always thoroughly discussed. Therefore, more rigorous studies are needed to provide evidence-based recommendations for using ChatGPT in education.

Finally, some researchers used ChatGPT to generate some of their content or suggestions, leading to repetitive ideas across articles. For example, the researchers of different articles asked ChatGPT how it can benefit teaching and learning, resulting in very similar content, such as personalised learning and language translation [ 8, 43, 45, 46, 48, 51]. This observation provides another reason to discourage the direct adoption of ChatGPT- or AI-generated texts as personal ideas in research articles, in addition to Thorp's [ 80] concern about "plagiarism of existing works" (p. 313). When ChatGPT is used as a co-author, it may generate similar points in different articles that do not acknowledge each other, which is the equivalent of self-plagiarism. If researchers plan to involve ChatGPT in writing, additional analysis of its ideas should be conducted.

5. Conclusions

This rapid review of 50 articles highlighted ChatGPT's varied performance across different subject domains and its potential benefits when serving as an assistant for instructors and as a virtual tutor for students. However, its use raises various concerns, such as its generation of incorrect or fake information and the threat it poses to academic integrity. The findings of this review call for immediate action by schools and universities to update their guidelines and policies for academic integrity and plagiarism prevention. Furthermore, instructors should be trained on how to use ChatGPT effectively and detect student plagiarism. Students should also be educated on the use and limitations of ChatGPT and its potential impact on academic integrity.

Supplementary Materials

Funding

This research received no external funding.

Institutional Review Board Statement

Informed Consent Statement

Data Availability Statement

The data samples and detailed coding procedures can be accessed by contacting the corresponding author.

Conflicts of Interest

The author declares no conflict of interest.

References

1. Afzal, S.; Dhamecha, T.; Mukhi, N.; Sindhgatta Rajan, R.; Marvaniya, S.; Ventura, M.; Yarbro, J. Development and deployment of a large-scale dialog-based intelligent tutoring system. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA, 2-7 June 2019; Association for Computational Linguistics: Stroudsburg, PA, USA, 2019; Volume 2, pp. 114-121. [Google Scholar]

2. OpenAI. Available online: https://openai.com (accessed on 10 March 2023).

3. ChatGPT Passes Exams from Law and Business Schools. Available online: https://edition.cnn.com/2023/01/26/tech/chatgpt-passes-exams (accessed on 10 March 2023).

4. ChatGPT Sets Record for Fastest-Growing User Base-Analyst Note. Available online: https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01 (accessed on 10 March 2023).

5. Schools Ban ChatGPT Amid Fears of Artificial Intelligence-Assisted Cheating. Available online: https://www.voanews.com/a/schools-ban-chatgpt-amid-fears-of-artificial-intelligence-assisted-cheating/6949800.html (accessed on 10 March 2023).

6. Sallam, M. The Utility of ChatGPT as an Example of Large Language Models in Healthcare Education, Research and Practice: Systematic Review on the Future Perspectives and Potential Limitations. Available online: https://www.medrxiv.org/content/10.1101/2023.02.19.23286155v1 (accessed on 1 March 2023).

7. ChatGPT Could Be a Stanford Medical Student, a Lawyer, or a Financial Analyst. Here's a List of Advanced Exams the AI Bot Has Passed So Far. Available online: https://www.businessinsider.com/list-here-are-the-exams-chatgpt-has-passed-so-far-2023-1 (accessed on 10 March 2023).

8. Creswell, J.W. Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research, 4th ed.; Pearson: Boston, MA, USA, 2012. [Google Scholar]

9. de Winter, J.C.F. Can ChatGPT Pass High School Exams on English Language Comprehension? Available online: https://www.researchgate.net/publication/366659237_Can_ChatGPT_pass_high_school_exams_on_English_Language_Comprehension (accessed on 1 March 2023).

10. Mogali, S.R. Initial Impressions of ChatGPT for Anatomy Education. Anat. Sci. Educ. 2023, 1-4. [Google Scholar] [CrossRef] [PubMed]

11. Buchberger, B. Is ChatGPT Smarter than Master's Applicants? Research Institute for Symbolic Computation: Linz, Austria, 2023. [Google Scholar] [CrossRef]

12. Ali, F. Let the Devil Speak for Itself: Should ChatGPT Be Allowed or Banned in Hospitality and Tourism Schools? J. Glob. Hosp. Tour. 2023, 2, 1-6. Available online: https://digitalcommons.usf.edu/jght/vol2/iss1/1/ (accessed on 10 March 2023).

13. Atlas, S. ChatGPT for Higher Education and Professional Development: A Guide to Conversational AI; University of Rhode Island: Kingston, RI, USA, 2023; Available online: https://digitalcommons.uri.edu/cba_facpubs/548 (accessed on 1 March 2023).

14. Zhang, B. Preparing Educators and Students for ChatGPT and AI Technology in Higher Education: Benefits, Limitations, Strategies, and Implications of ChatGPT & AI Technologies. Available online: https://www.researchgate.net/profile/Bo-Zhang-376/publication/367380845_Preparing_Educators_and_Students_for_ChatGPT_and_AI_Technology_in_Higher_EducationBenefits_Limitations_Strategies_and_Implications_of_ChatGPT_AI_Technologies/links/63d06849e922c50e99bd4d09/Preparing-Educators-and-Students-for-ChatGPT-and-AI-Technology-in-Higher-EducationBenefits-Limitations-Strategies-and-Implications-of-ChatGPT-AI-Technologies.pdf (accessed on 1 March 2023). [CrossRef]

15. Marusenko, R. New Challenges in Assessing Students' Knowledge: Chatbot ChatGPT and Real-Time Deepfakes. Available online: https://www.researchgate.net/profile/Roman-Marusenko/publication/368450665_New_challenges_in_assessing_students'_knowledge_chatbot_ChatGPT_and_real-time_deepfakes/links/63e815e8e2e1515b6b8bad02/New-challenges-in-assessing-students-knowledge-chatbot-ChatGPT-and-real-time-deepfakes.pdf (accessed on 1 March 2023).

16. SSRN. Available online: https://www.ssrn.com (accessed on 10 March 2023).

17. arXiv. Available online: https://arxiv.org (accessed on 10 March 2023).

18. ResearchGate. Available online: https://www.researchgate.net (accessed on 10 March 2023).

19. Turnitin. Available online: https://www.turnitin.com (accessed on 10 March 2023).

20. iThenticate. Available online: https://www.ithenticate.com (accessed on 10 March 2023).

21. Bloom, B.S. Taxonomy of Educational Objectives: The Classification of Educational Goals; David McKay: New York, NY, USA, 1956. [Google Scholar]

22. GPT-4. Available online: https://openai.com/research/gpt-4 (accessed on 5 April 2023).

23. Google Cloud: Dialogflow. Available online: https://cloud.google.com/dialogflow (accessed on 10 March 2023).

Figure 2. Countries/locations of the included articles (N = 50).

Figure 3. Publication sources of the included articles (N = 50).

Criterion

Inclusion

Exclusion

Article topic

Discuss ChatGPT in the field of education

Do not discuss GhatGPT in the field of education

Article type

Academic articles

Non-academic articles, such as articles from mass and social media

Time period

1 January 2022 to 28 February 2023

Articles outside the time period

Language

English

Non-English

Subject Domain

Studies

Overall
Performance

Representative Researcher Comments

Programming

Outstanding to satisfactory

"Nearly all answers of ChatGPT were completely correct and nicely explained... the explanations by ChatGPT were amazingly clear and goal-oriented" [ 35] (p. 1).
"The lecturer graded the assignment submission with a total score of 71 out of 100 points, resulting in a grade of 'Satisfactory'" [ 36] (p. 4).

Law

[ 10, 23]

Barely satisfactory to unsatisfactory

"ChatGPT performed on average at the level of a C+ student, achieving a low but passing grade" [ 10] (p. 1).
"It performed worst on exams that featured problem-style or 'issue spotting' questions" [ 23] (p. 1)

Medical education

[ 24, 25, 26, 27, 28, 29, 30, 31, 32]

Barely satisfactory to unsatisfactory

"ChatGPT yields moderate accuracy approaching passing performance on USMLE" [ 24] (p. 4).
In American Heart Association BLS and ACLS exams, "ChatGPT did not reach the passing threshold for any of the exams" [ 26] (p. 109732).

Disclaimer/Publisher's Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

AMA Style

Chicago/Turabian Style

# data[].attributes.attachment_link.title
What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature

# data[].attributes.attachment_link.description
An artificial intelligence-based chatbot, ChatGPT, was launched in November 2022 and is capable of generating cohesive and informative human-like responses to user input. This rapid review of the literature aims to enrich our understanding of ChatGPT's capabilities across subject domains, how it can be used in education, and potential issues raised by researchers during the first three months of its release (i.e., December 2022 to February 2023).