PERTANIKA JOURNAL OF SCIENCE AND TECHNOLOGY

ChatGPT, an artificial intelligence chatbot released in November 2022, is the fastest-growing consumer application in history. As a generative AI that uses Natural Language Processing, it creates a plethora of content with a ‘human voice’. Unsurprisingly, ChatGPT garnered much attention from academia as it passed several professional exams and has multiple avenues for potential misuse by students and researchers alike. Therefore, this study addresses the dearth in literature by performing a self-reflection study on the practical usage of AI chatbots in research, with a research question: What is the self-reflection of the authors on the usage of AI chatbots for research? This study was framed under the Technology Acceptance Model to provide a comprehensive discussion covering multiple domains. AI chatbots provide advantages and disadvantages to the end-user, but the resulting outcome lies in the hands of the user; hence, educating existing and future users of the tool to use it responsibly should be first and foremost. As Pandora's AI chatbot box has been opened, ethical issues are also plentiful in chatbots. However, it is up to academia to solve these in multidisciplinary settings because, as history has shown, curtailing the use of new technologies is futile. Overall, this study contributes to the body of knowledge in AI Chatbot research by emphasising their potential and addressing probable issues when using them in research.

• Alonso, C., Kothari, S., & Rehman, S. (2020, 8 December, 2020). Could artificial intelligence widen the gap between rich and poor nations? World Economic Forum. https://www.weforum.org/agenda/2020/12/artificial-intelligence-widen-gap-rich-developing-nations/
  
  Anthropic. (2023). Claude 2. https://claude.ai
  
  Ault, A. (2023, 26 January 2023). AI Bot ChatGPT Passes US Medical Licensing Exams Without Cramming – Unlike Students. WebMD LLC. https://www.medscape.com/viewarticle/987549
  
  Bang, Y., Cahyawijaya, S., Lee, N., Dai, W., Su, D., Wilie, B., Lovenia, H., Ji, Z., Yu, T., & Chung, W. (2023). A multitask, multilingual, multimodal evaluation of chatgpt on reasoning, hallucination, and interactivity. arXiv Preprint. https://doi.org/10.48550/arXiv.2302.04023
  
  Bansal, H., & Khan, R. (2018). A review paper on human computer interaction. International Journals of Advanced Research in Computer Science and Software Engineering, 8(4), 53-56. https://dx.doi.org/10.23956/ijarcsse.v8i4.630
  
  Black Technology LTD. (2024). Stable Diffusion Online. Black Technology LTD. https://stablediffusionweb.com/
  
  Brittain, B. (2023, 7 February 2023). Getty Images lawsuit says Stability AI misused photos to train AI. Reuters. https://www.reuters.com/legal/getty-images-lawsuit-says-stability-ai-misused-photos-train-ai-2023-02-06/#:~:text=Seattle%2Dbased%20Getty%20accused%20Stability,depictions%20based%20on%20user%20prompts
  
  Colby, K. M. (1975). Artificial paranoia: A computer simulation of paranoid processes. Elsevier.
  
  Consensus. (2023). Consensus AI. Consensus. https://consensus.app/search/
  
  Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319-340. https://doi.org/https://doi.org/10.2307/249008
  
  Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S., & Ebel, P. (2021). The future of human-AI collaboration: A taxonomy of design knowledge for hybrid intelligence systems. arXiv Preprint.
  
  Dinkelman, T. (2003). Self-study in teacher education: A means and ends tool for promoting reflective teaching. Journal of Teacher Education, 54(1), 6-18. https://doi.org/10.1177/0022487102238654
  
  Dowling, M., & Lucey, B. (2023). ChatGPT for (finance) research: The Bananarama conjecture. Finance Research Letters, 53, Article 103662. https://doi.org/10.1016/j.frl.2023.103662
  
  Dziri, N., Lu, X., Sclar, M., Li, X. L., Jian, L., Lin, B. Y., West, P., Bhagavatula, C., Bras, R. L., & Hwang, J. D. (2023). Faith and fate: Limits of transformers on compositionality. In 37th Conference on Neural Information Processing Systems. ACM Publishing.
  
  Editorial. (2023). The AI writing on the wall. Nature Machine Intelligence, 5(1), 1-1. https://doi.org/10.1038/s42256-023-00613-9
  
  Editors, I. C. M. J. (2023). Defining the Role of Authors and Contributors. International Committee of Medical Journal Editors. https://www.icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authors-and-contributors.html
  
  Elsevier. (2019). FACTSHEET: Authorship. Elsevier. https://www.elsevier.com/__data/assets/pdf_file/0006/653883/Authorship-factsheet-March-2019.pdf
  
  Elsevier. (2024). Launch of Scopus AI to Help Researchers Navigate the World of Research. Elsevier. https://www.elsevier.com/about/press-releases/launch-of-scopus-ai-to-help-researchers-navigate-the-world-of-research
  
  Farjoun, M., Ansell, C., & Boin, A. (2015). PERSPECTIVE—Pragmatism in organization studies: Meeting the challenges of a dynamic and complex world. Organization Science, 26(6), 1787-1804. https://doi.org/10.1287/orsc.2015.1016
  
  Goli, S. (2023). Unleashing the next chapter of personalized and interactive online learning with generative AI, machine learning, and virtual reality. Coursera Inc. https://blog.coursera.org/new-products-tools-and-features-2023/
  
  Gordijn, B., & Have, H. T. (2023). ChatGPT: Evolution or revolution? Medicine, Health Care and Philosophy, 26(1), 1-2. https://doi.org/10.1007/s11019-023-10136-0
  
  GPTZero. (2023). GPTZero The World's #1 AI Detector with over 1 Million Users. GPTZero. https://gptzero.me/
  
  Grace, K., Stewart, H., Sandkühler, J. F., Thomas, S., Weinstein-Raun, B., & Brauner, J. (2024). Thousands of AI authors on the future of AI. arXiv Preprint.
  
  Gursoy, D., Li, Y., & Song, H. (2023). ChatGPT and the hospitality and tourism industry: An overview of current trends and future research directions. Journal of Hospitality Marketing & Management, 32(5), 579-592. https://doi.org/10.1080/19368623.2023.2211993
  
  Gustafson, J. L. (2011). Moore’s Law. In D. Padua (Ed.), Encyclopedia of Parallel Computing (pp. 1177–1184). Springer. https://doi.org/10.1007/978-0-387-09766-4_81
  
  Hacker, P., Engel, A., & Mauer, M. (2023). Regulating ChatGPT and other Large Generative AI Models. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (pp. 1112-1123). ACM Publishing. https://doi.org/10.1145/3593013.3594067
  
  Hamilton, M. L., Smith, L., & Worthington, K. (2008). Fitting the methodology with the research: An exploration of narrative, self-study and auto-ethnography. Studying Teacher Education, 4(1), 17-28. https://doi.org/10.1080/17425960801976321
  
  Han, Y., & Nickerson, J. V. (2015). Exploring design space through remixing. Collective Intelligence, Stevens Institute of Technology School of Business Research Paper No. 2015–57, 1.1-1.4. https://ssrn.com/abstract=2614623
  
  Hanushek, E. A., & Woessmann, L. (2020). Education, knowledge capital, and economic growth. In C. G. S. Bradley (Ed.), The Economics of Education (pp. 171-182). Academic Press. https://doi.org/10.1016/B978-0-12-815391-8.00014-8
  
  Hosseini, M., Rasmussen, L. M., & Resnik, D. B. (2023). Using AI to write scholarly publications. Accountability in Research, 31(7), 715-723. https://doi.org/10.1080/08989621.2023.2168535
  
  Hsiao, S. (2024, 20 February). Bard becomes Gemini: Try Ultra 1.0 and a new mobile app today. Gemini. https://blog.google/products/gemini/bard-gemini-advanced-app/
  
  Hu, K. (2023, 2 February, 2023). ChatGPT sets record for fastest-growing user base - analyst note. Reuters. https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/
  
  Hutson, M. (2022). Could AI help you to write your next paper? Nature, 611(7934), 192-193. https://doi.org/10.1038/d41586-022-03479-w
  
  Jo, A. (2023). The promise and peril of generative AI. Nature, 614, 214-216. https://doi.org/10.1038/d41586-023-00340-6
  
  Khanna, A., Pandey, B., Vashishta, K., Kalia, K., Pradeepkumar, B., & Das, T. (2015). A study of today’s A.I. through chatbots and rediscovery of machine intelligence. International Journal of U- and e-Service, Science and Technology, 8(7), 277–284. https://dx.doi.org/10.14257/ijunesst.2015.8.7.28.
  
  Khosravi, H., Denny, P., Moore, S., & Stamper, J. (2023). Learnersourcing in the age of AI: Student, educator and machine partnerships for content creation. Computers and Education: Artificial Intelligence, 5, Article 100151. https://doi.org/10.1016/j.caeai.2023.100151
  
  King, M. R., & ChatGPT. (2023). A conversation on artificial intelligence, chatbots, and plagiarism in higher education. Cellular and Molecular Bioengineering, 16(1), 1-2. https://doi.org/10.1007/s12195-022-00754-8
  
  Kruijt, J., Meppelink, C. S., & Vandeberg, L. (2022). Stop and think! Exploring the role of news truth discernment, information literacy, and impulsivity in the effect of critical thinking recommendations on trust in fake COVID-19 news. European Journal of Health Communication, 3(2), 40-63. https://doi.org/10.47368/ejhc.2022.203
  
  Lee, K. L. K., & Kumar, N. (2023). Artificial intelligence for scientific discovery at high-performance computing scales. Computer, 56(4), 116-122. https://doi.org/10.1109/MC.2023.3241692
  
  Lin, M. P. C., & Chang, D. (2023). CHAT-ACTS: A pedagogical framework for personalized chatbot to enhance active learning and self-regulated learning. Computers and Education: Artificial Intelligence, 5, Article 100167. https://doi.org/10.1016/j.caeai.2023.100167
  
  Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. SAGE Publications, Inc.
  
  Luo, J., Li, T., Wu, D., Jenkin, M., Liu, S., & Dudek, G. (2024). Hallucination Detection and Hallucination Mitigation: An Investigation. arXiv Preprint.
  
  Merriam, S. B. (2009). Qualitative Research: A Guide to Design and implementation. Jossey Bass.
  
  Moore, S. K. (2023, 7 September 2023). The Secret to Nvidia’s AI Success Chief scientist Bill Dally explains the 4 ingredients that brought Nvidia so far. IEEE Spectrum. https://spectrum.ieee.org/nvidia-gpu
  
  Nature Editorial. (2023). Tools such as ChatGPT threaten transparent science; Here are our ground rules for their use. Nature, 613(7945), Article 612. https://doi.org/10.1038/d41586-023-00191-1
  
  OpenAI. (2022). ChatGPT: Optimizing Language Models for Dialogue. OpenAI. https://openai.com/blog/chatgpt/
  
  OpenAI. (2023). GPT-4 is OpenAI’s Most Advanced System, Producing Safer and More Useful Responses. OpenAI. https://openai.com/product/gpt-4
  
  Ought. (2023). Elicit. Elicit. https://elicit.com/
  
  Pavlik, J. V. (2023). Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education. Journalism & Mass Communication Educator, 78(1), 84-93. https://doi.org/10.1177/10776958221149577
  
  Perplexity AI. (2023). Perplexity AI. Perplexity AI. https://www.perplexity.ai
  
  Perry, T. S. (2018). Move Over, Moore’s Law: Make Way for Huang’s Law Graphics processors are on a supercharged development path that eclipses Moore’s Law, says Nvidia’s Jensen Huang. IEEE Spectrum. https://spectrum.ieee.org/move-over-moores-law-make-way-for-huangs-law
  
  PubGenius Inc. (2023). SciSpace. PubGenius Inc. https://typeset.io/
  
  Puig, B., Blanco-Anaya, P., & Pérez-Maceira, J. J. (2021). “Fake News” or Real Science? Critical thinking to assess information on COVID-19. Frontiers in Education, 6, 646909. https://doi.org/10.3389/feduc.2021.646909
  
  Qiu, R., & Liu, Z. (2023). AI Widens the Gap between the Rich and the Poor. SHS Web of Conferences.
  
  Radanliev, P. (2024). Artificial intelligence: reflecting on the past and looking towards the next paradigm shift. Journal of Experimental & Theoretical Artificial Intelligence, 1-18. https://doi.org/10.1080/0952813X.2024.2323042
  
  Rudolph, J., Tan, S., & Tan, S. (2023). War of the chatbots: Bard, Bing Chat, ChatGPT, Ernie and beyond. The new AI gold rush and its impact on higher education. Journal of Applied Learning and Teaching, 6(1), 364-389. https://doi.org/https://doi.org/10.37074/jalt.2023.6.1.23
  
  Ren, F., Ding, X., Zheng, M., Korzinkin, M., Cai, X., Zhu, W., Mantsyzov, A., Aliper, A., Aladinskiy, V., & Cao, Z. (2023). AlphaFold accelerates artificial intelligence powered drug discovery: Efficient discovery of a novel CDK20 small molecule inhibitor. Chemical Science, 14(6), 1443-1452. https://doi.org/10.1039/D2SC05709C
  
  Riera, R., & Rodríguez, R. (2022). What if peer-review process is killing thinking-out-of-the-box science? Frontiers in Marine Science, 9, 1-4. https://doi.org/10.3389/fmars.2022.924469
  
  scite_. (2023). scite_. scite Inc. https://scite.ai/assistant
  
  Shum, H. Y., He, X. D., & Li, D. (2018). From Eliza to XiaoIce: Challenges and opportunities with social chatbots. Frontiers of Information Technology & Electronic Engineering, 19, 10-26.
  
  Spector, J. M., & Ma, S. (2019). Inquiry and critical thinking skills for the next generation: from artificial intelligence back to human intelligence. Smart Learning Environments, 6(1), 1-11. https://doi.org/10.1186/s40561-019-0088-z
  
  Springer Nature. (2023). Authorship. Springer. https://www.nature.com/nature-portfolio/editorial-policies/authorship#authorship
  
  Stein, M. B. (2023). New ChatGPT plugin and generative AI courses help learners and employers build in-demand skills on Coursera. Coursera. https://blog.coursera.org/coursera-new-chatgpt-plugin-gen-ai-learning-content/
  
  Tao, T. (2023). Embracing change and resetting expectations. Microsoft Unlocked. https://unlocked.microsoft.com/ai-anthology/terence-tao/
  
  Taylor & Francis Group. (2023). Taylor & Francis Editorial Policies. Informa UK Limited. https://authorservices.taylorandfrancis.com/editorial-policies/
  
  Terwiesch, C. (2023, 17 January 2023). Would Chat GPT Get a Wharton MBA? A Prediction Based on Its Performance in the Operations Management Course. The Wharton School, The University of Pennsylvania. https://mackinstitute.wharton.upenn.edu/wp-content/uploads/2023/01/Christian-Terwiesch-Chat-GTP-1.24.pdf
  
  Thorp, H. H. (2023). ChatGPT is fun, but not an author. Science, 379(6630), 313-313. https://doi.org/10.1126/science.adg7879
  
  Trinh, T. H., Wu, Y., Le, Q. V., He, H., & Luong, T. (2024). Solving olympiad geometry without human demonstrations. Nature, 625(7995), 476-482.
  
  UNESCO. (2023). Artificial intelligence in education. UNESCO. https://www.unesco.org/en/digital-education/artificial-intelligence
  
  UNESCO. (2019). Beijing Consensus On Artificial Intelligence And Education. UNESCO.
  
  UNESCO. (2021). Artificial Intelligence and Education. Guidance for Policy-makers. UNESCO.
  
  Urbina, F., Lentzos, F., Invernizzi, C., & Ekins, S. (2022). Dual use of artificial-intelligence-powered drug discovery. Nature Machine Intelligence, 4(3), 189-191. https://doi.org/10.1038/s42256-022-00465-9
  
  van Dis, E. A., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023). ChatGPT: five priorities for research. Nature, 614(7947), 224-226. https://doi.org/10.1038/d41586-023-00288-7
  
  Wallace, R. S. (2009). The anatomy of ALICE. In R. Epstein, Roberts, G., & Beber, G. (Eds.), Parsing the Turing Test (pp. 181-210). Springer.
  
  Wang, X., Wei, J., Schuurmans, D., Le, Q., Chi, E., Narang, S., Chowdhery, A., & Zhou, D. (2022). Self-consistency improves chain of thought reasoning in language models. arXiv Preprint. https://doi.org/10.48550/arXiv.2203.11171
  
  Webber, J. (2022). Integrity as the goal of character education. Royal Institute of Philosophy Supplements, 92, 185-207. https://doi.org/10.1017/S1358246122000273
  
  Weizenbaum, J. (1966). ELIZA - A computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1), 36-45.
  
  Wiley Online Library. (2023). Publication Ethics Guidelines. John Wiley & Sons, Inc. R https://onlinelibrary.wiley.com/page/journal/21983844/homepage/publication-ethics-guidelines
  
  World Economic Forum. (2024, 12 February 2024). Education Meets AI | Davos 2024 | World Economic Forum. World Economic Forum. https://www.youtube.com/watch?v=1WJckLniMAg
  
  Xu, W., Agrawal, S., Briakou, E., Martindale, M. J., & Carpuat, M. (2023). Understanding and detecting hallucinations in neural machine translation via model introspection. Transactions of the Association for Computational Linguistics, 11, 546-564. https://doi.org/10.1162/tacl_a_00563
  
  Yeo-Teh, N. S. L., & Tang, B. L. (2023). Letter to editor: NLP systems such as ChatGPT cannot be listed as an author because these cannot fulfill widely adopted authorship criteria. Accountability in Research Ethics, Integrity and Policy, 1-3. https://doi.org/10.1080/08989621.2023.2177160
  
  Yip, K. S. (2006). Self-reflection in reflective practice: A note of caution. British Journal of Social Work, 36(5), 777-788. https://doi.org/10.1093/bjsw/bch323
  
  Zhang, M., Press, O., Merrill, W., Liu, A., & Smith, N. A. (2023). How language model hallucinations can snowball. arXiv Preprint. https://doi.org/10.48550/arXiv.2305.13534