Exploring Higher Education Learners' Experience of Utilizing Gemini Chatbot in English Language Learning
Abstract
The tremendous progress in Artificial Intelligence (AI) and Natural Language Processing (NLP) has resulted in the creation of advanced chatbots that can participate in intricate conversations. This research investigates university students' experiences using the Gemini chatbot for learning English as a second language. It emphasizes the advantages as well as the difficulties encountered. A case study method was used to observe and interview 10 students from a public institution in North Sumatra. The findings indicate that the Gemini chatbot's interface, which is easy to use, the comprehensive feedback it provides, and its wide range of capabilities have a substantial positive impact on students' language proficiency and self-assurance. Nevertheless, several constraints were observed, including imprecise translations, problems with speech recognition, and technological challenges such as poor internet connections. Effective approaches to address these obstacles including using alternate educational materials, implementing well-organized study timetables, participating in virtual learning groups, and employing formal language to enhance communication clarity with the chatbot. This study offers useful insights for educational institutions and policymakers on the optimization of AI chatbots in language teaching university students' experiences using the Gemini chatbot for learning English as a second language. to successfully enhance student learning.
References
Abbas, N., Ali, I., Manzoor, R., Hussain, T., & Al Hussaini, M. H. (2023). Role of artificial intelligence tools in enhancing students' educational performance at higher levels. Journal of Artificial Intelligence, Machine Learning and Neural Network (JAIMLNN), 3(5), 36-49. doi:https://doi.org/10.55529/jaimlnn.35.36.49
Allison, B., O'Sullivan, T., Owen, A., Rice, J., Rothwell, A., & Saunders, C. (1996). Research Skills for Students. London: Kogan Page.
Alnasib, B., & Alharbi, N. S. (2024). Challenges and motivation: Assessing Gemini’s impact on undergraduate EFL students in classroom settings. World Journal of English Language, 14(5), 501-514. doi:https://doi.org/10.5430/wjel.v14n5p501
Alneyadi, S., & Wardat, Y. (2023). ChatGPT: Revolutionizing student achievement in the electronic magnetism unit for eleventh-grade students in Emirates schools. Contemporary Educational Technology, 15(4), ep448. doi:https://doi.org/10.30935/cedtech/13417
Ananda, D. R., & Salmiah, M. (2024). Students’ perceptions on AI technology: Gemini as a writing assistant tool. Linguistics and English Language Teaching Journal, 12(1), 46-54. doi:https://doi.org/10.31764/leltj.v12i1.24393
Atkinson, R. C., & Shiffrin, R. M. (1968). Human memory: A proposed system and its control processes. Psychology Learning and Motivation, 2, 89-195. doi:https://doi.org/10.1016/S0079-7421(08)60422-3
Benotti, L., Martnez, M. C., & Schapachnik, F. (2017). A tool for introducing computer science with automatic formative assessment. IEEE Transactions on Learning Technology. 11, pp. 179 - 192. IEEE. doi:https://doi.org/10.1109/TLT.2017.2682084
Bittencourt, I. I., Chalco, G., Santos, J., Fernandes, S., Silva, J., Batista, N., . . . Isotani, S. (2023). Positive artificial intelligence in education (P-AIED): A roadmap. International Journal of Artificial Intelligence in Education, 1-61. doi:https://doi.org/10.1007/s40593-023-00357-y
Bruner, J. (1996). The culture of education. Cambridge, MA and London, England: Harvard University Press. doi:https://doi.org/10.4159/9780674251083
Chen, Z., Chen, W., Jia, J., & Le, H. (2022). Exploring AWE-supported writing process: An activity theory perspective. Language Learning & Technology, 26(2), 129-148. doi:https://doi.org/10125/73482
Clarizia, F., Colace, F., Lombardi, M., Pascale, F., & Santaniello, D. (2018). Chatbot: An education support system for student. In Cyberspace Safety and Security: 10th International Symposium, CSS 2018, Amalfi, Italy, October 29–31, 2018, Proceedings 10 (pp. 291-302). Amalfi, Italy: Springer International Publishing. doi:https://doi.org/10.1007/978-3-030-01689-0_23
Coniam, D. (2004). Using language engineering programs to raise awareness of future CALL potential. Computer Assisted Language Learning, 17(2), 149-175. doi:https://doi.org/10.1080/0958822042000334226
Creswell, J. W. (2007). Qualitative Inquiry and Research Design: Choosing Among Five Approaches . Thousand Oaks: Sage Publications.
Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: The state of the field. International Journal of Educational Technology in Higher Education, 20(22), 1-22. doi:https://doi.org/10.1186/s41239-023-00392-8
Crompton, H., Jones, M. V., & Diane, B. (2022). Affordances and challenges of artificial intelligence in K-12 education: A systematic review. Journal of Research on Technology in Education., 56(3), 248-268. doi:https://doi.org/10.1080/15391523.2022.2121344
Cunningham-Nelson, S., Boles, W., Trouton, L., & Margerison, E. (2019). A review of chatbots in education: Practical steps forward. In 30th Annual Conference for the Australasian Association for Engineering Education (AAEE 2019): Educators Becoming Agents of Change: Innovate, Integrate, Motivate. (pp. 299-306). Australia: Engineers Australia.
Durall, E., & Evangelos, K. (2020). Co-design for a competency self-assessment chatbot and survey in science education. Learning and Collaboration Technologies. Human and Technology Ecosystems. HCII 2020. Lecture Notes in Computer Science. 12206, pp. 13-24. Springer, Cham. doi:https://doi.org/10.1007/978-3-030-50506-6_2
Fauzi, F., Tuhuteru, L., Sampe, F., Ausat, A. A., & Hatta, H. R. (2023). Analysing the role of chatGPT in improving student productivity in higher education. Journal on Education, 5(4), 14886-14891. doi:https://doi.org/10.31004/joe.v5i4.2563
Fryer, L. K., Coniam, D., Carpenter, R., & L?pu?neanu, D. (2020). Bots for language learning now: Current and future directions. Language Learning & Technology, 24(2), 8-22. Retrieved from http://hdl.handle.net/10125/44719
Georgescu, A. A. (2018). Chatbots for education - trends, benefits and challenges. 14th International Conference e-Learning and Software for Education, 2, pp. 195-200. Bucharest, Romania. doi:10.12753/2066-026X-21-097
Haristiani, N. (2019). Artificial Intelligence (AI) chatbot as language learning medium: An inquiry. Journal of Physics: Conference Series International Conference on Education, Science and Technology. 1378, pp. 1-6. Padang: IOP Publishing Ltd. doi:https://doi.org/10.1088/1742-6596/1387/1/012020
Hien, H. T., Cuong, P. N., Nam, L. H., Nhung, H. T., & Thang, L. D. (2018). Intelligent assistants in higher-education environments: The FIT-ebot, a chatbot for administrative and learning support. Proceedings of the 9th International Symposium on Information and Communication Technology. 8, pp. 69-76. Danang City, Vietnam: Association for Computing Machinery. doi:https://doi.org/10.1145/3287921.3287937
Huang, J., & Li, S. (2023). Opportunities and challenges in the application of chatGPT in foreign language teaching. International Journal of Education and Social Science Research, 6(4), 75-89. doi:https://doi.org/10.37500/IJESSR.2023.6406
Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1), 237-257. doi:https://doi.org/10.1111/jcal.12610
Imran, M., & Almusharraf, N. (2024). Google Gemini as a next-generation AI educational tool: a review of emerging educational technology. Smart Learning Environments, 11(22), 1-8. doi:http://dx.doi.org/10.1186/s40561-024-00310-z
Ismail, M., & Ade-Ibijola, A. (2019). Lecturer's apprentice: A chatbot for assisting novice programmers. 2019 International Multidisciplinary Information Technology and Engineering Conference (IMITEC) (pp. 1-8). Vanderbjilpark, South Africa: IEEE. doi:https://doi.org/10.1109/IMITEC45504.2019.9015857
Knight, W. (2023, December 6). Google just launched Gemini, its long-awaited answer to ChatGPT. Retrieved from Wired.com: https://www.wired.com/story/google-gemini-ai-model-chatgpt/
Koubaa, A., Boulila, W., Ghouti, L., Alzahem, A., & Latif, S. (2023). Exploring ChatGPT capabilities and limitations: a survey. IEEE Access, 11, 118698-118721. doi:https://doi.org/10.1109/ACCESS.2023.3326474
Lee, G. G., Latif, E., Shi, L., & Zhai, X. (2023, December 27). Gemini pro defeated by GPT-4V: Evidence from education. doi:https://doi.org/10.48550/arXiv.2401.08660
Lee, G. G., Shi, L., Latif, E., Gao, Y., Bewersdorff, A., Nyaaba, M., . . . Zhai, X. (2023, December 12). Multimodality of AI for education: Towards artificial general intelligence. doi:https://doi.org/10.48550/arXiv.2312.06037
Loncar, M., Schams, W., & Liang, J. S. (2023). Multiple technologies, multiple sources: trends and analyses of the literature on technology-mediated feedback for l2 English writing published from 2015-2019. Computer Assisted Language Learning, 36(4). doi:https://doi.org/10.1080/09588221.2021.1943452
Lyu, Q., Tan, J., Zapadka, M. E., Ponnatapura, J., Niu, C., Myers, K. J., . . . Whitlow, C. T. (2023). Translating radiology reports into plain language using chatGPT and GPT-4 with prompt learning: results, limitations, and potential. Visual Computing for Industry, Biomedicine, and Art, 6(1). doi:https://doi.org.10.1186/s42492-023-00136-5
Mabunda, K., & Ade-Ibijola, A. (2019). Pathbot: An intelligent chatbot for guiding visitors and locating venues. In 2019 6th International Conference on Soft Computing & Machine Intelligence (ISCMI) (pp. 160-168). Johannesburg, South Africa: IEEE. doi:10.1109/ISCMI47871.2019.9004411.
McCardle, J. R. (2002). The Challenge of integrating AI & smart technology in design education. International Journal of Technology and Design Education, 12, 59-76. doi:https://doi.org/10.1023/A:1013089404168
McCarthy, J. (2007, November 12). What is artificial intelligence? Formal Reasoning Group, pp. 1-15. Retrieved from https://www-formal.stanford.edu/jmc/whatisai.pdf
Mendoza, S., Hernandez-Leon, M., Sanchez-Adame, L. M., Rodriguez, J., Decouchant, D., & Meneses-Viveros, A. (2020). Supporting student-teacher interaction through a chatbot. In Learning and Collaboration Technologies. Human and Technology Ecosystems: 7th International Conference, LCT 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Proceedings, Part II 22 (pp. 93-107). Copenhagen, Denmark: Springer International Publishing. doi:https://doi.org/10.1007/978-3-030-50506-6_8
Miles, M. B., Huberman, A. M., & Saldana, J. (2014). Qualitative Data Analysis: A Methods Sourcebook. London: Sage.
Morris, W. (1973). The American Heritage Dictionary of the English Language. Boston: Houghton Mifflin.
Nyaaba, M. (2023). Comparing human and AI’s (GPT-4 and Gemini) understanding of the nature of science. Association for the Advancement of Computing in Education (AACE). doi:https://dx.doi.org/10.2139/ssrn.4661602
Okonkwo, C. W., & Ade-Ibijola, A. (2020). Python-bot: A chatbot for teaching python programming. Engineering Letters, 29(1), 25-34.
Papa, R., & Jackson, K. M. (2021). Enduring questions, innovative technologies: Educational theories interface with AI. In Intelligent Computing: Proceedings of the 2021 Computing Conference. 284, pp. 725-742. Springer International Publishing. doi: https://doi.org/10.1007/978-3-030-80126-7_51
Pavlik, J. V. (2023). Collaborating with chatGPT: considering the implications of generative artificial intelligence for journalism and media education. Journalism & Mass Communication Educator, 78(1), 84-93. doi:https://doi.org/10.1177/10776958221149577
Perera, P., & Lankathilake, M. (2023). Preparing to revolutionize education with the multi-model GenAI tool Google Gemini? A journey towards effective policymaking. Journal of Advances in Education and Philosophy, 7(8), 246-253. doi:10.36348/jaep.2023.v07i08.001
Perez, J. Q., Daradoumis, T., & Puig, J. M. (2020). Rediscovering the use of chatbots in education: A systematic literature review. Computer Applications in Engineering Education, 28(6), 1549-1565. doi:https://doi.org/10.1002/cae.22326
Pham, X. L., Pham, T., Nguyen, Q. M., Nguyen, T. H., & Cao, T. T. (2018). Chatbot as an intelligent personal assistant for mobile language learning. Proceedings of the 2018 2nd International Conference on Education and E-Learning (pp. 16-21). Association for Computing Machinery. doi:https://doi.org/10.1145/3291078.3291115
Pokrivcakova, S. (2022). Teacher trainees attitudes towards integrating chatbots into foreign language classes. 16th International Technology, Education and Development Conference (pp. 8294-8302). IATED. doi:https://doi.org/10.21125/inted.2022.2108
Portakal, E. (2023, December 11). Google’s Gemini AI review. Retrieved from text.cortex: https://textcortex.com/post/gemini-ai-review
Ramadhan, F. K., Faris, M. I., Wahyudi, I., & Sulaeman, M. K. (2023). Pemanfaatan chatGPT dalam dunia pendidikan. Jurnal Ilmiah Flash, 9(1), 25-30. doi:https://doi.org/10.32511/flash.v9i1.1069
Ranoliya, B. R., Raghuwanshi, N., & Singh, S. (2017). Chatbot for university-related FAQs. 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI) (pp. 1525-1530). Udupi, India: IEEE. doi:10.1109/ICACCI.2017.8126057
Rizvi, M. (2023). Exploring the landscape of artificial intelligence in education: Challenges and opportunities. 2023 5th International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA) (pp. 1-3). Istanbul, Turkiye: IEEE. doi:10.1109/HORA58378.2023.10156773
Röhrig, C., & Heß, D. (2019). Omniman: A mobile assistive robot for intralogistics applications. Engineering Letters, 27 (4), 893-900.
Ross, S. (2018). Chatbots in education: A passing trend or a valuable pedagogical tool? Thesis, 58. Retrieved from https://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-355054
Saeidna, H. R. (2023). Welcome to the Gemini era: Google DeepMind and the information industry. Library Hi Tech News. doi:https://doi.org/10.1108/LHTN-12-2023-0214
Salas-Pilco, S. Z., & Yang, Y. (2022). Artificial intelligence applications in Latin American higher education: a systematic review. International Journal of Educational Technology in Higher Education, 19(21), 1-20. doi:https://doi.org/10.1186/s41239-022-00326-w
Shin, D., Kim, H., Lee, J. H., & Yang, H. (2021). Exploring the use of an artificial intelligence chatbot as second language conversation partners. Korean Journal of English Language and Linguistics, 21, 375-391. doi:https://doi.org/10.15738/kjell.21..202104.375
Shneiderman, B. (2020). Human-centered artificial Intelligence: reliable, safe & trustworthy. International Journal of Human-Computer Interaction, 36(6), 495-504. doi:https://doi.org/10.1080/10447318.2020.1741118
Simon, H. A. (1978). Information-processing theory of human problem-solving. Handbook of Learning and Cognitive Processes, 5, 271-295.
Sinha, S., Basak, S., Dey, Y., & Mondal, A. (2019). An educational chatbot for answering queries. Emerging Technology in Modelling and Graphics. Advances in Intelligent Systems and Computing. 937, pp. 55-60. Springer Nature Singapore Pte Ltd. doi:https://doi.org/10.1007/978-981-13-7403-6_7
Smutny, P., & Schreiberova, P. (2020). Chatbots for learning: A review of educational chatbots for the. Computers & Education, 151, 103862. doi:https://doi.org/10.1016/j.compedu.2020.103862
Supriyadi, E. (2024). Exploring Google Bard's (Gemini) role in enhancing research articles in computational thinking and mathematics education. Papanda Journal of Mathematics and Sciences Research (PJMSR), 3(1), 28-37. Retrieved from https://ejournal.papanda.org/index.php/pjmsr/article/view/707
Suthar, A., & Digaswala, F. J. (2024). A new chapter in AI: Unveiling the potential of Google's Gemini. International Journal of Research Publication and Reviews, 5(3), 6717-6720. Retrieved from https://ijrpr.com/uploads/V5ISSUE3/IJRPR24290.pdf
Taj, I. H., Ali, F., Sipra, M. A., & Ahmad, W. (2017). Effect of technology-enhanced language learning on vocabulary acquisition of EFL learners. International Journal of Applied Linguistics and English Literature, 6(3). doi:https://doi.org/10.7575/aiac.ijalel.v.6n.3p.262
Team, G., Anil, R., Borgeaud, S., Alayrac, J.-B., Yu, J., Soricut, R., . . . Johnson, M. (2024, June 17). Gemini: A family of highly capable multimodal models. doi:doi:10.48550/arXiv.2312.11805
Thomas, H. (2020). Critical literature review on chatbots in education. International Journal of Trend in Scientific Research and Development, 4(6), 786-788.
Vygotsky, L. S. (1978). Mind in society: Development of higher psychological processes. Edited by Michael Cole, Vera Jolm-Steiner, Sylvia Scribner, and Ellen Souberman. Harvard University Press. doi:https://doi.org/10.2307/j.ctvjf9vz4
Wang, T., Lund, B. D., Marengo, A., Pagano, A., Mannuru, N. R., Teel, Z. A., & Pange, J. (2023). Exploring the potential impact of artificial intelligence (AI) on international students in higher education: Generative AI, chatbots, analytics, and international student success. Applied Sciences, 13(11), 6716. doi: https://doi.org/10.3390/app13116716
Wang, T., Lund, B. D., Marengo, A., Pagano, A., Mannuru, N. R., Teel, Z. A., & Pange, J. (2023). Exploring the potential impact of artificial intelligence (AI) on international students in higher education: Generative AI, chatbots, analytics, and international student success. Applied Science, 13(11), 6716. doi:https://doi.org/10.3390/app13116716
Xu, L. (2021). The dilemma and countermeasures of AI in educational application. Proceedings of the 2020 4th International Conference on Computer Science and Artificial Intelligence. 6, pp. 289-294. Zhuhai, China: Association for Computing Machinery. doi:https://doi.org/10.1145/3445815.3445863
Yang, H., Kim, H., Lee, J. H., & Shin, D. (2022). Implementation of an AI chatbot as an English conversation partner in EFL speaking classes. ReCALL, 327-343. doi:https://doi.org/10.1017/s0958344022000039
Yang, S., & Evans, C. (2019). Opportunities and challenges in using AI chatbots in higher education. In Proceedings of the 2019 3rd International Conference on Education and E-Learning (pp. 79-83). Barcelona, Spain: Association for Computing Machinery. doi:https://doi.org/10.1145/3371647.3371659
Zhan, Z., Tong, Y., Lan, X., & Zhong, B. (2022). A systematic literature review of game-based learning in Artificial Intelligence education. Interactive Learning Environments, 32(3), 1137-1158. doi:https://doi.org/10.1080/10494820.2022.2115077
Zhao, J., Song, T., & Sun, Y. (2020). Apihelper: Helping junior Android programmers learn API usage. IAENG International Journal of Computer Science, 47 (1), pp. 92-97.
Copyright (c) 2024 RETORIKA: Jurnal Ilmu Bahasa
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
This journal provides immediate open access to its content on the principle that making research freely available to the public supports a greater global exchange of knowledge.
All articles published Open Access will be immediately and permanently free for everyone to read and download. We are continuously working with our author communities to select the best choice of license options, currently being defined for this journal as follows: Creative Commons-Non Ceomercial-Attribution-ShareAlike (CC BY-NC-SA)
Abstract viewed = 101 times
PDF downloaded = 115 times
2.png)
