AN USABILITY TEST USING THE METHOD EYE TRACKING ON ACADEMIC ONLINE WEBSITE UNIVERSITY MEDAN AREA
Keywords:
Usability, Eye Tracking, Effectiveness, Efficiency, Website
Abstract
The Academic Online Campus application is an information system used to manage academic data administration. Academic Online Campus websiteMedan Area University found several obstacles such as getting information quickly and the absence of an information assistance center. This study aims to determine the results of usability testing on the Academic Online Campus University of Medan Area website using the eye tracking method. Eye tracking is a method that helps researchers understand visual attention, with eye tracking we can detect where the user is looking, how long they are looking, and the order in which they are looking.This test was carried out by providing several tasks that were carried out by the respondent, to see the success of each task and the respondent's processing time. Then the SUS questionnaire was distributed to determine the level of satisfaction of the respondents. The results showed that the ease of using the Academic Online Campus website with an average level of effectiveness was 77.40% (quite effective), the average efficiency level of using the website was 73.65% (quite efficient), and fstudent satisfaction actors obtained an average score of 70.47 which indicates that the Academic Online Campus website is included in the acceptable category with a Good rating and is ranked C. This means that the Academic Online Campus website has an attractive appearance, displays information needed by students and lecturers, and provide complete and up-to-date information.
Downloads
Download data is not yet available.
References
[1] K. Saputra, "Web-Based Tourism Information System Design as Promotional Media in Singkawang-West Kalimantan,"J. Ekon. And Indonesian Business., vol. 2, no. 1, 2017, doi: https://doi.org/10.37673/jebi.v2i1.48.
[2] PS Hasugian, "Website Design as Media Promotion and Information,"J. Inform. Pelita Nusant., vol. 3, no. 1, 2018.
[3] M. Amin, "Internet Banking Service Quality and Its Implications on e-Customer Satisfaction and e-Customer Loyalty,"int. J.bank Mark., vol. 34, no. 3, pp. 280–306, 2016, doi: https://doi.org/10.1108/IJBM-10-2014-0139.
[4] Q. Aini, PA Sunarya, AS Bein, and others, “The Implementation OfViewboard Of The Head Of Department As A Media For Student Information Is Worth Doing Final Research,” IAIC Trans. sustain. digits. Innov., vol. 1, no. 1, pp. 18–25, 2019.
[5] I. Salamah, "Usability Evaluation of the National Police Website Using the System Usability Scale,"J. Nas. Educator. Tech. inform. JANAPATI, vol. 8, no. 3, pp. 176–183, 2019, doi: https://doi.org/10.23887/janapati.v8i3.17311.
[6] NLPA Wedayanti, NKA Wirdiani, and IKA Purnawan, "Evaluation of Usability Aspects in the Simalu Application Using the Usability Testing Method,"J. Ilm. Pigeons (Research Tower. Akad. Technology. Information), vol. 7, no. 2, pp. 113–124, 2019.
[7] Y. Delvika, CF Hasibuan, YD Polewangi, and M. Habibullah, "Website Usability Analysis of X University Academic Information Systems Using the Nielsen Attributes of Usability (NAU) Questionnaire,"JIME (Journal Ind. Manuf. Eng., vol. 5, p. 2, 2021, doi: 10.31289/jime.v5i2.6113.
[8] S. Sutrisno, AH Lubis, and S. Susilawati, “The Analysis of the Facilities and ICT Applications Usage by the University's Students,” inJournal of Physics: Conference Series, 2021, vols. 1793, no. 1, p. 12050.
[9] A. Ibrahim, A. Ambarita, and others, "Information System for Website-Based Water Customer Complaints at PDAM Kota Ternate,"IJIS-Indonesian J.Inf. syst., vol. 3, no. 1, 2018, doi: https://doi.org/10.36549/ijis.v3i1.37.
[10] I. Hanafi, "The Effectiveness of the Academic Portal as a Means of Delivering Academic Information for STIA NUSA Students,"J. Adm. Nusant. ALMIGHTY, vol. 2, no. 11, p. 125–140, 2020, doi: https://lppmstianusa.com/ejurnal/index.php/janmaha/article/view/383/178.
[11] C. Taddeo and A. Barnes, “The School Website: Facilitating Communication Engagement and Learning,”Brother J. Educ. Technol., vol. 47, no. 2, pp. 421–436, 2016, doi: https://doi.org/10.1111/bjet.12229.
[12] I. Blau and T. Shamir-Inbal, "Digital Competences and Long-term ICT Integration in School Culture: The Perspective of Elementary School Leaders,"educ. inf. Technol., vol. 22, no. 3, pp. 769–787, 2017, doi: https://link.springer.com/article/10.1007/s10639-015-9456-7.
[13] K. Hirsh-Pasek, JM Zosh, RM Golinkoff, JH Gray, MB Robb, and J. Kaufman, “Putting Education in 'Educational' Apps: Lessons From The Science of Learning,”Psychol. sci. Public Interests., vol. 16, no. 1, pp. 3–34, 2015, doi: https://doi.org/10.1177/1529100615569721.
[14] KS Paramitha, "Usability Evaluation on Website Design Institut Teknologi Sepuluh Nopember 2017 Using the Eye Tracking Method Based on the Nielsen Model and Nielsen Attributes Of Usability Questionnaire (NAU)," Institut Teknologi Sepuluh Nopember, 2017.
[15] T. Issa and P. Isaias, “Usability and Human--Computer Interaction (HCI),” inSustainable design, London: Springer, 2022, pp. 23–40.
[16] N. Bevan, J. Carter, and S. Harker, “ISO 9241-11 Revised: What Have We Learned About Usability Since 1998?,” inInternational conference on human-computer interaction, 2015, pp. 143–151, doi: 10.1007/978-3-319-20901-2_13.
[17] P. Zaphiris and S. Kurniawan,Human Computer Interaction Research in Web Design and Evaluation. Hershey - London: IGI Global, 2007.
[18] A. Abran, A. Khelifi, W. Suryn, and A. Seffah, “Usability Meanings and Interpretations in ISO Standards,”softw. Qual. J., vol. 11, no. 4, pp. 325–338, 2003.
[19] D. Green and JM Pearson, “Development of a Web Site Usability Instrument Based on ISO 9241-11,”J.Comput. inf. syst., vol. 47, no. 1, pp. 66–72, 2006.
[20] M. Speicher, “What is Usability? A Characterization Based on ISO 9241-11 and ISO/IEC 25010,”arXiv Prepr. arXiv1502.06792, 2015.
[21] A. Hussain, EOC Mkpojiogu, and Z. Hussain, “Usability Evaluation of a Web-Based Health Awareness Portal on Smartphone Devices Using ISO 9241-11 Model,”J. Technol., vol. 77, no. 4, pp. 1–5, 2015.
[22] N. Bevan, “Quality and Usability: A New Framework,”Achiev. softw. Prod. Qual., pp. 25–34, 1997.
[23] H. Singh and J. Singh, “Human Eye Tracking and Related Issues: A review,”int. J. Sci. Res. Publ., vol. 2, no. 9, pp. 1–9, 2012.
[24] K. Holmqvist, M. Nyström, R. Andersson, R. Dewhurst, H. Jarodzka, and J. de Weijer,Eye tracking: A Comprehensive Guide to Methods and Measures. United Kingdom: OUP Oxford, 2011.
[25] B. Sharif and JI Maletic, “An Eye Tracking Study on Camelcase and Under\_Score Identifier Styles,” in2010 IEEE 18th International Conference on Program Comprehension, 2010, pp. 196–205, doi: 10.1109/ICPC.2010.41.
[26] B. Smith, “Eye Tracking as A Measure of Noticing: A study of Explicit Recasts in SCMC,”Lang. learn. \& Technol., vol. 16, no. 3, pp. 53–81, 2012, doi: https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/7538ade7-283a-4225-8301-3037400aea71/content.
[27] M. Fitrah and others,Research Methodology: Qualitative Research, Class Action & Case Studies. West Java: CV Footprint (Imprint Publisher), 2018.
[28] Y. Othman, M. Khalaf, A. Ragab, A. Salaheldin, R. Ayman, and N. Sharaf, “Eye-To-Eye: Towards Visualizing Eye Gaze Data,” in2020 24th International Conference Information Visualization (IV), 2020, pp. 729–733, doi: 10.1109/IV51561.2020.00128.
[29] Y. Cheung and Q. Peng, “Eye Gaze Tracking With a Web Camera in a Desktop Environment,”IEEE Trans. Human-Machine System., vol. 45, no. 4, pp. 419–430, 2015, doi: 10.1109/THMS.2015.2400442.
[30] H. Wei, A.-N. Moldovan, and C. Muntean, "Sensing Learner Interest Through Eye Tracking,"Technology, vol. 22, p. 23, 2009.
[31] K. Harezlak, P. Kasprowski, and M. Stasch, “Towards Accurate Eye Tracker Calibration--Methods and Procedures,”Procedia Comput. sci., vol. 35, p. 1073–1081, 2014, doi: https://doi.org/10.1016/j.procs.2014.08.194.
[32] AP Nurrachman, Y. Priyandari, and Y. Yuniaristanto, "Usability Testing on Android-based Diponegoro University Student Academic Information Applications,"Techno. com, vol. 21, no. 3, pp. 534–542, 2022, doi: https://doi.org/10.33633/tc.v21i3.6307.
[33] AW Soejono, A. Setyanto, and AF Sofyan, "Usability Evaluation of the UNRIYO Website Using the System Usability Scale (Case Study: UNRIYO Website),"Respect, vol. 13, no. 1, 2018, doi: https://doi.org/10.35842/jtir.v13i1.213.
[34] W. Buana and BN Sari, "User Interface Analysis Improves User Experience Using Usability Testing on Android Course Applications,"J.Comput. inf. Technol., vol. 5, no. 2, pp. 91–97, 2022, doi: http://doi.org/10.25273/doubleclick.v5i2.11669.
[35] D. Setiawan and SL Wicaksono, "Usability Evaluation of Google Classroom Using the System Usability Scale,"Walisongo J.Inf. Technol., vol. 2, no. 1, pp. 71–78, 2020, doi: 10.21580/wjit.2020.2.1.5792.
[36] H. Cho, D. Powell, A. Pichon, LM Kuhns, R. Garofalo, and R. Schnall, “Eye-Tracking Retrospective Think-Aloud as a Novel Approach for a Usability Evaluation,”int. J.Med. inform., vol. 129, pp. 366–373, 2019.
[37] RF Salim and others, "Usability Level Evaluation of Online Shopping Site X Using Tobii-Eye Tracker and Face Reader,"J. Metris, vol. 22, no. 02, pp. 131–136, 2021, doi: https://doi.org/10.25170/metris.v22i02.2968.
[38] NW Budiani, “Effectiveness of the Karang Taruna Unemployment Program 'Eka Taruna Bhakti', Sumerta Kelod Village, East Denpasar District, Denpasar City,”J. Ekon. and Sauce. inputs, vol. 2, no. 1, pp. 49–57, 2007.
[39] A. Bangor, P. Kortum, and J. Miller, “Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale,”J. usability Stud., vol. 4, no. 3, pp. 114–123, 2009.
[2] PS Hasugian, "Website Design as Media Promotion and Information,"J. Inform. Pelita Nusant., vol. 3, no. 1, 2018.
[3] M. Amin, "Internet Banking Service Quality and Its Implications on e-Customer Satisfaction and e-Customer Loyalty,"int. J.bank Mark., vol. 34, no. 3, pp. 280–306, 2016, doi: https://doi.org/10.1108/IJBM-10-2014-0139.
[4] Q. Aini, PA Sunarya, AS Bein, and others, “The Implementation OfViewboard Of The Head Of Department As A Media For Student Information Is Worth Doing Final Research,” IAIC Trans. sustain. digits. Innov., vol. 1, no. 1, pp. 18–25, 2019.
[5] I. Salamah, "Usability Evaluation of the National Police Website Using the System Usability Scale,"J. Nas. Educator. Tech. inform. JANAPATI, vol. 8, no. 3, pp. 176–183, 2019, doi: https://doi.org/10.23887/janapati.v8i3.17311.
[6] NLPA Wedayanti, NKA Wirdiani, and IKA Purnawan, "Evaluation of Usability Aspects in the Simalu Application Using the Usability Testing Method,"J. Ilm. Pigeons (Research Tower. Akad. Technology. Information), vol. 7, no. 2, pp. 113–124, 2019.
[7] Y. Delvika, CF Hasibuan, YD Polewangi, and M. Habibullah, "Website Usability Analysis of X University Academic Information Systems Using the Nielsen Attributes of Usability (NAU) Questionnaire,"JIME (Journal Ind. Manuf. Eng., vol. 5, p. 2, 2021, doi: 10.31289/jime.v5i2.6113.
[8] S. Sutrisno, AH Lubis, and S. Susilawati, “The Analysis of the Facilities and ICT Applications Usage by the University's Students,” inJournal of Physics: Conference Series, 2021, vols. 1793, no. 1, p. 12050.
[9] A. Ibrahim, A. Ambarita, and others, "Information System for Website-Based Water Customer Complaints at PDAM Kota Ternate,"IJIS-Indonesian J.Inf. syst., vol. 3, no. 1, 2018, doi: https://doi.org/10.36549/ijis.v3i1.37.
[10] I. Hanafi, "The Effectiveness of the Academic Portal as a Means of Delivering Academic Information for STIA NUSA Students,"J. Adm. Nusant. ALMIGHTY, vol. 2, no. 11, p. 125–140, 2020, doi: https://lppmstianusa.com/ejurnal/index.php/janmaha/article/view/383/178.
[11] C. Taddeo and A. Barnes, “The School Website: Facilitating Communication Engagement and Learning,”Brother J. Educ. Technol., vol. 47, no. 2, pp. 421–436, 2016, doi: https://doi.org/10.1111/bjet.12229.
[12] I. Blau and T. Shamir-Inbal, "Digital Competences and Long-term ICT Integration in School Culture: The Perspective of Elementary School Leaders,"educ. inf. Technol., vol. 22, no. 3, pp. 769–787, 2017, doi: https://link.springer.com/article/10.1007/s10639-015-9456-7.
[13] K. Hirsh-Pasek, JM Zosh, RM Golinkoff, JH Gray, MB Robb, and J. Kaufman, “Putting Education in 'Educational' Apps: Lessons From The Science of Learning,”Psychol. sci. Public Interests., vol. 16, no. 1, pp. 3–34, 2015, doi: https://doi.org/10.1177/1529100615569721.
[14] KS Paramitha, "Usability Evaluation on Website Design Institut Teknologi Sepuluh Nopember 2017 Using the Eye Tracking Method Based on the Nielsen Model and Nielsen Attributes Of Usability Questionnaire (NAU)," Institut Teknologi Sepuluh Nopember, 2017.
[15] T. Issa and P. Isaias, “Usability and Human--Computer Interaction (HCI),” inSustainable design, London: Springer, 2022, pp. 23–40.
[16] N. Bevan, J. Carter, and S. Harker, “ISO 9241-11 Revised: What Have We Learned About Usability Since 1998?,” inInternational conference on human-computer interaction, 2015, pp. 143–151, doi: 10.1007/978-3-319-20901-2_13.
[17] P. Zaphiris and S. Kurniawan,Human Computer Interaction Research in Web Design and Evaluation. Hershey - London: IGI Global, 2007.
[18] A. Abran, A. Khelifi, W. Suryn, and A. Seffah, “Usability Meanings and Interpretations in ISO Standards,”softw. Qual. J., vol. 11, no. 4, pp. 325–338, 2003.
[19] D. Green and JM Pearson, “Development of a Web Site Usability Instrument Based on ISO 9241-11,”J.Comput. inf. syst., vol. 47, no. 1, pp. 66–72, 2006.
[20] M. Speicher, “What is Usability? A Characterization Based on ISO 9241-11 and ISO/IEC 25010,”arXiv Prepr. arXiv1502.06792, 2015.
[21] A. Hussain, EOC Mkpojiogu, and Z. Hussain, “Usability Evaluation of a Web-Based Health Awareness Portal on Smartphone Devices Using ISO 9241-11 Model,”J. Technol., vol. 77, no. 4, pp. 1–5, 2015.
[22] N. Bevan, “Quality and Usability: A New Framework,”Achiev. softw. Prod. Qual., pp. 25–34, 1997.
[23] H. Singh and J. Singh, “Human Eye Tracking and Related Issues: A review,”int. J. Sci. Res. Publ., vol. 2, no. 9, pp. 1–9, 2012.
[24] K. Holmqvist, M. Nyström, R. Andersson, R. Dewhurst, H. Jarodzka, and J. de Weijer,Eye tracking: A Comprehensive Guide to Methods and Measures. United Kingdom: OUP Oxford, 2011.
[25] B. Sharif and JI Maletic, “An Eye Tracking Study on Camelcase and Under\_Score Identifier Styles,” in2010 IEEE 18th International Conference on Program Comprehension, 2010, pp. 196–205, doi: 10.1109/ICPC.2010.41.
[26] B. Smith, “Eye Tracking as A Measure of Noticing: A study of Explicit Recasts in SCMC,”Lang. learn. \& Technol., vol. 16, no. 3, pp. 53–81, 2012, doi: https://scholarspace.manoa.hawaii.edu/server/api/core/bitstreams/7538ade7-283a-4225-8301-3037400aea71/content.
[27] M. Fitrah and others,Research Methodology: Qualitative Research, Class Action & Case Studies. West Java: CV Footprint (Imprint Publisher), 2018.
[28] Y. Othman, M. Khalaf, A. Ragab, A. Salaheldin, R. Ayman, and N. Sharaf, “Eye-To-Eye: Towards Visualizing Eye Gaze Data,” in2020 24th International Conference Information Visualization (IV), 2020, pp. 729–733, doi: 10.1109/IV51561.2020.00128.
[29] Y. Cheung and Q. Peng, “Eye Gaze Tracking With a Web Camera in a Desktop Environment,”IEEE Trans. Human-Machine System., vol. 45, no. 4, pp. 419–430, 2015, doi: 10.1109/THMS.2015.2400442.
[30] H. Wei, A.-N. Moldovan, and C. Muntean, "Sensing Learner Interest Through Eye Tracking,"Technology, vol. 22, p. 23, 2009.
[31] K. Harezlak, P. Kasprowski, and M. Stasch, “Towards Accurate Eye Tracker Calibration--Methods and Procedures,”Procedia Comput. sci., vol. 35, p. 1073–1081, 2014, doi: https://doi.org/10.1016/j.procs.2014.08.194.
[32] AP Nurrachman, Y. Priyandari, and Y. Yuniaristanto, "Usability Testing on Android-based Diponegoro University Student Academic Information Applications,"Techno. com, vol. 21, no. 3, pp. 534–542, 2022, doi: https://doi.org/10.33633/tc.v21i3.6307.
[33] AW Soejono, A. Setyanto, and AF Sofyan, "Usability Evaluation of the UNRIYO Website Using the System Usability Scale (Case Study: UNRIYO Website),"Respect, vol. 13, no. 1, 2018, doi: https://doi.org/10.35842/jtir.v13i1.213.
[34] W. Buana and BN Sari, "User Interface Analysis Improves User Experience Using Usability Testing on Android Course Applications,"J.Comput. inf. Technol., vol. 5, no. 2, pp. 91–97, 2022, doi: http://doi.org/10.25273/doubleclick.v5i2.11669.
[35] D. Setiawan and SL Wicaksono, "Usability Evaluation of Google Classroom Using the System Usability Scale,"Walisongo J.Inf. Technol., vol. 2, no. 1, pp. 71–78, 2020, doi: 10.21580/wjit.2020.2.1.5792.
[36] H. Cho, D. Powell, A. Pichon, LM Kuhns, R. Garofalo, and R. Schnall, “Eye-Tracking Retrospective Think-Aloud as a Novel Approach for a Usability Evaluation,”int. J.Med. inform., vol. 129, pp. 366–373, 2019.
[37] RF Salim and others, "Usability Level Evaluation of Online Shopping Site X Using Tobii-Eye Tracker and Face Reader,"J. Metris, vol. 22, no. 02, pp. 131–136, 2021, doi: https://doi.org/10.25170/metris.v22i02.2968.
[38] NW Budiani, “Effectiveness of the Karang Taruna Unemployment Program 'Eka Taruna Bhakti', Sumerta Kelod Village, East Denpasar District, Denpasar City,”J. Ekon. and Sauce. inputs, vol. 2, no. 1, pp. 49–57, 2007.
[39] A. Bangor, P. Kortum, and J. Miller, “Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale,”J. usability Stud., vol. 4, no. 3, pp. 114–123, 2009.
Published
2022-12-30
How to Cite
Sutrisno, S., Polewangi, Y. D., & Rambe, E. (2022). AN USABILITY TEST USING THE METHOD EYE TRACKING ON ACADEMIC ONLINE WEBSITE UNIVERSITY MEDAN AREA. INFOKUM, 10(5), 778-787. Retrieved from http://seaninstitute.org/infor/index.php/infokum/article/view/1171
Section
Articles
