An Important Aspect of Satisfaction on Mobile Apps: An Usability Evaluation Based on Gender

Dessy G. Palyama; Golda Tomasila

doi:10.35877/454RI.jinav1568

Authors

Dessy G. Palyama Department of Informatics, Faculty of Computer Sciences, Universitas Kristen Indonesia Maluku, Ambon, Indonesia
Golda Tomasila Department of Informatics, Faculty of Computer Sciences, Universitas Kristen Indonesia Maluku, Ambon, Indonesia

DOI:

https://doi.org/10.35877/454RI.jinav1568

Keywords:

Usability evaluation, System Usability Scale (SUS), User Satisfaction, Mobile Application

Abstract

The quality of the feasibility of a mobile application can be measured by evaluating the usability using certain testing methods. The refore to improve the performance of mobile applications, it is necessary to measure the level of satisfaction and user acceptance of the application. This study aims to improve the quality of the Myelkomsel mobile application by measuring the level of satisfaction and acceptance of end-users and evaluating the relationship between the level of user satisfaction with user gender differences using the System Usability Scale (SUS) method. Data collection was carried out by distributing questionnaires to 46 Telkomsel provider users consisting of 22 male users and 24 female users. The results showed that the average SUS score was 71.96 for the whole user. According to the calculation of the level of user acceptance included in the category of Acceptable, the scale of the class level is included in category C, and the ranking is included in the good category. While the results of calculations from the SUS Percentile Rank Score show that the MyTelkomsel mobile application is in class C. There are no significant differences according to gender, the average SUS score of the male is 71.93, and female is 71.98 so that gender differences do not affect the level of satisfaction and acceptance application. It can be seen that the level of end-user satisfaction from the MyTelkomsel mobile application is good but still has possible problems with its use

References

Ahmad, Naveed, Aimal Rextin, and Um E. Kulsoom. 2018. “Perspectives on Usability Guidelines for Smartphone Applications: An Empirical Investigation and Systematic Literature Review.” Information and Software Technology 94:130–49. doi: 10.1016/j.infsof.2017.10.005.

Brown, Benjamin, Panos Balatsoukas, Richard Williams, Matthew Sperrin, and Iain Buchan. 2018. “Multi-Method Laboratory User Evaluation of an Actionable Clinical Performance Information System : Implications for Usability and Patient Safety.” Journal of Biomedical Informatics 77(November 2017):62–80. doi: 10.1016/j.jbi.2017.11.008.

Grier, Rebecca A., Aaron Bangor, Philip Kortum, and S. Camille Peres. 2013. “The System Usability Scale: Beyond Standard Usability Testing.” Proceedings of the Human Factors and Ergonomics Society 187–91. doi: 10.1177/1541931213571042.

Harrati, Nouzha, Imed Bouchrika, Abdelkamel Tari, and Ammar Ladjailia. 2016. “Exploring User Satisfaction for E-Learning Systems via Usage-Based Metrics and System Usability Scale Analysis.” Computers in Human Behavior 61:463–71. doi: 10.1016/j.chb.2016.03.051.

Hsieh, Meng Hsueh, Yu Ching Chen, and Chun Heng Ho. 2019. A Usability Evaluation of Diabetes Mobile Applications. Vol. 11568 LNCS. Springer International Publishing.

Huang, Zhao, and Morad Benyoucef. 2014. “Usability and Credibility of E-Government Websites.” Government Information Quarterly 31(4):584–95. doi: 10.1016/j.giq.2014.07.002.

Hussain, Azham, Hamisu Ibrahim Abubakar, and Norlaily Binti Hashim. 2015. “Evaluating Mobile Banking Application: Usability Dimensions and Measurements.” Conference Proceedings - 6th International Conference on Information Technology and Multimedia at UNITEN: Cultivating Creativity and Enabling Technology Through the Internet of Things, ICIMU 2014 (1):136–40. doi: 10.1109/ICIMU.2014.7066618.

Lewis, James R. 2018a. “Measuring Perceived Usability : The CSUQ , SUS , and UMUX Measuring Perceived Usability : The CSUQ , SUS , and UMUX.” International Journal of Human–Computer Interaction 00(00):1–9. doi: 10.1080/10447318.2017.1418805.

Lewis, James R. 2018b. “The System Usability Scale : Past , Present , and Future The System Usability Scale : Past , Present , and Future.” International Journal of Human–Computer Interaction 00(00):1–14. doi: 10.1080/10447318.2018.1455307.

Lewis, James R., and James R. Lewis. 2019. “Item Benchmarks for the System Usability Scale Item Benchmarks for the System Usability Scale.” (January).

Michael Efuwape, Bamidele, and Ayotola Aremu. 2013. “Gender Differences in Acceptability and Usability of Computer Based Learning Package in Electrical and Electronics Technology in Nigeria.” American Journal of Educational Research 1(10):419–24. doi: 10.12691/education-1-10-2.

Nayebi, Fatih, Jean Marc Desharnais, and Alain Abran. 2012. “The State of the Art of Mobile Application Usability Evaluation.” 2012 25th IEEE Canadian Conference on Electrical and Computer Engineering: Vision for a Greener Future, CCECE 2012 1–4. doi: 10.1109/CCECE.2012.6334930.

Paz, Freddy, and José Antonio Pow-Sang. 2016. “A Systematic Mapping Review of Usability Evaluation Methods for Software Development Process.” International Journal of Software Engineering and Its Applications 10(1):165–78. doi: 10.14257/ijseia.2016.10.1.16.

Pekpazar, Aycan, and Cigdem Altin Gumussoy. 2019. “Usability Measurement of Mobile Applications with System Usability Scale ( SUS ): Selected Papers from the Global Joint Conference on Industrial Engineering and Its Application Areas ... Usability Measurement of Mobile Applications with System Usability S.” (September 2021). doi: 10.1007/978-3-030-03317-0.

Rahmat, Hazwani, Hazura Zulzalil, Abdul Azim Abd Ghani, and Azrina Kamaruddin. 2016. “An Approach towards Development of Evaluation Framework for Usability of Smartphone Applications.” 2015 9th Malaysian Software Engineering Conference, MySEC 2015 178–82. doi: 10.1109/MySEC.2015.7475217.

Satria Putra, Rani Laple, Joanna Cristy Patty, and Djoko Budiyanto Setyohadi. 2018. “Interaction Design Consideration for Senior High School Students: A Usability Evaluation of Go-Jek Mobile Applications.” Proceedings - 2018 International Seminar on Application for Technology of Information and Communication: Creative Technology for Human Life, ISemantic 2018 196–201. doi: 10.1109/ISEMANTIC.2018.8549841.

Ward, Deborah J., Christine Furber, Stephanie Tierney, and Veronica Swallow. 2013. “Using Framework Analysis in Nursing Research : A Worked Example.” (2000):2423–31. doi: 10.1111/jan.12127.

Widyanti, Ari, and Sarah Amalia Qurratu Ainizzamani. 2018. “Usability Evaluation of Online Transportation’ User Interface.” 2017 International Conference on Information Technology Systems and Innovation, ICITSI 2017 - Proceedings 2018-Janua:82–86. doi: 10.1109/ICITSI.2017.8331762.

Zbick, Janosch, Isabella Nake, Marcelo Milrad, and Marc Jansen. 2015. “A Web-Based Framework to Design and Deploy Mobile Learning Activities: Evaluating Its Usability, Learnability and Acceptance.” Pp. 88–92 in Proceedings - IEEE 15th International Conference on Advanced Learning Technologies: Advanced Technologies for Supporting Open Access to Formal and Informal Learning, ICALT 2015. Institute of Electrical and Electronics Engineers Inc.