Usability Analysis of the Authentication Feature in the Andal by Taspen Application Using the System Usability Scale Method
DOI:
https://doi.org/10.56127/juit.v5i1.2442Keywords:
Usability, Authentication Feature, Digital Public Service, System Usability Scale, User ExperienceAbstract
This study evaluates the usability of the authentication feature in the Andal by Taspen application for pensioners, focusing on challenges faced by elderly users, as initial reviews indicate issues with its effectiveness. Objective: This study aims to assess the usability of the Andal by Taspen authentication feature using the System Usability Scale (SUS) method, identify usability issues affecting elderly users, and provide recommendations for improvement. Specifically, the study focuses on evaluating whether the selfie-based authentication process meets the needs of elderly pensioners, who may face challenges in digital literacy and physical limitations. Methodology: This quantitative study involved distributing the System Usability Scale (SUS) questionnaire to PT Taspen pensioners in the Cempaka Putih District, Jakarta. The responses were analyzed using the SUS method to generate a usability score for the authentication feature and to identify areas for improvement. Findings: The findings reveal that the Andal by Taspen authentication feature received a SUS score of 61, which corresponds to Grade D on the SUS scale, with an adjective rating of "OK" and an acceptability range classified as "Marginal (Acceptable)." The primary issues identified include difficulties in the self-authentication process, particularly for elderly users, as well as challenges related to digital literacy and physical constraints. Implications: The study recommends the development of an heir-based authentication feature to assist elderly pensioners in the authentication process. Additionally, the study emphasizes the importance of improving digital literacy among elderly users to ensure that they can effectively use digital platforms. Originality: This research offers a unique contribution to the field of digital public services by providing an empirical evaluation of selfie-based biometric authentication in mobile applications for elderly users, a topic that remains underexplored in existing literature. The findings provide valuable insights into the usability challenges faced by older adults, particularly in the context of pension services, and propose actionable solutions to enhance accessibility and usability.
References
Alabdulrahman, R. et al. (2025). Uncovering Usability Issues in Mobile Government Applications: A User-Centered Approach. IEEE Access, 13, 169352–169366. https://doi.org/10.1109/ACCESS.2025.3614165
Almarashdeh, I., & Alsmadi, M. (2017). Heuristic evaluation of mobile government portal services: An experts’ review. 2016 11th International Conference for Internet Technology and Secured Transactions, ICITST 2016, 427–431. https://doi.org/10.1109/ICITST.2016.7856746
Amouzadeh, E. et al. (2025). Optimizing mobile app design for older adults: systematic review of age-friendly design. Aging Clinical and Experimental Research, 37(1). https://doi.org/10.1007/s40520-025-03157-7
Blanco-Gonzalo, R. et al. (2018). Biometrics: Accessibility challenge or opportunity? PLoS ONE, 13(3). https://doi.org/10.1371/journal.pone.0194111
BPS, B. P. S. (2024). Statistik Penduduk Lanjut Usia 2024. Badan Pusat Statistik. https://www.bps.go.id/id/publication/2024/12/31/a00d4477490caaf0716b711d/statistik-penduduk-lanjut-usia-2024.html
Ensink, C. J. et al. (2024). Translation and validation of the System Usability Scale to a Dutch version: D-SUS. Disability and Rehabilitation, 46(2), 395–400. https://doi.org/10.1080/09638288.2022.2160837
Habibillah, R., & Hadjri, M. I. (2024). Pengaruh perkembangan teknologi di era digital bagi pengembangan sumber daya manusia di daerah tertinggal di Indonesia. Jurnal Bisnis Dan Pemasaran Digital, 2(2), 115–125. https://doi.org/10.35912/jbpd.v2i2.2600
Hyzy, M. et al. (2022). System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis. JMIR MHealth and UHealth, 10(8). https://doi.org/10.2196/37290
Indonesia, K. K. R. (2024). Indonesia siapkan lansia aktif dan produktif. https://kemkes.go.id/id/indonesia-siapkan-lansia-aktif-dan-produktif
Kureerung, P., & Ramingwong, L. (2019). Factors supporting user interface design of mobile government application. ACM International Conference Proceeding Series, Part F1483, 115–119. https://doi.org/10.1145/3322645.3322663
Li, Q., & Luximon, Y. (2020). Older adults’ use of mobile device: usability challenges while navigating various interfaces. Behaviour and Information Technology, 39(8), 837–861. https://doi.org/10.1080/0144929X.2019.1622786
Lourenço, D. F. et al. (2022). Translation and cross-cultural adaptation of the System Usability Scale to Brazilian Portuguese. Aquichan, 22(2). https://doi.org/10.5294/aqui.2022.22.2.8
Menegazzo Verzeletti, G. et al. (2018). A National Mobile Identity Management Strategy for Electronic Government Services. Proceedings - 17th IEEE International Conference on Trust, Security and Privacy in Computing and Communications and 12th IEEE International Conference on Big Data Science and Engineering, Trustcom/BigDataSE 2018, 668–673. https://doi.org/10.1109/TrustCom/BigDataSE.2018.00098
Microsoft. (2025). What is authentication? Definition and methods. https://www.microsoft.com/en-gb/security/business/security-101/what-is-authentication
Mohamad Marzuki, M. F. et al. (2018). Translation, cross-cultural adaptation, and validation of the Malay version of the system usability scale questionnaire for the assessment of mobile apps. JMIR Human Factors, 5(2). https://doi.org/10.2196/10308
Nicora, G. et al. (2025). Exploring Usability Standards in Robotic Rehabilitation: A Meta-Analysis of System Usability Scale Scores. IEEE International Conference on Rehabilitation Robotics, 476–482. https://doi.org/10.1109/ICORR66766.2025.11063026
Ozturk, E. O. et al. (2019). Usability Evaluation of e-Kocaeli M-Goverment Application. Proceedings - 2019 Innovations in Intelligent Systems and Applications Conference, ASYU 2019. https://doi.org/10.1109/ASYU48272.2019.8946419
Prasodjo, T. (2023). Pelayanan publik era digital. CV. Literasi Nusantara Abadi. https://www.researchgate.net/publication/370654986
Quinn, C. C. et al. (2019). Mobile support for older adults and their caregivers: Dyad usability study. JMIR Aging, 2(1). https://doi.org/10.2196/12276
Rachmawati, I., & Setyadi, R. (2023). Evaluasi usability pada sistem website absensi menggunakan metode System Usability Scale. Journal of Information System Research, 4(2), 551–561. https://doi.org/10.47065/josh.v4i2.2868
Richard, L. (1990). Adequacy of sample size in health studies. World Health Organization.
Sheu, F.-R. et al. (2017). Pre-testing the Chinese version of the system usability scale (C-SUS). ICCE 2017 - 25th International Conference on Computers in Education: Technology and Innovation: Computer-Based Educational Systems for the 21st Century, Workshop Proceedings, 28–34. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85054182257&partnerID=40&md5=4df34fa83a1c3f380e359e6c41cb381d
Vlachogianni, P., & Tselios, N. (2022). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 54(3), 392–409. https://doi.org/10.1080/15391523.2020.1867938
Wahyuningrum, T. (2021). Mengukur usability perangkat lunak. Deepublish.
Zhang, T. et al. (2019). Evaluation of the Multifactor Authentication Technique for Mobile Applications. Advances in Intelligent Systems and Computing, 998, 696–707. https://doi.org/10.1007/978-3-030-22868-2_49
