Maejo Information Technology and Innovation Journal (MITIJ)
 Search | First Page   
 
 
 
» Home
» Current Issue
» Archives
» Journal Search/Article
» Register (OJS/PKP)
 

                               :: Article details ::
Return to search menu 
Article name
Development of an Automated Testing Suite and Accessibility Evaluation for an Internal Issue and Support Management System
Article type
Research article
Authors Sirawit Harnnarong, Kongkan Dulyachai, Alongkot Kongmanee and Somnuek Sinthupuan(*)
Office Department of Computer Science, Faculty of Science, Maejo University (*) Corresponding author: somnuk@mju.ac.th
Journal name Vol. 12 No.3 (2026): September - December
Abstract

        This research aimed to (1) develop an automated testing suite for evaluating the accessibility of an internal Issue and Support Management System using Playwright integrated with the Page Object Model, and (2) evaluate and compare the system’s accessibility based on the Web Content Accessibility Guidelines (WCAG) 2.1 Level AA through automated testing combined with manual inspection. The study was conducted on the internal system of Lucas Strategy Co., Ltd. and covered two main modules: project creation and issue reporting. The evaluation was carried out over a six-month period, with data collected every two months for a total of three rounds. Six accessibility aspects were assessed: form labels, keyboard accessibility, focus order, status messages, contrast ratio, and the use of color for conveying information. The data were analyzed using descriptive statistics and the Friedman test. The results showed that the overall average success rate continuously increased from 54.25% in month 2 to 79.25% in month 4 and 94.75% in month 6, while the standard deviation decreased from 14.88 to 7.98 and 3.70, respectively. The Friedman test revealed statistically significant differences among the three evaluation rounds at the .05 level (χ² = 12.00, df = 2, p = 0.002). The findings indicate that integrating Playwright, the Page Object Model, and manual inspection provides a systematic methodological approach for continuous accessibility evaluation in internal organizational systems.

Keywords Automated Testing; Playwright; Page Object Model; WCAG 2.1; Accessibility
Page number 194-213
ISSN ISSN 3027-7280 (Online)
DOI
ORCID_ID 0000-0003-1461-1243
Article file https://mitij.mju.ac.th/ARTICLE/R69112.pdf
  
Reference 
  Angelov, A. (2023). Automated Testing Unleashed. N.P.: Independently Published.
  Dosaj, C.R. (2020). The Self-Taught Software Tester: A Step-by-Step Guide to Learn Software Testing Using Real-Life Projects. N.P.: Independently Published.
  Graham, D., Black, R., and van Veenendaal, E. (2024). Foundations of Software Testing: ISTQB Certification. 5th ed. Andover: Cengage Learning EMEA.
  He, Z., Huq, S.F., and Malek, S. (2025). Enhancing Web Accessibility: Automated Detection of Issues with Generative AI. Proceedings of the ACM on Software Engineering 2(FSE): 2264-2287. Retrieved from https://doi.org/10.1145/3729371.
  Jirak, J. (2024). Think Different: How Test Automation Is Changing the World of Software Development. N.P.: Independently Published.
  Kinsbruner, E. (2018). Continuous Testing for DevOps Professionals: A Practical Guide from Industry Experts. N.P.: CreateSpace Independent Publishing Platform.
  Leotta, M., Clerissi, D., Ricca, F., and Spadaro, C. (2013). Improving Test Suites Maintainability with the Page Object Pattern: An Industrial Case Study. In 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops (ICSTW) (pp. 108-113). Piscataway, NJ: IEEE. Retrieved from https://doi.org/10.1109/ICSTW.2013.19.
  Mehralian, F., He, Z., and Malek, S. (2025). Automated Accessibility Analysis of Dynamic Content Changes on Mobile Apps. In 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE) (pp. 2689-2701). Piscataway, NJ: IEEE. Retrieved from https://doi.org/10.1109/ICSE55347.2025.00039.
  Microsoft. (2025a, June 25). Installation. Playwright. Retrieved from https://playwright.dev/docs/intro.
  Microsoft. (2025b, June 25). Page Object Models. Playwright. Retrieved from https://playwright.dev/docs/pom.
  Pressman, R.S. and Maxim, B.R. (2020). Software Engineering: A Practitioner’s Approach. 9th ed. New York: McGraw-Hill Education.
  WebAIM. (2025). The WebAIM Million: The 2025 Report on the Accessibility of the Top 1,000,000 Home Pages. Retrieved from https://webaim.org/projects/million/ 2025.
  Winter, A. and Meaney, R. (2021). Team Guide to Software Testability: Better Software Through Greater Testability. N.P.: Leanpub.
  World Wide Web Consortium. (2018). Web Content Accessibility Guidelines (WCAG) 2.1. Retrieved from https://www.w3.org/TR/WCAG21/.
 
 
 
 
 
 
 
 
 
 
 
 
 
Return to search menu
       
Editorial Board of Maejo Information Technology and Innovation Journal MAEJO UNIVERSITY
No. 63 Moo 4, Nong Han Subdistrict, San Sai District, Chiang Mai Province 50290  mitij@mju.ac.th