The rapid growth of Android applications and the acceleration of software release cycles highlight the need for efficient, accessible, and reproducible testing infrastructures. Commercial cloud platforms often address this challenge, providing scalability and device diversity, but they remain costly and inflexible for small and medium-sized development teams. This study proposes a unified, low-cost approach to Android application test automation that consolidates the entire testing infrastructure on a single Windows 10 machine using a headless Android emulator. The methodology is experimental and practice-oriented, focusing on open-source automation frameworks, emulator stability, continuous integration (CI) integration, and optimal resource utilization. Evaluation results demonstrate that tests executed in headless mode are on average 6.6% faster and reduce CPU usage by approximately 5% compared to UI-based emulation, without sacrificing reliability or reproducibility. This work contributes to the body of research on emulator-driven mobile testing by offering a practical, scalable, and reproducible solution, enabling smaller teams to implement complete automation pipelines while reducing dependence on commercial cloud platforms.
Keywords
AndroidAndroid Application TestingMobile Test AutomationWebdriverIOAppiumTypeScript.
References
A. Niroshan, S. Seneviratne, and A. Seneviratne, “An Empirical Study of Code Obfuscation Practices in the Google Play Store,” arXiv preprint, arXiv:2502.04636, 2025.
A. Bilal, H. T. Mirza, I. Hussain, and A. Ahmad, “Investigating Influence of Google Play Application Titles on Success,” Big Data Research, vol. 36, 2024, doi: 10.1016/j.bdr.2024.100443.
S. Godboley, D. Dalei, R. Sadam, and D. P. Mohapatra, “Agile GUI Testing by computing novel Mobile App Coverage Using Appium Tool,” in Proc. 38th ACM/SIGAPP Symp. Applied Computing, 2023, pp. 1026–1029, doi: 10.1145/3555776.3577806.
S. Adiatma and A. Darmayantie, “Implementation and Comparative Analysis of Test Automation Framework Performance for Functional Testing of Web-Based Applications using the Distance to the Ideal Alternative (DIA) Method,” Widya Teknik, vol. 22, no. 1, 2023, doi: 10.33508/wt.v22i1.5027.
H. Sun, A. Rosà, D. Bonetta, and W. Binder, “Automatically Assessing and Extending Code Coverage for NPM Packages,” in 2021 IEEE/ACM Int. Conf. on Automation of Software Test (AST), 2021, pp. 40–49, doi: 10.1109/AST52587.2021.00013.
P. H. Kuroishi, A. C. R. Paiva, J. C. Maldonado, and A. M. R. Vincenzi, “Testing infrastructures to support mobile application testing: A systematic mapping study,” Information and Software Technology, vol. 177, p. 107573, 2025, doi: 10.1016/j.infsof.2024.107573.
J. W. Lin, N. Salehnamadi, and S. Malek, “Test automation in open-source Android apps: A large-scale empirical study,” in Proc. 35th IEEE/ACM Int. Conf. on Automated Software Engineering (ASE), 2020, pp. 1078–1089, doi: 10.1145/3324884.3416623.
A. A. Menegassi and A. T. Endo, “Automated tests for cross-platform mobile apps in multiple configurations,” IET Software, vol. 14, no. 1, pp. 27–38, 2020, doi: 10.1049/iet-sen.2018.5445.
A. Romano, Z. Song, S. Grandhi, W. Yang, and W. Wang, “An Empirical Analysis of UI-Based Flaky Tests,” in Proc. 2021 IEEE/ACM 43rd Int. Conf. on Software Engineering (ICSE), 2021, pp. 1585–1597, doi: 10.1109/ICSE43902.2021.00141.
D. Kim, S. Park, J. Ko, S. Y. Ko, and S.-J. Lee, “X-Droid: A Quick and Easy Android Prototyping Framework with a Single-App Illusion,” in Proc. 32nd Annual ACM Symp. User Interface Software and Technology (UIST), 2019, pp. 95–108, doi: 10.1145/3332165.3347890.
J. Samhi, R. Just, T. F. Bissyandé, M. D. Ernst, and J. Klein, “Call Graph Soundness in Android Static Analysis,” in Proc. 33rd ACM SIGSOFT Int. Symp. Software Testing and Analysis (ISSTA), 2024, pp. 945–957, doi: 10.1145/3650212.3680333.
K. K. Luhana, C. Schindler, and W. Slany, “Streamlining mobile app deployment with Jenkins and Fastlane in the case of Catrobat’s Pocket Code,” in 2018 IEEE Int. Conf. on Innovative Research and Development (ICIRD), 2018, pp. 1–6, doi: 10.1109/ICIRD.2018.8376296.
P. Liu, X. Sun, Y. Zhao, Y. Liu, J. Grundy, and L. Li, “A First Look at CI/CD Adoptions in Open-Source Android Apps,” in Proc. 37th IEEE/ACM Int. Conf. on Automated Software Engineering (ASE), 2022, doi: 10.1145/3551349.3561341.
P. Duy Hung and D. Thanh Giang, “Continuous Integration for Android Application Development and Training,” in Proc. 2019 3rd Int. Conf. on Industrial and Business Engineering (ICIBE), 2019, pp. 66–70, doi: 10.1145/3345120.3345158.
D. Wang, Y. Zhao, L. Xiao, and T. Yu, “An Empirical Study of Regression Testing for Android Apps in Continuous Integration Environment,” in 2023 ACM/IEEE Int. Symp. on Empirical Software Engineering and Measurement (ESEM), 2023, pp. 1–11, doi: 10.1109/ESEM56168.2023.10304799.
“Practices for installing and running an Android emulator in headless mode on Ubuntu servers,” [Online]. Available: https://github.com/Oleksii-QA/android-emulator-headless-ubuntu.
S. Abolfazli, Z. Sanaei, M. Alizadeh, A. Gani, and F. Xia, “An Experimental Analysis on Cloud-Based Mobile Augmentation in Mobile Cloud Computing,” IEEE Transactions on Consumer Electronics, vol. 60, no. 1, pp. 146–154, Feb. 2014, doi: 10.1109/TCE.2014.6780937.
·
This work is licensed under a
Creative Commons Attribution-ShareAlike 4.0 International License
