QEX: Automated Testing Observability and QA Developer Experience Framework

Automated testing is now applied on a large scale, especially in organizations that embrace a continuous integration and continuous delivery (CI/CD) software development process [1], [2]. While numerous studies have demonstrated the impact of automated testing on software development, there is currently no standardised industrial framework for providing a comprehensive high-level overview on testing activity across projects. This is vital for developing and maintaining test frameworks, and thereby a crucial part of the Quality Assurance (QA) Developer Experience [3]. In this paper, we present QEX, which is a model for integrating common testing data sources to obtain observability on test development in a way that provides transparent and actionable insights to relevant stakeholders. It is most suitable for enterprise contexts where testing is performed on a large scale. We provide an open-source implementation that is used at our company, together with an evaluation of its performance and possible ways to extend it further.