Developer’s Perspectives on Unit Test Cases Understandability

Good unit testing plays the most important role when it comes to driving and evaluating software quality. However, writing effective tests is a very expensive and time-consuming practice. To reduce such load on developers, there are many different techniques for automatically generating test suites for an existing source code. However, how automatically generated test cases compare to manually written cases is an open research question. There are some understandability issues regarding autogenerated test cases. This paper presents an experiment based on A/B testing methodology to gather developer preferences at test cases presentation. This survey involved 44 developers from 17 country. It founds that majority developers prefer the manual written than automatic generated test cases. This result brings some new perspectives to improve the quality of the automatic generated test case.