Intrusive test automation with failed test case clustering

Chien Hsin Hsueh, Yung Pin Cheng, Wei Cheng Pan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Scopus citations


Regression testing is an indispensable process in software development, which ensures stable features have not been adversely broken by new changes. When GUI plays an important role in an application, a popular choice to automate the tests is applying GUI Capture/Replay tools. Unfortunately, in many applications which render images as output, the correctness of a replay run can no longer be straightforwardly verified. In this paper, we propose a test automation solution, called Intrusive Test Automation, which uses program instrumentation technique to collect the runtime internal information of a program. As a result, the correctness of a test run can be verified by the runtime traces. In addition, when large number of failed test cases are reported by the test automation system, recommending some representative test cases as a start for debugging can be helpful to programmers. This paper proposes a clustering technique based on the information collected from the instrumented code. In principle, fixing bugs in one representative test case can fix its related failed test cases as well. A case study is presented to demonstrate the effectiveness of the approach.

Original languageEnglish
Title of host publicationProceedings - 18th Asia-Pacific Software Engineering Conference, APSEC 2011
Number of pages8
StatePublished - 2011
Event18th Asia Pacific Software Engineering Conference, APSEC 2011 - Ho Chi Minh, Viet Nam
Duration: 5 Dec 20118 Dec 2011

Publication series

NameProceedings - Asia-Pacific Software Engineering Conference, APSEC
ISSN (Print)1530-1362


Conference18th Asia Pacific Software Engineering Conference, APSEC 2011
Country/TerritoryViet Nam
CityHo Chi Minh


  • Clustering
  • GUI Capture/Replay
  • Program instrumentation
  • Test automation
  • Test case selection
  • Test-suite reduction


Dive into the research topics of 'Intrusive test automation with failed test case clustering'. Together they form a unique fingerprint.

Cite this