TACP – A New ROI Focused TA Metric

分享者:Ivan Jin
职位A Site Manager
所在研发团队规模:200+
该研发团队职能定位:Software QA/Test
分享者介绍:Sr. QA Manager @Cisco System

---

案例简述
Test automation has always been a hot topic in software industry particularly when entering Agile era. How to guide and measure the effectiveness and efficiency of TA on a testing team could be extremely challenging due to the complexity of software development. TACP(Test Automation Contributing to Productivity), an in-house developed metric is introduced to address this need...

---

案例解读
１.目标
This invention was derived from an ask to answer the following questions from executives:
A.To what extent, test automation is implemented on your team?
B.How the above #1 reflects on the time/resource savings on your team?
TACP is designed to try to answer these questions in a quantified manner.

２.成功（或教训）要点：
The traditional method of measuring the test automation coverage is either leveraging the code coverage tool or calculating based on the automated tests. It can partially reflect on the degree of automation in a specific project; yet it cannot tell us of how the automation contributes to the productivity improvement in a test team. Another blind point of traditional method is prone to assume one TA approach for all the tests of a product. This newly defined TACP is attempting to disrupt the principles of traditional methodology in:
A.It introduces a new concept, “Test Aspect” which implies a different TA approach or solution for a different “Test Aspect”.
B.Try to measure the TA coverage or degree by using test effort.
…


３.案例ROI分析：
N/A

４.案例启示：
Actually this metric/methodology reveals the rationale behind of implementing test automation and where you can start:
A.Think from a low-hanging fruit area where you’re able to save the test time/resource at maximum if automation.
B.Start with an aspect where you can find an effective way to implement a TA solution.