Automatically Test Every ControlIt! Demo

Introduction

As the number of ControlIt! demos increase, continuously testing all of them is becoming too time consuming. To address this issue, we created an automated tester that goes throuch each of the demos and generates a report stating which demos work and which fail.

Execution Instructions

$ rosrun controlit_quality_assurance groupTest.py 

Expected Output

Here is example output:

---------------------
robot_name:  atlas_legs_plain
default_test:  True
Error Ratio:  12/12

robot_name:  atlas_plain_pinned
default_test:  True
Error Ratio:  28/28

robot_name:  stickbot_bipedal_12dof
error_message Checking fail

robot_name:  stickbot_humanoid_32dof
error_message Checking fail

robot_name:  stickbot_humanoid_32dof_pinned
error_message Checking fail

robot_name:  stickbot_leg_6dof
default_test:  True
Error Ratio:  6/6

robot_name:  stickbot_lowerleg_3dof
default_test:  True
Error Ratio:  3/3

robot_name:  stickbot_upperbody_10dof
default_test:  True
Error Ratio:  10/10

robot_name:  trikey
default_test:  True
Error Ratio:  3/3

robot_name:  trikey_pinned
default_test:  True
Error Ratio:  3/3

---------------------
The following demo(s) fail(s):
robot_name:  stickbot_bipedal_12dof
robot_name:  stickbot_humanoid_32dof
robot_name:  stickbot_humanoid_32dof_pinned
---------------------