An Environment for Conducting Families of Software Engineering Experiments

TitleAn Environment for Conducting Families of Software Engineering Experiments
Publication TypeBook Chapters
Year of Publication2008
AuthorsHochstein L, Nakamura T, Shull F, Zazworka N, Basili VR, Zelkowitz MV
EditorZelkowitz MV
Book TitleSoftware Development
VolumeVolume 74
Pagination175 - 200
ISBN Number0065-2458

The classroom is a valuable resource for conducting software engineering experiments. However, coordinating a family of experiments in classroom environments presents a number of challenges to researchers. Understanding how to run such experiments, developing procedures to collect accurate data, and collecting data that is consistent across multiple studies are major problems. This paper describes an environment, the Experiment Manager that simplifies the process of collecting, managing, and sanitizing data from classroom experiments, while minimizing disruption to natural subject behavior. We have successfully used this environment to study the impact of parallel programming languages in the high‐performance computing domain on programmer productivity at multiple universities across the United States.