Tuma Solutions - Software Consulting and Services

Metrics Framework Editor

When implementing any metrics program, an organization must decide upon a well-defined set of process metrics that they will collect. Without precisely-defined metrics, data collected by individuals cannot meaningfully be consolidated and analyzed at the team level.

For high-maturity processes inspired by TSP^(SM), these definitions include:

The size metrics that will be used estimate and measure product size
The process phases that will be used to characterize defect injection and removal

Choosing a particular set of size metrics and process phases will result in a unique metrics collection framework, which can be used in the planning and execution of a team project.

For convenience, the open source Process Dashboard includes a metrics collection framework that can be used out-of-the-box to support high-maturity teams. However, the Process Dashboard can support custom metrics collection frameworks for organizations that need this functionality.

Creating a Metrics Collection Framework

To create a custom metrics collection framework:

Launch the Custom Metrics Framework Editor by clicking here.
Enter the size metrics and phases in your process. Currently, this editor targets the creation PSP^(SM)-compatible metrics frameworks, so several metrics and phases will be present by default, and cannot be removed.
After describing a metrics framework, use "File > Save" to save the framework in the same directory where you installed the process dashboard. (For users on the Windows operating system, this defaults to C:\Program Files\Process Dashboard). The next time you launch the Process Dashboard and setup a team project, you will be given the option of using your custom metrics framework as the basis for the team project.

Great care should be taken in the creation of a new metrics framework, since many aspects of the framework cannot be changed once a project has been created. For more advice on the construction of an effective metrics framework, see the Team Users Manual.

Upgrading a Metrics Collection Framework

When you follow the steps above to create a metrics collection framework, the resulting framework will be based upon the functionality that is present in the current release of the Process Dashboard.

In general, you can continue to use this metrics collection framework indefinitely, even as you upgrade to future releases of the Process Dashboard. Great care is taken to ensure that future releases of the Process Dashboard remain backward-compatible with older custom metrics collection frameworks. (If a particular release of the Process Dashboard must break this backward-compatibility, the release notes for that version will make this clear.)

From time to time, releases of the Process Dashboard may add new functionality to the metrics collection framework meta-definition. For example, they may allow you to analyze your data in new ways, or they may provide new team collaboration features. Although you can continue to use your old metrics collection framework as-is, you may prefer to upgrade it, so that it takes advantage of the newly released functionality.

To upgrade your custom metrics collection framework, take the following steps:

Launch the Custom Metrics Framework Editor by clicking here.
Choose "File > Open" and select the existing ZIP file for your custom metrics collection framework.
Choose "File > Save" to resave the framework with the new functionality.
Copy the new ZIP file into the Templates subdirectory underneath the network team directory for each of your team projects. (If the existing ZIP file is locked and cannot be overwritten, the new ZIP file can be safely saved with a different name.)

For questions about this process, and additional assistance with deployment and versioning considerations, support is available.

PSP^(SM) and TSP^(SM) are service marks of Carnegie Mellon University. Tuma Solutions is not affiliated with or endorsed by Carnegie Mellon University.




Home Support Team Users Manual Metrics Framework Editor Consulting Contact		Metrics Framework Editor When implementing any metrics program, an organization must decide upon a well-defined set of process metrics that they will collect. Without precisely-defined metrics, data collected by individuals cannot meaningfully be consolidated and analyzed at the team level. For high-maturity processes inspired by TSP^(SM), these definitions include: The size metrics that will be used estimate and measure product size The process phases that will be used to characterize defect injection and removal Choosing a particular set of size metrics and process phases will result in a unique metrics collection framework, which can be used in the planning and execution of a team project. For convenience, the open source Process Dashboard includes a metrics collection framework that can be used out-of-the-box to support high-maturity teams. However, the Process Dashboard can support custom metrics collection frameworks for organizations that need this functionality. Creating a Metrics Collection Framework To create a custom metrics collection framework: Launch the Custom Metrics Framework Editor by clicking here. Enter the size metrics and phases in your process. Currently, this editor targets the creation PSP^(SM)-compatible metrics frameworks, so several metrics and phases will be present by default, and cannot be removed. After describing a metrics framework, use "File > Save" to save the framework in the same directory where you installed the process dashboard. (For users on the Windows operating system, this defaults to `C:\Program Files\Process Dashboard`). The next time you launch the Process Dashboard and setup a team project, you will be given the option of using your custom metrics framework as the basis for the team project. Great care should be taken in the creation of a new metrics framework, since many aspects of the framework cannot be changed once a project has been created. For more advice on the construction of an effective metrics framework, see the Team Users Manual. Upgrading a Metrics Collection Framework When you follow the steps above to create a metrics collection framework, the resulting framework will be based upon the functionality that is present in the current release of the Process Dashboard. In general, you can continue to use this metrics collection framework indefinitely, even as you upgrade to future releases of the Process Dashboard. Great care is taken to ensure that future releases of the Process Dashboard remain backward-compatible with older custom metrics collection frameworks. (If a particular release of the Process Dashboard must break this backward-compatibility, the release notes for that version will make this clear.) From time to time, releases of the Process Dashboard may add new functionality to the metrics collection framework meta-definition. For example, they may allow you to analyze your data in new ways, or they may provide new team collaboration features. Although you can continue to use your old metrics collection framework as-is, you may prefer to upgrade it, so that it takes advantage of the newly released functionality. To upgrade your custom metrics collection framework, take the following steps: Launch the Custom Metrics Framework Editor by clicking here. Choose "File > Open" and select the existing ZIP file for your custom metrics collection framework. Choose "File > Save" to resave the framework with the new functionality. Copy the new ZIP file into the `Templates` subdirectory underneath the network team directory for each of your team projects. (If the existing ZIP file is locked and cannot be overwritten, the new ZIP file can be safely saved with a different name.) For questions about this process, and additional assistance with deployment and versioning considerations, support is available. PSP^(SM) and TSP^(SM) are service marks of Carnegie Mellon University. Tuma Solutions is not affiliated with or endorsed by Carnegie Mellon University.