Compare two classification benchmark files
Use the procedure in this topic to compare two classification benchmark files.
To ensure that your classification configuration changes improve your project, perform classification benchmarks. After any changes to your classification configuration, perform a classification benchmark and compare it to your previous results. This enables you to determine whether your changes improve or deteriorate your classification results.
-
Optional. Perform and save a classification benchmark using all classification settings or for a specific classifier.
The Classification Benchmark window is displayed and the Result Matrix is populated with your benchmark data.
If you have at least two saved classification benchmarks of the same type, the Compare toolbar setting is available.
- Open the Classification Benchmark window if it is not already open.
-
On the toolbar, select
Compare.
The Classification Benchmark Comparison window is displayed.
-
Select a benchmark and configure the following settings.
The project statistics comparison and class statistics comparison are displayed in the lower two panes.
Setting
Description
Date
The date and time the benchmark file was saved. This field is read-only.
Precision/Recall
The precision and recall values saved in the benchmark file. This field is read-only.
Comment
The comment added when the benchmark is saved. This field is read-only.
Baseline
If selected, all other benchmarks are compared to the results in this benchmark file. Clear it to set another file as the baseline.
Result Matrix
Displays the benchmark results in graphical format.
Delete
Deletes the benchmark file from the project.
Project Statistics Comparison
Read-only statistics for each of the selected benchmark files, as well as their differences.
The following statistics are compared for the two benchmark files:
-
Recall
-
Precision
-
Threshold
Class Statistics Comparison
Displays the precision and recall statistics, as well as the differences between the two benchmark files for each class in the project.
-
-
Optional. Select
Result Matrix for either benchmark to view the
Result Matrix.
The screen shot taken when saving the benchmark is displayed.
- Select OK to close the Result Matrix.
- Select OK to close the Classification Benchmark Comparison window when you are finished with your comparison.
- Optional. Modify your classification settings, perform another benchmark, and compare the new benchmark to look for improvements.