Compare two classification benchmark files

Use the procedure in this topic to compare two classification benchmark files.

To ensure that your classification configuration changes improve your project, perform classification benchmarks. After any changes to your classification configuration, perform a classification benchmark and compare it to your previous results. This enables you to determine whether your changes improve or deteriorate your classification results.

Procedure
  1. Optional. Perform and save a classification benchmark using all classification settings or for a specific classifier.

    The Classification Benchmark window is displayed and the Result Matrix is populated with your benchmark data.

    If you have at least two saved classification benchmarks of the same type, the Compare toolbar setting is available.

  2. Open the Classification Benchmark window if it is not already open.
  3. On the toolbar, select Compare Classification Benchmark icon Compare.

    The Classification Benchmark Comparison window is displayed.

  4. Select a benchmark and configure the following settings.

    The project statistics comparison and class statistics comparison are displayed in the lower two panes.

    Setting

    Description

    Date

    The date and time the benchmark file was saved. This field is read-only.

    Precision/Recall

    The precision and recall values saved in the benchmark file. This field is read-only.

    Comment

    The comment added when the benchmark is saved. This field is read-only.

    Baseline

    If selected, all other benchmarks are compared to the results in this benchmark file. Clear it to set another file as the baseline.

    Result Matrix

    Displays the benchmark results in graphical format.

    Delete

    Deletes the benchmark file from the project.

    Project Statistics Comparison

    Read-only statistics for each of the selected benchmark files, as well as their differences.

    The following statistics are compared for the two benchmark files:

    • Recall

    • Precision

    • Threshold

    Class Statistics Comparison

    Displays the precision and recall statistics, as well as the differences between the two benchmark files for each class in the project.

  5. Optional. Select Result Matrix for either benchmark to view the Result Matrix.

    The screen shot taken when saving the benchmark is displayed.

  6. Select OK to close the Result Matrix.
  7. Select OK to close the Classification Benchmark Comparison window when you are finished with your comparison.
  8. Optional. Modify your classification settings, perform another benchmark, and compare the new benchmark to look for improvements.