Edit field properties, formatters, and validators

Use the procedure in this topic to manually apply formatting and validation to fields on both configurable and predefined document types. For configurable document types, the fields must exist before you can apply formatting and validation. For AI table fields, see Edit AI table field properties.

Both formatting and validation are applied to field data when extraction is performed for training documents and is tested for test documents. The formatted value is returned to the list of field extraction values. The original value before formatting is available in the field details displayed when you move the pointer over the extraction data circle or the field on the document image.

If validation fails, the validation message is also displayed in the field details.

Before you begin

Before you edit the properties of an extraction field, verify the following steps are complete.

  • Configurable document types have one or more fields already configured.

  • Field formatters and validators are configured, if needed.

    Field formatters and global or local field validators are configured, if needed.

    For more information about adding formatters and validators, refer to the Tungsten TotalAgility Advanced Studio Help.

Procedure
  1. On the Fields menu, select a document and then do one of the following:
    • Select List of configured fields.

    • For a field, select its menu and select Properties.

    In both cases, a list of configured fields is displayed for the selected document. Basic information is provided for each field and includes the field type, its location, whether it is a bar code, any warnings, if it is trained, and extracted. Additional field properties are displayed on the right.

  2. If not already selected, select a non-table field from the list of fields.

    The properties for the General tab are displayed.

  3. Depending on the type of field, edit the following settings as needed.

    Setting

    Description

    Availability

    Name

    Edit the existing field name.

    See Field name guidelines for more information.

    All field types

    Type

    Select the type of field that you are creating. (Default: Text)

    There are three values for this setting.

    • Text

    • Date

    • Number

    The selected field type determines additional settings.

    All field types

    Description

    Edit the existing description for the content you are extracting.

    For more information about useful descriptions, see Guidelines for descriptions.

    Copilot Auto Extract fields only

    Is this value located within a table?

    If selected, the field is expected to be found in a table cell. (Default: No)

    Copilot Auto Extract fields only

    Keywords

    Edit the existing keywords and add additional keywords as needed, separating each keyword with a semicolon.

    Suggested fields only

    Is bar code

    If selected, the field is assumed to be a bar code, and the following setting is enabled:

    Bar code type:

    When extracting a bar code, select the specific bar code type from the list to ensure the best extraction results. If the bar code type is known when the bar code is lassoed, the type is selected automatically. If the bar code type is unknown, use Select All.

    Bar code fields only

    Formatter

    It is possible to further refine a field by applying a formatter. (Default: No formatter)

    Field formatting is applied to field data when extraction is performed for both training documents and test documents. The original value is displayed when you move the pointer over the extraction data circle or the field on the image.

    Select a formatter from the list. The values in this list depend on what field formatters are created in the DocAI Studio Settings > Field formatters menu, or imported from Tungsten TotalAgility Advanced Studio.

    By default, the following formatters are available:

    No formatter:

    If selected, it does not take any text, characters, or digits from the document for formatting.

    Default Amount Formatter:

    Contains the default currency and typical decimal symbol formatting.

    Default Date Formatter:

    Contains basic date formatting, such as the date order and date output format.

    When the field Type is set to Date, the Default Date Formatter is selected automatically.

    All field types except bar code fields

    Is mandatory

    Select this setting if a value for this field is required during production. (Default: Cleared)

    All field types

  4. The following settings depend on the selected value for Type. Follow the steps for the relevant value from the table below.

    Setting

    Description

    Text

    Configure the following settings as required.

    Minimum character length:

    The minimum number of characters allowed for a field. Select to enter a minimum character length. If an extracted result is shorter than the minimum length, the field is marked as invalid. (Default: Cleared)

    Maximum character length:

    The maximum number of characters allowed for a field. Select to enter a maximum character length. If the extracted result is longer than the maximum length, the field is marked as invalid. (Default: Cleared)

    Define allowed characters:

    Select to enter a list of allowed characters. This list is literal, so no separator character is necessary. (Default: Cleared)

    Define restricted characters:

    Select to enter a list of restricted characters. This list is literal, so no separator character is necessary. (Default: Cleared)

    Date

    Configure the following settings as required.

    Reference date:

    Select a reference date. All dates are compared to this date to ensure they fit within a specific date range. (Default: Today)

    Period before reference date:

    Select this setting to provide the number of days that a date is valid before the reference date. It restricts a date found on a document to be within the past N days before the reference date. If a date falls outside the specified date range, it is invalid. (Default: Cleared)

    Period after reference date:

    Select this setting to provide the number of days that a date is valid after the reference date. It restricts a date on a document to be within N days after the reference date. If a date falls outside this range, it is invalid. (Default: Cleared)

    Number

    No additional steps are necessary for fields of this type.

  5. Select the Validation tab and configure the following settings.

    Validators are not supported for bar code fields.

    Setting

    Description

    Require manual field confirmation

    If selected, this field is flagged as invalid and requires manual confirmation. (Default: Cleared)

    Always valid

    If selected, this field is always valid, even when no result is extracted. (Default: Cleared)

    Validators

    A list of validation rules applied to this field. If the extraction result does not meet these rules, it is invalid and the configured validation message is displayed.

    Field validation is applied to field data when extraction is performed for both test documents and training documents. If an extracted field does not meet the validation requirements, a validation message is displayed when you move the pointer over the field on an image or its extraction data circle. Field validators are limited to regular expression and date validation.

    The color of the extraction data circle does not indicate if there are validation errors. It is possible to have a green extraction data circle and an extraction result that fails validation. After extraction or testing, move the pointer over the circle to see if there is a validation message.

    Validators are added using the DocAI Studio Settings > Field validators menu. Alternatively, you can import validators that were created in Tungsten TotalAgility Advanced Studio.

    For more information on adding field validators, refer to the Tungsten TotalAgility Advanced Studio Help.

    You can apply both local and global validators to this field. Local validators are added to a document type and available only within that document type. For more information, see Add local field validators.

    Global validators are added from the DocAI Studio Settings > Field validators menu. For more information on adding field validators, refer to the Tungsten TotalAgility Advanced Studio Help.

    Apply validators by following these steps:

    1. In the Validators section select Add field validator.

      The Add field validator window is displayed.

    2. Select each validator you want to add to this field.

      Each selected validator is added to the Selected items list.

    3. Select Done to save your field validators and you are returned to the field properties window.

    4. Select Save.

    1. In the Validators section select Add field validator.

      The Add field validator window is displayed and the Local tab is selected.

    2. Optional. On the Local tab, select each validator you want to add to this field.

      Each selected field is added to the Selected items list.

    3. Optional. Select the Global tab and select each validator you want to add to this field

      Each selected global validator is listed in the Selected items list.

    4. Select Done to save your field validators.

  6. Select Save.

    Extraction is performed for your training document and all configured formatting and validators are applied.

    Use the extraction data circle tooltip or the extracted value on the image to view details about the extracted values. If formatting is applied to a field, the original extraction value is included in this information, as is a validation message, if appropriate.

    If you apply formatting and the result is not as expected, test the field formatter using the extracted value as input. The test should succeed. If it fails, review the formatter settings and update as necessary.

  7. Optional. Repeat these steps to apply validation and formatting to more fields on this and other document types.
  8. Optional. Save your solution.
Next steps