Configure standard document separation
Use the procedure in this topic to configure standard document separation.
When standard document separation is configured, the settings on the Advanced Online Learning Options window include online learning for document separation in addition to classification online learning.
The content may contain single page or multi-page documents, or a combination of both, or loose pages. Document separation processes multi-page documents to split them to separate documents according to the settings, if necessary.
If document separation is activated then all loose pages are added to one multi-page document that is processed by document separation. In a first step document separation is executed. All multi-page documents are processed and then each multi-page document itself is processed sequentially, page-by-page.
After document separation is complete, the newly created documents are classified.
For the separation of a multi-page document, each single page is classified and either a new document is created for each page or the page is added to the current document depending on the separation settings for the classification result. Then the next page is classified and added to the current document or added to a new document until the complete multi-page document is processed.
When document separation is not activated then for each loose page a single page document is created.
You generally activate document separation at the project level.
These settings are disabled unless document separation is enabled for the project.
Before you can configure standard document separation, verify that classification is already configured.
-
On the
Project tab, in the
Configuration group, select
Project Settings.
- Select the Document Separation tab to view the document separation settings.
- Select the Document Separation tab.
-
Select
Standard Document Separation and configure the following settings.
Setting
Description
Duplex scan mode (front and back side will never be split)
This setting is disabled unless Standard Document Separation is selected.
Select if you have two-sided pages. The back side is ignored. (Default: Cleared)
Unclassified pages should be handled as
This setting is disabled unless Standard Document Separation is selected.
This setting defines how unclassified pages are handled during Standard Document Separation:
- first page of new document:
-
Used to handle an unclassified page as the first page of a new document.
For example, a multi-page document consists of four pages. Document separation processes the pages sequentially and the first page belongs to class A, whereas the other pages stay unclassified. If this first value is selected, for each unclassified page a document is created so that as the result of the document separation four single page documents are created.
- attachment to previous document:
-
Used to handle an unclassified page as an attachment to the previously classified document. (Default: Selected)
For example, a multi-page document consists of four pages. Document separation processes the pages sequentially and the first page belongs to class A, whereas the other pages stay unclassified. If this value is selected, the unclassified pages are added to the current document so as result of the document separation process, one multi-page document is created that consists of four pages.
- attachment if previous document was unclassified:
-
Used to handle an unclassified page as an attachment to the previous document, if that document was unclassified.
For example, a multi-page document consists of four pages. Document separation processes the pages sequentially, and the first page is assigned to class A while the other pages remain unclassified. A document is created for the first page and the next page is used to create a new document. The subsequent pages are treated in the same way.
- Open the Project Tree window if it is not already open.
- Open the Details window if it is not already open.
-
For each class, configure the following
Standard Document Separation settings in the Details window.
Setting
Description
Ignore for separation
When document separation is enabled for a project, you can disable document separation for single classes by selecting Ignore for separation. This means the pages of a document in this class are handled as unclassified pages.
If the setting is not selected, documents in this class are separated, and several additional settings become available. (Default: Cleared)
Class represents
If the "First page" setting is selected, a fixed page length can be set. By default, the value for the fixed page length is 0 (zero). This means the number of pages is unlimited.
For example, when the fixed page length is set to 3 and document separation is processed for a multi-page document, then the following occurs during processing.
Document separation processes the multi-page document page by page. For each page classification is performed and in case a page is classified to this class, then a new document is created and the page is added to this new document. As the fixed document length is set to three the following two pages are added to the document without classifying them and regardless if they would belong to another class. After the third page is added, the current document is closed; it contains three pages now. The next page of the multi-page document is processed until all pages of the multi-page document are processed.
If the value is set to zero and a page of a processed multi-page document is classified to this class, then a new document is created and the page is added. The next page of the multi-page document is added to the current document when:
-
The page is unclassified
-
The page is classified as a Middle page or Last page of the same class as its Corresponding first page
When a processed page of the multi-page document is classified to another class that is not a middle or last page of the current document, then the current document is closed and the current page is added to a new document.
After all pages of the multi-page document are processed the next multi-page document is processed.
If "Middle page" or "Last page" is selected, then the list for Corresponding first page is enabled, allowing a class for the middle or last page to be specified. If this is done, then a middle page (or last page) is added to the currently processed document, when the first page of the current document is classified to the class that is selected for the Corresponding first page setting. Otherwise, the document is closed and the middle (or last) page is added to a separate new document.
If you define a middle or last page for a first page then the setting Fixed page length for the first page needs to be set to 0 (unlimited) as this setting has priority over other settings. If Fixed page length is set to 1 or higher then the settings for middle or last page are never taken into account as for a fixed page length the pages are added without classifying them.
If <none> is selected, then the middle page is always added to the current document. For a last page, it works the same way except the document is closed after the page is added and a new document is started for the next processed page of the multi-page document.
If you define a middle or last page on a document where a fixed page length is defined, these settings are not taken into account as the Fixed page length setting has priority over the other settings.
Fixed page length
Available only if you select "First Page" for the "Class represents" setting. If all documents of this type are a fixed page length, you can specify that page length here. This ensures the documents are separated correctly, and makes it easier to determine if a page contains the content for extraction. (Default: 0)
This means there is no fixed page length, and that documents can have various page lengths.
Corresponding first page
Enabled only when "Class represents" is set to Middle page or Last page. Select a class from the list so a document that is classified as the selected class can have the middle or last page added to it rather than creating a new document.
-
-
Optional. Enable online learning for document separation.
Any documents that are not recognized based on your training documents require manual separation and classification during production. Those documents are then collected and the next time a document with that layout is encountered it is separated and classified successfully.
- Save the changes to your project.