Configuration of a Generative AI chat control

Configure the Generative AI chat control to enter an input for the AI provider to provide the response.

Use the Display rule action to hide or show the control.

The Generative AI chat control is supported only on Desktop forms.

Name Description

Header label

The header label to be displayed at runtime.

Provider

Select a Generative AI provider.

The Provider list includes the AI providers configured in Integration > Generative AI. See Integrate Generative AI with TotalAgility.

If a Generative AI provider is not already configured, a warning message appears when you add the Generative AI chat control to the form.

Source

Select one of the following options:

None (default)

The response from the AI provider is based on the input provided (plain text or variables).

Image

The response is generated based on the image provided. On the Document list, select a Web capture control and then select the file type on the Mime type list.

The following mime types are supported: GIF, JPEG, and PNG (default).

All the Generative AI models do not support the use of images.

Text

If the document has layout text, such as a semi-structured document (invoice, purchase order, and more) or a fixed form, the document text can provide better results when compared to the results returned using a Custom LLM provider.

On the Document list, select a Web capture control. The response is generated based on the text passed as an input.

  • The following file types that are supported in the Transformation Designer are supported for text source format in TotalAgility: TIFF (*.tif), JPEG (*.jpg), PNG (*.png), and PDF.

  • When you set the source format as Text, the standard model configuration is used.

  • On upgrading TotalAgility from an earlier version, the Source format is set to None.

Inline image

The response is generated based on the image provided at runtime. The attachment icon is available at runtime to upload an image and ask a question about it. The thumbnail of the uploaded image is displayed.

  • You need not save the document in the Web capture control to have the Document ID populated.

  • Make sure the EDoc rendering option is selected in a Web capture control to be able to upload different document types, such as Microsoft Word document.

Persist conversation

If selected, allows the context to persist for the duration of the conversation. (Default: Clear)

Persisting the conversation increases the token usage that may result in exceeding the token limit. When the prompt exceeds the token limit, the earlier conversation history is removed to manage the token limit automatically. The existing message that exceeded the token limit and the context is also cleared.

Use response profile

If selected, allows to add a response profile that can be used at runtime because you may want your responses to take a specific word count or style. (Default: Clear)

On the Response profile list, provide an inline value (for example, "Summarize the response in 20 words or less.") or select a global variable, form variable, or form control.

Use seed

If selected, allows to specify the seed value. (Default: Clear)

The seed value increases the likelihood of obtaining more consistent results from the AI provider across repeated requests, though not guaranteed. On the Seed list, provide an inline value or select a numeric variable. (Default: 0 and Maximum: 32,767)

When you view the control at runtime:

  • A welcome message appears in the Generative AI chat control, such as "Welcome <username>, how can I help you today?".

  • When you enter any input, a response is returned. If you add an image or text as part of the input, such as upload an image of car registration, and request the AI provider to get the registration number, the response is returned accordingly.

  • To clear the current conversation including the context if Persist conversation is turned on and start a new conversation, click the New chat icon in the top right corner of the Chat box.

  • An audit log entry is recorded.