AI Skill Classification

Hi Melvin,

Because machine learning is not deterministic, a high variance in your confidence score or accuracy scores may mean that your dataset is not representative enough. Please refer to our documentation on how to create a representative dataset: https://docs.appian.com/suite/help/23.4/collect-data.html as well as how to evaluate model performance: https://docs.appian.com/suite/help/23.4/evaluate-ai.html

Thank you gabby. I will check and revert if i have questions

The confidence score is internal to Appian and it represents how close the document classification and extraction is.

Thanks Abhay but my curiosity is Why confident score is still 50 when non trained document uploaded? confident score is crucial to decided on the flow of the process. 

I think this happens when the identified patterns in the documents are not strong enough and you upload a document that does not deviate enough from the training material.

May be Appian is still able to identify some of the fields from the non-trained document.

Thanks Stefan. i upload a picture in the PDF which is possible scenario in our process. we decide the flow based on the confident score but now it is different .. will check further

To address the issue of low confidence scores for untrained document types, it's essential to:

• Clearly separate known and unknown document types during the training phase.
• Consider training the model to recognize an "other" category for documents that do not fit into the predefined types.