https://community.appian.com/discussions/f/rules/34203/ai-skill---document-extraction-files-with-pages-with-too-many-tokens-warningWhat does the below warning mean in AI skills document extraction? Files with pages with too many tokens These files contained pages with too many tokens (token limit: 512) for the model to process. Labeled entities on these pages may not be includeden-USTelligent Community 12https://community.appian.com/thread/130932?ContentTypeID=1Fri, 08 Mar 2024 21:15:06 GMTd3a83456-d57b-489c-a84c-4e8267bb592a:76a82b88-7e06-4422-b97a-563f2204fa4aLouis Prensky<p>Hi <a href="/members/jitendras601">Appian Boy</a>&nbsp;, this warning will be thrown whenever a document contains pages with dense text. The behavior is as follows:<br />If a page contains over 512 tokens (~500 words), than any field you have labeled that comes after the 512th token will not be included when training the model. If you have some fields in your model that have particularly low recall while others are much higher, than the low recall fields are likely impacted by this warning.</p> <p></p> <p>We are evaluating options for raising this limit so that customers do not encounter it.</p><div style="clear:both;"></div>