Token Use

Question

Hi Appian Community, 
 Quick question: Is there any way for Appian Gen-AI to tell us how many tokens are used for a particular task, from input to output? 
 I believe there isn&rsquo;t, but just in case, I wanted to ask. The purpose of this is to analyze token usage so developers can be better informed. 
 Thank you!

Abhishek Karumuru · Accepted Answer

Hi Abdul Rahim AFAIK there is no way to count how many tokens used. A model breaks down data into meaningful parts tokens before it begins processing that data. Language processing models break down paragraphs of text into their smallest units, but these units aren't always equivalent to words. Instead, a token could be part of a word. Therefore, the number of tokens won't always equal the number of words in the text analyzed.

Konduru Chaitanya · Answer

Simple answer to your question is NO, there is no proven method to monitor or analyze the token consumption data.

Token Use

Top Replies