Hi Appian Community,
Quick question: Is there any way for Appian Gen-AI to tell us how many tokens are used for a particular task, from input to output?
I believe there isn’t, but just in case, I wanted to ask. The purpose of this is to analyze token usage so developers can be better informed.
Thank you!
Discussion posts and replies are publicly visible
Hi Abdul Rahim AFAIK there is no way to count how many tokens used. A model breaks down data into meaningful parts tokens before it begins processing that data. Language processing models break down paragraphs of text into their smallest units, but these units aren't always equivalent to words. Instead, a token could be part of a word. Therefore, the number of tokens won't always equal the number of words in the text analyzed.
I see, thank you for the reply.