Token Use

4 replies
51 views

Hi Appian Community,

Quick question: Is there any way for Appian Gen-AI to tell us how many tokens are used for a particular task, from input to output?

I believe there isn’t, but just in case, I wanted to ask. The purpose of this is to analyze token usage so developers can be better informed.

Thank you!

karumurua531442Answer

Participating Frequently

Hi [mention:c156a43eea0d473194ad62f647367f54:e9ed411860ed4f2ba0265705b8793d05] AFAIK there is no way to count how many tokens used. A model breaks down data into meaningful parts tokens before it begins processing that data. Language processing models break down paragraphs of text into their smallest units, but these units aren't always equivalent to words. Instead, a token could be part of a word. Therefore, the number of tokens won't always equal the number of words in the text analyzed.

karumurua531442Answer

Participating Frequently

Hi [mention:c156a43eea0d473194ad62f647367f54:e9ed411860ed4f2ba0265705b8793d05] AFAIK there is no way to count how many tokens used. A model breaks down data into meaningful parts tokens before it begins processing that data. Language processing models break down paragraphs of text into their smallest units, but these units aren't always equivalent to words. Instead, a token could be part of a word. Therefore, the number of tokens won't always equal the number of words in the text analyzed.

abdulrahimb9853Author

Known Participant

I see, thank you for the reply.

Rahim

konduruc733182

Inspiring

Simple answer to your question is NO, there is no proven method to monitor or analyze the token consumption data.

abdulrahimb9853Author

Known Participant

Alright, thank you for the reply.

Rahim

Sign up

Login with SSO

Login to the community

Login with SSO