Token
AIThe chunk a model works with: a word, a piece of a word or a punctuation mark.
The model picks the next token from a list of probabilities. Billing and hidden watermarks both live on that step: the mark is applied to the choice itself.
The chunk a model works with: a word, a piece of a word or a punctuation mark.
The model picks the next token from a list of probabilities. Billing and hidden watermarks both live on that step: the mark is applied to the choice itself.