The maximum number of tokens (words or subword units) a language model can process in a single input or conversation. Longer inputs are truncated or rejected.
DataScience
Exploring Knowledge, Led by Insight
The maximum number of tokens (words or subword units) a language model can process in a single input or conversation. Longer inputs are truncated or rejected.