Posted by
EOS and maximum length tokens tell an LLM when to stop generating a response
Tokens are words or subwords (e.g., prefixes) that a large language model processes to generate a response. During training, the model is taught that if it ever generates a special token called end-of-sequence, its response is complete.
Similar Posts
Showing 1440 posts similar to “EOS and maximum length tokens tell an LLM when to stop generating a response”
You've reached the end.