Posted by

EOS and maximum length tokens tell an LLM when to stop generating a response

Tokens are words or subwords (e.g., prefixes) that a large language model processes to generate a response. During training, the model is taught that if it ever generates a special token called end-of-sequence, its response is complete.

Similar Posts

Showing 1440 posts similar to EOS and maximum length tokens tell an LLM when to stop generating a response

You've reached the end.