Viewing a single comment thread. View all comments

Xotchkass t1_jczkfku wrote on March 20, 2023 at 7:23 PM

What are the input length of the Llama model? Can't find it anywhere.

YouAgainShmidhoobuh t1_jd2ojml wrote on March 21, 2023 at 12:26 PM

If you mean the context/sequence length, it's 2048 (https://github.com/facebookresearch/llama/pull/127).

thanks