Viewing a single comment thread. View all comments

UseNew5079 t1_jc204th wrote

Really cool project! There should be a configuration option to limit size of input text to protect from mistakes like `cat big_big_file | aichat`

1

sigoden OP t1_jc22w3y wrote

AIChat has a max_tokens limit: https://github.com/sigoden/aichat/blob/4a74f5cd72160585721dbce1e92c110125d046dd/src/config/mod.rs#L263

0

UseNew5079 t1_jc2a9t1 wrote

Oh i see. That makes sense. So if you try to send more than 4096 tokens the API will respond with error or will it charge you for >4096 tokens and just skip oldest?

1

sigoden OP t1_jc2f2mf wrote

You can't send more than 4096 tokens.AIChat will automatically evaluate the number of tokens used, and when it exceeds 4096, it will directly report an error and will not make a request

1