Viewing a single comment thread. View all comments

UseNew5079 t1_jc2a9t1 wrote

Oh i see. That makes sense. So if you try to send more than 4096 tokens the API will respond with error or will it charge you for >4096 tokens and just skip oldest?

1

sigoden OP t1_jc2f2mf wrote

You can't send more than 4096 tokens.AIChat will automatically evaluate the number of tokens used, and when it exceeds 4096, it will directly report an error and will not make a request

1