Submitted by minimaxir t3_11fbccz in MachineLearning
earslap t1_jb0qamw wrote
Reply to comment by qqYn7PIE57zkf6kn in [D] OpenAI introduces ChatGPT and Whisper APIs (ChatGPT API is 1/10th the cost of GPT-3 API) by minimaxir
When you feed messages into the API, there are different "roles" to tag each message ("assistant", "user", "system"). So you provide content and tell it from which "role" the content comes from. The model continues from there using the role "assistant". There is a token limit (limited by the model) so if your context exceeds that (combined token size of all roles), you'll need to inject salient context from the conversation using the appropriate role.
Viewing a single comment thread. View all comments