Viewing a single comment thread. View all comments

3Street t1_je30hpn wrote

Do we expect businesses to be able to fine-tune training chat gpt or other big models with their own data sets? Has this been discussed or rumoured at all? Or is it already happening? I may have missed something.

1

patniemeyer t1_je5v9m7 wrote

Yes, in fact OpenAI offers an API for this right now: https://platform.openai.com/docs/guides/fine-tuning

It *appears* from the terminology that they are using that they are actually performing training on top of their model with your data (which you supply in json). They talk about learning rate and epochs, etc. as params, however I have not seen a real doumentation of what they are doing.

2

3Street t1_je5wk7v wrote

Interesting, thank you! The link only seems to mention gpt 3, though? I wonder if / when they'll offer for gpt4

1

patniemeyer t1_je5wxiv wrote

The pricing page lists GPT-4. I think it was just added in the past day or two. (I have not confirmed that you can actually access it though)

EDIT: When I query the list of models through their API I still do not see GPT4, so maybe it's not actually available yet... or maybe I'm querying the wrong thing.

1