Viewing a single comment thread. View all comments

light24bulbs t1_jdm04sx wrote on March 25, 2023 at 11:49 AM

Are those it? Surely there's a bunch more notable open source ones?

michaelthwan_ai OP t1_jdm3v2y wrote on March 25, 2023 at 12:29 PM

Please suggest so.

philipgutjahr t1_jdn2p2u wrote on March 25, 2023 at 5:00 PM

from https://www.reddit.com/r/MachineLearning/comments/11uk8ti/d_totally_open_alternatives_to_chatgpt/

OpenChatKit (based on GPT-NeoX-20B) https://www.together.xyz/blog/openchatkit

Instruct-GPT https://carper.ai/instruct-gpt-announcement/

michaelthwan_ai OP t1_jdpxtp1 wrote on March 26, 2023 at 7:17 AM

Open alternative -> added most and so is in TODO (e.g. palm)
OpenChatKit -> added
Instruct-GPT -> seems it's not a released model but plan.

philipgutjahr t1_jdq43bq wrote on March 26, 2023 at 8:48 AM

not sure if this is true, but afaik chat-gpt is basically a implementation of instruct-gpt (where OpenAI have been very thoroughly at RLHF)

"instance of" https://nextword.dev/blog/chatgpt-instructgpt-gpt3-explained-in-plain-english

"sibbling but a lot better" https://openai.com/blog/chatgpt

Small-Fall-6500 t1_jdmftp5 wrote on March 25, 2023 at 2:14 PM

RWKV: main RWKV GitHub and the ChatRWKV GitHub

And here is a list of useful open or mostly open chatgpt-like projects/models

michaelthwan_ai OP t1_jdpxuzs wrote on March 26, 2023 at 7:17 AM

Chatgpt-like github -> added most and so is in TODO (e.g. palm)

RWKV -> added in backlog

philipgutjahr t1_jdn95o8 wrote on March 25, 2023 at 5:45 PM

for completeness, you should also add all those proprietary models: Megatron-Turing (530B, NVIDIA), Gopher (280B, Google), Chinchilla (70B, DeepMind) and Chatgenie (WriteCream)

michaelthwan_ai OP t1_jdpy06p wrote on March 26, 2023 at 7:19 AM

I only include recent LLM (Feb/Mar 2023) (that is the LLMs usually at the bottom) and 2-factor predecessors (parent/grandparent). See if your mentioned one is related to them.