TFenrir t1_j9iaxdg wrote on February 22, 2023 at 4:09 AM

Reply to comment by turnip_burrito in OpenAI has privately announced a new developer product called Foundry by flowday

I really want to see how coherent and sensible it can be at 32k tokens, and a fundamentally better model. Could it write a whole short story off a prompt?

turnip_burrito t1_j9ib4kx wrote on February 22, 2023 at 4:10 AM

That's a really good question. I want to see too how reasoning, coherence, and creativity are affected by large context length.

dasnihil t1_j9jzkpp wrote on February 22, 2023 at 2:54 PM

early glimpses of sophisticated and extremely coherent sounding output.

visarga t1_ja8cjid wrote on February 27, 2023 at 4:31 PM

There's much less long form data to train on. That's problematic.