> What OpenAI has done with, for example, ChatGPT, is manually add filters to check the outputs to see if they seem offensive. Did they over-correct a bit? Maybe, but the LLM itself is unaffected.

It told me it wouldn't provide me a recipe for horse meat because that would be unethical. It's definitely a little over the top.

At least it's not demanding I eat vegan anymore.