vladosaurus
vladosaurus OP t1_j9gnm8n wrote
Reply to comment by friend_of_kalman in [D] Can we use ChatGPT to implement first-order derivatives? by vladosaurus
In the recent update it was mentioned that the math skills were improved. So I was just curious to see. But thanks for your opinion.
vladosaurus OP t1_j9gnh7n wrote
Okay everyone, easy with the negative sentiment, I'm just experimenting with it, was curious to hear some opinion. But there it is I have it now .... nothing constructive in general except one comment.
vladosaurus OP t1_j9gnehk wrote
Reply to comment by blablanonymous in [D] Can we use ChatGPT to implement first-order derivatives? by vladosaurus
ChatGPT running on ChatGPT like a Turing Machine. GTFO!
vladosaurus OP t1_j9gncvj wrote
Reply to comment by ninjadude93 in [D] Can we use ChatGPT to implement first-order derivatives? by vladosaurus
Yes, I see your point, thanks. Probably I got a lucky shot. In any case, ChatGPT was updates with math reasoning so I was just curious.
vladosaurus OP t1_j9gn4i0 wrote
Reply to comment by Delacroid in [D] Can we use ChatGPT to implement first-order derivatives? by vladosaurus
Dude it's ok, I know it is high-school math you proved your point you are genius you know high-school math I don't.
That was not my aim. It was to treat the ChatGPT implementation as a black-box without touching it, and see whether is correct.
Submitted by vladosaurus t3_1183ilc in MachineLearning
vladosaurus OP t1_j9gu3cr wrote
Reply to comment by Delacroid in [D] Can we use ChatGPT to implement first-order derivatives? by vladosaurus
Ideally we have to generate many examples as such without seeing them and wrap them in some test suite using automatic differentiation to see how many will come out correct.
Something similar to what the authors did in the OpenAI Codex model. They provided the function signature and the docstrings and promted the model to generate the rest of it. Then they wrapped the generated function into test suites and calculated how many of them pass. It's the pass@K metric.
I am not aware if something similar is done for differentiation, maybe there is, I have to search for.