Viewing a single comment thread. View all comments

MrFlamingQueen t1_j1vmykp wrote

Reply to comment by respeckKnuckles in [P] Can you distinguish AI-generated content from real art or literature? I made a little test! by Dicitur

They're not worried because on some level, it is recognizable, especially if you have a writing sample from the student.

On the other hand, there are already tools that can detect it, by comparing the sequences to the model's internal weights.

4

respeckKnuckles t1_j1vo5s7 wrote

I've never seen empirical study demonstrating either: (1) professors can reliably differentiate between AI-generated text and a random B-earning or C-earning student's work, or (2) those "tools" you mention (probably you're talking about the huggingface GPT-2-based tool) can do that either.

You say "on some level", and I don't think anyone disagrees. An A-student's work, especially if we have prior examples from the student, can probably be distinguished from AI work. That's not the special case I'm concerned with.

3

MrFlamingQueen t1_j1vskd9 wrote

Thank you for your response. You are correct that it may be easier to distinguish between the work of an A-student and AI-generated text. However, it is possible that professors can still differentiate between AI-generated text and the work of a B-earning or C-earning student, even if it is more difficult. This is because professors are trained to evaluate the quality and originality of student work, and may be able to identify certain characteristics or patterns that suggest the work was generated by an AI.

As for the tools that I mentioned, it is possible that they may also be able to differentiate between AI-generated text and human-written text to some degree. These tools use advanced machine learning algorithms to analyze text and identify patterns or characteristics that are indicative of AI-generated text. While they may not be able to reliably distinguish between AI-generated text and human-written text in all cases, they can still be useful for identifying potentially suspect text and alerting professors to the possibility that it may have been generated by an AI. Overall, it is important for professors to remain vigilant and use their expertise and judgement to evaluate the quality and originality of student work.

1

j03ch1p t1_j1wnqgz wrote

...is this AI written?

2

MrFlamingQueen t1_j1wp6pv wrote

Yes, that was AI written as a cheeky way of demonstrating it can be recognizable after having a writing sample of mine in the previous post.

2