GPTZero claims to measure the perplexity of a sample of text. Am I missing something or is that a complete scam? You can’t measure perplexity without access to the model logits, which aren’t available for GPT-3.

You could guess what the logits would be by gathering text samples but there’s no way a pet project could gather enough data to accurately estimate conditional probabilities.