Yeah. Here’s a HF tutorial on how to do this QA tutorial

You can try extractive QA if you don't want to fine-tune it. Basically, create a QA pipeline and ask the same questions for different text

GPT-J is supposed to be quite good. Do you have a list of the types of entities you'd like to detect?