thatphotoguy89 t1_j63zz5q wrote on January 27, 2023 at 3:38 PM

GPT-J is supposed to be quite good. Do you have a list of the types of entities you'd like to detect?

TankAttack OP t1_j64p2oj wrote on January 27, 2023 at 6:15 PM

At this point I would like to imitate the example with position and company. It was taken from gpt-j btw. I thought neox is 3 times bigger so tried that first. Will run gptj and compare the results now.

Thank you

thatphotoguy89 t1_j64q5hm wrote on January 27, 2023 at 6:22 PM

You can try extractive QA if you don't want to fine-tune it. Basically, create a QA pipeline and ask the same questions for different text

TankAttack OP t1_j660bm9 wrote on January 27, 2023 at 11:21 PM

Do you mean free text questions? Like zero shot learning? Are there any examples of this?

thatphotoguy89 t1_j66n16v wrote on January 28, 2023 at 2:10 AM

Yeah. Here’s a HF tutorial on how to do this QA tutorial

TankAttack OP t1_j66s7js wrote on January 28, 2023 at 2:51 AM

Cool, will have a look! Do they list any models as being good at question answering?