Viewing a single comment thread. View all comments

pitrucha t1_j9ccuun wrote

proceed as with summarization. you can train gpt family using open ai or get yourself t5 and train it. training from scratch will be a waste of resources

6

nashcaps2724 OP t1_j9cdelh wrote

Just to make sure I’m following, steps here could be…

  1. Finetune GPT2 or GPT3 on Corpus A
  2. Take the finetuned GPT* and continue as a summarization task?
2

pitrucha t1_j9cdugi wrote

more like: given item x from Corpus B, predict item y from corpus A

5