Viewing a single comment thread. View all comments

master-leaf t1_je5dtrm wrote

There was a paper I read a few months ago (I think it was called tapas). In this paper they show how to ingest tabular data to a transformer model.

71

bttoddx t1_je5m3g6 wrote

Adding to this, it looks like a survey paper was released earlier this month that details a number of methods to do the task op is looking for. The bibliography is a great resource.

41

jaxolingo OP t1_je5eunu wrote

From Hugging Face?

7

master-leaf t1_je5hhu6 wrote

I would check the paper, but I think they fine tune a pre trained local LM. They also created their own encodings to account for the structure of tabular data, such as the column headers, entity rows etc.

I will note though, from what I remember the table sizes were pretty small.

12