Viewing a single comment thread. View all comments

ch9ki7 t1_j9nw6hu wrote

Reply to comment by dmart89 in [D] Python library to collect structured datasets across the internet by dmart89

building and maintaining scrapers is tedious! I would also like some better solution. the idea is not bad, just maybe difficult to solve.

3

dmart89 OP t1_j9olr3r wrote

Possibly, yes, I would need to check. I recently built parsing services for tiktok, and it was super annoying to deal with.

1

ch9ki7 t1_j9oqe44 wrote

maybe something like scraperapi but with some kind of Dsl one could send as post payload.

but als a Problem is that you often need a scraped result as input for another request

1