muwnd t1_j9qvxwf wrote on February 23, 2023 at 10:35 PM Reply to [D] Python library to collect structured datasets across the internet by dmart89 Better save yourself from all the crawling trouble and use data from Commoncrawl. So you can focus on the extraction part. Permalink 1
muwnd t1_j9qv9qx wrote on February 23, 2023 at 10:30 PM Reply to [P] What are the latest "out of the box solutions" for deploying the very large LLMs as API endpoints? by johnhopiler https://github.com/huggingface/text-generation-inference Permalink 5
muwnd t1_j9qvxwf wrote
Reply to [D] Python library to collect structured datasets across the internet by dmart89
Better save yourself from all the crawling trouble and use data from Commoncrawl. So you can focus on the extraction part.