boosandy
boosandy t1_jb0c05f wrote
Forget nn for regression. I would consider statistical models for it .
boosandy t1_jb0btu3 wrote
Flan t5 xl is a very good transformer finetuned on instructions. T5 is also good. You might want to tweak around some generation parameters to get good results.
boosandy t1_jb0bl7b wrote
Reply to comment by inFamous_16 in [R] Variable size input to pre-trained BERT model by inFamous_16
Padding has zero attention hence you don't lose context.
boosandy t1_j26qaep wrote
Reply to comment by Which-Distance1384 in What will you learn if you have 10 additional hours a week? by Which-Distance1384
Acl, emnlp
boosandy t1_j26jgwk wrote
Read papers
boosandy t1_izx7j90 wrote
Reply to Getting started with Deep Learning by MightyDuck35
Andrew Ng's course is the best out there beginners. He dilutes the complexities and slowly teaches all the math. You don't even need any book. That being said, his cpurse is based on Tensorflow. I would suggest learning pytorch on the side.
boosandy t1_izu0a27 wrote
Reply to comment by Accomplished-Bill-45 in Are currently state of art model for logical/common-sense reasoning all based on NLP(LLM)? by Accomplished-Bill-45
Its not a single model. But yeah that's a good starting point. There is also Entailment Writer.
boosandy t1_iztx75m wrote
Reply to Are currently state of art model for logical/common-sense reasoning all based on NLP(LLM)? by Accomplished-Bill-45
For reasoning go through allen ai's work. They are the best. They don't view it as an NLP problem, they view transformers as an agent which can do many things.
boosandy t1_iztwsst wrote
Sometimes tqdm goes nuts.
boosandy OP t1_izmkhg7 wrote
Reply to comment by incrediblediy in Graphics Card set up for deep learning by boosandy
Oh nice set up. I have thermaltake 850w 80+ gold. Judging by your answer i think my desktop will be okay.
boosandy OP t1_iziy5do wrote
Reply to comment by incrediblediy in Graphics Card set up for deep learning by boosandy
Depending on my set up, do you think 850 watt PSU will be good enough ? My CPU is i7 6700k.
boosandy OP t1_izht8ye wrote
Reply to comment by Volhn in Graphics Card set up for deep learning by boosandy
Oh nice. Thank you.
Submitted by boosandy t3_zgn046 in deeplearning
boosandy t1_jdi7fiy wrote
Reply to Cuda out of memory error by Rishh3112
Use smaller batch size