ApprehensiveNature69
ApprehensiveNature69 t1_j651pux wrote
Reply to comment by nmfisher in [R] SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot by Secure-Technology-78
Yep! This is known technique - if you search for it lots of papers on sparse fine tuning show up, its a very valid technique.
ApprehensiveNature69 t1_j61wedt wrote
Reply to [R] Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers by currentscurrents
This is really awesome!
ApprehensiveNature69 t1_j342gcc wrote
Reply to comment by learn-deeply in [News] AMD Instinct MI300 APU for AI and HPC announced by samobon
So far a lot of them - have not had any issues with various stable diffusion models, deolidfy, bloom3b, and basically anything I have tried
ApprehensiveNature69 t1_j33hkaz wrote
Reply to comment by AlmightySnoo in [News] AMD Instinct MI300 APU for AI and HPC announced by samobon
For an individual that’s pretty true of any card - Nvidia will probably ignore your random CUDA error and redirect you to the forums to figure it out wether it is a k80 or an H100.
ApprehensiveNature69 t1_j337qjg wrote
Reply to comment by rantana in [News] AMD Instinct MI300 APU for AI and HPC announced by samobon
Rocm works pretty well these days on my 6900xt?
ApprehensiveNature69 t1_j6nmxbc wrote
Reply to comment by qalis in [D] Have researchers given up on traditional machine learning methods? by fujidaiti
Tangential, but I am so happy cupy is still being developed even though Chainer died.