haowanr t1_iuqpgyp wrote on November 2, 2022 at 10:01 AM Reply to comment by bernhard-lehner in [R] Is there any work being done on reduction of training weight vector size but not reducing computational overhead (eg pruning)? by Moose_a_Lini For example if you prune using the builtin unstructured pruning methods in pytorch it will not lead to faster inference as by default pytorch does not leverage the sparsity. Permalink Parent 1
haowanr t1_ir2jbcn wrote on October 4, 2022 at 9:19 PM Reply to [Discussion] Best performing PhD students you know by Light991 Jonathan Frankle, the guy behind lottery ticket hypothesis seems quite impressive imo. Permalink 5
haowanr t1_iuqpgyp wrote
Reply to comment by bernhard-lehner in [R] Is there any work being done on reduction of training weight vector size but not reducing computational overhead (eg pruning)? by Moose_a_Lini
For example if you prune using the builtin unstructured pruning methods in pytorch it will not lead to faster inference as by default pytorch does not leverage the sparsity.