artsybashev t1_j2v9lx2 wrote on January 4, 2023 at 4:28 AM

Reply to comment by currentscurrents in [R] Massive Language Models Can Be Accurately Pruned in One-Shot by starstruckmon

If you believe in singularity, at some point we reach an infinite loop where "AI" creates better methods to run calculations that it uses to build better "AI". In a way that is already happening but once that loop gets faster and more autonomous it can find a balance where the development is "optimally" fast.

visarga t1_j2yv5hp wrote on January 4, 2023 at 10:15 PM

I hope 2023 will be the year of AI generated training data - Evolution through Large Models https://arxiv.org/abs/2206.08896