Viewing a single comment thread. View all comments

emotionalfool123 t1_irdvwr8 wrote

Reply to comment by victotronics in [R] Discovering Faster Matrix Multiplication Algorithms With Reinforcement Learning by EducationalCicada

Can you explain what does numerical stability mean in this case?

1

victotronics t1_ire6ha5 wrote

Behavior under roundoff. Floating point numbers are not actually mathematical numbers so all algorithms are inexact. You want them to be not too inexact: small perturbations should give only small errors. The fact that STrassen (and other algorithms) sometimes subtract quantities means that you can have numerical cancellation.

2