Viewing a single comment thread. View all comments

londons_explorer t1_is11x8p wrote

Reply to comment by shahaff32 in [R] Wavelet Feature Maps Compression for Image-to-Image CNNs by shahaff32

Sure this work was aimed at that, but these same techniques can be used to make a datacenter-scale inference machine into an even more powerful one.

And presumably if a way can be found to do backpropagation in 'wavelet domain', then training could be done like this too.

9

shahaff32 OP t1_is13c2c wrote

We are in fact doing the backpropagation in the wavelet domain :)

The gradient simply goes through the inverse wavelet transform

​

See WCC/util/wavelet.py in our GitHub repo, lines 52-83 define the forward/backward of WT and IWT.

18