nucLeaRStarcraft t1_j6nunti wrote on January 31, 2023 at 5:33 PM

Reply to comment by qalis in [D] Have researchers given up on traditional machine learning methods? by fujidaiti

There's also this survey of DL vs traditional methods for tabular data: https://arxiv.org/pdf/2110.01889.pdf

qalis t1_j6o6cou wrote on January 31, 2023 at 6:44 PM

That's a nice paper. There is also an interesting, but very niche line of using gradient boosting as a classification head for neural networks. Gradient flows through it normally, after all, just tree addition is used instead of gradient descent steps. But sadly I could not find any trustworthy open sourced implementation of this approach. If this works, it could bridge a gap between deep learning and boosting models.