violentdeli8
violentdeli8 t1_ivk53vn wrote
Reply to comment by gahaalt in Pytorch Symbolic: an equivalent of Keras Functional API [Project] by gahaalt
A very simple NAS example using perhaps one of the tabular benchmarks like 201 will be very useful illustration. Thanks!!
violentdeli8 t1_ivk4uel wrote
Reply to comment by gahaalt in Pytorch Symbolic: an equivalent of Keras Functional API [Project] by gahaalt
In https://arxiv.org/pdf/2203.02094.pdf figure 2 describes a GPT architecture configuration search space. Can one compile samples from this search space easily in Symbolic?
violentdeli8 t1_ivk090t wrote
This is really cool! I am wondering if I can use this as a “compiler” for Neural Architecture Search. During the search phase one has to sample from a search space of architectures and “compile” them into a valid nn.Module. Usually this code is written per search space. Wondering if that part becomes far less tedious with this.
violentdeli8 t1_isrsmgu wrote
Reply to comment by SkyThyme in [P] Why I quit my lucrative job at Google to start Vectara? (neural search as a service for developers everywhere). by awadallah1
Ray Kurzweil, I forgot that guy existed. Been a while since anyone brought him up. Lol!
violentdeli8 t1_iwrvqkf wrote
Reply to [R] RWKV-4 7B release: an attention-free RNN language model matching GPT-J performance (14B training in progress) by bo_peng
I cannot say how much I love that you are doing this!