seek_it
seek_it t1_iwyyo7k wrote
Reply to [N] new SNAPCHAT feature transfers an image of an upper body garment in realtime on a person in AR by SpatialComputing
Can someone explain how can it's inference be that fast that it can process realtime?
seek_it t1_iu1t7d4 wrote
Reply to [P] Up to 12X faster GPU inference on Bert, T5 and other transformers with OpenAI Triton kernels by pommedeterresautee
Can I also use this project to improve inference time of projects like yolov5, etc.?
seek_it t1_iwz0epu wrote
Reply to comment by Ok-Alps-7918 in [N] new SNAPCHAT feature transfers an image of an upper body garment in realtime on a person in AR by SpatialComputing
That's why I'm even more surprised. Such kind of models are usually GAN based that inference still require good compute power! On-device inference is even more astonishing!