cygn
cygn t1_ixe0rgg wrote
Reply to [P] BetterTransformer: PyTorch-native free-lunch speedups for Transformer-based models by fxmarty
does it work with vision transformers/swin?
cygn t1_itbsjr4 wrote
Reply to [R] Scaling Instruction-Finetuned Language Models - Flan-PaLM- Google 2022 - 75.2% on five-shot MMLU / Forecasters expected this SOTA would need until 2024! - Public checkpoints! by Singularian2501
Is it possible to run it on consumer grade gpus (3090) with 24 GB ram?
cygn t1_it25agy wrote
Reply to comment by new_name_who_dis_ in [R] can diffusion model be used for domain adaptation? by riccardogauss
you could use one of the datasets that are listed here: https://paperswithcode.com/task/domain-adaptation
Office-31 for example looks quite practical. It has product images from Amazon, DSLR and webcam images. The problems I'd like to solve are similar. Take good images of plants with diseases and adapt them to images taken from users with smartphones with lots of quality issues.
cygn t1_isx84ko wrote
Reply to comment by new_name_who_dis_ in [R] can diffusion model be used for domain adaptation? by riccardogauss
could you show some images please?
cygn t1_ixe1n1j wrote
Reply to comment by cygn in [P] BetterTransformer: PyTorch-native free-lunch speedups for Transformer-based models by fxmarty
looks like VIT is supported, swin isn't.