In Conditional GANs, the condition(class label) is prefixed to the latent space random vector, ie. The input vector becomes one-hot-class + rv. You can learn the 'conditions ' such as style by joint training. I believe similar concept can be applied to transformers, judging from the other answers.