Yes thats true. This is also what I thought about. Using a mixed dataset or transfer learning approaches (first train on synthetic data, then retrain on real world) should incorporate the domain knowledge. But you are right, right know thats just an hypothesis...but I will test it!