>It has to be trained on human behavior/information so its inherently limited

That is kindof meaningless though isn't it? There isnt infinite books you can write with 1,000,000,000,000 words but effectively there is when it comes to humans since even spending 1 second on each book would take 31,688 years to go through.

With something like an image AI if it learns an apple and a hat it has now learned more than 2 things. It has hats, apples, apples wearing hats, hats shaped like apples, etc...

​

It can get very creative with the way it makes things in the end and although there is technically a limitation, it's not something to care about since you will never in your life come close to exhausting it. It can create brand new styles for example since all styles are taken from previous styles/elements and you can even use embeddings to prove it to yourself since you can take a style it wasnt trained on then train an embedding for it (embeddings dont add any new info to the network and are more like searching it for a style then putting those terms and weights into a concise tag)