Also before going to make tests over 100k of samples check if you can lower the dimensions: feature selection, low variance, PCA, etc.

Well, you don't need to train on all of these data

First take samples of 10k, 50k and 100k and see if you have different results. Do you get different number of clusters?