Anything wrong with good old thin-set mortar? It's more work, but it's not super hard. With the quantities you're using, you could easily mix it with a stick or a common power drill. And it wouldn't have any of the problems you're worrying about.