I mean the moon is an extremely hostile lifeless rock. Technically it's nature but it's not like you're harming an ecosystem by mining there. On the contrary you could argue that you are protecting the Earth's by outsourcing mineral extraction there. Also as others have mentioned it would take an absurd amount of mining to appreciably change its mass. This is something we are nowhere near capable of.