since you can use adjectives to modify other adjectives, the order clarifies what each adjective is referring to.

e.g a brown brick wall is a wall that is brown colored and made of bricks. a brick brown wall is a wall that brick brown colored and of indeterminate material.

While most of these are actually not a problem, for example the big is still unambiguous, it still sounds wrong because you expect another adjective that the big is modifying, not a noun.