>“This makes sense but my question is that the molecules outside the mitochondria don't "know" that the concentration within the matrix is lower.”

They don’t need to “know”. They are randomly bouncing around, if there are more bouncing around on one side of a wall odds are more will pass through the gate to the side with less bouncing around than the other way around. And so they flow with the concentration gradient.