Maybe He was referring to the fact that Adam and Eve used the fig leaf to cover themselves when they disobeyed God and so what he was really condemning was the idea of man made religion that bears no good fruit…