I think you're romanticizing consciousness. We are logical creatures and we make logical choices, much like an AI is programmed to. Of course, we have the ability to pull a wild card, but that's just an inversion of the same logic, which is programmatically possible as well.

Your beliefs and values are the datasets you've been provided with, which you base your decisions on. If {statement} is true, then {something} else {something else} is quite an accurate summation of our own decision making process, regardless of how you want to pretend it is more than that.