It's not really. It's impossible to raise everything with a partner, you only talk about the things that are most important to you. If there's absolutely no indication that it's off limits, then why would it be a problem? If it does every come up, then you can apologise, but it probably won't.