You can't be harassing a hunter if the season is closed. TECHNICALLY, there is an argument to be made for leaving it up until April since that's when small game season ends and you can zap small game from a tree stand.

You're within your right to remove it. I wouldn't give it a second thought, the deadline has come and gone.