You’ll never get an accurate input reconstruction.

The whole goal of a model is to estimate an output from an input. The best you can do is estimate an input from an output as well. Neural networks aren’t designed to be "lossless", part of the information is loss but in a way that makes the relevant information to the task preserved.

But the estimated input will simply the value which makes the initial model best fit the label.