They're not tied together.

Half of each retina goes to each side of the brain. So half your right eye goes to the right brain, other half goes to left. Same for your left eye.

The brain integrates the signal from both eyes to form a cohesive image. The neurons aren't directly tied to each other in any real way except being bundled together in the optic nerve and terminating in the same region of the brain.