This is a quite appropriate thought experiment to all the AI doomsday panic that's being posted. I feel like it could use some refinement though, and the reason is because it feels very much like it's invoking the literary trope of the doppelganger, but I don't think it's explicit enough at it to be fully effective.

Eliciting the doppelganger trope would I think for most people, even those who aren't that familiar with much literature or film directly, make people think about how old this concept truly is. My own visual for the sci-fi doppelganger is the mechanical duplicate in Metropolis, which nicely fits this thread as it was part of a layered allegory that begins with the day-to-day workers moving through a soulless system to provide luxury for others. The machine could replace the worker, production would improve, and the worker would no longer be a ritual sacrifice to capitalism (but implicitly, where would he go?); instead the machine replaces the one person proposing a solution to the working class-vs-elite problem with an agent of the whole system's destruction. (Hopefully that's an abstract enough meta-summary that nobody will try to remember any of that when they eventually go see it -- which they will, because it's amazing.)

The point is that we have centuries of people freaking out over -- and making amazing literature about -- essentially the same root fear. AI is the new golem, the invading Body Snatcher, your Link's Shadow! But the hero does not fear! The hero stands in the corner and mashes, mashes B!