What about using a vector search engine like Weaviate? https://weaviate.io/

Grab a pre-trained autoencoder if you don't already have one and batch your images through it and into weaviate, then use it's search functionality to compute image similarity.