Viewing a single comment thread. View all comments

RingoCatKeeper t1_j70tokb wrote

Maybe you can take a look at ScanNN

2

mostlyhydrogen OP t1_j724ctr wrote

That was an interesting read, but I don't think it solves my problem. Their examples don't show joint vector searches: https://github.com/google-research/google-research/blob/master/scann/docs/example.ipynb

1

RingoCatKeeper t1_j79vmlw wrote

See the section "ScaNN interface features", you will find that you could search queries with batch, may this similar with your problem?

1

mostlyhydrogen OP t1_j7fxwyx wrote

>ScaNN interface features

Nope. Notice that the results have shape (10000, 20) instead of (20,). That is just doing a batched query i.e. "for each of these 10k input vectors, find me 20 neighbors". What I need is a joint query, i.e. "given these 10k positive examples, give me an additional 20 candidate samples".

2