Afaik you can not split the process into 'small parts' as the whole model needs to be in the VRAM when processing it. And a consumer computer have a hard time to utilize 250+ GB VRAM.
But with the development speed in this area maybe the hurdle will be overcome soon™.
Viewing a single comment thread. View all comments