Nvidia new System Memory fallback feature.

[exoticspice1]

NVIDIA introduces System Memory Fallback feature for Stable Diffusion - VideoCardz.com

NVIDIA has a solution to Stable Diffusion maxing out the available memory Drivers have a new feature called “System Memory Fallback”. The NVIDIA Control Panel may still look old, but it still continues to receive feature updates. In a recent driver release, NVIDIA introduced a new option in the...

videocardz.com

Seems interesting. Any thoughts?
Video memory will always be faster, of cource

 

[exoticspice1]

Reading more into it. It will fall back to DDR5 RAM if video memory is full.

So you can have up to 128GB of RAM for AI and modeling.

If you have those EYPC CPUs probably up to 4TB of RAM.

 

[dada_dave]

Seems like they’re just formalizing the page migration ability their GPUs have been capable of for awhile and allowing it to be a default where the driver can handle it on its own for user approved applications.