MetalFX and the ANE.

Jimmyjames

Elite Member
Joined
Jul 13, 2022
Posts
1,277
Do we know the extent to which MetalFX (Temporal) uses the ANE and or AI/ML? A cursory search yields some suggestions that it does, including from @leman on Reddit I think, and Philip Turner on the Apple forums. Trying it out on my M4 does show that with MetalFX Quality mode there is some ANE usage, but it seems really low: less than 5%. Can that be correct?
 
Do we know the extent to which MetalFX (Temporal) uses the ANE and or AI/ML? A cursory search yields some suggestions that it does, including from @leman on Reddit I think, and Philip Turner on the Apple forums. Trying it out on my M4 does show that with MetalFX Quality mode there is some ANE usage, but it seems really low: less than 5%. Can that be correct?
Seems plausible to me. M4 has a 38 TOPS ANE, so 5% of that is 1.9 TOPS. If you assume it's upscaling to 10MP, that'd be about 190K math ops per output pixel per second, or 3166 per pixel at 60 FPS.
 
Seems plausible to me. M4 has a 38 TOPS ANE, so 5% of that is 1.9 TOPS. If you assume it's upscaling to 10MP, that'd be about 190K math ops per output pixel per second, or 3166 per pixel at 60 FPS.
Ahhh ok. Makes sense. Thanks.
 
Does ANE utilization go up if you choose MFX Performance?

I also wonder if MFX Denoising uses AI model (like nvidia ray reconstruction).
 

Nvidia’s framegen apparently works quite well in Hogwarts Legacy through translation layers on an M1 Max. It must be using the ANE. I haven’t watched the original video just read the article so unclear how many other details there are.
 

Nvidia’s framegen apparently works quite well in Hogwarts Legacy through translation layers on an M1 Max. It must be using the ANE. I haven’t watched the original video just read the article so unclear how many other details there are.
The comparisons to FSR are odd. Apple doesn't hook it through a special path like they do DLSS so of course there is a performance hit.

Wonder if Apple is able to convert the transformer model or if it is just the CNN.
 
Back
Top