This is a very interesting breakdown over at anandtech ….
Apple Announces M3 SoC Family: M3, M3 Pro, and M3 Max Make Their Marks
www.anandtech.com
They speculate that the reason we are seeing different TOP numbers for A17pro and M3 is down to the precision….
A17pro apple communicated an 35 TOPS number at INT8 precision. Anandtech speculates that M3 with a figure of 18 TOPS is likely quoting INT16/FP16 precision. M1 and M2 communicated results based off of INT16/FP16.
Anandtech also asks (what I feel will be a very interersting thing to explore with live production samples) in the hands of real users - does M3 also support INT8 and allow to trade precision for throughput?!?!
This was probably the biggest head scratcher for me of the entire keynote!
I think @leman might have said that already? Also I believe Qualcomm’s npu is int4.
It was @Andropov
However Ryan is being a bit more circumspect as to whether the NPU is architecturally the same as in the A16 vs A17, stating it could be inconsistent messaging rather than using the old NPU.I found this surprising too: https://x.com/iancutress/status/1719176613445742855?s=46&t=AVo4Ae4rwcqD3xOi5WvXyg
Looks like the M3 doesn’t have the A17’s Neural Engine.