Which brings me to my point: Siri is being set up to fly for users. That Apple can basically pay whoever it thinks can produce a great model for them to their specific request, and then load it on servers that sip a fraction of the energy (500 Watts for this 4 Mac supercomputer vs 2.4 kilowatts for 4 H100s), means not only do they not need to resort to funding nuclear energy companies, but they can run Siri for low cost, which means they can continue to offer Siri for free.
That Apple can offer a personalized pocket assistant for free, and its promised feature set is being able to ask it to perform actions and get personal information of you and your friends/family you want to remember is a significant, actual competitive advantage.
Too bad that doesn't play into people's made up narrative of being behind in "AI."
I don't know, but I would be surprised if Apple didn't request (if they chose to go third party) that the model be encoded with ATSC in mind, which I believe is an industry first for widely deployed transformer models to consumers. Encoding weights with ATSC means they can shrink the bits down, and it's only possible because Apple's GPUs were designed with ATSC in mind. So while I don't know for sure if they will, Apple has the ability to get a far larger, more capable model into memory without needing more actual memory. This is significant given the nearing memory price increases for the industry, and for energy costs. It means Apple will be able to provide Siri to all users with Apple Intelligence enabled devices for free.
Apple's PCC model already does this with ATSC, and from recent reports on social media, PCC model seems to be upgraded significantly with 26.2, producing far faster, more accurate responses.
Apple is behind in AI my ass lol.
That Apple can offer a personalized pocket assistant for free, and its promised feature set is being able to ask it to perform actions and get personal information of you and your friends/family you want to remember is a significant, actual competitive advantage.
Too bad that doesn't play into people's made up narrative of being behind in "AI."
I don't know, but I would be surprised if Apple didn't request (if they chose to go third party) that the model be encoded with ATSC in mind, which I believe is an industry first for widely deployed transformer models to consumers. Encoding weights with ATSC means they can shrink the bits down, and it's only possible because Apple's GPUs were designed with ATSC in mind. So while I don't know for sure if they will, Apple has the ability to get a far larger, more capable model into memory without needing more actual memory. This is significant given the nearing memory price increases for the industry, and for energy costs. It means Apple will be able to provide Siri to all users with Apple Intelligence enabled devices for free.
Apple's PCC model already does this with ATSC, and from recent reports on social media, PCC model seems to be upgraded significantly with 26.2, producing far faster, more accurate responses.
Apple is behind in AI my ass lol.