The Ai thread

[dada_dave]

Nvidia and Apple: Frenemies are putting grudges aside to supercharge AI performance

Apple and Nvidia have announced a surprise collaboration targeted at improving LLM inference performance, combining Apple's open-source ReDrafter with Nvidia's raw silicon grunt. The result? A 2.7x improvement in performance over auto regression.

www.notebookcheck.net

This is interesting, Apple actually teaming up with Nvidia to improve Apple’s LLM performance on Nvidia’s GPUs. As the article states, collaboration between the two has been very rare over the last 16 years.

(EDIT) Apple’s post:

Accelerating LLM Inference on NVIDIA GPUs with ReDrafter

Accelerating LLM inference is an important ML research problem, as auto-regressive token generation is computationally expensive and…

machinelearning.apple.com

Here’s Nvidia’s more technical blog post:

NVIDIA TensorRT-LLM Now Supports Recurrent Drafting for Optimizing LLM Inference | NVIDIA Technical Blog

Recurrent drafting (referred as ReDrafter) is a novel speculative decoding technique developed and open-sourced by Apple for large language model (LLM) inference now available with NVIDIA TensorRT-LLM.

developer.nvidia.com

 

[Eric]

 

[Eric]

Almost all of my authentic video/reel posts get accused of being AI now and I've given up on defending it.

 

[Herdfan]

Almost all of my authentic video/reel posts get accused of being AI now and I've given up on defending it.

What gets me is I am a member of a Sedona visitor’s FB page and we don’t get many issues there, but other travel pages put up these clearly AI photos claiming to be Sedona that aren’t.

But the kicker is when someone responds that they have been to the place in the photo. No you haven’t because it doesn’t exist.

 

[Eric]

What gets me is I am a member of a Sedona visitor’s FB page and we don’t get many issues there, but other travel pages put up these clearly AI photos claiming to be Sedona that aren’t.

But the kicker is when someone responds that they have been to the place in the photo. No you haven’t because it doesn’t exist.

A lot of new pages were popping up that were featuring other people's art posted without credit and a lot of it was mine. They had no way to report copyright without going through a huge process so I gave up on it, it was one of the driving factors for me leaving the platform, Zuckerberg was just the final straw. They can steal my work but at least I no longer have FB recommending the pages of said thieves.

 

[Herdfan]

Here is a perfect example:

Can’t prove the photo is AI but I can’t determine what kind of car is on the road.

But the comments. SMH. This “supposed” road is 15 miles from my house and looks nothing like this.

 

[Nycturne]

That looks a lot more like it fits near Yosemite to me.

But there are elements of the car and the road markings that don't look right, but it's hard to tell from a screenshot like this.

 

[Herdfan]

That looks a lot more like it fits near Yosemite to me.

Here is a reel of the actual drive.

But there are elements of the car and the road markings that don't look right, but it's hard to tell from a screenshot like this.

Yes, the car seems too wide and too short. And I know cars pretty well and can’t even begin to identify the make or model.

 

[Yoused]

I know cars pretty well and can’t even begin to identify the make or model.

It looks a bit like an Oldsmobile from the '70s or early '80s. The length could be distorted by a long lens. But that is some damn sloppy driving, going over a double yellow line like that.