Intel Binary Optimisation and Geekbench warning.

Jimmyjames

Elite Member
Joined
Jul 13, 2022
Posts
1,499
Geekbench just posted a tweet and a blog post warning people that scores from Intel cpus where Intel’s Binary Optimisation tool have been used, are not comparable. Only 6 applications are listed which use this tool, Geekbench being one.

This feels like Intel are acting a little shady. Is that unfair?

1774387713393.png
 
It wouldn't be the first time that Intel cheated on benchmarks (I believe one of their compilers once recognized a benchmark and made optimizations that would not work in any other context) and it unfortunately won't be the last either.

All companies selling components based on benchmark results cheat. Not a long time ago AMD would enable unsafe CPU optimizations when they detected that a game is running. This resulted in occasional crashes, but hey, games crash, right?
 
I'm just pretty curious what the "Binary Optimisation Package" even does. - The fact it only works on a super limited set of programs is suspicious. I'd be OK with it if it, for example, statically analysed all applications for specific op-code patterns and replaced them with patterns that are better on a specific CPU but functionally identical. Like recognising something was compiled for generic x86 but being on a chip that supported SSE/AVX a specific pattern could safely and consistently be vectorised or whatever
 
I'm just pretty curious what the "Binary Optimisation Package" even does. - The fact it only works on a super limited set of programs is suspicious. I'd be OK with it if it, for example, statically analysed all applications for specific op-code patterns and replaced them with patterns that are better on a specific CPU but functionally identical. Like recognising something was compiled for generic x86 but being on a chip that supported SSE/AVX a specific pattern could safely and consistently be vectorised or whatever
From what PCGamer says, it is not automatic. So think of it like how AMD/NVidia does graphics driver updates (optimizations) for specific games. Apparently they have GB6 listed as a proof of concept, it appears that they are mainly focused on using this for games. From what I can tell it isn't terribly useful if you are not CPU bound (so I guess those folks with high end cards running at 1080p low would be good candidates).
 
All companies selling components based on benchmark results cheat. Not a long time ago AMD would enable unsafe CPU optimizations when they detected that a game is running. This resulted in occasional crashes, but hey, games crash, right?
That is a lot less scammy than hardcoding optimizations that only apply to a benchmark though. Some people could genuinely want to do that, and have better FPS at the expense of an increased risk of crashes.
 
Odd that Intel optimizes GB and yet AMD pantses them in the averages. It looks like AMD still uses HT, and the Intel Ultras are looking not so great without it. But its value is dubious: a 32-core/64-thread Threadripper has a MC score less than 10% higher than an 18-core M5 Max (and still only 30% better than an 18-core Snapdragon).
 
Odd that Intel optimizes GB and yet AMD pantses them in the averages. It looks like AMD still uses HT, and the Intel Ultras are looking not so great without it. But its value is dubious: a 32-core/64-thread Threadripper has a MC score less than 10% higher than an 18-core M5 Max (and still only 30% better than an 18-core Snapdragon).

That’s expected given GB 6’s design. It’s great for giving most consumers a sense of what they’re buying, but if you’re considering buying a Threadripper (or an Ultra or any other super high core count CPU), then you are no longer the target audience for GB - and that’s according to the people making GB. It’s designed for consumer devices.
 
Back
Top