Request for Adobe Acrobat Pro benchmarking

theorist9

Site Champ
Posts
671
Reaction score
639
I'm wondering how much better new devices (including Apple Silicon, as well as the latest AMD and Intel devices) are than my 2019 i9 iMac for routine office work, and it's tough to find such benchmarks, so I made my own. [UL Procyon has an "Office Productivity Benchmark" (see https://www.anandtech.com/show/1872...-review-taking-intel-s-raptor-lake-to-6-ghz/2 ), but I've not results for it with my machine or Apple Silicon.] If anyone has the latest version of Adobe Acrobat Pro, and would be willing to run it and report how long it takes, I would appreciate it.

[In practice, the more common office work delays I see with my machine are repeated small delays of ≈ 0.5 s – 3 s, which could collectively be termed "machine responsiveness", but those are hard to benchmark because they are both short (making them hard to time with a stopwatch), and typically not replicable. So I created this as a surrogate.]

Apple Silicon devices will be running a different version of Acrobat than my Intel Mac, but there's nothing to be done about that.

Please post:
Machine:
OS:
Acrobat Pro Version:
Runtime:


For me it's:
Machine: 2019 27" iMac, i9-9900K (8 cores)/128GB RAM/Radeon Pro 580X (8GB)
OS: MacOS 12.6.3
Acrobat Pro Version: 2022.003.20314
Runtime: 74 s

To set up this benchmark, you'll go to a US government website showing a recent Apple patent, export it as a PDF, and open it in Adobe Acrobat Pro. This will give you a flat file. Then you'll do a word search, which will cause Adobe to say the document isn't searchable, and ask if you'd like to use the OCR to convert it. You'll say yes, and will be measuring how long it takes to do the conversion and complete the search (which in this case will return no hits).

This is a single-threaded task that uses Acrobat at 100%:
1676847771483.png


Out of curiosity, I also took advantage of a period while mds_stores was running (this is MacOS doing a routine update of its search index) to see the extent to which other active processes would slow it down. To add to the burden, I did other activities, like taking screenshots. This increased the completion time by 20%, to 89 s. The most obvious explanation for the slowing (even though there were still idle cores—see screenshot below) is that, in the first test, only one core was loaded, allowing max turbo boost. It’s additionally possible the processes were contending for other system resources, like memory bandwidth. Of course, unlike with the first test, you won't be able to exactly replicate this second test's conditions:

1676847491585.png

1676847503018.png


Here are the steps:

[It looks complicated because I've laboriously indicated every step, but it should take under a minute to click through everything.]

0) Ensure no other significant active tasks are running.


1) In Safari (or the browser of your choice), go to this .gov website, which shows a recent Apple patent application:
https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20230050061


2) Export it as a PDF (Safari screenshot shown):
1676847400312.png



3) Open the PDF in the lastest version of Adobe Acrobat Pro:
1676847410837.png



4) Do CMD-F and then enter “unified” in the search box, and hit “Next” (there are no instances of this, so it will be forced to search the entire document):
1676847418435.png



5) You will see this prompt. Hit “Yes”
1676847427993.png



6) You will see this prompt. Have your stopwatch ready. Start the watch when you hit “OK”:
1676847439603.png



7) Once the above starts runing, you will see a black progress window at the lower right:
1676847448377.png


Immediately after it completes the conversion of the last page (p 56), it will search the document and this window will appear. Stop the watch when you see it:
1676847467377.png
 
Last edited:

Cmaier

Site Master
Staff Member
Site Donor
Posts
5,666
Reaction score
9,312
Machine: Apple M1 Max 16" MacBook Pro
OS:
MacOS 13.2.1
Acrobat Pro Version: 2022.003.20314
Runtime: 44.9 s
 

theorist9

Site Champ
Posts
671
Reaction score
639
Machine: Apple M1 Max 16" MacBook Pro
OS:
MacOS 13.2.1
Acrobat Pro Version: 2022.003.20314
Runtime: 44.9 s
Machine: Apple Mac Studio Ultra/64GB RAM/M1/20-core CPU, 48-core GPU
OS: MacOS 13.2.1
Acrobat Pro Version: 2022.003.20314
Runtime: 36 s
Thanks for running these. I'm puzzled by the large difference in run times, since the principal differences between these two machines are the number of CPU and GPU cores and, at least on my Intel box, this task is single-threaded and doesn't use the GPU. The only other major performance difference I can think of is the RAM bandwidth, but I don't know if that's relevant.

I'm thus wondering if these results are repeatable, i.e., if you'd get about the same times if you ran them again. Mine were, to within ≲ 1 sec (when run under the same conditions).
 
Last edited:

Cmaier

Site Master
Staff Member
Site Donor
Posts
5,666
Reaction score
9,312
Thanks for running these. I'm puzzled by the large difference in run times, since the principal differences between these two machines are the number of CPU and GPU cores and, at least on my Intel box, this task is single-threaded and doesn't use the GPU. The only other major performance difference I can think of is the RAM bandwidth, but I don't know if that's relevant.

I'm thus wondering if these results are repeatable, i.e., if you'd get about the same times if you ran them again. Mine were, to within ≲ 1 sec (when run under the same conditions).
Ran mine again, and got 44.7 seconds. So it seems pretty consistent on my machine.
 

theorist9

Site Champ
Posts
671
Reaction score
639
This is interesting. Any explanation for difference? Is it also 100% CPU and 0% GPU in AS?

45/36 => Ultra is 25% faster. That's a decent difference.
 
Last edited:

dada_dave

Elite Member
Posts
2,491
Reaction score
2,506
The only thing I can think of and it seems unlikely is that it hits the SLC cache hard and the Ultra having double of it helps even though it’s single-threaded. I dunno 🤷‍♂️
 
Top Bottom
1 2