The Snapdragon 8 Gen 1 Performance Preview: Sizing Up Cortex-X2by Dr. Ian Cutress on December 14, 2021 8:00 AM EST
Machine Learning: MLPerf and AI Benchmark 4
Even as a new benchmark in the space, MLPerf has been made available that runs representative workloads on devices and takes advantage of both common ML frameworks such as NNAPI as well as the respective chip libraries for each vendor. Using this benchmark on retail phones to date, Qualcomm has had the lead in almost all the tests, but given that the company is promoting a 4x increase in AI performance, it will be interesting to see if that comes across all of MLPerf’s testing scenarios.
It should be noted that Apple’s CoreML is currently not supported, hence the lack of Apple numbers here.
Across the board in these first four tests Qualcomm is making a sizable lead, going above and beyond what the S888 can do. Here we’re seeing up to a 2.2x result, making an average +75% gain. It’s not quite the 4x that Qualcomm promoted in its materials, but there’s a sizable gap with the other high-end silicon we’ve tested to date.
The only non-lead is with the language processing, where Google’s Tensor SoC is almost 2x what the S8g1 scores. This test is based on a mobileBERT model, and either for software or architecture reasons, it fits a lot better into the Google chip than any other. As smartphones increase their ML capabilities, we might see some vendors optimizing for specific workloads over others, like Google has, or offering different accelerator blocks for different models. The ML space is also fast paced, so perhaps optimizing for one type of model might not be a great strategy long-term. We will see.
In AI Benchmark 4, running in pure NNAPI mode, the Qualcomm S8g1 takes a comfortable lead. Andrei noted in previous reviews with this test that the power consumed during this test can be quite high, up to 14 W, and this is where some chips might be able to pull ahead an efficiency advantage. Unfortunately we didn’t record power at the same time as the test, but it would be good to monitor this in the future.
Post Your CommentPlease log in or sign up to comment.
View All Comments
TheinsanegamerN - Friday, December 17, 2021 - linkThe android world doesnt need 6-10 years of support to still download and play the latest games, unlike iphones. Android 6 can play anything android 12 can.
Now try that with iOS 9.
Sergio Luiz - Saturday, June 25, 2022 - linkThe problem here is that the IPhone 6s not only has the latest version of ios but all the compilers updated to run current games, see that the A9 runs the immortal Diablo in its Medias settings at 30fps, the updates survive longer for the devices, already that in each version of Apple makes improvements in the APIs of the devices, 6s will only not be compatible with ios 16 because of Metal 3 that will only be available on the A11 Bionic, but see that the 6s has not died yet because most Apps need ios 11 to run.
Nicon0s - Saturday, December 18, 2021 - link"The 6-10 years of support for iPhones more than mitigates what is at this point a very minor price difference outside of the very low end."
LoL, 10 years of support? These same excuses are really funny.
Phones hardly even last for 10 years, in general and after 2 years you need to change the battery especially with iphones so 5 years is the longest people keep their phones in general. And these are generally people that don't care about software updates, they don't even know what software version their phones has, they don't care what hardware their phones has and so on. The idea is that Android phones can be used for 5 years or more no problem. My A52s will get 4 years of updates but project Mainline will make it so the phone will continue to get updates well past that threshold, so I could probably keep it for as long it would last hardware wise.
"iPhone SE is only $400 after all."
The SE is a terrible phone in 2 very important areas: BATTERY and SCREEN.
It's OK for phone calls and basic stuff that doesn't stress the batter but in such cases even a low end Android phone is just as good.
"Android phones in that price range are not great performers and have at best 2 years of support typically."
Well I payed 350 Euros, VAT included for my A52s 5G also with a free pair of Galaxy Buds2. An SE would cost me 500 Euros with VAT and I struggle to think about anything that would make it better as a phone. Other that a nicer built quality(which is irrelevant as I always uses cases with my phones) there isn't really anything relevant. Oh and the A52s has official software support for 4 years.
"Even a used iPhone will typically have years more support than a comparably cheap new Android device, and for a non-power user that's great."
For a non-power user that's actually irrelevant.
Reflex - Monday, December 20, 2021 - linkThis is silly, I mean, iPhone batteries are as good or better than their Android counterpoints in similar price ranges. And no, the SE is not a terrible phone, it's just not a power users' phone. Nothing wrong with mid-range products, and they exist in the Android ecosystem as well.
The issue with using Android past it's support lifecycle is that it is easily compromised, I've delt with dozens of people, most often seniors, with tons of spyware on their phones due to one click sms malware or following the wrong email link. It's important to have ongoing security updates to any computing device in active use as users simplly are not a reliable source of security.
Nicon0s - Saturday, December 25, 2021 - link"This is silly, I mean, iPhone batteries are as good or better than their Android counterpoints in similar price ranges."
SE's battery is way worse in comparison to any Android phone in it's price range. So your claim is the silly one sir.
"And no, the SE is not a terrible phone, it's just not a power users' phone."
I guess if you expect to be able to use your phone throughout the entire day you are a "power user".
"Nothing wrong with mid-range products, and they exist in the Android ecosystem as well."
It's funny how you try to defend it. I didn't say there's any problem with mid-range phones, I only said the SE is bad in 2 very important areas, which obviously you can't deny.
"The issue with using Android past it's support lifecycle is that it is easily compromised"
No it's not.
"I've delt with dozens of people, most often seniors, with tons of spyware on their phones due to one click sms malware or following the wrong email link."
Yeah, I'm sure you didn't. Realistically if you click or tap on anything every time, you can get compromised on any phone no matter the OS version. iOS for example is full of 0 day vulnerabilities, way more than Android.
"It's important to have ongoing security updates to any computing device in active use as users simplly are not a reliable source of security"
It is important but not life dependent, or better it doesn't make a phone unusable, useless device that will surely be compromised. I have lots of phones, some of them on older Android versions and I've never encountered a "malware" in the last 10 years. Maybe I'm doing something wrong, I should start tapping of suspicious links from unknown senders.
lemurbutton - Tuesday, December 14, 2021 - linkAndroid phones will never have better value than iPhones unless you go into the sub $200 range. iPhones have much higher resale value. Android phone values tank fast.
TheinsanegamerN - Tuesday, December 14, 2021 - linkAndroid users dont have to have the new shiney every year, unlike iphone users, so who cares?
Wrs - Tuesday, December 14, 2021 - linkFor there to be a resale value there must be demand for the secondhand device or its parts. Clearly there’s huge relative demand for secondhand iPhones as compared to most Androids. Why?
michael2k - Tuesday, December 14, 2021 - linkBecause Apple provides updates for 6 years. Meaning a 3 year old iPhone will receive as many OS updates as a brand new 2021 Android phone.
And from the charts, a 3 year old iPhone will perform as well as a brand new 2021 Android phone.
Reflex - Wednesday, December 15, 2021 - linkIt's actually closer to ten years. Apple provides six years of major OS updates, however each major OS version gets four years of security updates which is why the iPhone 6S, which is six years old but just got iOS 15, still has four more years of support left.
Huge selling point for the people I support given their lack of interest in the latest and greatest.