The OPPO Reno 10x Zoom Review: Bezeless Zoom
by Andrei Frumusanu on September 18, 2019 10:00 AM EST- Posted in
- Mobile
- Smartphones
- Oppo
- Snapdragon 855
- Oppo Reno 10x Zoom
Machine Learning Inference Performance
AIMark 3
AIMark makes use of various vendor SDKs to implement the benchmarks. This means that the end-results really aren’t a proper apples-to-apples comparison, however it represents an approach that actually will be used by some vendors in their in-house applications or even some rare third-party app.
In AIMark, the Oppo Reno 10x ends up quite adequately amongst the Snapdragon 855 devices who come shipping with the corresponding Qualcomm libraries to make the benchmark work. We do note that other S855 phones have a slight edge here, likely due to their more optimised software stack.
AIBenchmark 3
AIBenchmark takes a different approach to benchmarking. Here the test uses the hardware agnostic NNAPI in order to accelerate inferencing, meaning it doesn’t use any proprietary aspects of a given hardware except for the drivers that actually enable the abstraction between software and hardware. This approach is more apples-to-apples, but also means that we can’t do cross-platform comparisons, like testing iPhones.
We’re publishing one-shot inference times. The difference here to sustained performance inference times is that these figures have more timing overhead on the part of the software stack from initialising the test to actually executing the computation.
AIBenchmark 3 - NNAPI CPU
We’re segregating the AIBenchmark scores by execution block, starting off with the regular CPU workloads that simply use TensorFlow libraries and do not attempt to run on specialized hardware blocks.
In the CPU accelerated workloads, we see that the Oppo Reno 10x absolutely stands out compared to all other Snapdragon devices, having nothing in common with the rest of the pack in terms of the resulting performance figures. The phone ends up with one performance regression, one test that didn’t complete, but otherwise the performance looks to actually be better than that of what’s available on other Snapdragon 855 phones.
The only explanation that I can offer here is that it looks like rather than using Qualcomm’s NN driver stack, the phone is falling back to the default Android Tensorflow libraries. The interesting thing here is indeed that the phone looks to be performing better with these libraries than that the ones that are shipping with the Qualcomm BSP, something the company should certainly look into.
AIBenchmark 3 - NNAPI INT8
AIBenchmark 3 - NNAPI FP16
AIBenchmark 3 - NNAPI FP32
Unfortunately for the rest of the AI Benchmark tests which make use of NNAPI acceleration for INT8, FP16 and FP32 models, the Reno 10x just didn’t have the correct drivers and thus wasn’t able to perform the tests.
If there’s one thing that’s worse than bad performance, it’s not able to perform a task at all. I’m not sure if the Reno 10x performs any differently in a global firmware version of if this issue is solely a characteristic of the Chinese variant. In any case, I find it quite disappointing for the machine learning ecosystem as Oppo is a major vendor, and the Reno is its flagship device. How are application developers supposed to embrace machine learning when we the software situation still has such enormous draw-backs?
40 Comments
View All Comments
Death666Angel - Thursday, September 19, 2019 - link
So, PCMark score better than anything else tested here? Maybe they apply some sort of cheating fix that identifies certain apks and allows more relaxed boosting behavior, which Andrei disables.ElFenix - Wednesday, September 18, 2019 - link
an honest to goodness telephoto camera in a phone, not just a marketing BS one!melgross - Wednesday, September 18, 2019 - link
No, mostly a marketing BS one.Arbie - Wednesday, September 18, 2019 - link
No headphone jack, no sale.FYI, on the low light page you're missing some words in "it looks like the phone 20-30% of the highlights" .
SanX - Thursday, September 19, 2019 - link
How about comparing the phone with broader range cheaper phones like UMIDIGI etc with other processors. They cost 5-10x less than Apple, Google or Samsung but definitely are not 5-10x worse, not even mentioning this OPPO phone.The_Assimilator - Thursday, September 19, 2019 - link
But does it have gangnam style?Psyside - Thursday, September 19, 2019 - link
Samsung has improved the night mode DRAMATICALLY, and also not only the Exynos get on pair with the Snapdragon, but now the exynos even manage to be better in low light, holy shit.And also bye bye Pixel, Samsung is so better in low light now its only bested by P30 pro and (maybe?) the new iPhones.
JewellMWilliam - Sunday, September 22, 2019 - link
max.pays12.Jacob36 - Tuesday, September 24, 2019 - link
Mobile eLogbook - an iPhone and Android App for users of the elogbook.org FHI Pan-Surgical Electronic Logbook. ... Once you have entered your elogbook.org login credentials, the app will ... This option can be activated in the settings page.https://loginsonline.xyz/
SanX - Wednesday, September 25, 2019 - link
How about comparing this OPPO Reno 10x to OPPO Reno II with new Helio P90?