Microsoft Surface Pro 3 Review
by Anand Lal Shimpi on June 23, 2014 3:55 AM ESTThickness, Thermals and Core: Understanding how Surface Pro 3 Got so Thin
Ever since Surface RT showed up I've wanted Surface Pro but in the RT chassis. Microsoft seemed to consciously avoid any lower TDP Core processors in favor of Ultrabook SKUs, which pretty much kept Surface Pro thicker than its ARM-based counterpart. Surface Pro 3 changes everything with a rethinking of how Microsoft embraced the thermal constraints of a tablet.
Surface Pro 3 is available with one of three CPU options: a Core i3, Core i5 or Core i7. The latter two are 15W TDP parts, while the former is a 11.5W TDP/6W SDP Haswell Y SKU. Haswell Y is really designed for passively cooled form factors, but all three CPU options receive the same heatpipe and fan cooling system offered by the Surface Pro 3. In short, the Core i3 model should behave a lot more like a standard Ultrabook part (sans Turbo).
Surface Pro 2 (left) vs. Surface Pro 3 (right)
Apple iPad Air (left) vs. Surface Pro 3 (right)
Microsoft's claim to fame is the ability to build the world's thinnest device with a Core series CPU inside. At 9.1mm thick, the Surface Pro 3 is just barely thicker than last year's Surface 2 but with a full blown dual-core Haswell instead instead of a high-end phone/tablet ARM SoC. As both the Surface Pro 2 and Surface Pro 3 used 15W Haswell Ultrabook parts and Microsoft claims a performance increase over last year's model, the question is how Microsoft can reduce thickness, keep TDP the same and increase performance. The answer is simply a difference in what's acceptable from a thermal standpoint.
Here's a look at the original Surface Pro while running an hour long loop of 3DMark Ice Storm Unlimited. I chose this test in particular as it behaves as a nice balance between CPU and GPU workloads on the device:
You can almost trace out the path of the heat pipe carrying the thermal load away from the CPU and to the two fans in the system. I measured peak temperature here at 41.7C.
Now let's look at Surface Pro 2:
Despite a move to Haswell, Microsoft lets the device get much warmer. You can make out the same U-shape thermal distribution as heat is carried away using the two fans, but the temperatures are much higher. I measured a maximum temperature running the same workload of 47.3C.
Here we have Surface Pro 3:
Right away you can see the new cooling system at work. The thermal load is mostly confined to the left side of the image (we are looking at the back with the kickstand unfolded towards the camera, so if you were looking at the display we're talking about the upper right side of the machine). The cooling solution is far more compact and I suspect ready for a move to Core M (Broadwell). Peak temps however are much closer to Surface Pro 1 at 43.2C.
The thermal story points us in the right direction. Either Surface Pro 3's fan and heatpipe configuration is able to remove heat far better than Surface Pro 2's design could, or the CPU in SP2 doesn't get as warm. I suspect it's the latter.
For starters, I'm guessing that Intel is helping Microsoft with delivering better binned Haswell ULT and Y series SKUs. But the big change is I believe Microsoft is more aggressive about reducing CPU and GPU frequencies in Surface Pro 3 compared to Surface Pro 2. Benchmarks will show an increase in performance due to more aggressive ramping up/down of clock speeds vs. Surface Pro 2, but prolonged load cases will likely show a decrease in performance vs. last year's model.
I first stumbled upon this behavior while trying to gather thermal data for Surface Pro 3. I noticed large run to run variance if I repeatedly ran 3DMark 11. I'm used to seeing this sort of behavior on smartphones that throttle quickly, but it was unique for a Surface Pro device.
3DMark is a synthetic test so the real question was how would Surface Pro 3 perform in a real world scenario where sustained CPU/GPU load was guaranteed for a long period of time. I figured a game playable on the machine like Dota 2 would be a great example. I asked our own Ryan Smith to whip up a custom benchmark using the game and I ran it on Surface Pro 1, 2, 3 as well as a 13-inch MacBook Air (Early 2014). The graph below illustrates average frame rate during our Dota 2 benchmark for all of the systems:
As you can see, even with Surface Pro 3's fan running the platform doesn't deliver sustained performance equal to last year's model. It's an understandable tradeoff given the substantial reduction in device thickness (and thus improvement in usability), but it's important to note nonetheless.
Workloads that are CPU and GPU heavy are one thing, but what about sustained productivity workloads? Penny Arcade's insanely talented artist Gabe mentioned that he noticed substantial lag when drawing on his Surface Pro 3. As Surface Pro 3's NTrig pen is actually lower latency than Surface Pro 2's, I wonder if what Gabe ran into might be thermal related rather than pen related (alternatively it could have to do with the much higher display resolution that Surface Pro 3 runs at). I needed a repeatable workload to see if non-gaming use cases also showed a regression. Thankfully PCMark 8 v2 provides a number of relatively long, repeatable workloads that are great for testing just this.
I decided to use the PCMark 8 v2 Work suite which includes web browsing, office producitivity (word processing and spreadsheet work) and video chat. It's a far cry from a Cinebench loop but I figured if I saw throttling here it would easily be present in heavier workloads. Each run of the suite actually repeats the tests three times and takes around 20 minutes to complete on the Surface devices. I measured performance for three suite runs (9 total runs of the Work loop) on both Surface Pro 2 and 3:
PCMark 8 v2 Work Performance Over Time | |||||||
Work Suite Run #1 | Work Suite Run #2 | Work Suite Run #3 | |||||
Microsoft Surface Pro 3 (Core i5) | 3273 | 3031 (92% of peak) | 3129 (95% of peak) | ||||
Microsoft Surface Pro 2 (Core i5) | 3222 | 3223 | 3218 |
As you can see, there's a 9% drop in performance on Surface Pro 3 from the first suite run to the next while Surface Pro 2 delivers consistent performance between runs. By the third run Surface Pro 3's performance recovers a bit, although it's still a few percent below the initial, cool run.
PCMark 8 v2 also plots CPU temperature and frequency throughout the course of the benchmark. Unfortunately I don't think I can export the data so I'm forced to present screenshots from the benchmark harness itself. Thankfully even looking at these screenshots is enough to tell us what's going on between the two Surface Pro devices:
Surface Pro 2 PCMark 8 v2 Work Suite
Surface Pro 3 PCMark 8 v2 Work Suite
Both devices do a good job of reaching max turbo fairly regularly, but Surface Pro 2 appears to spend more time at its max turbo state. By the last loop of the benchmark Surface Pro 3's max power is limited (green line) by the time we get to the video chat workload, I suspect that is where we lose a bit of performance. I'm only looking at the last of three suite runs here, if we looked at the second one the results would be even worse.
I haven't tested Surface Pro 3 in Microsoft's new docking station so I don't know if the device changes its thermal profile at all when docked, but in tablet or laptop mode it's definitely going to throttle quicker than Surface Pro 2 did. I must stress that I don't think this is necessarily a bad idea. Surface Pro 3 improves usability over Surface Pro 2 by leaps and bounds, and it's still faster under load than the original Surface Pro. All of this comes at the expense of reduced sustained performance. As you'll see from the rest of our tests, peak performance did get better over last year's model.
Fan Noise
Surface Pro 3's single fan is more noticeable than in Surface Pro 2. The sound it produces isn't necessarily louder, and when spinning it sounds a lot like any other Ultrabook with a fan in it. Compared to Surface Pro 2, the fan does kick in more frequently. For light tablet workloads or even light office work on Surface Pro 3, the fan remains silent. It's only when you're doing anything CPU or GPU intensive that you'll hear it spin up. The big difference is that in situations where you wouldn't hear fans spinning on Surface Pro 2, you'll sometimes hear it on SP3. This is the tradeoff that comes with the thinner chassis.
274 Comments
View All Comments
Walkop - Wednesday, September 17, 2014 - link
Edit: never , I see you meant now.Walkop - Wednesday, September 17, 2014 - link
Stupid Chrome Beta and gesture keyboards… *never mind, *see whatWalkop - Wednesday, September 17, 2014 - link
No.The Surface Pro's aspect ratio gives it a bigger display area than both MacBook Air's.
Sabresiberian - Monday, June 23, 2014 - link
I don't understand why you need a comparison written as an article. You are certainly capable of doing it for yourself - and have. :)Tegeril - Monday, June 23, 2014 - link
"TypeCover=1095g" when Macbook Air 11 is 108x grams but represented in kg suggests some sort of odd agenda, if you ask me.drmyfore - Tuesday, June 24, 2014 - link
Surface Pro 3 / 7.6V 42.2Whr 5547mAhMacbook Air 11 / 7.6V 38.75Whr 5100mAh
Macbook Air 13 / 7.6V 54.4Whr 7150mAh
Obviously, in battery life test, the MBA 11 is more appropriate than MBA 13.
name99 - Tuesday, June 24, 2014 - link
I think the more interesting comparison is with iPad Air.Basically (depending on the details) it's 2 to 3x as fast, with 3x tending to kick in when hyper threading is useful. How long does that advantage last?
The speed bump from A5 to Swift was about 2x, split between about 1.6x frequency improvement and 1.2x µarchitecture improvement. This accompanied a 45 to 32nm process change.
Swift to Cyclone was about a 1.5x improvement, all in architecture and µarchitecture, with a minor process improvement (32nm to 28nm HK).
A8 is expected to be a substantial process improvement (20nm, but still not FinFet). Personally I think this round the big changes will be in an Apple branded graphics cell and in the uncore, with minor changes in the core, but from process we should expect about a 1.5x boost, with obvious frequencies being 1.8 or 2GHz. So with the A8 round Apple does not hit Haswell, but gets a lot closer. Of course we then get Broadwell, but we expect Broadwell to be what, a 1.1x speedup or so?
IF Apple decides this is the year to switch to three cores rather than 2 that gives us a further factor of 1.5x (for that fraction of benchmarks that are substantially parallel) and we get even closer.
I'm on the fence about whether this makes sense yet, but Apple tends to design for products that stay relevant for 4yrs or so; and if they believe they're going to achieve substantially more parallelism over the next 4 yrs, it may make sense to do this now. They may also feel the marketing pressure is becoming problematic given the supposed China love of extra cores. They may also, this round, give us an A8X variant for iPads with three cores, keeping the phone A8 at two cores?
One final point is that, as Apple has methodically reached into the standard bag of "how to improve your CPU" tricks, one trick they have not yet used is that of putting a very small PMC on die to control turbo-ing --- like all ARM they're still doing everything in SW.
It seems obvious that at some point this will change, and the A8 may be the SoC where it changes. Ultimately such a change will allow Apple to get closer to Intel simply because it will be able to do the same sort of short high-speed thermally limited sprints that Intel can do. Of course it took Intel quite some time to get from the first generation of PMCs to today's sophisticated monsters that take into account things like thermal inertia, so one should expect that Apple's first attempt will not be nearly as aggressive as Intel --- though by the third attempt ...
Narg - Wednesday, July 30, 2014 - link
Why compare it to a Mac at all??? Most consumers won't bother with this, either they want Mac or they don't. It'd be better to compare it to say a Dell or Lenovo ultra/tablet/mix/something.coolhardware - Tuesday, June 24, 2014 - link
Interesting how few devices have a 3:2 aspect ratio, I notice the Nook HD+ as one and of course the Surface Pro 3 as another:http://pixensity.com/list/tablet/
I had the Nook HD+ and it is a very nice ratio IMHO (not too wide, not too tall).
I more Android tablets would start going 3:2 or 4:3 as I find it to be very beneficial for productivity work.
PS for movie viewing the ratio is not ideal, but in those cases I often just zoom in to fill the entire screen.
mmrezaie - Monday, June 23, 2014 - link
I tested it couple of times but I cannot get around the fact that this is still a beta, and they are asking too much for the price. I would rather go for thinkpad X or macbook air. Touch on Win8 is still a joke, and no homogeneity in software side.