Microsoft Surface Pro 3 Review
by Anand Lal Shimpi on June 23, 2014 3:55 AM ESTThickness, Thermals and Core: Understanding how Surface Pro 3 Got so Thin
Ever since Surface RT showed up I've wanted Surface Pro but in the RT chassis. Microsoft seemed to consciously avoid any lower TDP Core processors in favor of Ultrabook SKUs, which pretty much kept Surface Pro thicker than its ARM-based counterpart. Surface Pro 3 changes everything with a rethinking of how Microsoft embraced the thermal constraints of a tablet.
Surface Pro 3 is available with one of three CPU options: a Core i3, Core i5 or Core i7. The latter two are 15W TDP parts, while the former is a 11.5W TDP/6W SDP Haswell Y SKU. Haswell Y is really designed for passively cooled form factors, but all three CPU options receive the same heatpipe and fan cooling system offered by the Surface Pro 3. In short, the Core i3 model should behave a lot more like a standard Ultrabook part (sans Turbo).
Surface Pro 2 (left) vs. Surface Pro 3 (right)
Apple iPad Air (left) vs. Surface Pro 3 (right)
Microsoft's claim to fame is the ability to build the world's thinnest device with a Core series CPU inside. At 9.1mm thick, the Surface Pro 3 is just barely thicker than last year's Surface 2 but with a full blown dual-core Haswell instead instead of a high-end phone/tablet ARM SoC. As both the Surface Pro 2 and Surface Pro 3 used 15W Haswell Ultrabook parts and Microsoft claims a performance increase over last year's model, the question is how Microsoft can reduce thickness, keep TDP the same and increase performance. The answer is simply a difference in what's acceptable from a thermal standpoint.
Here's a look at the original Surface Pro while running an hour long loop of 3DMark Ice Storm Unlimited. I chose this test in particular as it behaves as a nice balance between CPU and GPU workloads on the device:
You can almost trace out the path of the heat pipe carrying the thermal load away from the CPU and to the two fans in the system. I measured peak temperature here at 41.7C.
Now let's look at Surface Pro 2:
Despite a move to Haswell, Microsoft lets the device get much warmer. You can make out the same U-shape thermal distribution as heat is carried away using the two fans, but the temperatures are much higher. I measured a maximum temperature running the same workload of 47.3C.
Here we have Surface Pro 3:
Right away you can see the new cooling system at work. The thermal load is mostly confined to the left side of the image (we are looking at the back with the kickstand unfolded towards the camera, so if you were looking at the display we're talking about the upper right side of the machine). The cooling solution is far more compact and I suspect ready for a move to Core M (Broadwell). Peak temps however are much closer to Surface Pro 1 at 43.2C.
The thermal story points us in the right direction. Either Surface Pro 3's fan and heatpipe configuration is able to remove heat far better than Surface Pro 2's design could, or the CPU in SP2 doesn't get as warm. I suspect it's the latter.
For starters, I'm guessing that Intel is helping Microsoft with delivering better binned Haswell ULT and Y series SKUs. But the big change is I believe Microsoft is more aggressive about reducing CPU and GPU frequencies in Surface Pro 3 compared to Surface Pro 2. Benchmarks will show an increase in performance due to more aggressive ramping up/down of clock speeds vs. Surface Pro 2, but prolonged load cases will likely show a decrease in performance vs. last year's model.
I first stumbled upon this behavior while trying to gather thermal data for Surface Pro 3. I noticed large run to run variance if I repeatedly ran 3DMark 11. I'm used to seeing this sort of behavior on smartphones that throttle quickly, but it was unique for a Surface Pro device.
3DMark is a synthetic test so the real question was how would Surface Pro 3 perform in a real world scenario where sustained CPU/GPU load was guaranteed for a long period of time. I figured a game playable on the machine like Dota 2 would be a great example. I asked our own Ryan Smith to whip up a custom benchmark using the game and I ran it on Surface Pro 1, 2, 3 as well as a 13-inch MacBook Air (Early 2014). The graph below illustrates average frame rate during our Dota 2 benchmark for all of the systems:
As you can see, even with Surface Pro 3's fan running the platform doesn't deliver sustained performance equal to last year's model. It's an understandable tradeoff given the substantial reduction in device thickness (and thus improvement in usability), but it's important to note nonetheless.
Workloads that are CPU and GPU heavy are one thing, but what about sustained productivity workloads? Penny Arcade's insanely talented artist Gabe mentioned that he noticed substantial lag when drawing on his Surface Pro 3. As Surface Pro 3's NTrig pen is actually lower latency than Surface Pro 2's, I wonder if what Gabe ran into might be thermal related rather than pen related (alternatively it could have to do with the much higher display resolution that Surface Pro 3 runs at). I needed a repeatable workload to see if non-gaming use cases also showed a regression. Thankfully PCMark 8 v2 provides a number of relatively long, repeatable workloads that are great for testing just this.
I decided to use the PCMark 8 v2 Work suite which includes web browsing, office producitivity (word processing and spreadsheet work) and video chat. It's a far cry from a Cinebench loop but I figured if I saw throttling here it would easily be present in heavier workloads. Each run of the suite actually repeats the tests three times and takes around 20 minutes to complete on the Surface devices. I measured performance for three suite runs (9 total runs of the Work loop) on both Surface Pro 2 and 3:
PCMark 8 v2 Work Performance Over Time | |||||||
Work Suite Run #1 | Work Suite Run #2 | Work Suite Run #3 | |||||
Microsoft Surface Pro 3 (Core i5) | 3273 | 3031 (92% of peak) | 3129 (95% of peak) | ||||
Microsoft Surface Pro 2 (Core i5) | 3222 | 3223 | 3218 |
As you can see, there's a 9% drop in performance on Surface Pro 3 from the first suite run to the next while Surface Pro 2 delivers consistent performance between runs. By the third run Surface Pro 3's performance recovers a bit, although it's still a few percent below the initial, cool run.
PCMark 8 v2 also plots CPU temperature and frequency throughout the course of the benchmark. Unfortunately I don't think I can export the data so I'm forced to present screenshots from the benchmark harness itself. Thankfully even looking at these screenshots is enough to tell us what's going on between the two Surface Pro devices:
Surface Pro 2 PCMark 8 v2 Work Suite
Surface Pro 3 PCMark 8 v2 Work Suite
Both devices do a good job of reaching max turbo fairly regularly, but Surface Pro 2 appears to spend more time at its max turbo state. By the last loop of the benchmark Surface Pro 3's max power is limited (green line) by the time we get to the video chat workload, I suspect that is where we lose a bit of performance. I'm only looking at the last of three suite runs here, if we looked at the second one the results would be even worse.
I haven't tested Surface Pro 3 in Microsoft's new docking station so I don't know if the device changes its thermal profile at all when docked, but in tablet or laptop mode it's definitely going to throttle quicker than Surface Pro 2 did. I must stress that I don't think this is necessarily a bad idea. Surface Pro 3 improves usability over Surface Pro 2 by leaps and bounds, and it's still faster under load than the original Surface Pro. All of this comes at the expense of reduced sustained performance. As you'll see from the rest of our tests, peak performance did get better over last year's model.
Fan Noise
Surface Pro 3's single fan is more noticeable than in Surface Pro 2. The sound it produces isn't necessarily louder, and when spinning it sounds a lot like any other Ultrabook with a fan in it. Compared to Surface Pro 2, the fan does kick in more frequently. For light tablet workloads or even light office work on Surface Pro 3, the fan remains silent. It's only when you're doing anything CPU or GPU intensive that you'll hear it spin up. The big difference is that in situations where you wouldn't hear fans spinning on Surface Pro 2, you'll sometimes hear it on SP3. This is the tradeoff that comes with the thinner chassis.
274 Comments
View All Comments
Da W - Monday, June 23, 2014 - link
I use touch on the desktop all the time and it woks well.ablejo26 - Monday, June 23, 2014 - link
You obviously don't know what you are doing on windows 8.1, I switched from mac air with the pro 2 and its way better. If you are not into learning new OS that's fine to stay with the old as it does the job but if want an experience that gives you a touch and type then do it you wont regret it.mmrezaie - Monday, June 23, 2014 - link
Maybe you are right. I am from oss (linux/unix) world, and as far as I am thinking about it, it feels like two distinct os, and not one unified shell. Don't get me wrong, I like the idea very much, but in the end I returned it because I couldn't see it as developer friendly. I use my macbook air a lot since I am always getting remote shell from my servers.basroil - Tuesday, June 24, 2014 - link
"far as I am thinking about it, it feels like two distinct os, and not one unified shell. "In that case you know linux is a schizoid, since bash is completely different to your desktop environment (despite being necessary and also allowing most software to run), and then each desktop environment is different (gnome, KDE, etc). Hell, it's even crazier because you can't actually expect your program to work out of the box on all systems even if they run the same base OS! (mostly because of desktop environment and default packages)
In windows, you have powershell if you need it, and you never NEED to develop for WinRT and Windows.h concurrently.
darwinosx - Tuesday, June 24, 2014 - link
Oh so he's not doing Windows 8.1 the right way...got it.I'll take an Air over the compromised device any day.
kyuu - Tuesday, June 24, 2014 - link
Your Air is a compromised device, as all laptops are. Compromises are made in the name of portability. Calling the SP3 a "compromised" device as though it's some sort of derogatory term is silly. Engineering is all about compromise.Voldenuit - Monday, June 23, 2014 - link
Yeah, $500 to jump to the 8GB/256GB config is pretty steep.$799 for the base model isn't bad, but you're getting severely compromised RAM and storage and a less capable CPU. As Anand says, the type cover needs to be included as standard at all price points, and the higher SKUs are just too expensive for me to stomach (YMMV).
fokka - Monday, June 23, 2014 - link
exactly this. the jump from 256gb to 512gb is $400, while a new 512gb msata evo costs 280 bucks.basroil - Tuesday, June 24, 2014 - link
The 512gb one isn't necessarily an evo, like the 128gb one that sure as hell isn't (hynix unbranded). If they swapped it out for a 840pro or similar I bet you wouldn't be complaining (costs about 400 )tential - Monday, June 23, 2014 - link
I agree with you but this is MSRP launch day prices. Give this a month or two and you'll see much lower prices. I wouldn't be surprised if the model Anand tested for $1299 was $900-1000 In November.