Exploring Performance Consistency in USB 3.0 Flash Drivesby Ganesh T S on November 15, 2014 2:00 PM EST
SSD technology has advanced to a stage where it is possible to have flash drives with bona-fide SSD controllers. The addition of a SATA to USB 3.0 bridge provides an ubiquitous high-speed direct attached storage interface. We have already looked at the Phison S9-based Corsair Flash Voyager GTX and the SandForce SF2281-based Mushkin Ventura Ultra. Our review of the Mushkin Ventura Ultra 120GB drive had a comment about the device's thermal throttling issues. This piqued our interest and we set out to see if any of the other units evaluated before had such issues. Obviously, we were also interested in determining whether our Ventura Ultra sample had the problem. In the case of throttling, we also wanted to make our review complete by bringing out the circumstances under which it would trigger. As we will see further down in this piece, our experiments did find evidence of throttling in the Mushkin Ventura Ultra.
Recently, we also received a sample of another SSD controller-based flash drive. Putting that drive through our throttling test revealed even worse results compared to the Mushkin Ventura Ultra. Upon our feedback, the manufacturer is contemplating a firmware update. In this piece, we will refer to the unit as 'BrandX 240GB' (a complete review of the unit with benchmark numbers will be published once the manufacturer provides us a resolution for the throttling issue). The list of DAS units put under the performance consistency scanner is provided below.
- Mushkin Ventura Ultra 120GB
- BrandX 240GB
- Corsair Voyager GTX 256GB
- LaCie Rugged Thunderbolt 500GB
- Mushkin Atom 64GB
Performance Consistency Evaluation Methodology
Our testing methodology for DAS units takes into consideration the usual use-case for such devices. The most common usage scenario is transfer of large amounts of photos and videos to and from the unit. In order to tackle this, we created three test folders with the following characteristics:
- Photos: 15.6 GB collection of 4320 photos (RAW as well as JPEGs) in 61 sub-folders
- Videos: 16.1 GB collection of 244 videos (MP4 as well as MOVs) in 6 sub-folders
- BR: 10.7 GB Blu-ray folder structure of the IDT Benchmark Blu-ray (the same that we use in our robocopy tests for NAS systems)
These folders were put in a RAM drive on our testbed. Using robocopy, each folder was copied from the RAM drive to the DAS (write benchmark) and back to the RAM drive (read benchmark). This process was repeated thrice. To check for performance consistency, we instrumented our benchmark script to record the flash drive's read and write transfer rates while the robocopy process took place in the background. For supported drives, we also recorded the internal temperature of the drive during the process.
Aspects that may influence performance consistency include thermal throttling and firmware caps on access rates to avoid overheating or other similar scenarios. This aspect is an important one, as the last thing that users want to see when copying over, say, 100 GB of data to the flash drive, is the transfer rate going to USB 2.0 speeds. The graphs below show the speeds observed during our real-world DAS suite processing with the instrumented benchmark script. The first three sets of writes and reads correspond to the photos suite. A small gap (for the transfer of the videos suite from the primary drive to the RAM drive) is followed by three sets for the next data set. Another small RAM-drive transfer gap is followed by three sets for the Blu-ray folder.
An important point to note here is that each of the first three blue and green areas correspond to 15.6 GB of writes and reads respectively. Throttling, if any, is apparent within the processing of the photos suite itself.
The Mushkin Ventura Ultra 120GB does throttle after the S.M.A.R.T temperature report reaches 45 C. In our testbed (ambient at 22C), this temperature was reached after approximately 18 GB of writes and 16 GB of reads without any interruptions. Beyond this, the write speeds got capped around 80 MBps (compared to the non-throttled 100 MBps), while the reads got capped around 100 MBps (compared to the non-throttled 140 MBps). The throttling allowed the temperature to stay below 50 C throughout our benchmark run.
BrandX, though, behaved differently. The temperature in the steady state settled around 53 C. Unfortunately, the throttling (after a similar amount of data transfer as the Mushkin Ventura Ultra) resulted in the write speeds getting capped at a paltry 20 MBps. The reads managed to remain around 80 MBps.
The Mushkin Atom is not meant to take the performance crown, and the advertised write speeds are in the 20 MBps range. Our benchmark run ran at a steady 15 MBps, while the reads didn't get throttled at all in our evaluation process.
The LaCie Rugged Thunderbolt drive is not a flash drive (unlike the other units considered in this piece). It is a bona-fide SSD in a USB 3.0 / Thunderbolt hybrid enclosure. It is no wonder that the transfer rates were hardly affected by the relatively small amount of data traffic. The real winner of our evaluation was the Corsair Voyager GTX. There is no performance degradation even after more than 120 GB of continuous traffic. It must also be remembered that we ran our robocopy benchmark with multiple queue depths in our original review (that was more than 480 GB of continuous traffic) and the table showed remarkable consistency. The instrumented benchmark run confirmed the same.
Coming to the business end of the piece, it must be remembered that the capabilities must be compared keeping the price in mind. If cost is not an issue and the form factor is not an issue, the LaCie Rugged Thunderbolt is the hands down winner for a fast portable DAS unit with consistent performance. If cost is the primary concern, and one doesn't mind a little bit of throttling after around 18 GB of continuous write traffic, the Mushkin Ventura Ultra is a great choice at less than $0.6/GB. The middle ground (right balance of cost and fast, consistent performance, along with a traditional flash drive form factor) is held by the Corsair Voyager GTX. At more than $0.85/GB, it also serves as a reminder that one gets what they pay for.
Post Your CommentPlease log in or sign up to comment.
View All Comments
tuxRoller - Saturday, November 15, 2014 - linkIf you're using sata drives why not use uas mode?
Not every device has support for it, but it's something that can drastically improve desktop workloads.
ganeshts - Saturday, November 15, 2014 - linkOther than the Atom drive (which is not SATA-based), all others were tested with UASP enabled.
cosmotic - Saturday, November 15, 2014 - linkIt's very confusing when the comparison graphs' axis domains aren't consistent.
mjcutri - Saturday, November 15, 2014 - link+1
ganeshts - Saturday, November 15, 2014 - linkThose are not specified as 'comparison' graphs. For the bandwidth comparisons, you can look at the dedicated review of the Mushkin Ventura Ultra.
The graphs are meant to be analyzed standalone - one by one - to identify whether there is any sudden drops in read or write speeds / whether that is correlated to temperature in any way.
The reason they are in a drop down selection is just because they are results from running the same workloads on the drive, and it is easier for readers to check up with that drop-down, rather than scroll down to view each of the graphs one by one.
Doroga - Sunday, November 16, 2014 - linkFor 5-7 graphs I would greatly prefer scrolling instead of using a dropdown.
Maybe load dropdown as default with a button "show all graphs" for those who don't like it.
basroil - Saturday, November 15, 2014 - linkAny chance we'll see a follow-up with some more reasonably priced drives like the Sandisk Extreme? That drive is a beast, especially in 4-32k performance
poohbear - Saturday, November 15, 2014 - linkYea the sandisk extreme is supposed to be the fastest usb 3.0 according to reviews, why not do a review of the common usb drives which the majority of users would have access to.
DanNeely - Sunday, November 16, 2014 - linkIt'll probably never happen because the OEMs are only interested in sending high end products for review. I'd really be interested in seeing if a $20-35 flash drive would be significantly faster than the $10-15 models I generally get.
basroil - Sunday, November 16, 2014 - link"It'll probably never happen because the OEMs are only interested in sending high end products for review. "
Anandtech did a partial review before, but only on speed.
"I have one of these and yes when it hits its stride it really flies but sometimes it seems rather picky with what USB3.0 ports it will decide to play ball with"
Works great on intel chipset ports, never had the chance to test with others