Drive Technology Overview
Drive Technology Overview
Abstract.............................................................................................................................................. 2
Introduction......................................................................................................................................... 2
Categories of server disk drives ............................................................................................................. 2
Characteristics of disk drives ................................................................................................................. 3
Small form factor and large form factor disk drives .............................................................................. 3
Disk drive capacity........................................................................................................................... 4
Disk drive performance..................................................................................................................... 4
Reliability ........................................................................................................................................ 5
Drive qualification process.................................................................................................................... 6
Interconnect technology ........................................................................................................................ 7
Serial Attached SCSI (SAS) ............................................................................................................... 7
SAS-2 ............................................................................................................................................. 8
Second generation Serial ATA (SATA) ................................................................................................ 8
Interconnect bandwidths and drive throughput..................................................................................... 8
Improved performance and reliability with RAID ...................................................................................... 9
Advanced controllers ........................................................................................................................... 9
Solid state drives for servers.................................................................................................................. 9
HP solid state drive reliability requirements........................................................................................ 10
NAND over provisioning and wear-levelling.................................................................................. 10
Power loss protection .................................................................................................................. 10
Value, mainstream and performance SSDs........................................................................................ 11
SSD performance ........................................................................................................................... 12
Conclusion........................................................................................................................................ 12
For more information.......................................................................................................................... 13
Call to action .................................................................................................................................... 13
1
Abstract
Disk drive capacity has increased at rates similar to those of microprocessor performance. New and
improved interconnect technologies allow the rapid transfer of large amounts of data to and from the
disk. New and more cost-effective applications are made possible by increased storage capacity and
reduced cost per bit. Through innovation and engineering expertise, HP develops industry-leading
disk technologies that optimize overall system capacity, performance, reliability, and value.
This technology brief reviews the classes of disk drives, the key factors determining capacity,
performance and reliability in single drives, the options available to connect the drives to the system,
and the use of multiple drives to further increase performance and reliability.
Introduction
Disk drives provide the primary mechanism for storing and retrieving permanent, or non-volatile, data
in almost all servers, desktop computers, and notebook computers. Disk drives are also increasingly
common in portable electronic devices such as music players and automobile navigation systems.
The key performance differences between main memory (semiconductor RAM) and primary storage
(typically, magnetic disk drives) are speed of access and capacity. Accessing a disk drive is typically
approximately 100,000 times slower than accessing main memory. Primary storage is typically at
least 100 times larger than main memory. Most engineering in disk drive and interconnect
technologies is driven by a desire to simultaneously reduce the difference in access speed and
increase disk drive capacity and reliability. Innovative strategies in disk and disk controller design
continue to deliver dramatic increases in disk capacity, performance, and availability.
Flash memory technology, which has previously been used as a low-performance, lower capacity
storage medium in consumer devices, is being adapted as primary storage in computers. This
technology has the promise of delivering enterprise class storage with lower latencies and
significantly better performance than disk drives. The cost per bit for flash memory is between that of
RAM and traditional disk drives. Flash-based solid state drives that can meet both the performance
and the heavy duty cycle requirements of server storage are being introduced.
2
HP Enterprise drives provide maximum reliability, highest performance, scalability, and error
management under the most demanding conditions. They are the only class of drives designed for use
at unconstrained I/O workloads and are intended for use in mission-critical applications such as large
databases, e-mail servers, and CRM.
General Performance and reliability High capacity, lowest Maximum reliability and
description intended for entry-level cost per gigabyte performance using state of
servers, lowest unit cost the art design
Workload Designed for workloads Designed for workloads Designed for near
< 40% < 40%, unconstrained workloads
Connectivity Single port Single port Dual port Single and dual port
3
and the reliability of these drives, combined with their lower power and smaller size, have hastened
this transition. By the end of 2010, all new enterprise class drives and all new 10k and 15k RPM
drives will be SFF. HP expects to continue to develop 3.5-inch midline and entry class drives.
4
Table 2. Strategies to improve single disk capacity, performance, and reliability
Increase platter Increase bit density per Write cache buffer data to be written to disk
rotation rate unit of track
Decrease seek times Reorder read and write operations to execute the next
operation physically available on drive
Several mechanical design strategies are used to reduce the physical distance that the read/write
heads must travel to reach the target segment:
smaller diameter platters
multiple platters per drive
increased speed of platter rotation
increased areal density of data
decreased seek time per track
Magnetic storage strategies are used to increase the amount of data in each track. Increasing the bit
density per unit length of track also helps increase the rate at which data can be written to and read
from the drive.
Disk I/O strategies are used to reduce the time that a logical read/write spends waiting for the
physical read/write operation. These strategies seek to effectively decouple the logical and physical
operations of the disk. Increasingly sophisticated approaches become practical as the embedded
processing power and memory incorporated into the drive increases. There are several approaches
that can be used:
buffering the data to be written to disk (write caching)
queuing read operations
read-ahead caching
queuing write operations
write caching
Reliability
Disk drive reliability is measured in terms of Annual Failure Rates (AFR). The AFR is the percentage of
disk drive failures occurring in a large population of drives in operation for one year. For example, a
population of 100,000 drives with an AFR of 1.5% would experience approximately 1,500 failures
per year. An AFR calculated from a small number of drives is subject to large statistical variations that
render it inaccurate.
Major factors in determining drive reliability are the duty cycle and the I/O workload to which the
drives are subject. Duty cycle is simply power-on time, which is calculated as the number of hours that
the disk drive is powered on, divided by the number of calendar hours. I/O workload is disk working
time, which is calculated as the number of hours that the disk drive is aggressively reading and
writing data, divided by the number of calendar hours.
5
Enterprise drives are designed for unlimited I/O workloads, that is, for continuous I/O activity.
Midline and Entry drives are designed for low work I/O workloads. If any doubt exists about the
expected workload, and if reliability is a priority, then Enterprise drives should be used.
Drives are subject to mechanical problems created by shock, vibration, environmental extremes, and
thermal effects. These problems may degrade performance or reliability (for example by displacing
the read head from the data track). They may cause data loss, or even cause catastrophic failure of
the drive. Of the three categories of HP drives, Enterprise drives are the most resistant to vibration
effects. Midline drives have a lower tolerance to vibration than Enterprise drives. Both HP Enterprise
and Midline drives have internal sensors that detect operational/rotational vibration and reduce the
performance impact from system, drive-to-drive, and environmental vibrations. Entry class drives will
exhibit degraded performance in high vibration environments.
Multiple drives in a single enclosure may interact to create coupled vibration problems. This can occur
when using Entry or Midline drives with Enterprise class I/O workloads. In fact, Entry drives are not
supported in some external storage solutions due to the higher levels of system and drive-to-drive
vibrations.
Temperature is a major factor influencing reliability and is usually best managed by controlling the
operating environment. Higher operating temperatures will negatively affect disk drive relaibility.
HP development engineers work closely with disk drive suppliers to execute a comprehensive set of
approximately 50 different procedures and specifications that determine the testing and metrics that a
candidate drive design must satisfy. Approximately 1000 unique hard disk drives are typically used
to evaluate a product family during the selection evaluation and development verification steps, and
approximately 2 million drive test hours transpire.
The supplier production qualification phase includes a thorough analysis of the supplier’s capabilities,
focused on validating supplier process capability and process controls, and on measured product
quality. The analysis includes extensive review of the supplier’s process controls, closed-loop
corrective action processes, and overall quality control system. The final stage of the supplier
production qualification includes a comprehensive analysis of the product’s quality performance
through the HP configuration pilot.
Disk drive products that pass the extensive HP qualification process proceed into the HP continuous
improvement/disk drive performance monitoring phase during volume production. This phase
includes three main areas of focus:
Validate that volume production is in process control
Measure, analyze, and react to product quality data
Deliver continuous product improvements
HP and the disk drive suppliers work as a team during the volume production phase of a product. The
team monitors the performance of each product through quality control methods at the supplier’s
6
factory and at HP option kitting configuration sites. Product quality data is reviewed on a daily,
weekly, and monthly basis.
Interconnect technology
Various interconnect technologies are used to connect one or more disk drives to a computer system.
Technology has transitioned from parallel bus data interfaces (ATA, IDE, and the original SCSI
interface) to SATA and SAS serial interfaces in which each drive has its own high-speed serial
communication channel to the disk controller. Table 3 lists basic characteristics of SATA and SAS
interfaces, which are now on their second generations.
Certain capabilities have traditionally been inherent in SAS or SATA, but this is changing. The
benefits and constraints of these two interfaces may become blurred.
Table 3. Comparison of SAS and SATA interfaces for industry-standard servers
Cable length 1m 6m 10 m
7
HP was instrumental in developing the SAS standard. For a more detailed discussion of SAS, see the
HP technology brief entitled “Serial Attached SCSI technology” available at
http://h20000.www2.hp.com/bc/docs/support/SupportManual/c01613420/c01613420.pdf.
SAS-2
The SAS-2 interface supports a link speed of 6 Gb/s, or 600 MB/s, in each direction. SAS-2
controllers were first introduced with HP ProLiant G6 servers in 2009. The SAS-2 interface will support
SAS and SATA drives; however, the 6 Gb/s link speed is only achieved using new SAS-2 compliant
disk drives.
SAS-2 also supports SAS expanders to create a SAS fabric supporting large numbers of drives on a
disk controller. This concept was introduced with SAS and has continued to evolve. SAS-2 can
theoretically support an unlimited number of drives in a SAS fabric, although the practical limit is
typically 512 – 2048 drives. This is based on the maximum size of the routing tables supported in the
SAS expanders.
The initial SATA 1.5 Gb/s variant was targeted at replacing ATA in the desktop and consumer
markets. It introduced a serial interface that supports one drive per controller port.
SATA 1.5 Gb/s with extensions is targeted to workstations and low-end servers. It adds native
command queuing.
SATA 3.0 Gb/s is targeted to workstations and low-end servers. It increases the data transfer rate.
For a more detailed discussion of SATA, see the technology brief entitled “Serial ATA technology” at
http://h20000.www2.hp.com/bc/docs/support/SupportManual/c00301688/c00301688.pdf
8
are connected to individual SAS-2 channels. In these cases, the performance limiter is the drive
throughput, not the speed of the SAS links.
The performance benefits of SAS-2 and its faster link speed becomes important when constructing
SAS fabrics and larger drive arrays using SAS expanders that support the SAS-2 standard. With these
configurations, the throughput of multiple drives is often aggregated across a single SAS-2 channel,
thus taking full advantage of the additional SAS-2 bandwidth for increased overall performance.
The improved bandwidths of SATA 3.0 and SAS-2 are also important when considering the emerging
category of solid state drives (SSDs). Second generation server SSDs using the SATA interface are
already capable of delivering 230 MB/s of sustained throughput, almost equal to the bandwidth of a
SATA 3.0 link. Third generation SAS SSDs scheduled for 2010 are expected to support 500 – 600
MB/s throughput and thus will be capable of consuming the entire bandwidth of a single SAS-2 link.
Both read performance and write performance also vary with the workload; that is, whether I/O
(many small data units) or bandwidth (fewer, large data units) predominates.
Advanced controllers
Advanced controllers, such as the HP Smart Array, decouple the logical disks seen by applications
from the physical devices used to implement the disk subsystem. These controllers include both
hardware and software. A single logical disk (as seen by an application) may be mapped onto an
array of multiple physical disks. This approach provides greatly enhanced flexibility, expandability,
maintainability, and performance. Smart Array controllers are available for SAS, SATA, and SCSI
interfaces.
For further details, see the technology brief entitled “HP Smart Array Controller Technology,” at
http://h20000.www2.hp.com/bc/docs/support/SupportManual/c00687518/c00687518.pdf.
9
advances in flash memory as well as the rapidly evolving capabilities of NAND flash memory
controllers, HP has been able to develop solid state drives that can meet the performance and
reliability requirements for use in server environments.
10
sustain a loss of power without requiring the lengthy metadata rebuild process required for SSDs that
do not have this feature.
Value SATA SSDs 2nd generation SATA SSDs 1st generation 6 GB SAS SSDs
(2010/2011) (2009) (2010)
General SFF and LFF Hot Plug SFF and LFF Hot Plug SFF and LFF Hot Plug
description ML, DL, BL platforms ML, DL, BL platforms
Reliability 1year service life @ 3 year service life @ 3-5 year service life.
Endurance constrained write constrained write Unconstrained workloads
workloads workloads
All SSDs are capable of operating in environments that are unsuitable for traditional disk drives:
Higher temperature environments (up to 60° C)
11
Limited airflow environments
Environments subject to higher shock and vibration (up to 1000G)
Environments requiring drives with lower power consumption (2 watts)
HP SSDs are designed for an operational life of over three years, the typical service life for a new
server. The NAND memory used in SSDs has a relatively well understood lifespan that is primarily
determined by the number of write/erase cycles to which it is subjected. As a result, SSD endurance
should be viewed differently from that of disk drives. A server SSD that has reached the end of its
service life is almost sure to start failing once the NAND endurance limit has been exceeded, whereas
a typical SAS disk drive may continue to operate for several years beyond its stated service life.
SSDs do not have great data retention characteristics. An SSD removed from a system may not be
readable one year later, whereas most disk drives will retain their data for a decade or more. This
makes them unsuitable for use as archival storage.
SSD performance
Second generations HP SSDs show significant performance improvements over the first generation
products from 2008. As Table 5 shows, the new midline SSDs offer performance that is equal to or
better than enterprise SAS drives. SSDs truly excel at random read operations, where their
performance is starting to approach over one hundred times that of disk drives.
Conclusion
Disk technology is evolving rapidly. Hardware should be reviewed periodically to ensure that the most
cost-effective solutions are deployed. Enterprise class drives with SAS interconnects and HP SAS
Smart Array Controllers provide high performance storage that is the most reliable for industry-
standard servers. Other technologies may be appropriate for non-mission-critical applications.
Solid state drives are a rapidly evolving class of storage technology that can operate reliably in more
extreme environments than traditional disk drives, and can provide random I/O performance that is
far superior to traditional disk drives.
12
For more information
For additional information, refer to the resources listed below.
Call to action
Send comments about this paper to TechCom@HP.com.
13