Docu 10602
Docu 10602
Deduplication Devices
Release 7.6 Service Pack 1
Integration Guide
P/N 300-011-326
REV 10
EMC Corporation
Corporate Headquarters:
Hopkinton, MA 01748-9103
1-508-435-1000
www.EMC.com
Copyright © 2010-2012 EMC Corporation. All rights reserved.
EMC believes the information in this publication is accurate as of its publication date. The information is subject to change
without notice.
THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.” EMC CORPORATION MAKES NO
REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION,
AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR
PURPOSE.
Use, copying, and distribution of any EMC software described in this publication requires an applicable software license.
For the most up-to-date regulatory document for your product line, go to the Technical Documentation and Advisories section
on EMC Powerlink.
EMC2, EMC, Data Domain, the EMC logo, and where information lives are registered trademarks or trademarks of EMC
Corporation in the United States and other countries. All other trademarks used herein are the property of their respective
owners.
For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com.
2 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Contents
Preface
Chapter 1 Introduction
Revision history ...................................................................................................... 14
NetWorker Data Domain integration features ................................................... 15
Integrated deduplication backup ................................................................... 15
NetWorker Data Domain storage devices .................................................... 15
Cloning and remote storage of backups ....................................................... 15
Data Domain configuration and monitoring................................................ 15
Version requirements.............................................................................................. 16
License requirements.............................................................................................. 16
NetWorker licenses .......................................................................................... 16
Data Domain licenses....................................................................................... 17
Hosts and software ................................................................................................. 17
Data Domain storage server ........................................................................... 17
NetWorker Management Console server ..................................................... 17
NMC portal ....................................................................................................... 18
NetWorker server ............................................................................................. 18
NetWorker client .............................................................................................. 18
NetWorker storage node ................................................................................. 19
NetWorker application modules.................................................................... 19
EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide 3
Contents
4 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Contents
Glossary
Index
EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide 5
Contents
6 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Figures
Title Page
EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide 7
Figures
8 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Preface
As part of an effort to improve and enhance the performance and capabilities of its product
lines, EMC periodically releases revisions of its hardware and software. Therefore, some
functions described in this document may not be supported by all versions of the software or
hardware currently in use. For the most up-to-date information on product features, refer to
your product release notes.
If a product does not function properly or does not function as described in this document,
please contact your EMC representative.
Audience This document is part of the NetWorker documentation set, and is intended for use
by system administrators. It contains planning, practices, and configuration
information for the use of NetWorker Data Domain devices within an EMC
NetWorker backup and storage management environment.
Readers of this document should be familiar with the following tasks:
◆ Identify the different hardware and software components that make up the
NetWorker datazone.
◆ Follow procedures to configure storage management operations.
◆ Follow guidelines to locate problems and implement solutions.
EMC NetWorker Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide 9
Preface
◆ EMC NetWorker License Manager 9th Edition Installation and Administration Guide
provides installation, setup, and configuration information for the NetWorker
License Manager product.
◆ EMC NetWorker 7.6 Service Pack 1 Error Message Guide provides information on
common NetWorker error messages.
◆ EMC NetWorker 7.6 Service Pack 1 Command Reference Guide provides reference
information for NetWorker commands and options.
◆ EMC NetWorker Management Console Online Help describes how to perform the
day-to-day administration tasks in the NetWorker Management Console and the
NetWorker Administration window.
◆ EMC NetWorker User Online Help describes how to use the NetWorker User
program, which is the Microsoft Windows client interface for the NetWorker
server, to back up, recover, archive, and retrieve files over a network.
10 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Running H/F 1
IMPORTANT
An important notice contains information essential to software or hardware
operation.
Typographical conventions
EMC uses the following type style conventions in this document:
<> Angle brackets enclose parameter or variable values supplied by the user
EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide 11
Preface
Where to get help EMC support, product, and licensing information can be obtained as follows.
Product information — For documentation, release notes, software updates, or for
information about EMC products, licensing, and service, go to the EMC Powerlink
website (registration required) at:
http://Powerlink.EMC.com
Your comments Your suggestions will help us continue to improve the accuracy, organization, and
overall quality of the user publications. Please send your opinion of this document to:
BSGdocumentation@emc.com
If you have issues, comments, or questions about specific information or procedures,
please include the title and, if available, the part number, the revision (for example,
A01), the page numbers, and any other details that will help us locate the subject that
you are addressing.
12 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
1
Introduction
Introduction 13
Introduction
Revision history
E-mail your clarifications or suggestions for this document to:
BSGdocumentation@emc.com
The following table presents the revision history of this document.
10 Nov. 19, 2012 Clarified “Data Domain native replication support” on page 62.
Changed book title to “EMC NetWorker and EMC Data Domain
Deduplication Devices Integration Guide”
A09 June 13, 2011 Changed the document to be applicable only with NetWorker 7.6 SP1 and
DD OS 4.8 or 4.9.
A08 March 22, 2011 “Configuring Data Domain for NetWorker” on page 46 correct command to
verify DD Boost on DD OS 5.0.
A07 March 2, 2011 NMM support: “Backup fails for older NetWorker application modules” on
page 81
A06 February 18, 2011 Initial general availability (GA) of this document:
• “NetWorker application modules” on page 19
• “Number of devices and save streams” on page 22
• “Memory and connection requirements” on page 22
• “Removing NetWorker Data Domain devices” on page 24
• “Configure the Data Domain system for NetWorker” on page 46
• “Creating NetWorker Data Domain devices with the wizard” on page 48
• “Configure NetWorker Data Domain devices” on page 51
A05 December 15, 2010 “Replace a failed or old storage node” on page 81
A04 December 1, 2010 • “Configure backup clients with the client wizard” on page 56
• “Configure backup clients with the property windows” on page 57
• “Backup fails for older NetWorker application modules” on page 81
A01 September 24, 2010 Initial restricted availability (RA) of this document.
14 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Introduction
Console (NMC) portal. The NMC server is accessible from any supported remote
Internet browser.
The NMC Device Configuration Wizard simplifies the configuration of storage
devices, backup clients, storage (target) pools, volume labeling, and save set cloning.
Version requirements
The hosts in NetWorker Data Domain backup and recovery datazone should meet the
following version requirements:
◆ The NetWorker server must be installed with NetWorker 7.6 SP1 software.
◆ The Data Domain Operating System (DD OS) must be version 4.8 or 4.9.
◆ NetWorker Management Console (NMC) must be release 7.6 SP1.
◆ Any storage node that uses NetWorker Data Domain devices must be running
NetWorker 7.6 SP1.
◆ NetWorker clients may be earlier releases, although release 7.5 SP 3 or 7.6 is
recommended.
◆ Other NetWorker storage nodes and clients that are not directly managing or
sending data to the Data Domain system can be earlier releases, although release
7.5 SP 3 or 7.6 is recommended.
License requirements
A fresh installation of a NetWorker release (not an upgrade) allows evaluation of all
features, including Data Domain features, with no enabler (license key) required for
30 days. You can extend this evaluation period by 15 additional days by typing
“grace” as an authorization code before the 30-day expiry period. After expiration,
backups cannot be performed unless permanent enablers are applied.
NetWorker licenses
Two types of license keys must be enabled for the NetWorker server to interact with a
Data Domain system, the Data Domain Device Type Enabler and a Data Domain
Device Type Capacity Enabler. Upgrade enablers may be available for earlier releases.
The EMC NetWorker Licensing Guide and your EMC sales representative can provide
licensing details.
16 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Introduction
• Each NIC is used for a device with the Media type attribute set to Data
Domain. “Configure NetWorker Data Domain devices” on page 51 provides
details.
• The NICs are not aggregated (by ifgroup).
However, if you use the Data Domain ifgroup command, you can effectively
configure an aggregated link for the individual NICs, provided they are on the
same network, so they will all appear (and be addressed) as a single network
identity and require only a single DD system enabler.
NMC portal
The NMC server may be accessed and operated from a portal on a remote computer
with a supported Internet web browser and Java Runtime Environment (JRE)
software installed. Multiple users can access the NMC server concurrently from
different portals.
The EMC NetWorker Installation Guide provides information on supported web
browsers and versions of the JRE.
NetWorker server
NetWorker 7.6 SP1 software must be installed on the NetWorker server that stores or
clones data on Data Domain systems.
The NetWorker software provides services to back up and recover data for client
computers within a NetWorker datazone. Deduplicated backup data is stored on a
Data Domain system by the use of special NetWorker Data Domain devices, which
are created and managed by the NetWorker software. The NetWorker software also
provides features to create clone copies of stored deduplicated data.
The EMC NetWorker Release Notes provides details on supported Data Domain
features.
NetWorker client
A NetWorker client is a supported host whose data requires backup and restore
services. The NMC server, NetWorker server, and NetWorker storage nodes are all
NetWorker clients.
NetWorker client software must be installed and running before NetWorker Data
Domain devices are configured. Clients may use a supported earlier release of
NetWorker client software than the NetWorker server or storage node.
The EMC Information Protection Software Compatibility Guide provides information on
supported releases.
18 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Introduction
Note: A NetWorker storage node host that is running on a supported Intel 32-bit or 64-bit
platform requires a Pentium 4 or higher processor.
20 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
2
Planning and
Practices
CAUTION
The use of more than 14 NetWorker Data Domain devices on a Data Domain
system can impair the performance of the devices and the system.
Optimum performance is achieved when there are at least eight concurrent save
streams (sessions) to the Data Domain system and the save streams are balanced
among the devices. New save streams should attach to devices with the least load. To
support this, the Target sessions value for NetWorker Data Domain devices is set to
one as the default value. The Max sessions value has a default value of four and
cannot be set to a value greater than 10.
“Configure NetWorker Data Domain devices” on page 51 provides details on target
and maximum sessions.
The Data Domain Administration Guide provides details on save streams and
performance.
22 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Planning and Practices
Note: Currently, NetWorker Data Domain devices support only an IP network and do not
support SAN (Fibre Channel) data transport.
The EMC Data Domain Storage system with EMC NetWorker 7.6.0 and earlier Best
Practices Planning white paper provides details on deployments of NetWorker with
Data Domain in a VTL or CIFS/NFS AFTD environment.
Note: If a NetWorker Data Domain device becomes full during a backup, the backup fails
immediately. It does not pause or wait for space to become available.
The DD OS filesys clean command describes all the available options for managing
how expired save sets will be deleted from the Data Domain system. The Data
Domain documentation also provides details on reclaiming storage space.
CAUTION
Incorrect removal of a NetWorker Data Domain device can cause data to be lost.
Deletion of a device by the NetWorker software does not remove the storage unit or
its subdirectories on the Data Domain system. NetWorker does not support the
renaming of a device or the storage unit folder on the Data Domain system. The
devices and their directories remain on the system even after the data written on
them has expired, regardless of whether the devices are mounted or unmounted.
Note: If you need to remove a device, both the read-write and read-only components of the
device must be unmounted or an error results. To toggle the display of these components, in
the NetWorker Administration application, Devices view, click View > Display read-only
devices and volumes.
Retention period
The deduplication ratio increases with longer data retention periods. The longer the
stored save sets are retained, the greater the chances that identical data already exists
in storage that can be used to deduplicate each subsequent backup, and the greater
the efficiency of the storage usage.
24 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Planning and Practices
Data types
Some types of user data such as text documents, slide presentations, spreadsheets,
most database types, source code, and e-mail are known to contain redundant data
and are good deduplication candidates.
Some other types of data such as audio, video, and scanned images already consist of
compressed data. Typically, the first full deduplication backup of these data types
yields low reductions, but subsequent backups will typically produce high
deduplication ratios if the data has a low change rate.
Change rate
Data that does not change much between backups (low change rate) produces high
deduplication ratios and is a good candidate for deduplication. Data that has already
been stored will not be stored again.
When a completely new save set is deduplicated, the number of unique blocks within
it can vary widely depending on the data type, and often there is little that can be
deduplicated. Yet because the Data Domain system compresses the data blocks, there
is typically a 2:1 to 3:1 (50–75 percent) data reduction.
The storage savings begin to increase significantly with each subsequent backup of
the save set because only those data blocks that are unique to each backup need to be
written to disk. In conventional business operations, the data change rate is typically
low and unique data may represent only 1–2 percent of the data present in each
additional backup set. The remainder of the backup is deduplicated against what is
already stored on the system.
The following guidelines are offered to help you create consistent, easily identifiable
hostnames that facilitate configuration, reporting, and troubleshooting in the
NetWorker Data Domain environment:
◆ Create names that are unique across all NetWorker datazones. They should
identify the network role, such as administration, backup, cloning, or production,
with possibly a location or server name.
◆ Use a single hostname associated with each NIC or IP interface within the same
NetWorker datazone. Each new hostname or IP address used by NetWorker will
require its own enabler.
◆ Include source and target abbreviations in names to quickly identify whether
network connections are correct. For example, add an abbreviation of the storage
node hostname in the Data Domain name and an abbreviation of the Data
Domain hostname in the storage node name. Ensure that these names are
included in the Data Domain /etc/hosts file.
◆ Specify all aliases (long and short names, IP address, etc.) for the NetWorker
server and storage nodes in their respective Client resources (Globals 1 of 2 tab).
◆ Ensure that all hostnames in the network can be consistently resolved from
multiple locations in both directions. For example: Shortname to IP, Longname to
IP, IP to Shortname, IP to Longname.
◆ In general, use short, easy to identify, descriptive names instead of IP addresses or
fully qualified name strings for devices and storage nodes. Long names might not
fit into some views. Examples of a long and short name:
NWDD365-1.brloa.lab.remcy.com:/DatazNW_Dir1
NWDD365-1:/DatazNW_Dir1
◆ Use standard alphanumeric characters, including “-” and “_” with no spaces or
special characters, except pool names may not use underscores “_”.
◆ Use fixed formats (text field length and case) and include leading 0s in numbers,
with a maximum of 50 characters.
◆ Avoid the use of dates in names where the dates might change or become
meaningless in the future.
IP addresses
The use of IP addresses is generally not recommended because numbers are more
difficult to identify and troubleshoot than descriptive names.
However, there are exceptions:
◆ The Data Domain system requires IP addresses to be used to interface with an
“ifgroup” for Advanced Load Balancing and Link Failover features.
◆ For clone-controlled replications, the hosts file on the source Data Domain system
should list the IP address of the target Data Domain system. Otherwise, the
clone-controlled replication will use the same network that is used to access the
source and target systems for backup and restore operations.
The Data Domain documentation provides details.
26 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Planning and Practices
Examples
The following are some example name formats.
Firewall requirements
Regardless of the network connections used, communication through a firewall
requires the use of specific ports and protocols for backup, monitoring, and
replication across sites. Ensure that the following firewall ports are open between the
Data Domain, NetWorker, and NMC servers:
◆ TCP 111 (NFS portmapper)
◆ TCP 161 (for NMC server to query for alerts and statistics)
◆ TCP 162 (SNMPTRAP for NMC server to monitor status and events)
◆ TCP 2049 (NFS)
◆ TCP 2051 (Replication, if clone-controlled replication is used, Data Domain to
Data Domain systems)
◆ TCP xxxx (select a random port for NFS mountd, 2052 is the default)
On the Data Domain system, type the following command from SE mode:
# nfs set mountd-port xxxx
Restart the Data Domain system.
The Data Domain system provides functionality to review your network
configuration and capabilities, as well as SSH Telnet to help diagnose issues.
Note: Clone-controlled replication across datazones or to Data Domain devices that are not
managed by NetWorker are not supported.
28 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Planning and Practices
Servers
IFGROUP
DD Device 09
DD Device 10
Storage Node Tape Library
Admin Network
Backup Network
Servers
DD Device 01 DD Device 05
WAN connection
GEN-001471
30 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Planning and Practices
Note: The performance required for the concurrent method depends on many factors
and would need to be validated by testing at the individual sites.
For example, the original backup on the primary Data Domain system is used
as the source to create simultaneous clones on two target Data Domain
systems.
Figure 2 on page 31 illustrates data paths 2a and 2b for this method.
Backup IP Network
Clients
Storage Node Storage Node Storage Node
10 GbE connection
WAN connection
GEN-001637
environment, the NetWorker server requires two Data Domain Storage System
Enablers, one for each datazone:
1. The two NetWorker servers initiate backups of client groups within their
respective datazones.
2. The three storage nodes write the backup data to specific pools, which are
targeted to storage devices on the Data Domain system.
DZ-A datazone
Clients
NetWorker Server (DZ-A)
Clients
Backup Network
DZ-B datazone
Clients
DD Device 21 DD Device 01 DD Device 11
DD Device 22 DD Device 02 DD Device 12
Tape Library DD Device 03 DD Device 13
DD Device 04 DD Device 14
10 GbE connection
GEN-001472
32 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Planning and Practices
IFGROUP
IP Network
NetWorker Server
Clients Clients
DD Device 01 DD Device 21
Clients Clients
DD Device 02 DD Device 22
DD Device 03
DD Device 04
10 GbE connection
GEN-001473
Figure 4 Single datazone with dedicated storage nodes and one high bandwidth link
34 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
3
Data Redirection and
Migration
36 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Data Redirection and Migration
Note: This also stops the NetWorker Backup and Recovery Service and the EMC GST
service.
g. Right-click the NetWorker Backup and Recovery Service and click Start. This
also starts the NetWorker Remote Exec Service.
h. If the NetWorker server is also the NMC server, right-click the EMC GST
Service and click Start.
5. Run the NMC New Device Wizard. The following tasks are specific to NetWorker
Data Domain devices:
a. Select or create NetWorker Data Domain devices on the Data Domain system
where the backup save sets will be stored.
b. Select or create a Pool resource that will target the save sets to the devices.
Note: The wizard enforces that a NetWorker Media Pool created for the Data Domain
system uses only NetWorker Data Domain devices. This can be verified in the NMC
property windows (Media Pool, Selection Criteria tab) for Target Device > Devices.
The wizard also sets Target Media > Media type required to Data Domain.
c. Select or create a NetWorker storage node on which to label and mount the
new devices.
d. Complete the wizard.
“Creating NetWorker Data Domain devices with the wizard” on page 48 provides
details.
6. In the NMC NetWorker Administration window:
a. In the Media view, open the pool created or modified in step 5.
b. In the Data Source attribute, ensure that the groups selected for this pool are
intended for NetWorker Data Domain devices.
c. Ensure that these backup groups are removed from their legacy pools.
“Create pools to target NetWorker Data Domain devices” on page 54 provides
details.
Note: Existing individual NetWorker Client resources should not require any changes to
their settings, including the Data Domain backup attribute. The redirection is more
efficiently configured in the Pool resource.
7. Test the backup environment to ensure that the new configuration operates
correctly and existing backups that should be unaffected continue to run as
expected. For backups to new devices, the test should also include a restore from
those devices.
8. Start your redirection with a full backup to the new devices. This avoids a
dependency on the last full backup stored with the legacy storage environment
and the potential need to restore from two different environments.
9. Monitor backup performance and adjust the backup schedule to optimize the
configuration for maximum throughput or additional clients. “Monitoring
NetWorker Data Domain devices” on page 72 provides details.
Migration methods
Data migration is essentially a one-time NetWorker clone operation that is tailored to
the different device types and timescales. The migration can include all the data or be
limited to data selected from a specific timeframe or backup type, such as weekly full
backups.
38 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Data Redirection and Migration
The details of the migration procedure depend on the method to be used and the
granularity of the data to be migrated:
◆ NetWorker scheduled clone operation. “Migration scenarios” on page 39
provides details.
◆ A NetWorker nsrclone script to be run from a command line, which is not
covered in this document.
◆ NetWorker staging (data moving) operation, which is not covered in this
document.
Migration scenarios
This section offers some typical scenarios to help you migrate existing backup data
from legacy devices or filesystems to NetWorker Data Domain devices. The best
scenario for you will depend on the configuration of your current storage
environment and the capacities and bandwidth available.
Some example migration scenarios are as follows:
◆ “Migrating to a new DD system from traditional tape or disk storage” on page 39:
• “Migrate to new devices on a different storage node” on page 39
• “Migrate to new devices on the same storage node” on page 40
◆ “Migrating to the existing DD system from non-integrated storage” on page 41:
• “Migrate to a new devices on a different storage node” on page 41
• “Migrate to new devices on the same storage node” on page 42
Migration scenarios 39
Data Redirection and Migration
and restore operations, then additional effort and time will be required to ensure that
the data transfer does not impact the regular backup operations.
IP Network
2Gb
DDS1Device1
DD
R
4Gb
DDS1Device2
DD
Data Domain System
(DDS1) ERIC OLIVE BUSTER
Rd=Cassie:\tape0
SAN Rd=Cassie:\tape1
SSID 3034
SSID 3452
Data Read Path CASSIE
SSID 1261 Tape Library (SAN)
GEN-001566
Figure 5 Migration from traditional storage to NW-DD devices on a different storage node
40 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Data Redirection and Migration
Data Domain system. A storage node could be configured for data migration to seed
the Data Domain system as an interim step.
IP Network
NW Storage NW NW
DDS1Device1 Node Client Server
DD
R
2Gb
4Gb
DDS1Device2
Data Migration DD
Path
(Internal)
Rd=Cassie:\tape0
Data Domain System
(DDS1) Rd=Cassie:\tape1 CASSIE OLIVE BUSTER
SAN
SSID 3034
Figure 6 Migration from traditional storage to NW-DD devices on the same storage node
Migration scenarios 41
Data Redirection and Migration
Data Domain system over the SAN connection. Then the new storage node DOVE,
reads this data and concurrently stores only unique data, in this case the storage
metadata, across the IP network to the Data Domain system. The speed of the transfer
of non-deduplicated data across the IP network would be the limiting factor.
IP Network
2Gb
DDS1Device1
DD
R
4Gb
DDS1Device2
DD
Data Domain System
(DDS1) DOVE OLIVE BUSTER
Rd=Cassie:\tape0
VTL
Rd=Cassie:\tape1
42 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Data Redirection and Migration
IP Network
2Gb
R
4Gb
Figure 8 Migration from VTL to NW-DD devices on the same storage node
Note: When existing deduplicated VTL or CIFS/NFS AFTD save sets are migrated, the
save sets are first reverted to their native non-deduplicated format, which the storage node
reads and stores in deduplicated format on the new NetWorker Data Domain devices. This
reversion process occurs for both Data Domain and non-Data Domain storage.
2. Create a clone pool to target NetWorker Data Domain devices for the migration:
• In the Data Source attribute, select groups for the migration.
Typically, you will migrate the same groups that you selected for the
redirection of backups. “Redirect backups to NetWorker Data Domain
devices” on page 36 provides details.
• In the Target Devices attribute, select the NetWorker Data Domain devices
where the migrated data will be stored.
“Create pools to target NetWorker Data Domain devices” on page 54 provides
details.
3. Configure a NetWorker scheduled clone operation with the Write Clone Data to
Pool attribute selected for your clone pool.
44 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
4
Software
Configuration
Software Configuration 43
Software Configuration
Note: DD Boost functionality requires NFS service to be enabled on the Data Domain
system, even if no users or shares are configured. The NetWorker server, storage nodes, or
clients are not required to be enabled for NFS.
Note: Use the same username in both of these commands. Only one OST user may have
access to Data Domain at a time.
44 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Software Configuration
9. Verify that distributed segment processing (DD Boost) is enabled. This is required
for deduplication operations on the NetWorker storage nodes:
• To verify DD Boost on a DD OS 4.9 system:
# ost option show boost
• To enable DD Boost on a DD OS 4.9 system:
# ost option set boost enabled
Note: The boost (distributed segment processing) option must be enabled. The disabled
setting is not supported for production use.
10. (Optional) Use of the Device Configuration Wizard is strongly recommended for
the creation of storage units and device configuration details. This step is
included for power users and for special configurations that require the manual
creation of storage units.
To create a storage unit (storage folder), which can later be used to manually
create a NetWorker Data Domain Device, use the following DD OS 4.9 command:
# ost lsu create folder_name
IMPORTANT
Although NFS service data is stored in the /backup directory, clients that are
configured for NFS access have the ability to see, change, and delete the
/backup/ost directory, which contains the NetWorker Data Domain devices.
Additional configurations may be needed to avoid potential problems.
Methods
The NMC software provides the New Device Wizard, which is used to create and
configure the NetWorker Data Domain devices, as well as the required volume labels
and storage pools that are necessary to target and store client backups on NetWorker
Data Domain devices.
After a device has been created with the wizard, its configuration may be modified, if
required, by using the individual NMC property windows:
◆ “Creating NetWorker Data Domain devices with the wizard” on page 48
◆ “Configuring NetWorker Data Domain devices with the property windows” on
page 50.
Note: You may click a link in the wizard steps panel to go directly to the page you want to
modify. The number of steps may vary according to the type of configuration chosen.
Note: Only one Data Domain OST username and password may be defined. All
NetWorker storage nodes and servers that access the Data Domain system must use
the same username and password. “Configure the Data Domain system for
NetWorker” on page 46 provides details on setting the OST username.
44 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Software Configuration
Note: All NetWorker Data Domain devices are located under the /backup/ost tree
on the Data Domain system. This folder structure is used by all NetWorker
datazones and should not be changed or modified. Any folder created at this level
can be defined as a device and any subfolder under this level should not be used as
a device.
The new folder (Data Domain storage unit) appears in the folder tree. The
NetWorker Device Name acquires the name of the hostname of the Data
Domain system, which may be modified if desired. The Storage Unit field
acquires the name of the new folder and cannot be changed.
By default, the NetWorker Device Name is in the format:
<Data Domain system hostname>_<Storage Unit name>
For example:
dd160-1.emc.com_DataDomainStorageUnit
“Host naming guidelines” on page 25 provides guidelines for creating
names.
e. Configure Pool Information
– Ensure Configure Media Pools for Devices is selected.
– Specify the pool that will target clients to the devices, either Backup for
backups or Backup Clone for cloning or staging operations, or create a
new pool.
Note: Storage nodes on AIX, HP-UX, Solaris AMD64, and all Itanium based operating
systems do not support Data Domain devices.
6. Verify that the device is labelled and mounted, ready for use. The NMC Devices
view should list the device with its appropriate Volume Name. Figure 9 on
page 50 shows an example.
44 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Software Configuration
Note: If you manually try to create a device with this procedure, NMC will list the device but
no corresponding storage unit will be created on the Data Domain system. If you try to label
such a device, an error results. “Configure the Data Domain system for NetWorker” on page 46
provides an optional step to manually create a storage unit on the Data Domain system.
4. In the Identity section, configure the NetWorker Data Domain device (storage
unit) pathname and the Data Domain hostname. The device may be configured
on a remote storage node. For example:
Storage node hostname = SN1
Data Domain hostname = dd6600-4
Data Domain device = deep4-1
Storage unit pathname (DD OS 4.9) = /backup/ost/su3
Note: To modify an existing device, both the read-write and read-only components of the
device must be unmounted or an error results. To show or hide the read-only components,
in the NetWorker Administration application, Devices view, click
View > Display read-only devices and volumes.
Note: The storage_unit_name value should not include /backup/ost (DD OS 4.9). All
NetWorker Data Domain devices are located under these trees on the respective Data
Domain systems. This folder structure is used by all NetWorker datazones and should
not be changed or modified.
44 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Software Configuration
c. In the Media type attribute, select Data Domain from the list.
Note: Each Data Domain system NIC that is used as device with the Media type
attribute set to Data Domain will require a Data Domain Storage System Enabler.
“License requirements” on page 16 provides details.
5. Do not select Auto media management. Only one volume is used and this
attribute, which pertains to tape volumes, does not apply to NetWorker Data
Domain devices.
6. In the Remote user and Password attributes, type the Data Domain OST
username and password, respectively. This allows NetWorker interfaces to
connect to the Data Domain interface.
Only one OST user may be defined. All NetWorker storage nodes and servers that
access the Data Domain system must use the same username and password
7. On the Configuration tab, set the number of concurrent save or clone streams
(sessions) the device may handle:
• Target sessions are the number of sessions that the NetWorker storage node
may send to this device before the storage node looks for another available
device. It is your preferred setting and is not a limit. This should be set to a low
value for best performance. The default setting is 1.
• Max sessions may be set to a maximum value of 10. The default setting is 4.
8. On the Advanced tab, ensure that common device interface (CDI) is set to Not
used with No reserver release. This setting pertains to tape volumes and does not
apply to NetWorker Data Domain devices.
9. Click OK to save the device settings.
The NetWorker Administration window displays the Data Domain system and
details of the device. Figure 11 on page 53 lists devices on the selected Data
Domain system.
10. Ensure that the device is labeled and mounted before attempting to use it,
otherwise an error results. “Label and mount devices on the storage node” on
page 56 provides details.
Note: The Device Wizard automatically creates a label template for the volumes and this
procedure does not apply if the wizard is used.
A label template defines the components of a volume label. All the volumes in the
same pool will have the same label name (for example, “DD_zmedia”) but different
volume numbers (for example, .001–.003).
For example, a Data Domain system may have three devices, each of which is
mounted with a storage volume (Volume Name). If each device/volume is associated
with the same pool, the Volume Names would be as follows:
◆ DD_zmedia.001
◆ DD_zmedia.002
◆ DD_zmedia.003
To create a volume label:
1. From the NetWorker Administration window, click Media.
2. In the browser tree, select Label Templates, and from the File menu, click New to
open the Create Label Template window.
3. In the Name and Comment attributes, type a name and description for the label
template. The label will associate a storage pool to a device.
4. In the Fields attribute, type components of the label. Place each label component
on a separate line. The template must include at least one volume number range
component. The label template will be applied to the volumes mounted on
NetWorker Data Domain devices in a Data Domain system.
For example:
DD_zmedia
001-999
“Host naming guidelines” on page 25 provides guidelines for creating names.
5. Select a Separator and click OK.
6. In the Next attribute, specify the next Volume Label in the sequence to be to be
applied during the next label and mount operation. For example,
DD_zmedia.001.
7. Click OK.
44 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Software Configuration
the device. The Volume Name implicitly associates the volume and the device with
the specified pool.
Note: Dynamic Drive sharing (DDS) is not supported for NetWorker Data Domain devices.
• Select only NetWorker Data Domain storage devices for the pool. Do not mix
with other types of storage devices. The pool Selection Criteria may also
include client attributes that need to be removed or updated.
Note: If you modify an existing pool in this step, ensure that the pool excludes all
devices that are not NetWorker Data Domain devices.
44 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Software Configuration
Note: If you want to redirect existing client backups to new NetWorker Data Domain devices,
“Redirecting backups to the new devices” on page 36 provides details.
To create or modify a client and its scheduled backup with the wizard:
1. In the NMC Enterprise view, select the NetWorker server name, and double-click
the NetWorker managed application to launch it.
2. In the Configuration view, under the NetWorker server name, right-click Clients
and select Client Backup Configuration > New.
3. Follow the instructions on the wizard pages:
• Show the Client Name.
• Specify the Backup Configuration Type.
• Specify the Backup Options:
– In the Deduplication settings, select Data Domain Backup.
– Set Target Pool to a media pool that is associated with Data Domain
devices. This setting ensures that the client data will be backed up to
NetWorker Data Domain devices. “Create pools to target NetWorker Data
Domain devices” on page 54 provides details.
Note: For some older environments, these settings should not be used. “Backup
fails for older NetWorker application modules” on page 81 provides details.
a. In the Name attribute, type the hostname for the client and, optionally, type a
comment in the Comment attribute.
b. Select values for Browse Policy and Retention Policy:
– The browse policy determines how long the details of individual
backed-up files are maintained in a browsable index for quick recovery
through the GUI or command line.
– The retention policy determines how long backed-up data is protected and
available for recovery even though the browse policy has lapsed. Recovery
might require rebuilding an index.
c. Select the Scheduled Backups checkbox.
d. In the Save Sets attribute, click the Browse button to open the Choose
Directory window. Browse to and select all the directories or individual files
to be backed up. When finished selecting, click OK.
Each item should appear on a separate line. For example:
accounting
sales
To back up all client data, type All in the Save Sets attribute.
Note: For Microsoft Windows systems, the SYSTEM or Volume Shadow Copy Service
(VSS) SYSTEM save sets should be backed up on a regular basis for disaster recovery of
the client system.
The EMC NetWorker Administration Guide provides details for this step.
5. In the Group attribute, select a backup group. A backup group consists of clients
that are backed up according to the schedule for the group.
This attribute may show groups pre-selected based on the pool selected. It is
recommended to not separate groups from their associated pools at the client
level.
Note: Groups that are specifically devoted to deduplication backups help you monitor
deduplication operations and configure backup schedules for either deduplication or
traditional storage.
6. In the Pool attribute, select a pool that targets the NetWorker Data Domain
devices you want to use. The pool selected in this attribute overrides any other
pool that might be configured for the client or its save sets.
Note: For some older environments, this setting should not be used. “Backup fails for older
NetWorker application modules” on page 81 provides details.
7. (Optional) A Data Domain backup applies only to the save sets (the data portion
of backups), and does not back up the NetWorker server’s bootstrap and index
files to a Data Domain device. Normally, the bootstrap and index files are backed
up to a traditional disk or tape device that is locally attached to the NetWorker
server.
If you want to back up the bootstrap and index files to a NetWorker Data Domain
device, create a Pool resource specifically for them. In the pool’s Save Sets
attribute, specify the following:
bootstrap*
index*
44 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Software Configuration
Note: For some older environments, this setting should not be used. “Backup fails for older
NetWorker application modules” on page 81 provides details.
44 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
5
Cloning and
Replicating Data
Datazone requirement
A clone of stored data may not be created in a different NetWorker datazone. For the
NetWorker server to manage and monitor clone operations, the storage nodes at both
the source and target locations must be clients of the same NetWorker server. The
NetWorker server maintains browse and retention policies for all cloned copies and
can monitor and report on their storage operations.
Clone pool
In order for the NetWorker software to copy save sets from one device to another, a
special pool must be created. This pool, known as a “clone pool,” is assigned to
devices on the target system. It must be properly configured and available for use.
“Create pools to target NetWorker Data Domain devices” on page 54 provides
details. The EMC NetWorker Administration Guide provides additional details.
Note: If Data Domain replication is used for other (non-DD Boost directories) on the same
system, ensure that there is adequate network load and bandwidth capacity such that
NetWorker clone-controlled replication operations will not be impaired.
62 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Cloning and Replicating Data
IMPORTANT
If collection replication is performed, the Data Domain devices on the target
system become read-only and NMC and NetWorker will not be aware of any
DD Boost devices on the target system. NetWorker awareness and recovery
from the target Data Domain system would require further procedures, testing,
and qualifications to be performed. EMC Professional services are strongly
recommended.
Clone reports
NetWorker Data Domain clone operation reports can be viewed in the NMC Reports
view.
“Backup and clone reports” on page 75 provides details.
Clone formats
Copies of data stored on a NetWorker Data Domain device may be created by the
NetWorker clone process. The type of clone produced depends on the type of media
on which the clone copy will be stored, whether a clone-controlled replication or a
regular clone.
Note: A NetWorker Data Domain device that is used to store clone-controlled replications
should not also be used to store normal backups.
Clone formats 63
Cloning and Replicating Data
Clone methods
NetWorker clone operations may be configured by several methods, which are
suitable to different environment and storage needs. In some cases it may be
necessary to use multiple or mixed approaches in order to achieve the desired control
and flexibility.
As choices, you can configure clone operations to be run by automatic start
(auto-clone), by a schedule, or by a customized script.
Immediate clone
Also known as “auto-clone.” Save sets can be automatically cloned when the backup
group that contains them is completed. This clone method is suitable for smaller
environments, or a small number of clients, where the clone operations need to be
completed quickly and immediately within the backup window:
1. In the NetWorker Administration window, select Configuration.
2. Create a Group resource and specify the Clones option and Clone pool.
“Create pools to target NetWorker Data Domain devices” on page 54 provides details
on creating a clone pool.
Scheduled clone
NetWorker scheduled clone operations can be configured and run in NMC according
to a schedule for predetermined clients, pools, savesets, and devices. This method is
suitable for environments where copies of save sets need to be regularly provided,
typically as part of a well-defined maintenance cloning window, which runs
independently of the main backup operation.
“Scheduling a clone operation” on page 67 provides details.
nsrclone command
A NetWorker nsrclone script can be created and used to run clone operations and be
launched either manually or as a scheduled task run from the operating system or an
external scheduler. This method is typically used in larger environments where
flexibility and conditional controls are required.
One example would be to start Clone Job B, which clones to tape storage, if and only
if Clone Job A successfully completes. Another example would be to select multiple
specific save sets to be cloned to specific devices or storage nodes.
Scripted solutions require additional knowledge and have external dependencies,
such as operating system, scripting tool, and so forth.
The EMC NetWorker Administration Guide and the EMC NetWorker Command Reference
Guide provides details. EMC Professional Services are also available.
Clone requirements
To clone data from one Data Domain device to another by NetWorker
clone-controlled replication (optimized cloning), ensure that the following
64 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Cloning and Replicating Data
requirements are met. These requirements assume the previous creation of a clone
target pool, for example, named newclonepool:
1. Ensure that both the source and target storage nodes are clients of the same
NetWorker server.
2. Ensure that the Data Domain systems are properly licensed, including a
Replication license, which is required to create optimized clones.
“Configure the Data Domain system for NetWorker” on page 46 provides details.
3. Ensure that the Client resource for the NetWorker server and both storage nodes
specify, in their Aliases attribute (Globals 1 of 2 tab), all of their names in use
(fully qualified name, short name, aliases, and IP address).
Note: If a nsrclone command or script is used to perform an optimized clone from a host
that is not the NetWorker server, then this command must specify the NetWorker server by
its primary hostname (as listed in the NMC Enterprise view). Otherwise, a regular clone
might be produced instead of an optimized clone.
4. Ensure that a target pool (for example, newclonepool) has been created for Backup
Clone type with the Media type required attribute set to Data Domain.
With this setting, if a Data Domain device is not available for a clone operation in
the specified target pool, then NMC displays a “Media waiting” message.
Note: The Default Clone pool does not allow any modification and Media type required
cannot be set in that pool. The use of the default clone pool is not recommended.
Clone requirements 65
Cloning and Replicating Data
• For immediate clone operations for a group, in the Clone pool attribute of the
Group resource, select newclonepool.
• For clones of entire volumes, “Cloning by pools” on page 69 provides details.
66 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Cloning and Replicating Data
Note: Do not set the Storage node to WITE save sets or the Storage node to READ save
sets attributes. NetWorker Data Domain devices cannot be shared among storage nodes.
7. To skip invalid save sets, select Continue on save set error. If not selected (default
setting), an invalid save set will stop the clone operation and generate an error
message.
8. The Limit number of save set clones attribute has a default value of 1. This
allows only one clone to be made to the target pool for each save set.
This setting of 1 is useful, for example, if you need to manually restart an
interrupted clone operation, and you want to produce only the missed clones but
do not want to reproduce clones that were already successful.
This attribute limits the number of clones of each save set that may be produced
in the clone pool for a scheduled clone operation. A zero (0) setting allows an
unlimited number of duplicate clones.
Note: The NetWorker software allows only one unique save set clone to be stored on a
single volume. If multiple clones of the same save set are created, each will be stored on a
different volume in the pool.
9. Configure the schedule for the clone operation. Figure 12 on page 68 shows the
settings for a schedule.
Typically, to reduce the use of resources, you would schedule clone operations to
be performed after the backup window has completed:
a. Select Enable to enable the clone operation to run at its scheduled times.
b. In the Start Time attribute, click the spin arrows, or type values, to set the start
time.
c. Select either Weekly by day or Monthly by day to display either a calendar
week or a calendar month. In the calendar, select the days on which you want
the clone operation to run.
d. To repeat the clone operation within a day, specify an Interval time in hours.
For example, if the start time is 6 a.m., and the interval is 6 hours, then the
clone operation will run at 6 a.m., 12 p.m., and 6 p.m.
If the Limit the number of save set clones value is set, then the repeat clone
operation will fail after the limit is reached.
10. Select the Save Set Filters tab and specify the source save sets to include in your
scheduled clone operation.
There are two main options as follows:
• Select Clone save sets that match selections and limit the save sets to be
cloned by specifying the following details:
– save groups
– NetWorker clients
– pools
– save set levels
– save set name, as specified in the NetWorker Client resource
– save sets from the past number of days, weeks, months, or years
• Select Clone specific save sets and type the names of the source save sets to be
cloned, either by save set ID (ssid) or by clone ID (clonid). Use a separate line
for each save set name.
To find save set and clone IDs, in the NetWorker Administration window,
click Media, select Save Sets in the browser tree, and specify values for your
search. Alternatively, you may use the NetWorker mminfo command. The
EMC NetWorker Administration Guide provides details.
11. Click Preview Save Set Selection to review save set filter settings.
68 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Cloning and Replicating Data
Cloning by pools
In order to copy save sets from Data Domain storage to a device, a special pool may
be specified. This pool is know as a “clone pool.” A clone pool must be assigned to a
device on the target Data Domain system, where it will be available for use. There are
two main purposes for a clone pool:
◆ To copy existing deduplicated VTL or CIFS/NFS AFTD save sets to a NetWorker
Data Domain device.
◆ To copy the existing save sets from one NetWorker Data Domain device to
another NetWorker Data Domain device, typically at a remote location for
disaster recovery purposes.
Note: Selection of the volumes, pools, or save sets for a clone operation must ensure that all
appropriate save sets are identified and successfully cloned. Failure to clone the entire backup
set may result in a failure to perform a recovery from that clone copy. Expiration or deletion of
the primary save sets should be performed only when you are confident that all save sets have
been successfully cloned.
Cloning by pools 69
Cloning and Replicating Data
70 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
6
Monitoring,
Reporting, and
Troubleshooting
Note: On NMC servers with HP-UX operating systems, status monitoring (SNMP) in the
Enterprise view is supported, but event monitoring (SNMPTRAP) in the Events view is not
supported.
To configure NMC to monitor Data Domain backup status and events (SNMP traps):
1. Provided you have viewing privileges, the NMC Enterprise view should list the
Data Domain systems as network hosts. “Add a host Data Domain system to
NMC Enterprise view” on page 50 provides details.
2. Ensure that SNMP is enabled on the Data Domain system and Data Domain
system is configured to send traps to NMC server. “Configure the Data Domain
system for NetWorker” on page 46 provides details.
3. In the NMC Enterprise view left panel, right-click the Data Domain system to be
monitored and select Properties. The Properties window opens.
4. On the Manage Data Domain tab, select Capture Events.
If the box is not checked, NMC will monitor the status of the NetWorker Data
Domain devices, but will not monitor Data Domain SNMP traps, required to
monitor event.
5. On the Configure SNMP monitoring tab, type a value for SNMP Community
String. The typical setting is “public,” which allows all users to monitor events.
Figure 13 on page 73 shows an example.
6. Type a value for the SNMP Process Port. The default value is 162. This setting
should agree with the firewall setting on the Data Domain system. “Firewall
requirements” on page 28 provides details.
7. Select the appropriate SNMP Traps that you want to monitor. Some traps are
pre-selected. Figure 13 on page 73 shows an example for Data Domain 4.8 alerts.
Other versions may differ.
8. Click OK.
72 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Monitoring, Reporting, and Troubleshooting
• /ddvar indicates log file space used on the Data Domain file system.
• Compression (Reduction), which is represented by two values:
– Pre-Compression ÷ Post-comp Used
– (1 - Post-comp Used) ÷ Pre-Compression) x 100%
74 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Monitoring, Reporting, and Troubleshooting
Configure a report
To configure and display a Data Domain backup or clone report:
1. From the NetWorker Management Console window, click Reports.
2. Expand the Reports folder, expand the Data Domain Statistics folder, and then
select a summary or statement report type to view.
The Configure tab for the selected report type appears in the right panel.
3. In the Configure tab, customize the items that you want to include in the report
‹
by selecting the item parameters and clicking the Remove ( ), Add ( ), Remove ›
« »
All ( ), or Add All ( ) buttons as required.
If Save Time values are not specified, the report will display all the available data.
Table 1 on page 75 lists details of report configuration parameters. The specific
parameters available depend on the type of report selected.
Figure 15 on page 76 shows an example report configuration.
4. To display the report, select the View Report tab.
Server Name Selects managed hosts within the enterprise. Selected server names
Save Set Name Selects one or more save sets. Values are Selected save set names
case-sensitive and wild cards cannot be used.
Save Time Limits the report to a specified time range. Save time (range)
View a report
Backup reports are available in various formats. Most are basic reports. The Backup
Summary and Monthly Client Statement are drill-down reports:
◆ Figure 16 on page 77 shows an example save set summary report.
◆ Figure 17 on page 78 shows an example save set details report.
◆ “Basic reports” on page 78 describes details of basic reports.
◆ “Table 2 on page 78 describes the basic reports available for Data Domain.” on
page 78 describes details of drill-down reports.
◆ “Advanced Reporting” on page 79 describes advanced reporting functionality
with the optional EMC Data Protection Advisor (DPA).
◆ For clone operations, there is no specific report. You can query and list the copies
of save sets in the NetWorker Administration, Media view, under Save sets.
76 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Monitoring, Reporting, and Troubleshooting
Basic reports
A basic report collects statistics for a specific datazone component, time span, or
attribute. You can modify the scope of a report by adjusting the parameters on the
Configure tab.
Table 2 on page 78 describes the basic reports available for Data Domain.
Client Summary For all or specified clients, provides the following statistics:
• Amount of data: The amount of the data that would have been moved using
traditional NetWorker backup (protected data).
• Target size: Size of the data after deduplication has taken place on the Data
Domain System (stored data).
• Deduplication ratio: Percentage of savings by using Data Domain
deduplication.
• Number of Save Sets: The number of save sets included in the backup.
• Number of Files: The number of files included in the backup.
78 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Monitoring, Reporting, and Troubleshooting
Save Set Summary For all or specified save sets, provides deduplication statistics on the following:
• Amount of data: The amount of the data that would have been moved using
traditional NetWorker backup.
• Target size: Size of the data after deduplication has taken place on the Data
Domain System.
• Deduplication ratio: Percentage of savings by using deduplication.
• Number of Save Sets: The number of save sets included in the backup.
• Number of Files: The number of files included in the save set.
Save Set Details Displays details about each save set, including backup duration.
The Save Set Details report provides statistics on the following:
• Save Set ID
• Save time
• Backup level
• Save set size (protected data size)
• Target size: Size of the data after deduplication has taken place on the Data
Domain System (stored data size).
• Deduplication ratio: Percentage of savings by using deduplication.
• Number of Files: The number of files included in the save set.
Drill-down reports
A drill-down report consists of multiple basic reports, connected as layers and all
configured with the same parameters used in the top layer.
Reports can be run for groups, clients, or save sets. You can modify the scope of a
report by adjusting the parameters on the Configure tab.
Table 3 on page 79 lists the drill-down reports available for Data Domain Statistics.
Backup Summary Reports backup statistics over a period of time, 1. Client Summary
starting from client summary down to individual 2. Save Set Summary
save sets level. 3. Save Set Details
Advanced Reporting
NMC provides reports for only the recent backup history in a specific datazone. The
optional EMC Data Protection Advisor (DPA) software can provide extended reports
of backups, trends, and analysis for one or multiple datazones, including reports of
Data Domain systems. DPA is recommended for larger environments where
additional analysis with forecasts and trends are required.
Troubleshooting
Name resolutions, network connections, and high latency are common causes of
backup issues. The following sections will help you identify and resolve common
configuration issues.
Name resolution
If connectivity issues are present, ensure that the network names are valid and
consistent for the NetWorker server, the storage nodes, and the Data Domain
systems. Use the same names that are used within the NetWorker software
configuration.
Validate connections in both directions for both IP address and network names. If you
use short names or aliases, then these should also be verified. Correct improper
names by amending DNS entries or by populating the local hosts files.
◆ Use the NetWorker nslookup command to verify that network names resolve to
the appropriate IP address on storage nodes and servers.
◆ On the Data Domain system, you may use the net hosts command.
“Host naming guidelines” on page 25 provides suggestions for names.
Network connections
Diagram and verify all relevant network connections. A typical Data Domain
network configuration should provide a minimum of two network connections, one
of which is dedicated to administration and the other for backup data only. Although
this is not a firm requirement, it is strongly recommended as a best practice. Make
effective use of 10 GbE connectivity or multiple backup connections that are
aggregated or “teamed” by using the ifgroup command on the Data Domain system.
The Data Domain system can be tested by using the net lookup command through an
SSH telnet session, which requires sysadmin or administrator permissions. The Data
Domain system can also show the current network configuration by using the net
show and other network related commands, available through the Data Domain
interface (http://DDR_IP_ADDRESS). Log in and go to the specific Data Domain
system. Then select the Hardware > Network tabs to access the commands.
“Network connectivity and firewall” on page 27 provides suggestions for network
connections.
80 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Monitoring, Reporting, and Troubleshooting
Troubleshooting 81
Monitoring, Reporting, and Troubleshooting
• Operations tab:
– Volume Name
– Volume Pool
4. Remove the original NetWorker Data Domain devices from the NetWorker
application. The devices (storage units) will continue to exist on the Data Domain
system:
a. In the Devices view, Devices tree, right-click and unmount each affected
device that is mounted. Mounted devices have a Volume Name.
b. In the Media view, Media Pool tree, right-click each affected Media Pool
(Volume Pool), select Properties, and on the Selection Criteria tab, remove
each affected device from the Target Devices list.
c. In the Devices view, Devices tree, right-click and delete each affected device.
5. Re-create the devices on the NetWorker application associated with a replacement
storage node:
a. In the Devices view, right-click the Data Domain systems tree and run the
New Device Wizard.
b. Specify the Data Domain system and OST credentials to gain access the
system.
c. On the Select Folders to use as Devices page, select the NetWorker Data
Domain devices (storage units, which appear as folders) that were associated
with the failed storage node.
When you leave this page, a message box notifies you that the devices were
previously associated with a different storage node. Confirm your selection.
d. On the Configure Pool Information page, specify the media pool for the
devices and unselect the Label and Mount option. The devices must be
manually mounted on the new storage node later in this procedure.
IMPORTANT
Ensure the Label and Mount check box is not selected. If the volume is
re-labeled all the data will be lost. This action cannot be undone.
e. On the Select the Storage Nodes page, select a storage node to handle the new
devices by doing one of the following:
– Select an existing storage node
– Create a replacement storage node
– Use the NetWorker server itself, which will handle the devices
The storage node must be running on the appropriate network and its
hostname must be resolvable by DNS.
f. Complete the wizard.
6. Manually mount each new device:
a. From the NetWorker Administration window, click Devices.
b. Click View > Display read-only devices and volumes to unhide the
associated read-only devices.
c. In the navigation tree, select the Data Domain system.
82 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Monitoring, Reporting, and Troubleshooting
d. In the right panel, right-click each device and each corresponding read-only
(RO) device to be mounted, and select Mount.
The device mounts on the storage node and will use the label associated with the
pool you have specified.
7. Review the NMC log for any error messages.
If no errors are reported from this procedure, then the device and its volume should
be available for use. Backup and recovery operations may require further
configuration depending on the original settings and the purpose of the device
recovery.
Troubleshooting 83
Monitoring, Reporting, and Troubleshooting
84 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Glossary
A
administrator Person who normally installs, configures, and maintains software on network
computers, and who adds users and defines user privileges.
AFTD (advanced file Disk storage device that uses a volume manager to enable multiple concurrent
type device) backup and recovery operations and dynamically extend available disk space.
B
backup 1. Duplicate of database or application data, or entire computer system, stored
separately from the original, which can be used to recover the original if it is
destroyed or damaged.
2. Operation that saves data to a volume for use as a backup.
bootstrap Save set that is essential for NetWorker disaster recovery procedures with the
NetWorker server. The bootstrap consists of three components that reside on the
NetWorker server: the media database, the resource database, and a server index.
browse policy NetWorker policy that specifies the period of time during which backup entries are
retained in the client file index. The index makes the associated backed-up data
readily accessible for recovery by desktop users. See “retention policy.”
C
client Computer, workstation, or fileserver whose data can be backed up and restored with
NetWorker software.
client file index Database maintained by the NetWorker server that tracks every database object, file,
or file system backed up. The NetWorker server maintains a single index file for each
EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide 85
Glossary
client computer. The tracking information is purged from the index after the browse
time of each backup expires.
Client resource NetWorker server resource that identifies the save sets to be backed up on a client.
The Client resource also specifies information about the backup, such as the schedule,
browse policy, and retention policy for the save sets.
clone Duplicate copy of backed-up data, which is indexed and tracked by the NetWorker
server. Single save sets or entire volumes can be cloned.
clone-controlled Creation of a replica of deduplicated data copied from one NetWorker Data Domain
replication device to another, which can be scheduled by the NMC clone feature and is indexed
and tracked by the NetWorker server.
clone volume Exact duplicate of a backup or archive volume. NetWorker software can track four
types of volumes (backup, archive, backup clone, and archive clone). Save sets of
these different types may not be intermixed on one volume. Clone volumes may be
used in exactly the same way as the original backup or archive volume.
D
database 1. A collection of data arranged for ease and speed of update, search, and retrieval by
computer software.
2. An instance of a database management system (DBMS), which in a simple case
might be a single file containing many records, each of which contains the same set of
fields.
datazone Group of clients, storage devices, and storage nodes that are administered by a
NetWorker server.
DD Boost An optimized library and communication framework with a special Data Domain
API that allows the NetWorker software to define and interact with storage devices
on the Data Domain system.
deduplication Process of detecting and identifying the redundant variable-length blocks (data
segments) within a given set of data to eliminate redundancy.
deduplication Type of backup in which redundant data blocks are replaced by metadata pointers
backup and only unique blocks of data are stored. When the deduplicated data is restored,
the data is returned to its original native format.
deduplication ratio Reduction in storage space required to store data as a result of deduplication
technology, usually combined with data compression, for example, a 20:1 space
reduction.
device 1. Storage unit that can contain a backup volume. A storage unit can be a tape device,
optical drive, autochanger, or disk connected to the server or storage node.
2. Access path to the physical drive, when dynamic drive sharing (DDS) is enabled. 3.
General term that refers to storage hardware.
86 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Glossary
disaster recovery Recovery from any disruptive situation, such as hardware failure or software
corruption, in which ordinary data recovery procedures are not sufficient to restore a
system and its data to normal day-to-day operations.
distributed segment Part of the DD Boost interface, which enables data deduplication to be performed on
processing (DSP) a host before the data is sent to the Data Domain system for storage.
E
enabler code Special code that activates the software. The enabler code that unlocks the base
features for software is called a base enabler. Enabler codes for additional features or
products (for example, library support) are called add-on enablers.
G
group Client computer or group of clients that are configured to back up files during a
NetWorker scheduled backup, according to a single designated schedule or set of
conditions.
H
host Computer on a network.
L
label Electronic header on a volume used for identification by NetWorker or other data
mover application.
M
managed application Program that can be monitored or administered, or both from the Console server.
media Physical storage, such as magnetic tape, optical disk, or file system, to which backup
data is written. See also “volume.”
media index Database that contains indexed entries of storage volume location and the lifecycle
status of all data and volumes managed by the NetWorker server. Also known as
media database.
N
NetWorker Data A logical storage device created on a Data Domain server, which is used to store
Domain device deduplicated NetWorker backups. Each device appears as a folder on the Data
Domain system and is listed with a storage volume name in NMC.
NetWorker server Computer on a network that runs the NetWorker server software, contains the online
indexes, and provides backup and restore services to the clients and storage nodes on
the same network.
EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide 87
Glossary
NMC (NetWorker Software product that is used to manage NetWorker servers and clients. The NMC
Management server also provides reporting and monitoring capabilities for all NetWorker
Console) processes.
notification Message sent to the NetWorker administrator about important NetWorker events.
O
online indexes Databases located on the NetWorker server that contain all the information
pertaining to the client backups (client file index) and backup volumes (media
database).
P
pathname Set of instructions to the operating system for accessing a file. An absolute pathname
indicates how to find a file starting from the root directory and working down the
directory tree. A relative pathname indicates how to find a file starting from the
current location.
policy Set of constraints that specify how long the save sets for a client are available for
recovery. Each NetWorker client has a browse policy and a retention policy. When the
browse policy expires, the save sets associated with that policy are no longer readily
available for browsing in an index. When the retention policy expires, the save sets
associated with that policy are marked recyclable.
pool 1. NetWorker feature that assigns specific backup data to be stored on selected media
volumes.
2. Collection of NetWorker backup volumes to which specific data has been backed
up.
R
recover To restore data files from a backup volume to a client disk and apply transactional
(redo) logs to the data to make it consistent with a given point in time.
remote device 1. Storage device that is attached to a storage node that is separate from the
NetWorker server.
2. Storage device located at an offsite location that stores a copy of data from a
primary storage device for disaster recovery.
replication Process of creating an exact copy of an object or data. Examples in this guide include
NetWorker clone-controlled replication and Data Domain collection replication.
resource Software component that describes details of the NetWorker server or its clients.
Clients, devices, schedules, groups, and policies are all NetWorker resources. Each
resource has configurable attributes that define its properties.
restore To retrieve individual data files from backup media and copy the files to disk,
without applying transaction logs. See also “recover.”
88 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Glossary
retention policy NetWorker setting that determines the minimum period of time that backup data is
retained on a volume available for recovery. Once this time is exceeded, the data is
eligible to be overwritten. See also “browse policy.”
S
save NetWorker command that backs up client files to backup media volumes and makes
data entries in the online index.
save set Group of files or a file system that has been backed up on storage media by using
NetWorker software.
save stream Data and save set information that is written to a storage volume during a backup. A
save stream originates from a single save set.
scheduled backup Type of backup that is configured to start automatically at a specified time for a group
of one or more NetWorker clients. A scheduled backup generates a bootstrap save set.
storage node Computer with NetWorker software installed whose primary purpose is to receive a
backup stream from one or more backup clients and then write to save sets on storage
media.
T
trap Unsolicited notification sent from the SNMP agent to the network manager’s SNMP
event manager.
V
volume 1. Unit of physical storage medium, such as a magnetic tape, optical disk, or file
system used to store data. Backup data must be stored on a backup volume and
cannot be stored on an archive volume or a clone volume.
2. Identifiable unit of data storage that may reside on one or more computer disks.
volume ID (volid) Internal identification that NetWorker software assigns to a backup volume.
volume name Name that you assign to a backup volume when it is labeled. See also “label.”
VTL Virtual tape library. Software emulation of a physical tape library storage system.
EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide 89
Glossary
90 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Index
A D
Add New Host Wizard 50 daily summary report 79
AFTD disk configurations 23, 43 Data Domain
authorization code 16 backup attribute 37, 57, 59
Device Type Capacity Entitlement Enabler 17
replication 38, 62
B
Retention Lock not supported 23
backup failure
server 17
older NetWorker application modules 81
Data Protection Advisor 79
backup, redirect 36
DD Boost
bootstrap 58
enabling 47
feature 15
C license 17
cascaded replication configuraiton 30 DD format 63
CIFS formats 23, 43 dedicated storage nodes 33
cleaning storage space 23 deduplication
client feature 15
configuration wizard 56 ratio 24
non-wizard configuration 57 devices
clone creating 48
auto 64 mounting 56
by pool 69 non-wizard configuration 51
feature 62 number of 22
immediate 64 removal 24
manually started 70 renaming 24
native non-deduplicated 63 disaster recovery configuation 28
nsrclone 64 distributed segment processing 15, 47
pool 62 dynamic drive sharing 55
regular 63
requirements 62, 64 E
scheduled 64, 67
encryption not supported 23
clone-controlled replication
evaluation period 16
cascade configuration 30
feature 15
for disaster recovery 28 F
process 63 filesys clean command 24
scheduling 67 filesys show space command 23
shared datazones 31 firewall requirements 28
with shared storage nodes 33 full device 24
compression not supported 23
configuring
I
Data Domain for NetWorker 46
ifgroup
NetWorker for Data Domain 47
licensing useage 17
EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide 91
Index
92 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide
Index
V
version requirements 16
virtual tape libraries 23, 43
volume name 54
Volume Shadow Copy Service 58
W
wizard
Add New Host 50
Client Configuration 56
New Device 48
EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide 93
Index
94 EMC NetWorker and EMC Data Domain Deduplication Devices 7.6 Service Pack 1 Integration Guide