Showing posts with label NDMP. Show all posts
Showing posts with label NDMP. Show all posts

Tuesday, December 10, 2013

Networker Application Integration

VMWare Integration:
Can do guest or Image-based backup (VADP).  When doing image backups, there is no need for LAN connectivity to the guests and is well suited to DR.  File-level backup/recover is supported on Windows only.  There is little impact on the host and guest.

When defining backup policies for guest-level backup, create backup groups with VMs across multiple ESX server to reduce load on individual hosts due to concurrent backup.  Reduce full backup frequency to decrease I/O and network traffic and use modules for apps and database.

When using VADP, backup processing is offloaded to a proxy and can be done any time if done on another host.  There is file-level recovery only for NTFS, and image recovery of a full VM from an incremental CBT is not possible.

Image-level backup requires a full backup after hardware change, OS patch or update, or driver updates.  CBT can be used on ESX4.0+ with virtual hardware 7.  One or more VADP proxy system is required (Windwos 2003-2008R2) and one or more vCenter server running a supported version (vSphere5-5.1, vCenter 4.0 or 4.1 managing ESXi 3.5-4.1 or VirtualCenter 2.5 with ESX 3.5).  Networker 7.62 SP2 or newer on VADP procy and vCenter and have access to all LUNs.


VADP does not support IPv6, so disable it on Windows 2008.   Set client parallelism on VADP proxy to max number of VM backups it will run concurrently, and keep the vCenter and VADP proxy as separate machines.  Make your VADP proxy a storage node for any transport mode.

If using SAN transport mode, have 500MB RAM for each VM backup to run concurrently.  Add proxies to increase throughput.  Max concurrent backup per proxy is 50, unless using DDBoost, when it is 100.

If using Hotadd transport mode, at least 4 vCPU and 8 GB vRAM per virtual proxy.  Client parallelism should not be set higher than 12, and no more than 5 virtual proxies on one standalone ESX server.  Datastore for VADP proxy must have sufficient free BEFORE hotadd backup begins.  Can not use hotadd backup for IDE virtual disks, you need to use ndb mode for these.  Host all proxies on a dedicated ESXi server, and if VMs have more than 12 disks attached per VM, do NOT use hotadd mode.

 Oracle Integration is possible with Networker.

RMAN channels are streams of data sent to a device or app like Networker.  RMAN Multiplexing is not the same as tap multiplexing, but is rather multiplexing into a specific RMAN channel.  FILESPERSET is the max number of files for a backup set, and MAXOPENFILES determines the max number of input files a backup can have open at one time.

Tune RMAN channels by using RMAN Multiplexing.  Increase the stream count to match the target device count.  Avoid tape multiplexing.  Keep FILESPERSET <= MAXOPENFILES and increase RMAN multiplexing if there is little no striping of datafiles across disk storage and decrease if datafiles are striped across many disks.

Exclude things that don't change, but never exclude system tables (Master DB, control files) and reduce database sized by archiving databases.  RMAN backup L1 will be differential by default unless specified to be cumulative.  L1 diff backs up all data since last L0 or L1, cumulative backs up all since last L0 or full.  On Oracle 10g or newer, CBT can be enabled to increase backup performance.

FOr M$ SQL databases, stripes are like RMAN channels in Oracle.  Networker stores each stripe as a different save set. 


NDMP is used for backing up NAS devices.  NDMP separates data path from control path to minimize network resource demand.  NDMP file history is metadata sent to Networker server, and it is processed at the end of the backup job.  This file history is read into a temp file and processed on disk in the form of a B-Tree.  At the end of the backup the B-Tree on disk is processed and indexes are generated and committed.  NDMP file history processing time is influenced by storage system factors such as RAID type, number of disks, cache size, etc.

During NDMP file history processing, /nsr/tmp is heavily used and the temp file isn't removed until after B-Tree file processing completes, meaning double the space is required during processing.  Failover in a clustered Networker environment will interrupt index processing and index generation would be incomplete, so file level recovery will not be possible without restarting.

Space for the /nsr/tmp can be calculated as 2*(144+average file name length)*# of files.  for a million files with an average filename length of 128 it would be 2*(144+128)*1,000,000 = 544 MB approximately.  The location of the tmp directory can also be changed using NSR_NDMP_TMP_DIR set in the application information window on client config.




AVamar Integration with NDMP

The Avamar NDMP accelerator supports VNX, Celerra, and NAS devices running Data ONTAP.  It supports NDMP version 4 over 100/1000 Mb/sec Ethernet and will work over a LAN or WAN.

A single NDMP accelerator appliance will support multiple storage devices and up to 8 simultaneous streams, performing real-time data dedupe.  Of course, there needs to be sufficient RAM and configuration on the accelerator.

 By default, NDMP backups contain all storage device accounting information and ACLs.  Only volumes are visible , and include/exclude lists are not supported.  When combined with VNX or Celerra, the NDMP accelerator performs incremental backup at the volume level only and defaults to full backup of sub-root directories.  Best practice is to not backup more than 10 million files in a single backup job, which can be overridden in the config but jobs may fail for lack of memory with too many files.

When backing up NetApp Filers, the NDMP accelerator is backward compatible to Avamar 4.1 servers, but version 5.0 or newer is recommended.  The appliance will backup and restore volumes, qtrees and directories, and SnapVault snapshots must be backed up in full. 

The NDMP accelerator will perform file level restores, as well as single directories and sub-directories, but data backed up on other Avamar client types are not restorable to a NAS - if it came from NDMP, it stays on NDMP and vice-versa.  There is no web restore with external authentication - users must have local authentication, and ACLs are fully supported, but there is no control for overwrite options.

Both LAN and WAN location of the NDMP device are supported, but it is recommended to have the accelerator local to the device being protected.   8 GB of memory is required in the appliance for multiple streams, and the recommendation is to have 4GB of memory per stream (8 streams max).

Multi-volume accounts will attempt to backup all volumes simultaneously, opening up to the possibility that there would be too many simultaneous streams.  It is best practice to combine all multi-volume accounts into one account and have a single multi-volume backup using the avsetupndmp script.