NetBackup™ for Hadoop Administrator's Guide
- Introduction
- Prerequisites and best practices for the NetBackup for Hadoop plug-in for NetBackup
- Configuring NetBackup for Hadoop
- About configuring NetBackup for NetBackup for Hadoop
- Managing backup hosts
- Adding NetBackup for Hadoop credentials in NetBackup
- Configuring the NetBackup for Hadoop plug-in using the NetBackup for Hadoop configuration file
- Configuring NetBackup for a highly-available NetBackup for Hadoop cluster
- Configuring a custom port for the NetBackup for Hadoop cluster
- Configuring number of threads for backup hosts
- Configuring number of streams for backup hosts
- Configuring distribution algorithm and golden ratio for backup hosts
- Configuring communication between NetBackup and Hadoop clusters that are SSL-enabled (HTTPS)
- Configuration for a NetBackup for Hadoop cluster that uses Kerberos
- Hadoop.conf configuration for parallel restore
- Create a BigData policy for Hadoop clusters
- Disaster recovery of a NetBackup for Hadoop cluster
- Performing backups and restores of Hadoop
- Troubleshooting
- About troubleshooting NetBackup for NetBackup for Hadoop issues
- About NetBackup for Hadoop debug logging
- Troubleshooting backup issues for NetBackup for Hadoop data
- Backup operation fails with error 6609
- Backup operation failed with error 6618
- Backup operation fails with error 6647
- Extended attributes (xattrs) and Access Control Lists (ACLs) are not backed up or restored for Hadoop
- Backup operation fails with error 6654
- Backup operation fails with bpbrm error 8857
- Backup operation fails with error 6617
- Backup operation fails with error 6616
- Backup operation fails with error 84
- NetBackup configuration and certificate files do not persist after the container-based NetBackup appliance restarts
- Unable to see incremental backup images during restore even though the images are seen in the backup image selection
- One of the child backup jobs goes in a queued state
- Troubleshooting restore issues for NetBackup for Hadoop data
- Restore fails with error code 2850
- NetBackup restore job for NetBackup for Hadoop completes partially
- Extended attributes (xattrs) and Access Control Lists (ACLs) are not backed up or restored for Hadoop
- Restore operation fails when Hadoop plug-in files are missing on the backup host
- Restore fails with bpbrm error 54932
- Restore operation fails with bpbrm error 21296
- Hadoop with Kerberos restore job fails with error 2850
- Configuration file is not recovered after a disaster recovery
Best practices for deploying the NetBackup for Hadoop plug-in
Consider the following when you deploy NetBackup for Hadoop plug-in and configure NetBackup for NetBackup for Hadoop:
Use consistent conventions for hostnames of backup hosts, media servers, and primary server. For example, if you are using the host name as hadoop.veritas.com (FQDN format) use the same everywhere.
Add the entries of all the NameNodes and DataNodes to the
/etc/hostsfile on all the backup hosts. You must add the hostname in FQDN format.Or
Add the appropriate DNS entries in the
/etc/resolv.conffile.Always specify the NameNode and DataNodes in FQDN format.
Ping all the nodes (use FQDN) from the backup hosts.
Hostname and port of the NameNode must be the same as you have specified with the http address parameter in the
core-site.xmlof the NetBackup for Hadoop cluster.By cancelling a parent job in a compound restore job does not cancel the child restore job. You must manually cancel the child restore jobs.
Ensure the following for a Hadoop cluster that is enabled with SSL (HTTPS):
A valid certificate exists on the backup host that contains the public keys from all the nodes of the Hadoop cluster.
For a Hadoop cluster that uses CRL, ensure that the CRL is valid and not expired.
Ensure to have enough free ports on the media servers.
Avoid creating file or directory name with special characters % or ^ into the Hadoop Distributed File System (HDFS).