Veritas NetBackup™ Cloud Administrator's Guide

Last Published:
Product(s): NetBackup (9.0)
Platform: Linux,UNIX,Windows
  1. About NetBackup cloud storage
    1.  
      About cloud storage features and functionality
    2.  
      About the catalog backup of cloud configuration files
    3.  
      About support limitations for NetBackup cloud storage
  2. About the cloud storage
    1.  
      About the cloud storage vendors for NetBackup
    2. About the Amazon S3 cloud storage API type
      1.  
        Amazon S3 cloud storage vendors certified for NetBackup
      2.  
        Amazon S3 storage type requirements
      3.  
        Permissions required for Amazon S3 cloud provider user
      4.  
        Amazon S3 cloud storage provider options
      5.  
        Amazon S3 cloud storage options
      6.  
        Amazon S3 advanced server configuration options
      7.  
        Amazon S3 credentials broker details
      8.  
        About private clouds from Amazon S3-compatible cloud providers
      9.  
        About Amazon S3 storage classes
      10.  
        Amazon virtual private cloud support with NetBackup
      11. About protecting data in Amazon for long-term retention
        1. About protecting data in Amazon Glacier
          1.  
            About restoring data from Amazon Glacier
        2. About protecting data in Amazon Glacier vault
          1.  
            About backing up data to Amazon Glacier vault
          2.  
            About restoring data from Amazon Glacier vault
      12. Protecting data using Amazon's cloud tiering
        1.  
          About backing up data using LIFECYCLE storage class
        2.  
          About restoring data from LIFECYCLE storage class
      13. About using Amazon IAM roles with NetBackup
        1.  
          Configuring AWS IAM Role with NetBackup
      14.  
        About NetBackup character restrictions for Amazon S3 cloud connector
      15. Protecting data with Amazon Snowball and Amazon Snowball Edge
        1.  
          Configuring NetBackup for Amazon Snowball with Amazon Snowball client
        2.  
          Configuring NetBackup for Amazon Snowball with Amazon S3 API interface
        3.  
          Using multiple Amazon S3 adapters
        4.  
          Configuring NetBackup with Amazon Snowball Edge with file interface
        5.  
          Configuring NetBackup for Amazon Snowball Edge with S3 API interface
        6.  
          Configuring NetBackup for Amazon Snowball and Amazon Snowball Edge for NetBackup CloudCatalyst Appliance
        7.  
          Configuring SSL for Amazon Snowball and Amazon Snowball Edge
        8.  
          Post backup procedures if you have used S3 API interface
    3. About Microsoft Azure cloud storage API type
      1.  
        Microsoft Azure cloud storage vendors certified for NetBackup
      2.  
        Microsoft Azure storage type requirements
      3.  
        Microsoft Azure cloud storage provider options
      4.  
        Microsoft Azure advanced server configuration options
      5.  
        Protecting data in Microsoft Azure Archive for long-term retention
    4. About OpenStack Swift cloud storage API type
      1.  
        OpenStack Swift cloud storage vendors certified for NetBackup
      2.  
        OpenStack Swift storage type requirements
      3.  
        OpenStack Swift cloud storage provider options
      4.  
        OpenStack Swift storage region options
      5.  
        OpenStack Swift add cloud storage configuration options
      6.  
        OpenStack Swift proxy settings
  3. Configuring cloud storage in NetBackup
    1.  
      Before you begin to configure cloud storage in NetBackup
    2.  
      Configuring cloud storage in NetBackup
    3.  
      Cloud installation requirements
    4. Scalable Storage properties
      1.  
        Configuring advanced bandwidth throttling settings
      2.  
        Advanced bandwidth throttling settings
    5. Cloud Storage properties
      1.  
        Adding a cloud storage instance
      2.  
        Changing cloud storage host properties
      3.  
        Deleting a cloud storage host instance
    6. About the NetBackup CloudStore Service Container
      1.  
        NetBackup CloudStore Service Container security certificates
      2.  
        NetBackup CloudStore Service Container security modes
      3.  
        NetBackup cloudstore.conf configuration file
    7.  
      Deploying host name-based certificates
    8.  
      Deploying host ID-based certificates
    9.  
      About data compression for cloud backups
    10.  
      About data encryption for cloud storage
    11.  
      About NetBackup KMS for encryption of NetBackup cloud storage
    12.  
      About external KMS for encryption of NetBackup cloud storage
    13.  
      About cloud storage servers
    14.  
      About object size for cloud storage
    15. About the NetBackup media servers for cloud storage
      1.  
        Using media server as NetBackup Cloud master host
    16. Configuring a storage server for cloud storage
      1.  
        KMS database encryption settings
      2.  
        Assigning a storage class to Amazon cloud storage
    17.  
      Changing cloud storage server properties
    18. NetBackup cloud storage server properties
      1.  
        NetBackup cloud storage server bandwidth throttling properties
      2.  
        NetBackup cloud storage server connection properties
      3.  
        NetBackup CloudCatalyst storage server properties
      4.  
        NetBackup cloud storage server encryption properties
    19.  
      About cloud storage disk pools
    20.  
      Configuring a disk pool for cloud storage
    21.  
      Saving a record of the KMS key names for NetBackup cloud storage encryption
    22.  
      Adding backup media servers to your cloud environment
    23. Configuring a storage unit for cloud storage
      1.  
        Cloud storage unit properties
      2.  
        Configure a favorable client-to-server ratio
      3.  
        Control backup traffic to the media servers
    24.  
      About NetBackup Accelerator and NetBackup Optimized Synthetic backups
    25.  
      Enabling NetBackup Accelerator with cloud storage
    26.  
      Enabling optimized synthetic backups with cloud storage
    27.  
      Creating a backup policy
    28. Changing cloud storage disk pool properties
      1.  
        Cloud storage disk pool properties
    29.  
      Certificate validation against Certificate Revocation List (CRL)
    30.  
      Managing Certification Authorities (CA) for NetBackup Cloud
  4. Monitoring and Reporting
    1.  
      About monitoring and reporting for cloud backups
    2.  
      Viewing cloud storage job details
    3.  
      Viewing the compression ratio
    4.  
      Viewing NetBackup cloud storage disk reports
    5.  
      Displaying KMS key information for cloud storage encryption
  5. Operational notes
    1.  
      NetBackup bpstsinfo command operational notes
    2.  
      Unable to configure additional media servers
    3.  
      Cloud configuration may fail if NetBackup Access Control is enabled
    4.  
      Deleting cloud storage server artifacts
    5.  
      Using csconfig reinitialize to load updated cloud configuration settings
    6.  
      Enabling or disabling communication between master server and legacy cloud storage media servers
  6. Troubleshooting
    1. About unified logging
      1.  
        About using the vxlogview command to view unified logs
      2.  
        Examples of using vxlogview to view unified logs
    2. About legacy logging
      1.  
        Creating NetBackup log file directories for cloud storage
    3.  
      NetBackup cloud storage log files
    4.  
      Enable libcurl logging
    5.  
      NetBackup Administration Console fails to open
    6. Troubleshooting cloud storage configuration issues
      1.  
        NetBackup Scalable Storage host properties unavailable
      2.  
        Connection to the NetBackup CloudStore Service Container fails
      3.  
        Cannot create a cloud storage disk pool
      4.  
        Cannot create a cloud storage
      5.  
        Data transfer to cloud storage server fails in the SSL mode
      6.  
        Amazon GovCloud cloud storage configuration fails in non-SSL mode
      7.  
        Data restore from the Google Nearline storage class may fail
      8.  
        Backups may fail for cloud storage configurations with Frankfurt region
      9.  
        Backups may fail for cloud storage configurations with the cloud compression option
      10.  
        Fetching storage regions fails with authentication version V2
    7. Troubleshooting cloud storage operational issues
      1.  
        Cloud storage backups fail
      2.  
        Stopping and starting the NetBackup CloudStore Service Container
      3.  
        A restart of the nbcssc (on legacy media servers), nbwmc, and nbsl processes reverts all cloudstore.conf settings
      4.  
        NetBackup CloudStore Service Container startup and shutdown troubleshooting
      5.  
        bptm process takes time to terminate after cancelling GLACIER restore job
      6.  
        Handling image cleanup failures for Amazon Glacier vault
      7.  
        Cleaning up orphaned archives manually
      8.  
        Restoring from Amazon Glacier vault spans more than 24 hours for single fragment
      9.  
        Restoring from GLACIER_VAULT takes more than 24 hours for Oracle databases
      10.  
        Troubleshooting failures due to missing Amazon IAM permissions
      11.  
        Restore job fails if the restore job start time overlaps with the backup job end time
      12.  
        Post processing fails for restore from Azure archive
    8.  
      Troubleshooting Amazon Snowball and Amazon Snowball Edge issues
  7.  
    Index

About protecting data in Amazon Glacier vault

To protect your data for long-term retention with Amazon vault lock policy, you can back up the data to a vault in Amazon Glacier using NetBackup.

When you create a GLACIER_VAULT storage class using NetBackup, you specify a vault name and a region in which you want to create the vault.

You can use the Amazon vault lock policy to enforce compliance control on the vault or to make the vault a Write-Once-Read-Many (WORM) device. See the Amazon documentation for more information.

Figure: Protecting data in Amazon Glacier vault

Protecting data in Amazon Glacier vault

To configure a cloud storage server for GLACIER_VAULT storage class

  1. Configure the Amazon GLACIER vault cloud storage server.

    See Configuring a storage server for cloud storage.

    Note:

    Each storage server is associated with only one region.

  2. Create a disk pool using the Amazon bucket for GLACIER storage.

    See Configuring a disk pool for cloud storage.

    Note:

    If you cannot see the desired vault, it means either the vault does not have an S3 bucket in the same region as the vault region or the vault does not exist in the region corresponding to the storage server for which you are creating the disk pool.

  3. Use the Amazon console to create a vault lock policy. See the Amazon documentation for more information.
  4. Create a backup policy.

    See Creating a backup policy.

Best practices

When you configure a storage server to backup data to a vault in Amazon Glacier, consider the following:

  • If you have configured immutable vault lock policy to deny the deletion of archives, Amazon Glacier vault does not allow deletion of archives till the archives are unlocked for deletion. Hence, the retention period configured for a backup policy must be greater than the vault lock period by at least two weeks or the maximum time taken to backup or duplicate data to GLACIER_VAULT with retries in your environment. Else, the image cleanup job on image expiry will fail. See Handling image cleanup failures for Amazon Glacier vault.

  • It is recommended you use a vault as a secondary target for backing up data.

  • If you plan to use the vault lock policy, ensure you create a vault for each retention level you want to use for the vault.

  • Use compression and incremental backups to reduce the size of the data stored per backup.

  • Select True Image Recovery option wherever possible to reduce time and cost for image imports.

    To retrieve data sent to Glacier, there is an inherent time delay of around four hours per fragment of the backup image. For phase 2 of image imports, this time delay is prevalent for image(s) in the Glacier storage. However, if you enable True Image Recovery in the policy, time spent for phase 2 imports reduces drastically from four hours to a few minutes per fragment. Phase 1 imports are faster, irrespective of whether True Image Recovery is enabled or not for the policy.

    See the NetBackup Administrator's Guide, Volume I to know more about supported workloads and file systems for True Image Recovery.

    See the NetBackup Administrator's Guide, Volume I to know more about the phases during image imports.

Limitations

Consider the following limitations:

  • NetBackup Accelerator feature is not supported for policies of the storage units that are created for GLACIER_VAULT. Do not select the Accelerator check box.

  • CloudCatalyst with GLACIER_VAULT is not supported.

  • Glacier endpoint for the Amazon GovCloud cloud provider (that is glacier.us-gov-west-1.amazonaws.com) supports only secure mode of communication using the NetBackup GLACIER_VAULT storage class. Therefore, if you disable the Use SSL option while you configure the Amazon GovCloud cloud storage with GLACIER_VAULT storage class, the configuration fails.

Permissions

You must have the following permissions:

  • glacier:ListVaults

  • glacier:CreateVault

  • glacier:DescribeVault

  • glacier:UploadArchive

  • glacier:DeleteArchive

  • glacier:ListJobs

  • glacier:Describejob

  • glacier:InitiateJob

  • glacier:GetJobOutput

  • Also, ensure you have the required S3 related IAM USER permissions. See Permissions required for Amazon S3 cloud provider user.

For issues related to permissions, See Troubleshooting failures due to missing Amazon IAM permissions.