APTARE IT Analytics
- Section I. Introducing APTARE IT Analytics
- Section II. Certified Configurations
- Portal and Database Servers
- Data Collector Server Configurations
- Capacity Manager Configurations
- Array/LUN Performance Data Collection
- Host Access Privileges, Sudo Commands, Ports, and WMI Proxy Requirements
- Cloud Configurations
- Virtualization Manager Configurations
- File Analytics Configurations
- Fabric Manager Configurations
- Backup Manager Configurations
- Internal TCP Port Requirements
- Section III. End User
- Understanding the Portal
- About the Admin Tab
- Exploring Your Inventory
- Using the Hierarchy Toolbar to Organize Your Data
- Show Objects
- Using Attributes to Organize Your Data
- Pinning Reports - Saving Reports with Inventory Objects
- Assigning Attributes in the Inventory List View
- Getting Acquainted With Reports
- About Badging
- Generating and Maintaining Reports
- Selecting Report Scope
- Group Hosts by Attributes
- Searching for Hosts in the Report Scope Selector
- Backup Manager Advanced Scope Selector Settings
- Solution Reports Scope Selector Settings
- Units of Measure in Reports
- Customizing Report Filter Logic
- Sorting Columns in Reports
- Distributing, Sharing, Scheduling, and Alerting
- Scheduling Exported Reports and Dashboards
- Organizing Reports
- Working with the Dynamic Template Designer
- Dynamic Template Designer Quick Start
- Converting to a Homogeneous, Product-Specific Template
- Dynamic Template Function Configurations
- Create Fields with the Field Builder
- Scope Selector Component - Custom Filter
- Configure a Bar Chart Dynamic Template
- Steps to Create a Bar Chart Dynamic Template
- Configure an Area/Stacked Area Chart Dynamic Template
- Line Charts for Performance Metrics
- Line Chart Field Requirements
- One Object Per Line Chart, One or More Metrics Per Chart
- Multiple Objects Per Line Chart, One Metric Per Chart
- Example of a Stacked Bar Chart Dynamic Template
- Create a Sparkline Chart in a Tabular Dynamic Template
- Adding or Editing Methods
- Validate and Save a Method
- Working with the SQL Template Designer
- Configure SQL Template Scope Selector Components
- Sample SQL Queries
- Number, Size, Date, and Time Formatting
- Alignment, Aggregation, Bar Type, and Bar Type Color
- Pipelined Functions for Report Query Building
- APTlistOfDates
- aptStringConcat
- getServerAttributeValue
- getObjectAttributeValue
- getChildServerGroupContextById
- getServerGroupContextById
- secsToHoursMinSecs
- APTgetTapeDriveStatusName
- getFullPathname
- listJobSummaryAfterRestart
- listJobSummaryAfterRestartNBW
- listJobSummaryAfterRestart for NetWorker Backup Jobs
- listOfBackupWindowDates
- listChargebackCatByVOLSDetail
- listChargebackCatByFSDetail
- listChargebackCatByFSDetail
- listChargebackByLUNSummary
- listChargebackByLUNDetail
- listChargebackCatByLUNSummary
- listChargebackCatByLUNDetail
- Alerting
- Adding/Editing an Alert Policy
- Managing Hosts, Backup Servers and Host Groups
- NetBackup Master Servers
- Managing Attributes and Objects
- Host Groups vs Attributes
- Providing Portal Access and User Authentication
- Setting/Resetting Passwords
- Managing User Group Home Pages (Administrator)
- Configuring Master Schedules and Backup Windows
- Adding and Editing Policies
- Adding/Editing a Threshold Policy
- Capacity Chargeback Policy Types
- Solutions Administration
- Managing and Monitoring Data Collection
- About Data Collection Tasks
- Reviewing Collectors and Collection Status
- Upgrading Data Collectors
- Working with Capacity Manager Host Data Collection
- Host Access Requirements
- Manage Credentials
- Configure Host Discovery Policies to Populate the Host Discovery and Collection View
- Validate Host Connectivity
- Search and Export in Host Discovery and Collection
- Propagate Probe Settings: Copy Probes, Paste Probes
- Discovery Policies for Veritas NetBackup
- About Discovery Types
- Viewing and Managing System Notifications
- Customizing with Advanced Parameters
- Access Control Advanced Parameters
- General Data Collection Advanced Parameters
- Cloud Data Collection Advanced Parameters
- Host Discovery and Collection Advanced Parameters
- Backup Manager Advanced Parameters
- Capacity Manager Advanced Parameters
- File Analytics Advanced Parameters
- Virtualization Manager Advanced Parameters
- Managing Your Portal Environment
- Analyzing Files
- Troubleshooting the Portal
- Retrieving Log Files
- Debugging
- Attribute Inheritance Overrides
- Understanding Report Data Caching
- Understanding the Portal
- Section IV. Report Reference
- Introduction to APTARE IT Analytics
- Alert Reports
- Risk Mitigation Solution Reports
- Risk Mitigation Reports
- Storage Optimization Solution Reports
- System Administration Reports
- Array Capacity Utilization Reports
- Array Capacity & Utilization (Generic Data)
- Array Capacity & Utilization (IBM SVC View)
- Array Capacity and Utilization (IBM XIV View)
- Array Capacity and Utilization (NetApp View)
- Array Capacity and Utilization (NetApp Cluster)
- NetApp Storage System Detail
- Array Capacity and Utilization (OpenStack Swift)
- IBM Array Site Summary
- IBM Array Detail
- LUN Utilization Summary
- NetApp Aggregate Detail
- NetApp Cluster-Mode Aggregate Detail
- NetApp Plex Details
- NetApp Volume Details
- NetApp Cluster-Mode Volume Detail
- Host Capacity Utilization Reports
- Thin Provisioning Reports
- Hitachi Dynamic Provisioning Pool Utilization
- Capacity Forecasting Reports
- Available/Reclaimable Capacity Reports
- Storage Performance Reports
- Mission Control for Performance Analysis
- Application Capacity Reports
- Capacity at Risk Reports
- File Analytics Reports
- Capacity Chargeback Reports
- Virtualization Manager Reports
- Understanding the Datastore
- VM Server Detail
- VM Snapshot Summary
- VM Detail
- Datastore Utilization Summary
- Datastore Detail
- Fabric Manager Reports
- Host to Storage Dashboard
- Backup Manager Management Reports
- Error Log Summary
- Job Duration Report
- Veeam Backup & Replication Job Summary Report (Homogeneous)
- Veeam and RMAN Job Details Report
- Adding a Note to a Job
- Job Volume Summary Report
- Backup Administration Reports
- Host Details
- IBM Spectrum Protect (TSM) Storage Pools Dashboard
- Backup Media Management Reports
- TSM Tape Media Detail Table
- Backup Service Level Agreement (SLA) Reports
- Determining and Improving Backup Start Time Performance
- Determining and Improving Backup Success Performance
- Determining and Improving Backup Duration Performance
- Backup Storage Utilization Reports
- Backup Manager Forecasting Reports
- Backup Billing and Usage Reports
- Backup Policies Reports
- HP Data Protector Backup Specification Detail
- Replication Manager Reports
- SnapVault Detail
- Section V. Data Collector Installation and Troubleshooting
- Installing the Data Collector Software
- Validating Data Collection
- Uninstalling the Data Collector
- Manually Starting the Data Collector
- Data Collector Troubleshooting
- Host Resources: Check the Status of the WMI Proxy Server
- Host Resources: Check Host Connectivity Using Standard SSH
- Host Resources: Generating Host Resource Configuration Files
- Configuring Parameters for SSH
- Firewall Configuration: Default Ports
- CRON Expressions and Probe Schedules
- Clustering Data Collectors with VCS and Veritas NetBackup (RHEL 7)
- Clustering Data Collectors with VCS and Veritas NetBackup (Windows)
- Installing the Data Collector Software
- Section VI. Data Collection for the Cloud
- Pre-Installation Setup for Amazon Web Services (AWS)
- Create an AWS IAM User
- Link AWS Accounts for Collection of Consolidated Billing Data
- Pre-Installation Setup for OpenStack Ceilometer
- Pre-Installation Setup for OpenStack Swift
- Pre-Installation Setup for Microsoft Azure
- Pre-Installation Setup for Amazon Web Services (AWS)
- Section VII. Data Collection for Data Protection (Backup)
- Introduction
- Pre-Installation Setup for Commvault Simpana
- Open TCP/IP Access to the Commvault Database
- Set Up a Read-Only User in the CommServe Server
- Pre-Installation Setup for Cohesity DataProtect
- Pre-Installation Setup for EMC Avamar
- Importing EMC Avamar Server Information
- Pre-Installation Setup for EMC Data Domain Backup
- Pre-Installation Setup for EMC NetWorker
- Architecture Overview (EMC NetWorker)
- Pre-Installation Setup for Dell EMC NetWorker Backup & Recovery
- Pre-Installation Setup for Generic Backup
- Generic Backup Data Collection
- CSV Format Specification
- Pre-Installation Setup for HP Data Protector
- Architecture Overview (HP Data Protector)
- Configure the Data Collector Server in Cell Manager (HP Data Protector)
- Pre-Installation Setup for IBM Spectrum Protect (TSM)
- Architecture Overview (IBM Spectrum Protect -TSM)
- Importing IBM Spectrum Protect (TSM) Information
- Pre-Installation Setup for NAKIVO Backup & Replication
- Pre-Installation Setup for Veritas Backup Exec
- Pre-Installation Setup for Veritas NetBackup
- Veritas NetBackup 8.1 (or later) Requirements for Centralized Collection
- Pre-Installation Setup for Oracle Recovery Manager (RMAN)
- Pre-Installation Setup for Rubrik Cloud Data Management
- Pre-Installation Setup for Veeam Backup & Replication
- Discovery Policies for Veritas NetBackup
- About Discovery Types
- About SNMP Probes
- Appendix A. Load Historic Events
- Section VIII. Data Collection for Fabrics
- Section IX. Data Collection for File Analytics
- Pre-Installation Setup for File Analytics
- Host Discovery and Collection File Analytics Probe
- Adding a File Analytics Data Collector Policy
- File Analytics Export Folder Size and Folder Depth
- Pre-Installation Setup for File Analytics
- Section X. Data Collection for Replication
- Section XI. Data Collection for Storage (Capacity)
- Data Collection for Capacity Overview
- Pre-Installation Setup for Dell Compellent
- Pre-Installation Setup for DELL EMC Elastic Cloud Storage (ECS)
- Pre-Installation Setup for EMC Data Domain Storage
- Pre-Installation Setup for EMC Isilon
- Pre-Installation Setup EMC Symmetrix
- Pre-Installation Setup for Dell EMC Unity
- Pre-Installation Setup for EMC VNX Celerra
- Pre-Installation Setup for EMC VNX CLARiiON
- Pre-Installation Setup for EMC VPLEX
- Pre-Installation Setup for EMC XtremIO
- Pre-Installation Setup for Hitachi Block
- Configuring a Hitachi Device Manager User
- Pre-Installation Setup for Hitachi Content Platform (HCP)
- Hitachi Content Platform System Management Console
- Hitachi Content Platform Tenant Management Console
- Pre-Installation Setup Hitachi NAS
- Host Inventory Pre-Installation Setup
- Host Access Privileges, Sudo Commands, Ports, and WMI Proxy Requirements
- Manage Credentials
- Configure Host Discovery Policies to Populate the Host Inventory
- Execute and Monitor Host Discovery
- Validate Host Connectivity
- Host Inventory Search and Host Inventory Export
- Configure and Edit Host Probes
- Propagate Probe Settings: Copy Probes, Paste Probes
- Pre-Installation Setup for HP 3PAR
- Pre-Installation Setup for HP EVA
- Pre-Installation Setup for Huawei OceanStor
- Pre-Installation Setup for IBM Enterprise
- Pre-Installation Setup for NetApp E-Series
- Pre-Installation Setup for IBM SVC
- Pre-Installation Setup for IBM XIV
- Pre-Installation Setup for INFINIDAT InfiniBox
- Pre-Installation Setup for NetApp-7
- Pre-Installation Setup for Microsoft Windows Server
- Pre-Installation Setup for NetApp Cluster
- Pre-Installation Setup for Pure Storage FlashArray
- Pre-Installation Setup for Veritas NetBackup Appliance
- Section XII. Data Collection for Virtualization
- Pre-Installation Setup for VMware
- Pre-Installation Setup for IBM VIO
- Pre-Installation Setup for Microsoft Hyper-V
- Section XIII. System Administration
- Preparing for Updates
- Backing Up and Restoring Data
- Monitoring APTARE IT Analytics
- Accessing APTARE Reports with the REST API
- Defining NetBackup Estimated Tape Capacity
- Automating Host Group Management
- Categorize Host Operating Systems by Platform and Version
- Load Relationships Between Hosts and Host Group
- Automating NetBackup Utilities
- Attribute Management
- Importing Generic Backup Data
- Backup Job Overrides
- Managing Host Data Collection
- System Configuration in the Portal
- Host Discovery: EMC Avamar
- Performance Profile Schedule Customization
- Configuring LDAP
- Configuring Single Sign On (SSO) Using Security Assertion Markup Language (SAML)
- Changing Oracle Database User Passwords
- Tuning APTARE IT Analytics
- Defining Report Metrics
- Working with Log Files
- Portal and Data Collector Log Files - Reduce Logging
- Data Collector Log File Naming Conventions
- Portal Log Files
- SNMP Trap Alerting
- SSL Certificate Configuration
- Configure Virtual Hosts for Portal and/or Data Collection SSL
- Keystore on the Portal Server
- Portal Properties: Format and Portal Customizations
- Advanced Configuration for NetBackup Discovery
- Data Retention Periods for SDK Database Objects
- Configure Multi-Tenancy Data Purging Retention Periods
- Troubleshooting
- Section XIV. Portal Install and Upgrade (Windows)
- Installing the Portal on a Windows Server
- Upgrading a Portal and Data Collectors (Windows)
- Troubleshooting - Manual Data Collector Upgrades
- Attribute Merging During the Portal Upgrade
- Upgrading and Migrating to a New Server
- Installing the Portal on a Windows Server
- Section XV. Portal Install and Upgrade (Linux)
- Installing the Portal on a Linux Server
- Upgrading a Portal and Data Collectors (Linux)
- Data Collector Upgrades
- Attribute Merging During the Portal Upgrade
- Installation from a Single File Specific to an OS
- Adding Additional Products
- Upgrading and Migrating to a New Server
- Installing the Portal on a Linux Server
- Section XVI. Technical Notes
- Enabling Oracle's Transparent Data Encryption (TDE)
- Array Performance Statistics Technical Note
- EMC Symmetrix Back-end Director Performance
- Section XVII. Licensing
- License Installation and Guidelines
- Verifying the Current License Configuration
- Criteria for Determining Licensing Limits
- Managing Licenses
- Configure the Data Collector Policy to Exclude the Object
- License Key Utility
- License Installation (Command Line Alternative)
- Report Configuration Utility
- License Verification Utility
- License Installation and Guidelines
- Section XVIII. Inventory Reports
- Inventory Operations
Configuring Risk Mitigation Rules
A set of risk mitigation rules are provided to assess areas within your enterprise that may be at risk of meeting data protection objectives. These rules include parameters that can be configured to isolate specific conditions relevant for your environment. For example, the Clients with No Recent Backups rule can be modified to specify the number of days for which no backups occurred and also to exclude retired clients. While various use cases drive how you configure a rule, the goal is to have analytics that help you identify areas at risk and trends that require attention. This on-going process should periodically assess trends and codify business practices.
See Risk Mitigation Solution Overview.
Once configured, a scheduled process gathers historical data for these categories so that you can identify areas that require further scrutiny. Accompanying reports present data that can be monitored over time, enabling an actionable process to reduce risk.
Best Practice
When configuring values for parameters, be as liberal as possible, initially. Then, over time, change parameters to produce a narrower actionable list. For optimal data comparisons, avoid frequent parameter modifications.
To edit a risk mitigation rule
If risk mitigation rules are not modified, the historical data process uses an active rule's default settings to collect the historical data.
- Select Admin > Solutions > Risk Mitigation
Rule
Rules are listed within relevant categories, such as Cloud and Storage.
Availability
If a particular type of collection is not licensed or collected, risk mitigation data will not be available, regardless of how a rule is configured. In some cases, a Portal may have the necessary license, but collection may not have been enabled and/or completed.
Data Protection rules require a Backup Manager license.
Storage requires a Capacity Manager license.
Description
The full description of the Risk Mitigation rule can be viewed by placing your mouse over the description.
Notes
Enter operational notes for future reference.
Status
Green check mark indicates successful collection of risk mitigation historical data for enabled rules.
Red X indicates failed historical data collection. It could be that collection is attempting to access data for a product module that is not in your Portal environment. Click the red icon to view the Database Error Aggregation report.
A non-colored circle indicates that the background process did not run, typically because the rule is not enabled.
State
Indicates if the rule is Enabled or Disabled.
Last Run
The date and time that the background process ran and evaluated the collected data against the rule's configured parameters.
- Select a rule in the Risk Mitigation grid and click Edit. Or, simply double-click the rule to access the edit dialog.
Risk Mitigation Rule
Description
Data Protection Rules
Backup Job Duration Variance
Compares a client's average job duration to help identify clients with successful backups where the current period's average job duration is more than the prior period's average job duration. Significant differences in average backup job duration may indicate a data protection issue.
Backup Job Size Variance
Compares average job size for clients with successful backups where the current period's average is lower than the prior period's average job size, which may help to identify backup issues.
Compliance RTO RPO
Considers RTO (Recovery Time Objectives) and RPO (Recovery Point Objectives) for backups by determining when/if the last full backup was performed. Then, add in the time it takes to apply any incremental backups.
Assists in computing RTO (Recovery Time Objectives) and RPO (Recovery Point Objectives) for backups by determining when/if the last full backup was performed. Then, add in the time it takes to apply any incremental backups to determine if you are meeting your SLAs.
NetBackup Disk Pool Forecast
Provides NetBackup disk pool statistics for the number of weeks in the selected period are examined to forecast the date when storage will run out within the next three years.
If the prediction is beyond three years, a status is returned.
Source Overall Status Summary
Considers sources for which backup jobs were not successful to determine risk. This rule helps in finding such sources by providing Status Summary.
Determining if source backups were successful is complicated, especially if there are multiple policies and schedules defined for that source and if there are multiple streams per backup set. Also there needs to be an established cutoff time to determine what to do if a source is still running or has not made all of its attempts.
The following criteria is considered:
1. If a source fails all of its jobs it is failed.
2. If a source successfully completes all of its jobs it is successful.
3. If a source completes all of its jobs with status 1 (skipped files) it was partially successful and probably OK.
4. If a source has a mixture of successful jobs and failed jobs, it needs further examination to determine if the jobs were truly successful.
Now, there is logic that can be applied to #4 in order to programmatically determine whether a source was successful or not, but that logic varies from customer to customer.
Sources Consecutive Failure
Evaluates sources where consecutive backups have failed or no backups have occurred for consecutive days. This rule examines the past 14 days of history, providing insights to possible problematic areas.
Best Practice: Schedule this rule to run every day at the end of the backup window. This rule works with any backup product.
Sources with No Recent Backups
Reviews details of sources that have not been backed up in a defined number of days to help determine if the sources are at risk.
Specify the number of days for which backups have not occurred to determine the risk.
Suspect Backups with Job Size
Backup jobs with an unexpected small size may signify issues with the policy setup.
Storage Rules
Host Multi-Pathing Exposure
Identifies hosts that are at risk because they have less than the specified number of paths. Examines LUN mappings of hosts that do not have multiple HBA ports and Array ports configured between a host and a LUN. Normally, the requirement is 2 HBA and 2 Array ports are configured, so when any HBA or Array port fails, there is another port to keep the connection between the host and the LUN.
Hot Array Ports
Identifies overactive array ports, which may indicate a risk to application performance.
Array port performance data is examined to identify spikes in data transferred.
Hot LUNs by Read IO
Reveals spikes in Read I/O performance metrics, which may indicate an area of risk. This rule uses a unique yet simple algorithm to identify abnormal performance patterns.
Hot LUNs by Read Response
Reveals spikes in Read Response Time metrics, which may indicate an area of risk. This rule uses a unique yet simple algorithm to identify abnormal performance patterns.
Hot LUNs by Write IO
Reveals spikes in Write I/O activity, which may indicate an area of risk. This rule uses a unique yet simple algorithm to identify abnormal performance patterns.
Hot LUNs by Write Response
Reveals spikes in Write Response Time metrics, which may indicate an area of risk. This rule uses a unique yet simple algorithm to identify abnormal performance patterns.
Thin Pool Forecast
Uses multi-vendor and multi-metric pool capacity and forecast data to identify storage at risk.
Virtualization Rules
VM Datastore Forecast
Examines VMWare datastore statistics for the number of weeks in the defined period to forecast the date when storage will run out within a three year period.
VM Guest Disk Forecast
Examines VMWare guest disk statistics for the number of weeks in the defined period to forecast the date when storage will run out within a three year period.