APTARE IT Analytics
- Section I. Introducing APTARE IT Analytics
- Section II. Certified Configurations
- Portal and Database Servers
- Data Collector Server Configurations
- Capacity Manager Configurations
- Array/LUN Performance Data Collection
- Host Access Privileges, Sudo Commands, Ports, and WMI Proxy Requirements
- Cloud Configurations
- Virtualization Manager Configurations
- File Analytics Configurations
- Fabric Manager Configurations
- Backup Manager Configurations
- Internal TCP Port Requirements
- Section III. End User
- Understanding the Portal
- About the Admin Tab
- Exploring Your Inventory
- Using the Hierarchy Toolbar to Organize Your Data
- Show Objects
- Using Attributes to Organize Your Data
- Pinning Reports - Saving Reports with Inventory Objects
- Assigning Attributes in the Inventory List View
- Getting Acquainted With Reports
- About Badging
- Generating and Maintaining Reports
- Selecting Report Scope
- Group Hosts by Attributes
- Searching for Hosts in the Report Scope Selector
- Backup Manager Advanced Scope Selector Settings
- Solution Reports Scope Selector Settings
- Units of Measure in Reports
- Customizing Report Filter Logic
- Sorting Columns in Reports
- Distributing, Sharing, Scheduling, and Alerting
- Scheduling Exported Reports and Dashboards
- Organizing Reports
- Working with the Dynamic Template Designer
- Dynamic Template Designer Quick Start
- Converting to a Homogeneous, Product-Specific Template
- Dynamic Template Function Configurations
- Create Fields with the Field Builder
- Scope Selector Component - Custom Filter
- Configure a Bar Chart Dynamic Template
- Steps to Create a Bar Chart Dynamic Template
- Configure an Area/Stacked Area Chart Dynamic Template
- Line Charts for Performance Metrics
- Line Chart Field Requirements
- One Object Per Line Chart, One or More Metrics Per Chart
- Multiple Objects Per Line Chart, One Metric Per Chart
- Example of a Stacked Bar Chart Dynamic Template
- Create a Sparkline Chart in a Tabular Dynamic Template
- Adding or Editing Methods
- Validate and Save a Method
- Working with the SQL Template Designer
- Configure SQL Template Scope Selector Components
- Sample SQL Queries
- Number, Size, Date, and Time Formatting
- Alignment, Aggregation, Bar Type, and Bar Type Color
- Pipelined Functions for Report Query Building
- APTlistOfDates
- aptStringConcat
- getServerAttributeValue
- getObjectAttributeValue
- getChildServerGroupContextById
- getServerGroupContextById
- secsToHoursMinSecs
- APTgetTapeDriveStatusName
- getFullPathname
- listJobSummaryAfterRestart
- listJobSummaryAfterRestartNBW
- listJobSummaryAfterRestart for NetWorker Backup Jobs
- listOfBackupWindowDates
- listChargebackCatByVOLSDetail
- listChargebackCatByFSDetail
- listChargebackCatByFSDetail
- listChargebackByLUNSummary
- listChargebackByLUNDetail
- listChargebackCatByLUNSummary
- listChargebackCatByLUNDetail
- Alerting
- Adding/Editing an Alert Policy
- Managing Hosts, Backup Servers and Host Groups
- NetBackup Master Servers
- Managing Attributes and Objects
- Host Groups vs Attributes
- Providing Portal Access and User Authentication
- Setting/Resetting Passwords
- Managing User Group Home Pages (Administrator)
- Configuring Master Schedules and Backup Windows
- Adding and Editing Policies
- Adding/Editing a Threshold Policy
- Capacity Chargeback Policy Types
- Solutions Administration
- Managing and Monitoring Data Collection
- About Data Collection Tasks
- Reviewing Collectors and Collection Status
- Upgrading Data Collectors
- Working with Capacity Manager Host Data Collection
- Host Access Requirements
- Manage Credentials
- Configure Host Discovery Policies to Populate the Host Discovery and Collection View
- Validate Host Connectivity
- Search and Export in Host Discovery and Collection
- Propagate Probe Settings: Copy Probes, Paste Probes
- Discovery Policies for Veritas NetBackup
- About Discovery Types
- Viewing and Managing System Notifications
- Customizing with Advanced Parameters
- Access Control Advanced Parameters
- General Data Collection Advanced Parameters
- Cloud Data Collection Advanced Parameters
- Host Discovery and Collection Advanced Parameters
- Backup Manager Advanced Parameters
- Capacity Manager Advanced Parameters
- File Analytics Advanced Parameters
- Virtualization Manager Advanced Parameters
- Managing Your Portal Environment
- Analyzing Files
- Troubleshooting the Portal
- Retrieving Log Files
- Debugging
- Attribute Inheritance Overrides
- Understanding Report Data Caching
- Understanding the Portal
- Section IV. Report Reference
- Introduction to APTARE IT Analytics
- Alert Reports
- Risk Mitigation Solution Reports
- Risk Mitigation Reports
- Storage Optimization Solution Reports
- System Administration Reports
- Array Capacity Utilization Reports
- Array Capacity & Utilization (Generic Data)
- Array Capacity & Utilization (IBM SVC View)
- Array Capacity and Utilization (IBM XIV View)
- Array Capacity and Utilization (NetApp View)
- Array Capacity and Utilization (NetApp Cluster)
- NetApp Storage System Detail
- Array Capacity and Utilization (OpenStack Swift)
- IBM Array Site Summary
- IBM Array Detail
- LUN Utilization Summary
- NetApp Aggregate Detail
- NetApp Cluster-Mode Aggregate Detail
- NetApp Plex Details
- NetApp Volume Details
- NetApp Cluster-Mode Volume Detail
- Host Capacity Utilization Reports
- Thin Provisioning Reports
- Hitachi Dynamic Provisioning Pool Utilization
- Capacity Forecasting Reports
- Available/Reclaimable Capacity Reports
- Storage Performance Reports
- Mission Control for Performance Analysis
- Application Capacity Reports
- Capacity at Risk Reports
- File Analytics Reports
- Capacity Chargeback Reports
- Virtualization Manager Reports
- Understanding the Datastore
- VM Server Detail
- VM Snapshot Summary
- VM Detail
- Datastore Utilization Summary
- Datastore Detail
- Fabric Manager Reports
- Host to Storage Dashboard
- Backup Manager Management Reports
- Error Log Summary
- Job Duration Report
- Veeam Backup & Replication Job Summary Report (Homogeneous)
- Veeam and RMAN Job Details Report
- Adding a Note to a Job
- Job Volume Summary Report
- Backup Administration Reports
- Host Details
- IBM Spectrum Protect (TSM) Storage Pools Dashboard
- Backup Media Management Reports
- TSM Tape Media Detail Table
- Backup Service Level Agreement (SLA) Reports
- Determining and Improving Backup Start Time Performance
- Determining and Improving Backup Success Performance
- Determining and Improving Backup Duration Performance
- Backup Storage Utilization Reports
- Backup Manager Forecasting Reports
- Backup Billing and Usage Reports
- Backup Policies Reports
- HP Data Protector Backup Specification Detail
- Replication Manager Reports
- SnapVault Detail
- Section V. Data Collector Installation and Troubleshooting
- Installing the Data Collector Software
- Validating Data Collection
- Uninstalling the Data Collector
- Manually Starting the Data Collector
- Data Collector Troubleshooting
- Host Resources: Check the Status of the WMI Proxy Server
- Host Resources: Check Host Connectivity Using Standard SSH
- Host Resources: Generating Host Resource Configuration Files
- Configuring Parameters for SSH
- Firewall Configuration: Default Ports
- CRON Expressions and Probe Schedules
- Clustering Data Collectors with VCS and Veritas NetBackup (RHEL 7)
- Clustering Data Collectors with VCS and Veritas NetBackup (Windows)
- Installing the Data Collector Software
- Section VI. Data Collection for the Cloud
- Pre-Installation Setup for Amazon Web Services (AWS)
- Create an AWS IAM User
- Link AWS Accounts for Collection of Consolidated Billing Data
- Pre-Installation Setup for OpenStack Ceilometer
- Pre-Installation Setup for OpenStack Swift
- Pre-Installation Setup for Microsoft Azure
- Pre-Installation Setup for Amazon Web Services (AWS)
- Section VII. Data Collection for Data Protection (Backup)
- Introduction
- Pre-Installation Setup for Commvault Simpana
- Open TCP/IP Access to the Commvault Database
- Set Up a Read-Only User in the CommServe Server
- Pre-Installation Setup for Cohesity DataProtect
- Pre-Installation Setup for EMC Avamar
- Importing EMC Avamar Server Information
- Pre-Installation Setup for EMC Data Domain Backup
- Pre-Installation Setup for EMC NetWorker
- Architecture Overview (EMC NetWorker)
- Pre-Installation Setup for Dell EMC NetWorker Backup & Recovery
- Pre-Installation Setup for Generic Backup
- Generic Backup Data Collection
- CSV Format Specification
- Pre-Installation Setup for HP Data Protector
- Architecture Overview (HP Data Protector)
- Configure the Data Collector Server in Cell Manager (HP Data Protector)
- Pre-Installation Setup for IBM Spectrum Protect (TSM)
- Architecture Overview (IBM Spectrum Protect -TSM)
- Importing IBM Spectrum Protect (TSM) Information
- Pre-Installation Setup for NAKIVO Backup & Replication
- Pre-Installation Setup for Veritas Backup Exec
- Pre-Installation Setup for Veritas NetBackup
- Veritas NetBackup 8.1 (or later) Requirements for Centralized Collection
- Pre-Installation Setup for Oracle Recovery Manager (RMAN)
- Pre-Installation Setup for Rubrik Cloud Data Management
- Pre-Installation Setup for Veeam Backup & Replication
- Discovery Policies for Veritas NetBackup
- About Discovery Types
- About SNMP Probes
- Appendix A. Load Historic Events
- Section VIII. Data Collection for Fabrics
- Section IX. Data Collection for File Analytics
- Pre-Installation Setup for File Analytics
- Host Discovery and Collection File Analytics Probe
- Adding a File Analytics Data Collector Policy
- File Analytics Export Folder Size and Folder Depth
- Pre-Installation Setup for File Analytics
- Section X. Data Collection for Replication
- Section XI. Data Collection for Storage (Capacity)
- Data Collection for Capacity Overview
- Pre-Installation Setup for Dell Compellent
- Pre-Installation Setup for DELL EMC Elastic Cloud Storage (ECS)
- Pre-Installation Setup for EMC Data Domain Storage
- Pre-Installation Setup for EMC Isilon
- Pre-Installation Setup EMC Symmetrix
- Pre-Installation Setup for Dell EMC Unity
- Pre-Installation Setup for EMC VNX Celerra
- Pre-Installation Setup for EMC VNX CLARiiON
- Pre-Installation Setup for EMC VPLEX
- Pre-Installation Setup for EMC XtremIO
- Pre-Installation Setup for Hitachi Block
- Configuring a Hitachi Device Manager User
- Pre-Installation Setup for Hitachi Content Platform (HCP)
- Hitachi Content Platform System Management Console
- Hitachi Content Platform Tenant Management Console
- Pre-Installation Setup Hitachi NAS
- Host Inventory Pre-Installation Setup
- Host Access Privileges, Sudo Commands, Ports, and WMI Proxy Requirements
- Manage Credentials
- Configure Host Discovery Policies to Populate the Host Inventory
- Execute and Monitor Host Discovery
- Validate Host Connectivity
- Host Inventory Search and Host Inventory Export
- Configure and Edit Host Probes
- Propagate Probe Settings: Copy Probes, Paste Probes
- Pre-Installation Setup for HP 3PAR
- Pre-Installation Setup for HP EVA
- Pre-Installation Setup for Huawei OceanStor
- Pre-Installation Setup for IBM Enterprise
- Pre-Installation Setup for NetApp E-Series
- Pre-Installation Setup for IBM SVC
- Pre-Installation Setup for IBM XIV
- Pre-Installation Setup for INFINIDAT InfiniBox
- Pre-Installation Setup for NetApp-7
- Pre-Installation Setup for Microsoft Windows Server
- Pre-Installation Setup for NetApp Cluster
- Pre-Installation Setup for Pure Storage FlashArray
- Pre-Installation Setup for Veritas NetBackup Appliance
- Section XII. Data Collection for Virtualization
- Pre-Installation Setup for VMware
- Pre-Installation Setup for IBM VIO
- Pre-Installation Setup for Microsoft Hyper-V
- Section XIII. System Administration
- Preparing for Updates
- Backing Up and Restoring Data
- Monitoring APTARE IT Analytics
- Accessing APTARE Reports with the REST API
- Defining NetBackup Estimated Tape Capacity
- Automating Host Group Management
- Categorize Host Operating Systems by Platform and Version
- Load Relationships Between Hosts and Host Group
- Automating NetBackup Utilities
- Attribute Management
- Importing Generic Backup Data
- Backup Job Overrides
- Managing Host Data Collection
- System Configuration in the Portal
- Host Discovery: EMC Avamar
- Performance Profile Schedule Customization
- Configuring LDAP
- Configuring Single Sign On (SSO) Using Security Assertion Markup Language (SAML)
- Changing Oracle Database User Passwords
- Tuning APTARE IT Analytics
- Defining Report Metrics
- Working with Log Files
- Portal and Data Collector Log Files - Reduce Logging
- Data Collector Log File Naming Conventions
- Portal Log Files
- SNMP Trap Alerting
- SSL Certificate Configuration
- Configure Virtual Hosts for Portal and/or Data Collection SSL
- Keystore on the Portal Server
- Portal Properties: Format and Portal Customizations
- Advanced Configuration for NetBackup Discovery
- Data Retention Periods for SDK Database Objects
- Configure Multi-Tenancy Data Purging Retention Periods
- Troubleshooting
- Section XIV. Portal Install and Upgrade (Windows)
- Installing the Portal on a Windows Server
- Upgrading a Portal and Data Collectors (Windows)
- Troubleshooting - Manual Data Collector Upgrades
- Attribute Merging During the Portal Upgrade
- Upgrading and Migrating to a New Server
- Installing the Portal on a Windows Server
- Section XV. Portal Install and Upgrade (Linux)
- Installing the Portal on a Linux Server
- Upgrading a Portal and Data Collectors (Linux)
- Data Collector Upgrades
- Attribute Merging During the Portal Upgrade
- Installation from a Single File Specific to an OS
- Adding Additional Products
- Upgrading and Migrating to a New Server
- Installing the Portal on a Linux Server
- Section XVI. Technical Notes
- Enabling Oracle's Transparent Data Encryption (TDE)
- Array Performance Statistics Technical Note
- EMC Symmetrix Back-end Director Performance
- Section XVII. Licensing
- License Installation and Guidelines
- Verifying the Current License Configuration
- Criteria for Determining Licensing Limits
- Managing Licenses
- Configure the Data Collector Policy to Exclude the Object
- License Key Utility
- License Installation (Command Line Alternative)
- Report Configuration Utility
- License Verification Utility
- License Installation and Guidelines
- Section XVIII. Inventory Reports
- Inventory Operations
Configuring Storage Optimization Rules
A set of storage optimization rules are provided to assess areas within your enterprise that offer candidates for optimization. These rules include parameters that can be configured to isolate specific conditions relevant for your environment. You can also associate costs with rules. Cost sources may related to Chargeback values or you can set your own custom value. For example, the Unallocated LUNs rule can be configured to exclude LUNs less than a certain size. While various use cases drive how you configure a rule, the goal is to have analytics that help you identify storage optimization candidates and trends that require attention. This on-going process should periodically assess trends and codify business practices.
See Storage Optimization Solution Overview.
See Enabling Storage Optimization Rules.
See Report Reference Guide for details on Storage Optimization Solution Reports.
Once configured, a scheduled process gathers historical data for these categories so that you can identify areas that require further scrutiny. Accompanying reports present data that can be monitored over time, enabling an actionable process to maintain an optimized storage environment.
Best Practice
When configuring values for parameters, be as liberal as possible, initially. Then, over time, change parameters to produce a narrower actionable list. For optimal data comparisons, avoid frequent parameter modifications.
To edit a storage optimization rule
If optimization rules are not modified, the historical data process uses an active rule's default settings to collect the historical data.
- Select Admin > Solutions > Storage Optimization.
Rule
Rules are listed within relevant categories, such as Cloud and Storage.
Availability
If a particular type of collection is not licensed or collected, storage optimization data will not be available, regardless of how a rule is configured. In some cases, a Portal may have the necessary license, but collection may not have been enabled and/or completed.
Cloud does not require a specific license in order to deploy a data collector.
Data Protection requires a Backup Manager license.
File Analytics requires a File Analytics license.
Storage requires a Capacity Manager license.
Virtualization requires a Virtualization Manager license.
Description
The full description of the Storage Optimization rule can be viewed by placing your mouse over the description.
Notes
Enter operational notes for future reference.
Status
Green check mark indicates successful collection of storage optimization historical data for enabled rules.
Red X indicates failed historical data collection. It could be that collection is attempting to access data for a product module that is not in your Portal environment. Click the red icon to view the Database Error Aggregation report.
A non-colored circle indicates that the storage optimization process did not run, typically because the rule is not enabled.
State
Indicates if the rule is Enabled or Disabled.
Last Run
The date and time that the Storage Optimization process ran and evaluated the collected data against the rule's configured parameters.
- Select a rule in the Storage Optimization grid and click Edit. Or, simply double-click the rule to access the edit dialog.
See Storage Optimization Rule Prerequisites and Logic.
Storage Optimization Rule
Description
Cloud Rules
AWS Orphan Snapshots
Amazon Web Services orphaned snapshots that are consuming storage may be impacting costs. This rule identifies snapshots for EC2 instances that no longer exist. When an EC2 instance is deleted, its snapshots need to be reviewed and its volumes brought back into the pool of usable storage. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For actionable information, see the Storage Optimization detail reports.
AWS Orphan Volumes
Amazon Web Services orphaned volumes that are consuming storage may be impacting costs. This rule identifies volumes for EC2 instances that no longer exist. When an EC2 instance is deleted, its snapshots need to be reviewed and its volumes brought back into the pool of usable storage. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For actionable information, see the Storage Optimization reports.
Data Protection Rules
Sources Backed Up by Multiple Servers
Sources backed up by multiple servers may be wasting storage and increasing maintenance costs. This rule identifies sources backed up by more than one server within a specific number of days (default is 7 days). If a source is moved from one backup system to another backup system, this rule would identify those changes too.
This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. The cost is calculated based on the number of different servers minus 1, times the average job size in GiB. For example, if a source is backed up by 3 different servers, the average size of these jobs is 200 GiB, and $0.25 for each GiB, then the saving might be: (3-1) * 200 GiB * $0.25 = $100
Data Domain File Compression
Compression metrics for the last 30 days are evaluated for inefficient storage usage and compression ratios for Data Domain clients. A low compression ratio may indicate a storage optimization opportunity or it may warrant a move of low compression clients to less expensive storage. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the Data Domain NetBackup File Compression Summary report.
High Backup Retention Jobs
Backups retained for too many days may be wasting storage and increasing maintenance costs. This rule identifies backups with a high number of retention days. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports.
File Analytics Rules
File Type Usage
File types that are consuming storage can be reviewed. The filename extension identifies a file type, such as iso, log, and cab. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. This File Type rule is relevant only if File Analytics data collection is enabled. For a list of file types that are relevant for your environment, see the File Types report.
Inactive Large Files
Large files consuming storage can be considered when making tiered storage migration decisions. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. This rule is relevant only if File Analytics data collection is enabled. For additional details, see the Largest Files report.
Storage Rules
Inactive LUNs
LUNs that have no I/O activity collected in the last 30 days, or the collected value during that time period is zero, are candidates for storage reclamation.
This rule explicitly examines 30 days of collected LUN performance data. This rule can filter the data by RAID type. The format for RAID type specification is specific to storage vendors. For a list of RAID types in your environment, run the LUN Utilization Summary report. This rule also allows you to set a Cost Source for displaying associated costs in the generated reports. Choose from Chargeback values or add a custom value. If you have set up Chargeback rules, those are more granular and can provide greater cost accuracy.
Overprovisioned Hosts
File system usage can help identify overprovisioned file systems and hosts. For additional information, run the Host Utilization Summary report and the Host Filesystem Reclamation Candidates cloud report. This rule also allows you to set a Cost Source for displaying associated costs in the generated reports. Choose from Chargeback values or add a custom value. If you have set up Chargeback rules, those are more granular and can provide greater cost accuracy.
Unallocated LUNs
Storage associated with LUNs that have not been allocated to hosts can be considered for storage optimization. This rule also allows you to set a Cost Source for displaying associated costs in the generated reports. Choose from Chargeback values or add a custom value. If you have set up Chargeback rules, those are more granular and can provide greater cost accuracy.
This rule can filter the data by RAID type. The format for RAID type specification is specific to storage vendors. For a list of RAID types in your environment, run the LUN Utilization Summary or the Unallocated LUNs report. In addition, the Reclamation Summary report can reveal potential reclamation categories.
Undiscovered LUNs
LUNs that have been assigned to a host, but have not been discovered and therefore are not seen on the host side, indicate a reclamation opportunity. The storage in these orphaned LUNs is not available for mounting file systems. This rule also allows you to set a Cost Source for displaying associated costs in the generated reports. Choose from Chargeback values or add a custom value. If you have set up Chargeback rules, those are more granular and can provide greater cost accuracy.
This rule can filter the data by RAID type. The format for RAID type specification is specific to storage vendors. For a list of RAID types in your environment, run the LUN Utilization Summary report. In addition, the Reclamation Summary report illustrates potential reclamation categories.
Unused LUNs
Unused LUNs could be considered for reclamation. These are LUNs that have been assigned to a host, but the host has not been placed into a volume group, or a partition has not been created. This rule also allows you to set a Cost Source for displaying associated costs in the generated reports. Choose from Chargeback values or add a custom value. If you have set up Chargeback rules, those are more granular and can provide greater cost accuracy.
This rule can filter the data by RAID type. The format for RAID type specification is specific to storage vendors. For a list of RAID types in your environment, run the LUN Utilization Summary report. In addition, the Reclamation Summary report illustrates potential reclamation categories.
Virtualization Rules
Non-VM Files
VM storage that is being consumed by files that are unknown VM file types can be considered for storage optimization. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the Datastore Usage Breakdown and the VM Files Summary reports.
VMs Aged Snapshots
VM snapshots have storage associated with them, but these snapshots have been forgotten for some time. Aged snapshots present a reclamation opportunity. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the VM Snapshot Summary.
VMs Low CPU
VMs where the average CPU utilization is low for last 24 hours and CPU usage is less than 5%, may provide a storage optimization opportunity.
Filter your actionable list by guest size and guest state, for example, including only running large guests. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the VM Summary report.
VMs Not in VM Inventory
VMs that are not in the VM inventory may be consuming storage. When a VM is removed from the inventory, it doesn't necessarily mean that the associated storage is returned to the storage pool. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the Datastore Usage Breakdown and the VM Files Summary reports.
VMs Powered Off
VMs that have been powered off may have storage associated with them. For additional details, see the VM Summary report. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports.
VMs Undiscovered Disks
VMs that have been provisioned storage, but that storage is not being used by the VMs, may indicate a storage optimization opportunity. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the Physical Disk Utilization report.
- Click in a parameter field to view the green help text at the bottom of the dialog and then use those details to configure parameters. Each rule includes parameters unique to the data that is being evaluated.