Arctera Data Insight Administrator's Guide
- Section I. Getting started- Introduction to Arctera Data Insight administration
- Configuring Data Insight global settings- About Data Insight licensing
- SQLite WAL mode
- Configuring SMTP server settings
- About scanning and event monitoring
- Monitoring Indexer Node Storage Utilization
- About filtering certain accounts, IP addresses, and paths
- About archiving data
- About Data Insight integration with Data Loss Prevention (DLP)
- Importing sensitive files information through CSV
- Configuring advanced analytics
- About open shares
- About user risk score
- Configuring file groups
- Configuring Workspace data owner policy
- Configuring Management Console settings
- About bulk assignment of custodians
- Configuring Watchlist settings
- Configuring Metadata Framework
- Proof of concept
 
 
- Section II. Configuring Data Insight- Configuring Data Insight product users
- Configuring Data Insight product servers- About Data Insight product servers
- Adding a new Data Insight server
- Managing Data Insight product servers
- Viewing Data Insight server details
- About node templates
- Adding Portal role to a Data Insight server
- Adding Classification Server role to a Data Insight server
- Assigning Classification Server to a Collector
- Associating a Classification Server pool to a Collector
- Viewing in-progress scans
- Configuring Data Insight services
- Configuring advanced settings
- Monitoring Data Insight jobs
- Rotating the encryption keys
- Viewing Data Insight server statistics
- About automated alerts for patches and upgrades
- Deploying upgrades and patches remotely
- Using the Upload Manager utility
- About migrating storage devices across Indexers
- Viewing the status of a remote installation
 
- Configuring saved credentials
- Configuring directory service domains- About directory domain scans
- Adding a directory service domain to Data Insight
- Managing directory service domains
- Fetching users and groups data from NIS+ scanner
- Configuring attributes for advanced analytics
- Deleting directory service domains
- Scheduling scans
- Configuring business unit mappings
- Importing additional attributes for users and user groups
 
- Configuring containers
 
- Section III. Configuring native file systems in Data Insight- Configuring NetApp 7-mode file server monitoring- About configuring NetApp file server monitoring
- Prerequisites for configuring NetApp file servers
- Credentials required for configuring NetApp filers
- Credentials required for configuring NetApp NFS filers
- Configuring SMB signing
- About FPolicy
- Preparing Data Insight for FPolicy
- Preparing the NetApp filer for Fpolicy
- Preparing the NetApp vfiler for Fpolicy
- Configuring NetApp audit settings for performance improvement
- Preparing a non-administrator domain user on the NetApp filer for Data Insight
- Enabling export of NFS shares on a NetApp file server
- Excluding volumes on a NetApp file server
- Handling NetApp home directories in Data Insight
 
- Configuring clustered NetApp file server monitoring- About configuring a clustered NetApp file server
- About configuring FPolicy in Cluster-Mode
- Pre-requisites for configuring clustered NetApp file servers
- Credentials required for configuring a clustered NetApp file server
- Preparing a non-administrator local user on the clustered NetApp filer
- Preparing a non-administrator domain user on a NetApp cluster for Data Insight
- Persistent Store
- Preparing Data Insight for FPolicy in NetApp Cluster-Mode
- Preparing the ONTAP cluster for FPolicy
- About configuring secure communication between Data Insight and cluster-mode NetApp devices
- Enabling export of NFS shares on a NetApp Cluster-Mode file server
- Enabling SSL support for Cluster Mode NetApp auditing
 
- Configuring EMC Celerra or VNX monitoring
- Configuring EMC Isilon monitoring- About configuring EMC Isilon filers
- Prerequisites for configuration of Isilon or Unity VSA file server monitoring
- Credentials required for configuring an EMC Isilon cluster
- Configuring audit settings on EMC Isilon cluster using OneFS GUI console
- Configuring audit settings on EMC Isilon cluster using the OneFS CLI
- Configuring Isilon audit settings for performance improvement
- Preparing Arctera Data Insight to receive event notifications from an EMC Isilon or Unity VSA cluster
- Creating a non-administrator user for an EMC Isilon cluster
- Utilizing access zone's SmartConnect Zone/Alias mappings
- Purging the audit logs in an Isilon filer
 
- Configuring EMC Unity VSA file servers
- Configuring Hitachi NAS file server monitoring
- Configuring Windows File Server monitoring
- Configuring Veritas File System (VxFS) file server monitoring
- Configuring monitoring of a generic device
- Managing file servers- About configuring filers
- Viewing configured filers
- Adding filers- Add/Edit NetApp filer options
- Add/Edit NetApp cluster file server options
- Add/Edit EMC Celerra filer options
- Add/Edit EMC Isilon file server options
- Add/Edit EMC Unity VSA file server options
- Add/Edit Windows File Server options
- Add/Edit Veritas File System server options
- Add/Edit a generic storage device options
- Add/Edit Hitachi NAS file server options
 
- Custom schedule options
- Editing filer configuration
- Deleting filers
- Viewing performance statistics for file servers
- About disabled shares
- Adding shares
- Managing shares
- Editing share configuration
- Deleting shares
- About configuring a DFS target
- Adding a configuration attribute for devices
- Configuring a DFS target
- About the DFS utility
- Running the DFS utility
- Importing DFS mapping
 
- Renaming storage devices
 
- Configuring NetApp 7-mode file server monitoring
- Section IV. Configuring SharePoint data sources- Configuring monitoring of SharePoint web applications- About SharePoint server monitoring
- Credentials required for configuring SharePoint servers
- Configuring a web application policy
- About the Data Insight web service for SharePoint
- Viewing configured SharePoint data sources
- Adding web applications
- Editing web applications
- Deleting web applications
- Adding site collections
- Managing site collections
- Removing a configured web application
 
- Configuring monitoring of SharePoint Online accounts- About SharePoint Online account monitoring
- Configuring user with minimum privileges in Microsoft 365
- Creating an application in the Microsoft Azure portal
- Configuring application without user impersonation for Microsoft 365
- Adding SharePoint Online accounts
- Managing a SharePoint Online account
- Adding site collections to SharePoint Online accounts
- Managing site collections
 
 
- Configuring monitoring of SharePoint web applications
- Section V. Configuring cloud data sources- Configuring monitoring of Box accounts
- Configuring OneDrive account monitoring
- Configuring Azure Netapp Files Device
- Managing cloud sources
 
- Section VI. Configuring Object Storage Sources
- Section VII. Health and monitoring
- Section VIII. Alerts and policies
- Section IX. Remediation- Configuring remediation settings
 
- Section X. Reference- Appendix A. Data Insight best practices
- Appendix B. Migrating Data Insight components
- Appendix C. Backing up and restoring data
- Appendix D. Data Insight health checks- About Data Insight health checks- Services checks
- Deployment details checks
- Generic checks
- Data Insight Management Server checks
- Data Insight Indexer checks
- Data Insight Collector checks
- Data Insight Windows File Server checks
- Data Insight SharePoint checks
- Classification server health checks
- Data Insight self service portal server health checks
 
 
- About Data Insight health checks
- Appendix E. Command File Reference
- Appendix F. Data Insight jobs
- Appendix G. Troubleshooting- About general troubleshooting procedures
- About the Health Audit report
- Location of Data Insight logs
- Downloading Data Insight logs
- Migrating the data directory to a new location
- Troubleshooting FPolicy issues on NetApp devices
- Troubleshooting EMC Celera or VNX configuration issues
- Troubleshooting EMC Isilon configuration issues
- Troubleshooting SharePoint configuration issues
- Troubleshooting Hitachi NAS configuration issues
- Troubleshooting installation of Tesseract software
- Troubleshooting RHEL 9 upgrade issue
 
 
Adding SharePoint Online accounts
Data Insight discovers and scans the data residing in the SharePoint Online accounts that are configured on the Management Console.
Note:
Data Insight disables addition of SharePoint Online accounts if you do not have a valid cloud license or if your license has expired. Also, Data Insight will not discover new accounts that have been added after the expiry of the license.
To add a SharePoint Online account
- In the Console, click Settings > SharePoint Sources. The SharePoint page displays the list of configured web applications and Online accounts. 
- Click Add SharePoint Source > SharePoint Online Account.
- On the Add New SharePoint Online Account page, specify the URL of the account you want to add and enter the properties.
- Click Save.
Note:
For verification of the permission for the newly added SharePoint account, wait till the account's next incremental or full scan, triggered after Local User Scan. By default, LocalUserScanJob runs at 12.30a.m every day on the Collector node. You can manually run the job by navigating to Settings >> Data Insight Servers >> Server >> Jobs >> Select LocalUserScanJob >> Actions >> Run
Use this dialog box to add a new SharePoint Online account to Arctera Data Insight or to edit the configuration of an existing account.
Table: Add/Edit SharePoint Online account options
| Field | Description | 
|---|---|
| SharePoint Online Account URL | Enter the URL of the SharePoint Online URL that you want Data Insight to
monitor. For example,   | 
| Collector | Do the following: 
 Data Insight connects to the SharePoint server from the Collector node. It is recommended to choose the Collector worker node that is close in proximity to the SharePoint Online account server. | 
| Indexer | Do the following: 
 Events and metadata that are collected from the site collections are processed and stored on the Indexer node. | 
| Client ID Client Secret Key Tenant ID | The client ID is the unique application ID assigned when you create and register an app with Microsoft. You can add up to 5 client IDs. Client Secret Key: In the SharePoint App, navigate to the Certificates & secrets page. There is a code in the Value column under the Client secret section. You need to use that code as a Client Secret Key while configuring a SharePoint account in Data Insight. Tenant ID: This is an unique ID assigned to an organization If you have missed copying the code, go back to the Certificates & secrets page in the SharePoint app and click + New client secret. Copy the code in the Value column and use it as a Client Secret Key in Data Insight. You can add up to 5 client secret keys. Follow the procedure described in the following topic to get these details: Note: Microsoft servers might briefly block certain client credentials for initiating frequent requests. In such scenarios, Data Insight fails to retrieve data from the Microsoft servers. To eliminate such delay, you can add up to 5 client credentials to the SharePoint Online account. If one client credential is blocked by Microsoft, another client credential will be used to fetch data. Add one client ID, Client Secret Key, authorize the app and click Add More Apps to add another set of client credentials. | 
| Authorize access | Do the following: 
 Note: After authorization, do not update the same set of client and secret key. | 
| Automatically discover and add site collections in this SharePoint Online account | This check box is selected by default. This option allows you to automatically include all site collections in the selected SharePoint Online account for the purpose of monitoring. Clear the check box to add site collections manually. You can do this from the SharePoint Online account details page. Discovery of site collections takes place as soon as you add a SharePoint Online account and then twice each day at 2:00 A.M. and 2:00 P.M. | 
| Exclude following site collections from discovery | Enter the details of the site collections which should not be included during discovery. This option is available when you select . Specify comma separated patterns that you want to ignore. Patterns can have 0 or more wildcard * characters. For example, https://onlineaccount1/sites/test* ignores site collections https://onlineaccount1/sites/testsite1 and https://onlineaccount1/sites/testsite2. | 
| Monitor SharePoint accesses to this SharePoint Online account | By default, Microsoft SharePoint Online Event Monitoring is enabled. If disabled, select this check box to enable event monitoring on the SharePoint Online account. You must manually enable auditing in the Microsoft 365 Admin Center to enable Data Insight to collect audit logs for the SharePoint Online account. | 
| Enable Scanning for this SharePoint Online account | Select the check box to enable SharePoint Online account scanning according to the specified schedule. | 
| Scanning schedule (for full scans) | Select one of the following to define a scanning schedule for the SharePoint Online account: 
 Arctera Data Insight periodically scans site collections to obtain file metadata. Each Collector worker node by default initiates a full scan of the SharePoint device at 11:00 P.M. each night. Note: You can also customize the schedule for each site collection using the Add/Edit Site Collection dialog box. | 
| Scan newly added site collections immediately | Select this option to scan newly added site collections immediately instead of waiting for the regular scan schedule. Scanning will still proceed only when scanning is permitted on the Collector node. | 
| Fetch Microsoft Labels | Check the box if you want to fetch Azure Information Protection (AIP) and Microsoft Sensitive labels for this SharePoint Online account. AIP label is a functionality that enables organizations to classify documents and emails in Microsoft 365. |