System jobs library

OneFS contains a library of system jobs that run in the background to help maintain your Isilon cluster. By default, system jobs are categorized as either manual or scheduled. However, you can run any job manually or schedule any job to run periodically according to your workflow. In addition, OneFS starts some jobs automatically when particular system conditions arise—for example, FlexProtect and FlexProtectLin, which start when a drive is smartfailed.

Job name
Description
Exclusion Set
Impact Policy
Priority
Operation
AutoBalance
Balances free space in a cluster, and is most efficient in clusters that contain only hard disk drives (HDDs). Run as part of MultiScan, or automatically by the system when a device joins (or rejoins) the cluster.
Restripe
Low
4
Manual
AutoBalanceLin
Balances free space in a cluster, and is most efficient in clusters when file system metadata is stored on solid state drives (SSDs). Run as part of MultiScan, or automatically by the system when a device joins (or rejoins) the cluster.
Restripe
Low
4
Manual
AVScan
Performs an antivirus scan on all files.
None
Low
6
Manual
ChangelistCreate
Creates a list of changes between two snapshots with matching root paths. You can specify these snapshots from the CLI.
None
Low
5
Manual
Collect
Reclaims free space that previously could not be freed because the node or drive was unavailable. Run as part of MultiScan, or automatically by the system when a device joins (or rejoins) the cluster.
Mark
Low
4
Manual
Dedupe*
Scans a directory for redundant data blocks and deduplicates all redundant data stored in the directory. Available only if you activate a SmartDedupe license.
None
Low
4
Manual
DedupeAssessment
Scans a directory for redundant data blocks and reports an estimate of the amount of space that could be saved by deduplicating the directory.
None
Low
6
Manual
DomainMark
Associates a path, and the contents of that path, with a domain.
None
Low
5
Manual
FlexProtect
Scans the file system after a device failure to ensure that all files remain protected. FlexProtect is most efficient on clusters that contain only HDDs. While there is a device failure on a cluster, only the FlexProtect (or FlexProtectLin) job is allowed to run. Depending on the size of your data set, this process can last for an extended period. The cluster is said to be in a degraded state until FlexProtect (or FlexProtectLin) finishes its work. If you notice that other system jobs cannot be started or have been paused, you can use the isi job status --verbose command to see if a "Cluster Is Degraded" message appears.
Note Image

Unlike HDDs and SSDs that are used for storage, when an SSD used for L3 cache fails, the drive state should immediately change to REPLACE without a FlexProtect job running. An SSD drive used for L3 cache contains only cache data that does not have to be protected by FlexProtect. After the drive state changes to REPLACE, you can pull and replace the failed SSD.

Restripe
Medium
1
Manual
FlexProtectLin
Scans the file system after a device failure to ensure that all files remain protected. This command is most efficient when file system metadata is stored on SSDs. In this situation, run FlexProtectLin instead of FlexProtect.
Restripe
Medium
1
Manual
FSAnalyze*
Gathers and reports information about all files and directories beneath the /ifs path. This job requires you to activate an InsightIQ license. Reports from this job are used by InsightIQ users for system analysis purposes. For more information, see the Isilon InsightIQ User Guide.
None
Low
1
Scheduled
IntegrityScan
Verifies file system integrity.
Mark
Medium
1
Manual
MediaScan
Locates and clears media-level errors from disks to ensure that all data remains protected.
Restripe
Low
8
Scheduled
MultiScan
Performs the work of the AutoBalance and Collect jobs simultaneously.
Restripe

Mark

Low
4
Manual
PermissionRepair
Uses a template file or directory as the basis for permissions to set on a target file or directory. The target directory must always be subordinate to the /ifs path. This job must be manually started.
None
Low
5
Manual
QuotaScan*
Updates quota accounting for domains created on an existing file tree. Available only if you activate a SmartQuotas license. This job should be run manually in off-hours after setting up all quotas, and whenever setting up new quotas.
None
Low
6
Manual
SetProtectPlus
Applies a default file policy across the cluster. Runs only if a SmartPools license is not active.
Restripe
Low
6
Manual
ShadowStoreDelete
Frees up space that is associated with shadow stores. Shadow stores are hidden files that are referenced by cloned and deduplicated files.
None
Low
2
Scheduled
ShadowStoreProtect
Protects shadow stores that are referenced by a logical i-node (LIN) with a higher level of protection.
None
Low
6
Scheduled
SmartPools*
Enforces SmartPools file pool policies. Available only if you activate a SmartPools license. This job runs on a regularly scheduled basis, and can also be started by the system when a change is made (for example, creating a compatibility that merges node pools).
Restripe
Low
6
Scheduled
SnapRevert
Reverts an entire snapshot back to head.
None
Low
5
Manual
SnapshotDelete
Creates free space associated with deleted snapshots. Triggered by the system when you mark snapshots for deletion.
None
Medium
2
Manual
TreeDelete
Deletes a specified file path in the /ifs directory.
None
Medium
4
Manual
Upgrade
Upgrades the file system after a software version upgrade.
Note Image

The Upgrade job should be run only when you are updating your cluster with a major software version. For complete information, see the Isilon OneFS Upgrade Planning and Process Guide.

Restripe
Medium
3
Manual
WormQueue
Processes the WORM queue, which tracks the commit times for WORM files. After a file is committed to WORM state, it is removed from the queue.
None
Low
6
Scheduled
* Available only if you activate an additional license