4 .\" The contents of this file are subject to the terms of the
5 .\" Common Development and Distribution License (the "License").
6 .\" You may not use this file except in compliance with the License.
8 .\" You can obtain a copy of the license at usr/src/OPENSOLARIS.LICENSE
9 .\" or https://opensource.org/licenses/CDDL-1.0.
10 .\" See the License for the specific language governing permissions
11 .\" and limitations under the License.
13 .\" When distributing Covered Code, include this CDDL HEADER in each
14 .\" file and include the License file at usr/src/OPENSOLARIS.LICENSE.
15 .\" If applicable, add the following below this CDDL HEADER, with the
16 .\" fields enclosed by brackets "[]" replaced with your own identifying
17 .\" information: Portions Copyright [yyyy] [name of copyright owner]
21 .\" Copyright (c) 2007, Sun Microsystems, Inc. All Rights Reserved.
22 .\" Copyright (c) 2012, 2018 by Delphix. All rights reserved.
23 .\" Copyright (c) 2012 Cyril Plisko. All Rights Reserved.
24 .\" Copyright (c) 2017 Datto Inc.
25 .\" Copyright (c) 2018 George Melikov. All Rights Reserved.
26 .\" Copyright 2017 Nexenta Systems, Inc.
27 .\" Copyright (c) 2017 Open-E, Inc. All Rights Reserved.
35 .Nd configure ZFS storage pools
48 command configures ZFS storage pools.
49 A storage pool is a collection of devices that provides physical storage and
50 data replication for ZFS datasets.
51 All datasets within a storage pool share the same space.
54 for information on managing datasets.
56 For an overview of creating and managing ZFS storage pools see the
61 All subcommands that modify state are logged persistently to the pool in their
66 command provides subcommands to create and destroy storage pools, add capacity
67 to storage pools, and provide information about the storage pools.
68 The following subcommands are supported:
74 Displays a help message.
83 Displays the software version of the
85 userland utility and the ZFS kernel module.
91 Creates a new storage pool containing the virtual devices specified on the
93 .It Xr zpool-initialize 8
94 Begins initializing by writing to all unallocated regions on the specified
95 devices, or all eligible devices in the pool if no individual devices are
101 .It Xr zpool-destroy 8
102 Destroys the given pool, freeing up any devices for other use.
103 .It Xr zpool-labelclear 8
104 Removes ZFS label information from the specified
111 .Xr zpool-attach 8 Ns / Ns Xr zpool-detach 8
113 Converts a non-redundant disk into a mirror, or increases
114 the redundancy level of an existing mirror
115 .Cm ( attach Ns ), or performs the inverse operation (
118 .Xr zpool-add 8 Ns / Ns Xr zpool-remove 8
120 Adds the specified virtual devices to the given pool,
121 or removes the specified device from the pool.
122 .It Xr zpool-replace 8
123 Replaces an existing device (which may be faulted) with a new one.
125 Creates a new pool by splitting all mirrors in an existing pool (which decreases
130 Available pool properties listed in the
135 Lists the given pools along with a health status and space usage.
137 .Xr zpool-get 8 Ns / Ns Xr zpool-set 8
139 Retrieves the given list of properties
145 for the specified storage pool(s).
150 .It Xr zpool-status 8
151 Displays the detailed health status for the given pools.
152 .It Xr zpool-iostat 8
153 Displays logical I/O statistics for the given pools/vdevs.
154 Physical I/O operations may be observed via
156 .It Xr zpool-events 8
157 Lists all recent events generated by the ZFS kernel modules.
158 These events are consumed by the
160 and used to automate administrative tasks such as replacing a failed device
162 That manual page also describes the subclasses and event payloads
163 that can be generated.
164 .It Xr zpool-history 8
165 Displays the command history of the specified pool(s) or all pools if no pool is
172 Begins a scrub or resumes a paused scrub.
173 .It Xr zpool-checkpoint 8
174 Checkpoints the current state of
176 which can be later restored by
177 .Nm zpool Cm import Fl -rewind-to-checkpoint .
179 Initiates an immediate on-demand TRIM operation for all of the free space in a
181 This operation informs the underlying storage devices of all blocks
182 in the pool which are no longer allocated and allows thinly provisioned
183 devices to reclaim the space.
185 This command forces all in-core dirty data to be written to the primary
186 pool storage and not the ZIL.
187 It will also update administrative information including quota reporting.
190 will sync all pools on the system.
191 Otherwise, it will sync only the specified pool(s).
192 .It Xr zpool-upgrade 8
193 Manage the on-disk format version of storage pools.
195 Waits until all background activity of the given types has ceased in the given
202 .Xr zpool-offline 8 Ns / Ns Xr zpool-online 8
204 Takes the specified physical device offline or brings it online.
205 .It Xr zpool-resilver 8
207 If an existing resilver is already running it will be restarted from the
209 .It Xr zpool-reopen 8
210 Reopen all the vdevs associated with the pool.
212 Clears device errors in a pool.
217 .It Xr zpool-import 8
218 Make disks containing ZFS storage pools available for use on the system.
219 .It Xr zpool-export 8
220 Exports the given pools from the system.
221 .It Xr zpool-reguid 8
222 Generates a new unique identifier for the pool.
226 The following exit values are returned:
227 .Bl -tag -compact -offset 4n -width "a"
229 Successful completion.
233 Invalid command line options were specified.
237 .\" Examples 1, 2, 3, 4, 12, 13 are shared with zpool-create.8.
238 .\" Examples 6, 14 are shared with zpool-add.8.
239 .\" Examples 7, 16 are shared with zpool-list.8.
240 .\" Examples 8 are shared with zpool-destroy.8.
241 .\" Examples 9 are shared with zpool-export.8.
242 .\" Examples 10 are shared with zpool-import.8.
243 .\" Examples 11 are shared with zpool-upgrade.8.
244 .\" Examples 15 are shared with zpool-remove.8.
245 .\" Examples 17 are shared with zpool-status.8.
246 .\" Examples 14, 17 are also shared with zpool-iostat.8.
247 .\" Make sure to update them omnidirectionally
248 .Ss Example 1 : No Creating a RAID-Z Storage Pool
249 The following command creates a pool with a single raidz root vdev that
250 consists of six disks:
251 .Dl # Nm zpool Cm create Ar tank Sy raidz Pa sda sdb sdc sdd sde sdf
253 .Ss Example 2 : No Creating a Mirrored Storage Pool
254 The following command creates a pool with two mirrors, where each mirror
256 .Dl # Nm zpool Cm create Ar tank Sy mirror Pa sda sdb Sy mirror Pa sdc sdd
258 .Ss Example 3 : No Creating a ZFS Storage Pool by Using Partitions
259 The following command creates a non-redundant pool using two disk partitions:
260 .Dl # Nm zpool Cm create Ar tank Pa sda1 sdb2
262 .Ss Example 4 : No Creating a ZFS Storage Pool by Using Files
263 The following command creates a non-redundant pool using files.
264 While not recommended, a pool based on files can be useful for experimental
266 .Dl # Nm zpool Cm create Ar tank Pa /path/to/file/a /path/to/file/b
268 .Ss Example 5 : No Making a non-mirrored ZFS Storage Pool mirrored
269 The following command converts an existing single device
271 into a mirror by attaching a second device to it,
273 .Dl # Nm zpool Cm attach Ar tank Pa sda sdb
275 .Ss Example 6 : No Adding a Mirror to a ZFS Storage Pool
276 The following command adds two mirrored disks to the pool
278 assuming the pool is already made up of two-way mirrors.
279 The additional space is immediately available to any datasets within the pool.
280 .Dl # Nm zpool Cm add Ar tank Sy mirror Pa sda sdb
282 .Ss Example 7 : No Listing Available ZFS Storage Pools
283 The following command lists all available pools on the system.
284 In this case, the pool
286 is faulted due to a missing device.
287 The results from this command are similar to the following:
288 .Bd -literal -compact -offset Ds
289 .No # Nm zpool Cm list
290 NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
291 rpool 19.9G 8.43G 11.4G - 33% 42% 1.00x ONLINE -
292 tank 61.5G 20.0G 41.5G - 48% 32% 1.00x ONLINE -
293 zion - - - - - - - FAULTED -
296 .Ss Example 8 : No Destroying a ZFS Storage Pool
297 The following command destroys the pool
299 and any datasets contained within:
300 .Dl # Nm zpool Cm destroy Fl f Ar tank
302 .Ss Example 9 : No Exporting a ZFS Storage Pool
303 The following command exports the devices in pool
305 so that they can be relocated or later imported:
306 .Dl # Nm zpool Cm export Ar tank
308 .Ss Example 10 : No Importing a ZFS Storage Pool
309 The following command displays available pools, and then imports the pool
311 for use on the system.
312 The results from this command are similar to the following:
313 .Bd -literal -compact -offset Ds
314 .No # Nm zpool Cm import
316 id: 15451357997522795478
318 action: The pool can be imported using its name or numeric identifier.
326 .No # Nm zpool Cm import Ar tank
329 .Ss Example 11 : No Upgrading All ZFS Storage Pools to the Current Version
330 The following command upgrades all ZFS Storage pools to the current version of
332 .Bd -literal -compact -offset Ds
333 .No # Nm zpool Cm upgrade Fl a
334 This system is currently running ZFS version 2.
337 .Ss Example 12 : No Managing Hot Spares
338 The following command creates a new pool with an available hot spare:
339 .Dl # Nm zpool Cm create Ar tank Sy mirror Pa sda sdb Sy spare Pa sdc
341 If one of the disks were to fail, the pool would be reduced to the degraded
343 The failed device can be replaced using the following command:
344 .Dl # Nm zpool Cm replace Ar tank Pa sda sdd
346 Once the data has been resilvered, the spare is automatically removed and is
347 made available for use should another device fail.
348 The hot spare can be permanently removed from the pool using the following
350 .Dl # Nm zpool Cm remove Ar tank Pa sdc
352 .Ss Example 13 : No Creating a ZFS Pool with Mirrored Separate Intent Logs
353 The following command creates a ZFS storage pool consisting of two, two-way
354 mirrors and mirrored log devices:
355 .Dl # Nm zpool Cm create Ar pool Sy mirror Pa sda sdb Sy mirror Pa sdc sdd Sy log mirror Pa sde sdf
357 .Ss Example 14 : No Adding Cache Devices to a ZFS Pool
358 The following command adds two disks for use as cache devices to a ZFS storage
360 .Dl # Nm zpool Cm add Ar pool Sy cache Pa sdc sdd
362 Once added, the cache devices gradually fill with content from main memory.
363 Depending on the size of your cache devices, it could take over an hour for
365 Capacity and reads can be monitored using the
367 subcommand as follows:
368 .Dl # Nm zpool Cm iostat Fl v Ar pool 5
370 .Ss Example 15 : No Removing a Mirrored top-level (Log or Data) Device
371 The following commands remove the mirrored log device
373 and mirrored top-level data device
376 Given this configuration:
377 .Bd -literal -compact -offset Ds
380 scrub: none requested
383 NAME STATE READ WRITE CKSUM
385 mirror-0 ONLINE 0 0 0
388 mirror-1 ONLINE 0 0 0
392 mirror-2 ONLINE 0 0 0
397 The command to remove the mirrored log
399 .Dl # Nm zpool Cm remove Ar tank mirror-2
401 The command to remove the mirrored data
403 .Dl # Nm zpool Cm remove Ar tank mirror-1
405 .Ss Example 16 : No Displaying expanded space on a device
406 The following command displays the detailed information for the pool
408 This pool is comprised of a single raidz vdev where one of its devices
409 increased its capacity by 10 GiB.
410 In this example, the pool will not be able to utilize this extra capacity until
411 all the devices under the raidz vdev have been expanded.
412 .Bd -literal -compact -offset Ds
413 .No # Nm zpool Cm list Fl v Ar data
414 NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
415 data 23.9G 14.6G 9.30G - 48% 61% 1.00x ONLINE -
416 raidz1 23.9G 14.6G 9.30G - 48%
422 .Ss Example 17 : No Adding output columns
423 Additional columns can be added to the
424 .Nm zpool Cm status No and Nm zpool Cm iostat No output with Fl c .
425 .Bd -literal -compact -offset Ds
426 .No # Nm zpool Cm status Fl c Pa vendor , Ns Pa model , Ns Pa size
427 NAME STATE READ WRITE CKSUM vendor model size
429 mirror-0 ONLINE 0 0 0
430 U1 ONLINE 0 0 0 SEAGATE ST8000NM0075 7.3T
431 U10 ONLINE 0 0 0 SEAGATE ST8000NM0075 7.3T
432 U11 ONLINE 0 0 0 SEAGATE ST8000NM0075 7.3T
433 U12 ONLINE 0 0 0 SEAGATE ST8000NM0075 7.3T
434 U13 ONLINE 0 0 0 SEAGATE ST8000NM0075 7.3T
435 U14 ONLINE 0 0 0 SEAGATE ST8000NM0075 7.3T
437 .No # Nm zpool Cm iostat Fl vc Pa size
438 capacity operations bandwidth
439 pool alloc free read write read write size
440 ---------- ----- ----- ----- ----- ----- ----- ----
441 rpool 14.6G 54.9G 4 55 250K 2.69M
442 sda1 14.6G 54.9G 4 55 250K 2.69M 70G
443 ---------- ----- ----- ----- ----- ----- ----- ----
446 .Sh ENVIRONMENT VARIABLES
447 .Bl -tag -compact -width "ZPOOL_STATUS_NON_NATIVE_ASHIFT_IGNORE"
451 to dump core on exit for the purposes of running
459 .It Sy ZPOOL_AUTO_POWER_ON_SLOT
460 Automatically attempt to turn on the drives enclosure slot power to a drive when
466 This has the same effect as passing the
468 option to those commands.
469 .It Sy ZPOOL_POWER_ON_SLOT_TIMEOUT_MS
470 The maximum time in milliseconds to wait for a slot power sysfs value
471 to return the correct value after writing it.
472 For example, after writing "on" to the sysfs enclosure slot power_control file,
473 it can take some time for the enclosure to power down the slot and return
474 "on" if you read back the 'power_control' value.
475 Defaults to 30 seconds (30000ms) if not set.
476 .It Sy ZPOOL_IMPORT_PATH
477 The search path for devices or files to use with the pool.
478 This is a colon-separated list of directories in which
480 looks for device nodes and files.
485 .It Sy ZPOOL_IMPORT_UDEV_TIMEOUT_MS
486 The maximum time in milliseconds that
488 will wait for an expected device to be available.
489 .It Sy ZPOOL_STATUS_NON_NATIVE_ASHIFT_IGNORE
490 If set, suppress warning about non-native vdev ashift in
491 .Nm zpool Cm status .
492 The value is not used, only the presence or absence of the variable matters.
493 .It Sy ZPOOL_VDEV_NAME_GUID
496 subcommands to output vdev guids by default.
497 This behavior is identical to the
498 .Nm zpool Cm status Fl g
500 .It Sy ZPOOL_VDEV_NAME_FOLLOW_LINKS
503 subcommands to follow links for vdev names by default.
504 This behavior is identical to the
505 .Nm zpool Cm status Fl L
507 .It Sy ZPOOL_VDEV_NAME_PATH
510 subcommands to output full vdev path names by default.
511 This behavior is identical to the
512 .Nm zpool Cm status Fl P
514 .It Sy ZFS_VDEV_DEVID_OPT_OUT
515 Older OpenZFS implementations had issues when attempting to display pool
516 config vdev names if a
518 NVP value is present in the pool's config.
520 For example, a pool that originated on illumos platform would have a
522 value in the config and
524 would fail when listing the config.
525 This would also be true for future Linux-based pools.
527 A pool can be stripped of any
529 values on import or prevented from adding
535 .Sy ZFS_VDEV_DEVID_OPT_OUT .
537 .It Sy ZPOOL_SCRIPTS_AS_ROOT
538 Allow a privileged user to run
539 .Nm zpool Cm status Ns / Ns Cm iostat Fl c .
540 Normally, only unprivileged users are allowed to run
542 .It Sy ZPOOL_SCRIPTS_PATH
543 The search path for scripts when running
544 .Nm zpool Cm status Ns / Ns Cm iostat Fl c .
545 This is a colon-separated list of directories and overrides the default
550 .It Sy ZPOOL_SCRIPTS_ENABLED
552 .Nm zpool Cm status Ns / Ns Cm iostat Fl c .
554 .Sy ZPOOL_SCRIPTS_ENABLED
555 is not set, it is assumed that the user is allowed to run
556 .Nm zpool Cm status Ns / Ns Cm iostat Fl c .
557 .\" Shared with zfs.8
558 .It Sy ZFS_MODULE_TIMEOUT
559 Time, in seconds, to wait for
565 .Sy 600 Pq 10 minutes .
573 .Sh INTERFACE STABILITY
578 .Xr zpool-features 7 ,
579 .Xr zpoolconcepts 7 ,
585 .Xr zpool-checkpoint 8 ,
588 .Xr zpool-destroy 8 ,
593 .Xr zpool-history 8 ,
595 .Xr zpool-initialize 8 ,
597 .Xr zpool-labelclear 8 ,
599 .Xr zpool-offline 8 ,
604 .Xr zpool-replace 8 ,
605 .Xr zpool-resilver 8 ,
612 .Xr zpool-upgrade 8 ,