Posts for: #zfs

OpenZFS Introduces New RAIDZ Expansion Feature

Phoronix reports that OpenZFS has recently added a new feature called RAIDZ expansion. This feature allows for the incremental addition of disks to a RAID-Z group, enabling users to expand the capacity of their RAID arrays one disk at a time. This feature is particularly useful for small pools.

The development of RAIDZ expansion has been in progress for several years, with the FreeBSD Foundation sponsoring the initial work in 2017. iXsystems and vStack have also provided sponsorship to complete this feature.

Source: Phoronix.

TrueNAS SCALE 23.10 Released with Enhanced SMB Features

TrueNAS has announced the release of TrueNAS SCALE 23.10 “Cobia,” the third major release of TrueNAS SCALE. This release brings improvements in quality, functionality, security, and performance.

One of the key highlights of the TrueNAS SCALE 23.10 release is the improvement in Server Message Block (SMB) features. SMB is the most common file sharing protocol and is widely supported on various platforms. The new features in this release include SMB and NFSv4 compatibility, SMB share import from other systems, SMB file sync with 3rd party servers, and fast file copy with ZFS block cloning.

In addition to the SMB features, TrueNAS SCALE 23.10 brings several other enhancements. The infrastructure has been improved with Linux Kernel 6.1 and better hardware support, NVIDIA driver updates, and Netdata backend stats collection. The web interface has also been enhanced with improved Apps and Storage Pool UI, as well as simplified feedback and bug reporting.

TrueNAS SCALE 23.10 also includes updates to ZFS and performance improvements. It features OpenZFS 2.2 with contributions from iXsystems, ZFS block cloning for faster file copies, ZFS dRAID pool layouts, and improved ZFS scrub controls. The release also brings updates to protocols and services such as Samba security and speed improvements, simplified SMB cluster expansion via TrueCommand 3.0 (coming soon), and iSCSI improvements.

TrueNAS 13.1, which is planned for release in early 2024, will inherit some of the improvements from TrueNAS SCALE Cobia. This update will include the SMB and ZFS enhancements implemented and tested in Cobia. Nightly versions of TrueNAS 13.1 are available for testing and contribution to the development process.

TrueNAS SCALE 22.12.4.2 is the final version of Bluefin, and going forward, TrueNAS SCALE 23.10 Cobia will gradually become the recommended version. No further versions of Bluefin are planned. TrueNAS provides options for migrating storage services and VMs from CORE to SCALE, and plugins and jails can be manually replaced with Apps.

The TrueNAS installer can be downloaded from the TrueNAS website or the system update feature within an existing TrueNAS installation.

TrueNAS Highlights of OpenZFS Summit: Fast Dedup and RAIDZ Expansion

TrueNAS, a leading provider of storage systems, uses OpenZFS as the foundation for its data management layer. As the deployment vehicle for the majority of OpenZFS storage systems used today, TrueNAS is excited about the continuous improvement of OpenZFS.

The 11th annual OpenZFS Developer Summit for 2023 kicked off on October 16th in San Francisco. Among the many exciting projects being developed, two projects stand out with significant contributions and investments from iXsystems.

One of the primary issues with traditional deduplication (dedup) with ZFS has been the need to keep the dedup tables in memory at all times, which led to performance penalties and usability issues. However, with the introduction of Fast Dedup, the metadata size is now constrained to fit in either RAM or flash, eliminating the performance penalty. The metadata structure for Fast Dedup has been completely re-engineered to allow efficient updates and the ability to evict non-deduplicated blocks. These improvements, combined with properly configured storage, will result in a significant improvement in dedup performance for larger systems. Allan Jude, a major sponsor of the Fast Dedup project, will be presenting the details at the summit.

RAIDZ expansion is another exciting project that is entering its final quality assurance cycle. This feature allows a small pool with as few as two drives to be gradually expanded with one drive at a time, preserving existing data with its original parity. The administrative process for small systems has also been simplified. Don Brady and Matt Ahrens will be presenting the latest updates on RAIDZ expansion at the summit. This project has taken a few years but is now in its final stretch and will be included in OpenZFS 2.3.

The current release, OpenZFS 2.2, has been integrated into TrueNAS SCALE 23.10 (Cobia). The release candidate version of Cobia, which includes dRAID, has been successfully provided to the community with over 3,000 testers. The formal release of TrueNAS SCALE 23.10 is planned in the coming weeks. In early 2024, TrueNAS CORE 13.1 will be released with OpenZFS 2.2, and TrueNAS Enterprise appliances will also use OpenZFS 2.2 in their respective software versions.

OpenZFS 2.3 (or potentially 3.0) is expected to take most of the next 12 months to mature and reach release quality and status. The RAIDZ expansion and Fast Dedup features will be integrated with TrueNAS at that time. Early availability of Nightlies and BETA software is expected in mid-2024 for TrueNAS SCALE.

Source: TrueNAS.

OpenZFS Releases Version 2.2.0

OpenZFS has announced the release of version 2.2.0, an open-source implementation of the ZFS file system and volume manager. This release comes with several new features and performance improvements.

One notable new feature is block cloning, which allows for the creation of shallow copies of files or parts of files. This facility is used to implement “reflinks” or “file-level copy-on-write”. Additionally, Linux container support has been added, including support for Linux-specific container interfaces such as renameat(2), overlayfs, idmapped mounts in a user namespace, and namespace delegation support for containers.

Another important addition is the scrub error log, which allows zpool status to report all affected filesystems, snapshots, and clones when a shared corrupt block is found. The zpool scrub -e command can be used to perform a fast, targeted repair of known damaged blocks.

In terms of performance, this release introduces fully adaptive ARC, which allows the ARC to better adjust to highly dynamic workloads and minimizes the need for manual workload-dependent tuning. It also includes optimized SHA2 and Edon-R checksum implementations, as well as improvements in prefetching and general optimization.

For those interested in the technical details, the complete change log and module options are available in the OpenZFS documentation.

Overall, the release of version zfs-2.2.0 brings exciting new features and performance improvements to the OpenZFS/ZFS on Linux community. It is recommended for users who are looking to enhance their server, Linux, DevOps, and home lab environments.

For more information, please refer to the OpenZFS documentation for Linux and FreeBSD, and the complete change log.

OpenZFS Releases 2.2.0-rc5

OpenZFS has launched release candidate 5 (rc5) of version v2.2.0.

The release includes several changes and updates, including improvements to ZIL (ZFS Intent Log), rpm fixes, enhancements to zfsconcepts, and updates to ARC (Adaptive Replacement Cache) headers. Additionally, there are compatibility updates for Linux and FreeBSD platforms.

Here are the supported platforms for this release:

  • Linux: compatible with 3.10 - 6.5 kernels
  • FreeBSD: compatible with releases starting from 12.2-RELEASE

The release candidate includes numerous bug fixes and enhancements to improve stability and performance. It is recommended for users who are interested in testing the latest features and providing feedback to the OpenZFS community.

To learn more and download the release candidate, visit the official OpenZFS GitHub page at https://github.com/openzfs/zfs/releases/tag/zfs-2.2.0-rc5.

TrueNAS Scale Gets New Web Interface in Cobia Release

TrueNAS SCALE is introducing a new and improved WebUI in the upcoming Cobia (23.10) release. The first Release Candidate for Cobia was launched on September 19th, and it currently has over 2,000 systems running on it. The official release of 23.10 is scheduled for October. The Cobia release includes significant technical advancements such as the new dRAID “Distributed RAID” pool type, an improved Apps UI, and an integrated bug-reporting process.

The new Cobia WebUI has been rearchitected from the CORE WebUI to provide a simpler interface. It is designed to present only the necessary information on each page, with advanced features hidden by default and additional forms appearing as needed. Initial reviews of this modernized and streamlined UI have been positive.

Major improvements have been made to the WebUI in Cobia, including:

  • Improved Apps Screens
  • Reimagined ZFS Storage Dashboard
  • New and Improved Pool Creation Wizard
  • Built-in Feedback and Bug Reporting

The Apps Screens in TrueNAS SCALE have been significantly enhanced. Each App is now effectively a Kubernetes Helm Chart that points to container images and provides configuration information for integrating multiple containers into an application. The new Apps screens offer better-structured access to all Apps based on category, and the new Discovery screens assist with App discovery. The Information screen provides details about each App and its sources, and bulk operations for updating Apps are available.

The ZFS Storage Dashboard in Cobia has also been reimagined to handle larger systems with more than a thousand drives. A new Pool Creation Wizard simplifies the process of creating pools based on available resources, automatically selecting drives for vdevs (drive groups) based on their size. The updated Storage Dashboard provides a simple dashboard to display the status of each pool and allows for the creation of new pools or expansion of existing ones using unassigned disks.

A new Feedback and Bug Reporting system has been introduced with TrueNAS SCALE Cobia RC.1. Users can provide feedback on the design of the page, add important details for their use case, and optionally capture a screenshot of the current page. Bug reports can also be submitted, including a brief summary of the issue and the option to attach debug files. Users will receive a TrueNAS ticket link to monitor the status and resolution of their bug.

While TrueNAS encourages users to try out the early releases of TrueNAS SCALE Cobia and provide feedback, it is recommended to use TrueNAS SCALE 22.12.3.3 for cases where reliability and primary data retention are required. TrueNAS SCALE 22.12.4, which is planned for release in early October, will be the last major update for the 22.12 release branch. TrueNAS SCALE Cobia will gradually become the recommended version in Q4 2023 and beyond.

Users have the option to automatically migrate storage services and VMs from CORE to SCALE, and TrueNAS provides the ability to replace TrueNAS CORE Plugins and jails with Apps. For further advice or answers to questions, users can visit the TrueNAS Community Forums or Discord Channel.

Source: TrueNAS.