Posts for: #zfs-on-linux

Improved Deduplication Efficiency in OpenZFS

iXsystems and Klara are collaborating to implement Fast Dedup support in OpenZFS, with plans to integrate these improvements into TrueNAS SCALE starting next month.

The upgraded OpenZFS Fast Dedup brings a significant overhaul to the file system’s deduplication capabilities. Notable improvements include addressing challenges related to deduplication hash tables, ensuring they are in memory when needed, and tackling performance and scalability issues. The new iteration allows dynamic sizing of metadata to fit in RAM or dedicated flash devices. The metadata structure has undergone a re-engineering process, and the deduplication table now prioritizes dedup-able data while efficiently pruning blocks with no deduplication potential.

For further insights into the OpenZFS Fast Dedup feature, refer to the iXsystems blog.

Source: Phoronix.

TrueNAS 13.0-U6.1 Release: Concluding the TrueNAS 13.0 Series

TrueNAS 13.0-U6.1 Release: Concluding the TrueNAS 13.0 Series

TrueNAS, the open-source storage platform developed by iXsystems, has announced the release of TrueNAS 13.0-U6.1. This update is expected to be the final version of TrueNAS 13.0, following a series that has been recognized for its stability and quality.

Incremental Improvements and Bug Fixes

TrueNAS 13.0-U6.1 includes updates to OpenZFS, addressing approximately 20 bug fixes and security improvements. Notably, this release incorporates OpenZFS 2.1.14 to correct a rarely-occurring upstream ZFS bug. The incremental improvements aim to enhance the overall performance and reliability of the platform.

Transition to TrueNAS 13.1

With TrueNAS 13.0-U6.1 serving as the concluding chapter of the 13.0 series, the development focus will shift to TrueNAS 13.1, scheduled for release in early 2024. The upcoming version is expected to maintain storage-focused features with updates to FreeBSD, OpenZFS, Samba, and other key components.

Recommendations for Users

TrueNAS recommends that existing users of TrueNAS 12.0 and TrueNAS 11.3 update their systems to TrueNAS 13.0-U6.1. This step is advised not only for resolving any software or performance issues but also to prepare for future updates, including the transition to TrueNAS 13.1 in 2024.

Current TrueNAS 13.0 users can update to U6.1 directly from the TrueNAS web UI by navigating to the System -> Update page. New users can get started by downloading the TrueNAS CORE installation media from the official website.

Looking Ahead

As TrueNAS continues to evolve, the focus remains on providing a reliable and efficient storage solution. TrueNAS Enterprise users will have the option to sidegrade to TrueNAS SCALE Enterprise 23.10 and other SCALE-based releases, catering to specific functionality requirements.

For detailed recommendations and updates, users are encouraged to refer to the TrueNAS Software Status page, which provides the latest information on stability and security releases.

OpenZFS/ZFS on Linux Releases Versions 2.2.2 and 2.1.14, Addressing Critical Data Corruption Issue

OpenZFS has released versions 2.2.2 and 2.1.14 to address a critical data corruption issue.

The bug, which was discovered due to changes in cp in coreutils 9.x, could cause data corruption due to an incorrect dirty dnode check. While it is unlikely that the bug was encountered on EL7, EL8, or EL9 when running cp, it is still recommended that users upgrade to either version 2.2.2 or 2.1.14 to ensure the fix is applied.

In addition to the data corruption fix, the release includes several other bug fixes and improvements. These include fixing ZFS so that snapshots under .zfs/snapshot are NFS visible on FreeBSD, addressing compatibility issues with Linux 6.6, and fixing build and shell-init errors on FreeBSD.

For a full list of changes and bug fixes, refer to the release notes.

OpenZFS Continues to Grapple with Data Corruption Challenges

Last week saw the release of OpenZFS 2.2.1, which was initially believed to have fixed a data corruption issue attributed to a block cloning bug in a new feature introduced in the v2.2 release. However, further investigation over the US holiday weekend revealed that the block cloning feature was not the root cause, and both v2.2.1 and pre-v2.2 releases remain susceptible to data corruption.

It has been discovered that the data corruption bug affects not only the v2.2 release but also older versions of OpenZFS. While real-world instances of data corruption are believed to be limited, scripting can reproduce the issue. Additionally, it is now understood that the OpenZFS 2.2 block cloning feature increases the likelihood of encountering the problem.

The FreeBSD project has issued an advisory regarding the OpenZFS data corruption issue and recommends a workaround involving setting sysctl vfs.zfs.dmu_offset_next_sync=0 to “drastically reduce the likelihood” of experiencing the problem.

A pending pull request on GitHub is anticipated to address the OpenZFS data corruption issue. Hopefully, a new OpenZFS point release will be available soon, effectively resolving the data corruption problem.

Source: Phoronix.

ZFS on Linux (OpenZFS) Unveils Important Version 2.2.1 Update

ZFS on Linux (OpenZFS), the open-source implementation of the ZFS file system and volume manager, has released an important update, version 2.2.1. Users are recommended to update to this release, especially if they are currently running 2.2.0, to avoid the block cloning bug. Users running older versions of ZFS are unaffected by this issue.

Changes in version 2.2.1 include:

  • Disabling block cloning by default to fix a block cloning bug that could result in data corruption
  • Adding a tunable to disable BRT support
  • Auto-generating changelog during configure for packaging
  • Compatibility updates for Linux 6.6
  • Various bug fixes and optimizations

Supported Platforms:

  • Linux: compatible with 3.10 - 6.6 kernels
  • FreeBSD: compatible with releases starting from 12.2-RELEASE

For more information and to download the latest release, visit the OpenZFS GitHub page.

TrueNAS F-Series: TrueNAS Performance Flagship Models

TrueNAS has introduced the F60 and F100 models as the newest additions to their TrueNAS Enterprise portfolio. These models belong to the high-performance line of all-NVMe systems known as the TrueNAS F-Series. The F-Series is designed to offer maximum performance, reliability, and density for organizations with ultra-demanding workloads. It provides organizations with a new choice for their performance-centric workloads, complementing other models in the TrueNAS portfolio that are optimized for capacity.

The TrueNAS F-Series supports file, block, and object protocols, and offers the rich data management capabilities of OpenZFS. Like other TrueNAS Enterprise appliances, the F-Series can be equipped with iXsystems’ award-winning enterprise support.

The TrueNAS F-Series includes two models:

  • F100: This model features up to 24 NVMe Gen4 SSDs per 2U system, providing a storage capacity of 720TB. It offers up to 30GB/s bandwidth per node with 6x 40/100 GbE optical NICs and has a typical power draw of 800W.
  • F60: The F60 model also supports up to 24 NVMe Gen4 SSDs per 2U system, with a storage capacity of 720TB. It offers up to 20GB/s bandwidth per node with 4x 40/100 GbE optical NICs and has a typical power draw of 800W.

The TrueNAS F-Series appliances come with the latest version of TrueNAS software, TrueNAS Enterprise 23.10. These all-NVMe models are designed to deliver maximum performance, reliability, and density for the most demanding workloads. Compared to previous models, the F-Series offers significant reductions in all-flash power, space, and Total Cost of Ownership (TCO).

The TrueNAS portfolio also includes the TrueNAS M-Series, which caters to hybrid flash and HDD requirements, and the TrueNAS Mini series. Both the M-Series and F-Series systems run on the same TrueNAS Enterprise 23.10 software, offering compatible features and a common WebUI. All TrueNAS systems can be monitored and managed as a fleet using TrueCommand.