Any Linux box with a USB-C port can now pick up 40 TOPS of dedicated AI inference. The ASUS UGen300 is a fanless dongle built around the Hailo-10H processor, paired with 8 GB of LPDDR4 running at 4266 MT/s. It measures 10.5 x 5.0 x 1.8 cm (4.1 x 2.0 x 0.7 in), weighs 145 g (5.1 oz), and draws a typical 2.5 W from the USB bus. That makes it a genuinely portable accelerator for mini PCs, single-board computers, or laptops running x86 or Arm hosts on Linux, Windows, or Android.
The Hailo-10H inside delivers 40 TOPS at INT4 or 20 TOPS at INT8, and the dongle connects over USB 3.2 Gen 2 at 10 Gbps. That interface is the key difference from the Raspberry Pi AI HAT+ 2, which uses the same silicon but sits on a PCIe lane and only fits a Pi 5. The UGen300 trades some bus bandwidth for universal compatibility, meaning it works just as well plugged into a Beelink mini PC or a Radxa board as it does on a full desktop.
On the software side, the runtime that drives it is open source. HailoRT provides C/C++ and Python APIs, compiles from source for both x86 and Arm Linux, and its master branch already covers the Hailo-10H family. Hailo also distributes HailoRT 5.3.0 as prebuilt Debian packages, with a separate hailort-usb-driver for the USB interface and the main hailort runtime, both available for amd64 and arm64. ASUS ships documentation and Python tutorials for LLM, VLM, and speech-to-text workflows, and the device supports frameworks including TensorFlow, PyTorch, and ONNX with over 150 pre-trained models available. The Asus-UGen-Series GitHub organization accompanies the product line with a Linux-based UGen Utility for validating Hailo pre-trained models and an official Linux firmware upgrade guide with packages tested on Ubuntu 22.04.5, Raspberry Pi 5, and Tinker Board. Worth noting: the Hailo-10H is strongest at accelerating vision workloads. For LLMs it functions more as an offloader, freeing host CPU and memory rather than dramatically speeding up token generation.
The UGen300 is available now at $300 (€276). An M.2 variant of the same Hailo-10H module with 8 GB is listed at $260 (€239), and a 2 GB version is in development but not yet on sale.
