Hailo cards are edge accelerators designed for video processing and computer-vision inference, not large AI/LLM workloads. They have limited on-board memory, so they are best suited to lightweight, real-time inference at the edge.
Before you begin
You’ll need:- A Talos Linux cluster running v1.11 or later.
- At least one node with a Hailo accelerator.
talosctlandkubectlconfigured and authenticated against your cluster.- The
siderolabs/hailortTalos system extension:
Enable Hailo support
System extensions are baked into the Talos boot image rather than installed at runtime. If your node booted from an image that does not includesiderolabs/hailort, add the extension by switching the node to an image that does. The node performs a standard upgrade cycle to boot into the new image.
- Standalone Talos
- Omni
Generate a new schematic that includes the For the full schematic workflow, see Boot Assets
siderolabs/hailort extension using the Talos Image Factory, then upgrade the node to the matching installer image:/dev/hailo0.
Verify Hailo support
After the node boots with the extension, confirm the driver is loaded and the device is available to your workloads.Step 1: Confirm the extension is installed
Check that thehailort extension is loaded on the node. Replace the <node-ip> placeholder with the IP address of your node:
hailort extension listed, along with its version:
Step 2: Create a namespace for the verification pod
The verification pod needs access to the host’s/dev directory, which requires privileged execution. Talos enforces Pod Security Admission at the baseline level by default, so rather than relaxing security on an existing namespace, create a dedicated namespace for the verification and allow privileged workloads:
Step 3: Run a verification pod
Create the verification pod. The pod mounts the host’s/dev directory and checks that the Hailo device node is present:
Step 4: Confirm the result
Read the pod logs:Step 5: Clean up
Remove the verification pod and its namespace:Going further: verify with the HailoRT CLI
The verification above confirms the device node is present and reachable from a workload. To confirm the card itself responds — for example, to read its firmware details — you can run the HailoRT CLI (hailortcli scan) from a container. See the HailoRT documentation for the available commands.
Troubleshooting
Issues can show up at two layers: the device may not be detected by the operating system, or it may be detected but not visible inside a pod. The following sections outline how to diagnose each.Device not detected
If the Hailo device does not appear:-
Confirm the system extension is installed:
-
Review the kernel logs for driver messages:
Device not visible inside the pod
If the pod cannot see/dev/hailo0:
- Confirm the namespace is labelled to allow privileged workloads.
-
Confirm the pod runs with
privileged: trueand mounts the host’s/devdirectory. - Confirm the device is detected on the node using the steps in Verify the card is detected.