Llama.cpp b11045 adds Hexagon ROLL support: an operator compatibility signal, not full-model validation

If your local inference workload is already known to require ROLL and you are considering Hexagon execution, llama.cpp b11045 gives you a specific reason to revisit compatibility. It does not establish that your model is ready to deploy.

The upstream b11045 release page labels the build a prerelease and announces “hexagon: add ROLL op support”, linking PR #29105. That is an operator-support announcement. The release page does not identify compatible models or devices, supported tensor configurations, numerical validation results, full-graph offload, or performance gains. The linked PR’s implementation and tests are not assessed here.

Start with the operator, not the whole model

My recommendation is a bounded compatibility trial before investing in full-model validation. These are proposed checks, not results reported by the release:

  1. Confirm that ROLL is relevant to your workload. Identify the operation and input configurations you actually need to exercise. Without that connection, this release note alone is not a reason to prioritize an upgrade.
  2. Establish the build and backend being tested. Record the exact runtime revision, build configuration and hardware. Verify that the intended Hexagon path is available before interpreting any successful run as evidence for it.
  3. Check actual ROLL execution on Hexagon. Use execution evidence sufficient to distinguish the intended backend from another execution path. A completed request without that attribution leaves the operator compatibility question open.
  4. Compare outputs with a trusted reference. Use the same inputs and operation configuration, with an explicit correctness criterion appropriate to the workload. The release note supplies neither a tolerance nor numerical results, so do not treat either as an upstream guarantee.

There is a download-selection trap here: the page lists Android arm64 (CPU) and Windows arm64 (OpenCL Adreno) assets. Neither label establishes Hexagon compatibility. Confirm the artifact’s backend support separately; an arm64 label is not enough to select a binary for this trial.

Keep the result narrower than the announcement

Use the trial to make the next investment decision:

Trial observation Next step
You cannot establish that ROLL executed on Hexagon Resolve build or execution attribution before calling the trial a compatibility pass.
Execution is established, but output comparison fails Investigate that configuration before advancing to full-model validation.
Execution and reference-output checks pass Proceed to full-model correctness and graph-coverage checks, retaining the exact tested configuration.

A passing operator trial should be recorded as evidence for that build, hardware, operation configuration and input set, not for every model that might use ROLL. Full-model correctness, which parts of the graph execute on the intended backend, and end-to-end performance remain separate questions to measure.

The useful decision from b11045 is therefore whether to reopen a specific ROLL compatibility test. It is not yet a deployment recommendation or a speedup claim.

Before treating a reference-output match as a pass, I would check whether the comparison can detect an incorrect ROLL result at all. That is a test-design condition, separate from proving that execution reached Hexagon.

For the initial probe, choose a configuration your workload actually needs and an input with distinguishable values. Establish the expected output independently, and confirm that it differs from the unchanged input. An input that happens to look identical after the intended transformation cannot distinguish correct execution from a no-op.

Then run a negative control through the comparison harness: deliberately supply the unchanged input as the candidate output, without changing the runtime implementation. The comparator should reject it under the same acceptance criterion used for the real output. If it accepts both, a successful backend run would still leave the correctness question unresolved; fix the fixture or criterion before expanding the trial.

This is a proposed evaluation method, not a report of tests in b11045 or its linked PR. It adds a useful stop condition to the compatibility decision: do not advance on a passing comparison until the harness also rejects a known-wrong result. Once that control works, broaden coverage to the configurations the workload requires. A sensitive single probe is a starting point, not evidence of general ROLL support across configurations.