Measured browser compatibility for LiteRT (.tflite) models: what loads, what delegates to WebGPU, what matches CPU outputs, and at what latency. Passing and failing models are listed — a model that does not run in the browser is information.
Every number is labeled with the environment that produced it — headless desktop Chromium is not a user’s phone, and results are only meaningful together with their environment. Click a column header to sort.
| Model | Task | Native delegation | wasm_xnnpack | webgpu_mldrift | Device runs | Card | Demo |
|---|---|---|---|---|---|---|---|
3ddfa-v2 | keypoint-detection | — | pass · 25.31 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 1.255 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 3.539 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
6drepnet-headpose | image-classification | — | pass · 240.73 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 17.325 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 140.556 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
audio8-tts-preview-0.6b__codec_decoder_fp16_t128 | text-to-speech | gpu_mldrift @ litert 2.2.0: 81.6% · 154 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-28 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-28 | not measured | CARD.md · card.json | — |
audio8-tts-preview-0.6b__codec_decoder_fp16_t192 | text-to-speech | gpu_mldrift @ litert 2.2.0: 81.6% · 154 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-28 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-28 | not measured | CARD.md · card.json | — |
audio8-tts-preview-0.6b__codec_decoder_int8_t128 | text-to-speech | gpu_mldrift @ litert 2.2.0: 90% · 74 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-28 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-28 | not measured | CARD.md · card.json | — |
audio8-tts-preview-0.6b__codec_encoder_fp16_10s | text-to-speech | gpu_mldrift @ litert 2.2.0: 83.5% · 210 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-28 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-28 | not measured | CARD.md · card.json | — |
audio8-tts-preview-0.6b__fast_ar_int8 | text-to-speech | gpu_mldrift @ litert 2.2.0: 91.2% · 10 partition(s) | pass · 2.48 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-28 | output_mismatch · 3.423 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-28 | not measured | CARD.md · card.json | run it |
audio8-tts-preview-0.6b__slow_ar_int4 | text-to-speech | gpu_mldrift @ litert 2.2.0: 93.5% · 104 partition(s) | not measured | not measured | mac-studio-m4-max cpu_xnnpack: passMac Studio (M4 Max) · Apple M4 Max · litert 2.2.0 · macOS 27.0 (26A428) · 2026-09-28 | CARD.md · card.json | — |
audio8-tts-preview-0.6b__slow_ar_int8 | text-to-speech | gpu_mldrift @ litert 2.2.0: 93.5% · 104 partition(s) | not measured | not measured | mac-studio-m4-max cpu_xnnpack: passMac Studio (M4 Max) · Apple M4 Max · litert 2.2.0 · macOS 27.0 (26A428) · 2026-09-28mac-studio-m4-max cpu_xnnpack: passMac Studio (M4 Max) · Apple M4 Max · litert 2.2.0 · macOS 27.0 (26A428) · 2026-09-28 | CARD.md · card.json | — |
basic-pitch | audio-classification | — | pass · 24.417 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 6.148 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 248.21 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 4544.38 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 23.973 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
bisenet-face-parsing | image-segmentation | — | pass · 442.142 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 79.592 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 249.388 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
bitcpm-cann-1b-int4 | text-generation | — | not measured | not measured | mac-studio-m4-max gpu: pass · 188.85 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · 2026-08-12pixel-8a gpu: pass · 7.84 tok/s decodePixel 8a · Google Tensor G3 · litert-lm gallery-1.0.15 · 2026-07-23 | CARD.md · card.json | — |
clipseg-rd64__clipseg_decoder | image-segmentation | — | pass · 21.015 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 4.105 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 3.252 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 1.67 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 19.04 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
clipseg-rd64__clipseg_text_fp16 | image-segmentation | — | pass · 370.805 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 8.715 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 6.199 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 2.1 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 69.883 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
clipseg-rd64__clipseg_vision_fp16 | image-segmentation | — | pass · 4231.068 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 41.017 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 35.509 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 15.903 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 856.718 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
cloth-segmentation-u2net | image-segmentation | — | pass · 9313.855 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 114.715 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 6544.635 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
cmgan | audio-to-audio | — | pass · 9213.145 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 114.805 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 376.162 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: load_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 7768.922 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
cpga-net-lowlight | image-to-image | — | pass · 248.613 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 17.345 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 14.94 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 4.62 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 78.796 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
crepe-pitch | audio-classification | — | pass · 188.315 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 6.043 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 49.534 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
d-fine-s__dfine_grapha_fp16 | object-detection | — | pass · 1461.235 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 47.127 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 19.73 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 23.812 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 358.316 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
d-fine-s__dfine_graphb_fp16 | object-detection | — | pass · 432.95 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 25.665 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 134.036 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 172.363 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 1018.76 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
decider-2b-vision-fp16 | image-text-to-text | — | not measured | not measured | mac-studio-m4-max cpu: passMac Studio (M4 Max) · Apple M4 Max · litert-lm 0.17.1 · macOS 27.0 (26A428) · 2026-09-29mac-studio-m4-max cpu_xnnpack: passMac Studio (M4 Max) · Apple M4 Max · litert 2.2.0 · macOS 27.0 (26A428) · 2026-09-29mac-studio-m4-max gpu: passMac Studio (M4 Max) · Apple M4 Max · litert-lm 0.17.1 · macOS 27.0 (26A428) · 2026-09-29 | CARD.md · card.json | — |
decider-2b-vision-fp16-int8vocab | image-text-to-text | — | not measured | not measured | mac-studio-m4-max cpu: passMac Studio (M4 Max) · Apple M4 Max · litert-lm 0.17.1 · macOS 27.0 (26A428) · 2026-09-29mac-studio-m4-max cpu_xnnpack: passMac Studio (M4 Max) · Apple M4 Max · litert 2.2.0 · macOS 27.0 (26A428) · 2026-09-29mac-studio-m4-max gpu: passMac Studio (M4 Max) · Apple M4 Max · litert-lm 0.17.1 · macOS 27.0 (26A428) · 2026-09-29 | CARD.md · card.json | — |
decider-2b-vision-int8 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.1 · Android 16 · 2026-09-29galaxy-s26 cpu: fallback stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-29galaxy-s26 gpu: pass stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.1 · Android 16 · 2026-09-29galaxy-s26 gpu: pass stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-29mac-studio-m4-max cpu: passMac Studio (M4 Max) · Apple M4 Max · litert-lm 0.17.1 · macOS 27.0 (26A428) · 2026-09-29mac-studio-m4-max gpu: passMac Studio (M4 Max) · Apple M4 Max · litert-lm 0.17.1 · macOS 27.0 (26A428) · 2026-09-29 | CARD.md · card.json | — |
deepseek-r1-distill-qwen-7b-q4-block32-ekv4096 | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 8.43 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 1.76 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
dehazeformer-mct | image-to-image | — | pass · 709.245 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 96.34 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 2183.792 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
dewarpnet | image-to-image | — | pass · 633.472 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 22.56 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 593.957 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
dinov2-vit-s14 | image-feature-extraction | — | pass · 2977.405 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 29.86 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | not measured | CARD.md · card.json | run it |
dis-isnet | image-segmentation | — | pass · 4440.095 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 65.37 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 2956.654 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
dm-count-crowd | image-to-image | — | pass · 2999.897 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 14.847 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 1923.847 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
edsr-x4 | image-to-image | — | pass · 1531.135 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 31.675 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 1015.911 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
example-tiny-clean | image-classification | gpu_mldrift @ litert 0.0.0-example: 100% · 1 partition(s) | not measured | not measured | example-phone cpu_xnnpack: pass · 4.8 ms exampleExample Phone · Example SoC · litert 0.0.0-example · EXAMPLE.240001.001 · 2026-01-01example-phone npu_qnn: fallback · 1.2 ms exampleExample Phone · Example SoC · litert 0.0.0-example · QNN SDK 0.0.0-example · EXAMPLE.240001.001 · 2026-01-01 | CARD.md · card.json | — |
example-tiny-mixed | image-segmentation | gpu_mldrift @ litert 0.0.0-example: 40% · 1 partition(s) | not measured | not measured | example-workstation gpu: pass · 45.6 tok/s decode exampleExample Workstation · Example Desktop SoC · litert-lm 0.0.0-example · macOS 0.0-example · 2026-01-02 | CARD.md · card.json | — |
example-web-a | example-elementwise | — | pass · 0.032 ms exampleexample-dev-mac-arm64 · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-10 | pass · 0.55 ms exampleexample-dev-mac-arm64 · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-10 | not measured | CARD.md · card.json | run it |
example-web-b | example-elementwise | — | pass · 0.043 ms exampleexample-dev-mac-arm64 · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-10 | pass · 0.635 ms exampleexample-dev-mac-arm64 · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-10 | not measured | CARD.md · card.json | run it |
falcon-h1-0.5b-instruct-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 40.48 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 28.14 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24pixel-8a cpu: fallback · 25.86 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05raspberry-pi-5 cpu: pass · 7 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
falcon-h1-1.5b-deep-instruct-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 11.97 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 6 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 2.05 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
falcon-h1-1.5b-instruct-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 20.71 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 20.6 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 3.38 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
falcon-h1-tiny-r-0.6b-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 23.9 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 16.13 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05iphone-17-pro cpu: pass · 29.38 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-09-01iphone-17-pro gpu: pass · 22.84 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-09-01mac-studio-m4-max cpu: pass · 47.75 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-01mac-studio-m4-max gpu: pass · 97.76 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-01pixel-8a cpu: fallback · 14.02 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05pixel-8a gpu: pass · 9.98 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05 | CARD.md · card.json | — |
falconh1-3b | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 11.49 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24iphone-17-pro cpu: pass · 7.85 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-14iphone-17-pro gpu: pass · 14.04 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-14mac-m4-max cpu: pass · 20.88 tok/s decode stale — latest known 0.17.1mac-m4-max · litert-lm 0.16.0 · 2026-08-14mac-m4-max gpu: pass · 65.32 tok/s decode stale — latest known 0.17.1mac-m4-max · litert-lm 0.16.0 · 2026-08-14raspberry-pi-5 cpu: pass · 1.9 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
fast-neural-style__style_candy_fp16 | image-to-image | — | pass · 1307.595 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 7.34 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 13.875 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 7.405 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 287.492 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
fast-neural-style__style_mosaic_fp16 | image-to-image | — | pass · 1307.638 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 7.19 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 13.845 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 7.414 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 288.032 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
fast-neural-style__style_rain_princess_fp16 | image-to-image | — | pass · 1307.967 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 7.342 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 13.845 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 7.481 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 287.576 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
fast-neural-style__style_udnie_fp16 | image-to-image | — | pass · 1307.873 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 7.373 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 13.764 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 7.415 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 287.501 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
fastcontext-1.0-4b-sft-model-block128 | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 7.49 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 1.49 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
fastcontext-4b | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 7.14 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05mac-studio-m4-max gpu: pass · 74.53 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-23raspberry-pi-5 cpu: pass · 1.44 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
fun-asr-nano-2512 | automatic-speech-recognition | — | not measured | not measured | galaxy-s26 cpu: pass · 1237.1 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.17.1 · Android 16 · 2026-09-27galaxy-s26 cpu: fallback · 31.55 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.1 · Android 16 · 2026-09-27galaxy-s26 gpu: pass · 26.26 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.1 · Android 16 · 2026-09-27mac-studio-m4-max cpu: pass · 48.94 tok/s decodeMac Studio (M4 Max) · Apple M4 Max · litert-lm 0.17.1 · macOS 27.0 · 2026-09-27mac-studio-m4-max cpu: pass · 50.21 tok/s decodeMac Studio (M4 Max) · Apple M4 Max · litert-lm 0.17.1 · macOS 27.0 · 2026-09-27mac-studio-m4-max gpu: pass · 143.03 tok/s decodeMac Studio (M4 Max) · Apple M4 Max · litert-lm 0.17.1 · macOS 27.0 · 2026-09-27mac-studio-m4-max gpu: pass · 137.18 tok/s decodeMac Studio (M4 Max) · Apple M4 Max · litert-lm 0.17.1 · macOS 27.0 · 2026-09-27 | CARD.md · card.json | — |
gfpgan-v1.4__gfpgan_fp16 | image-to-image | — | pass · 10.412 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 60.61 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 88.949 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 32.258 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 4085.305 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
gfpgan-v1.4__yunet_fp16 | image-to-image | — | not measured | not measured | galaxy-s26 gpu_mldrift: pass · 3.277 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 1.828 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 33.537 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | — |
gliformer-large-ner__gliformer_large_ner_s128_wfp16 | token-classification | gpu_mldrift @ litert 2.2.0: 83.6% · 681 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | galaxy-s26 cpu_xnnpack: fallback · 322.54960900000003 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 cpu_xnnpack: fallback · 189.904922 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 gpu_mldrift: output_mismatch · 46.997577500000006 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 gpu_mldrift: pass · 82.27380199999999 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 gpu_mldrift: output_mismatch · 116.21625 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26 | CARD.md · card.json | — |
gliformer-large-ner__gliformer_large_ner_s256_encoder_wfp16 | token-classification | gpu_mldrift @ litert 2.2.0: 89.1% · 194 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | galaxy-s26 gpu_mldrift: output_mismatch · 175.55677 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 gpu_mldrift: pass · 390.950938 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26 | CARD.md · card.json | — |
gliformer-large-ner__gliformer_large_ner_s256_head_wfp16 | token-classification | gpu_mldrift @ litert 2.2.0: 79.6% · 2568 partition(s) | pass · 2425.31 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | galaxy-s26 cpu_xnnpack: fallback · 167.031874 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 cpu_xnnpack: fallback · 128.378021 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26 | CARD.md · card.json | run it |
gliformer-large-ner__gliformer_large_ner_s512_encoder_wfp16 | token-classification | gpu_mldrift @ litert 2.2.0: 89.1% · 194 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | galaxy-s26 gpu_mldrift: output_mismatch · 931.4937235 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26 | CARD.md · card.json | — |
gliformer-large-ner__gliformer_large_ner_s512_head_wfp16 | token-classification | gpu_mldrift @ litert 2.2.0: 79.6% · 5128 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | galaxy-s26 cpu_xnnpack: fallback · 348.8584375 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26 | CARD.md · card.json | — |
gliner2.5-decide__gliner25_decide_s128_wfp16 | text-classification | gpu_mldrift @ litert 2.2.0: 89% · 196 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | galaxy-s26 cpu_xnnpack: pass · 213.804844 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 gpu_mldrift: pass · 69.639375 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 gpu_mldrift: pass · 83.143021 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26 | CARD.md · card.json | — |
gliner2.5-decide__gliner25_decide_s256_wfp16 | text-classification | gpu_mldrift @ litert 2.2.0: 89% · 196 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | galaxy-s26 cpu_xnnpack: pass · 509.982031 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 cpu_xnnpack: pass · 474.6950255 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 gpu_mldrift: pass · 198.833698 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 gpu_mldrift: pass · 205.67757749999998 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26 | CARD.md · card.json | — |
gliner2.5-decide__gliner25_decide_s512_wfp16 | text-classification | gpu_mldrift @ litert 2.2.0: 89% · 196 partition(s) | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-26 | galaxy-s26 cpu_xnnpack: pass · 1665.9826295 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 cpu_xnnpack: pass · 1242.723984 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 gpu_mldrift: pass · 733.1154160000001 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26galaxy-s26 gpu_mldrift: pass · 639.23664 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36, build BP4A.251205.006) · 2026-09-26 | CARD.md · card.json | — |
granite-4.0-h-1b | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 29.39 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 24.06 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · 2026-08-12raspberry-pi-5 cpu: pass · 4.38 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
granite-4.0-h-350m-fp16 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 9.54 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: load_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · 2026-08-12raspberry-pi-5 cpu: pass · 3.83 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
granite-4.0-h-350m-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 11.48 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: load_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-06pixel-8a cpu: fallback · 8.86 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05raspberry-pi-5 cpu: pass · 5.57 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
granite-4.0-h-350m-int8-gpu | text-generation | — | not measured | not measured | galaxy-s26 cpu: pass · 95.16 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-27galaxy-s26 gpu: pass · 47.87 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-27iphone-17-pro cpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-08-28iphone-17-pro gpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-08-28pixel-8a cpu: fallback · 40.7 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-07pixel-8a gpu: pass · 20.7 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-07raspberry-pi-5 cpu: pass · 14.04 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
granite-4.1-3b-int4 | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 15.28 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-m4-max gpu: pass · 38.06 tok/s decode stale — latest known 0.17.1Mac Studio M4 Max · litert-lm 0.16.0 · 2026-08-17pixel-8a gpu: pass · 7.07 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · 2026-08-17raspberry-pi-5 cpu: pass · 2.16 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
granite-4.1-3b-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 8.61 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-06galaxy-s26 gpu: pass · 9.52 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-25mac-m4-max gpu: pass · 32.74 tok/s decode stale — latest known 0.17.1Mac Studio M4 Max · litert-lm 0.16.0 · 2026-08-17pixel-8a gpu: pass · 3.86 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · 2026-08-17raspberry-pi-5 cpu: pass · 1.73 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
granite-4.2-3b-int4 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 9.83 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-31galaxy-s26 gpu: pass · 15.61 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-31iphone-17-pro cpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-08-31iphone-17-pro gpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-08-31mac-studio-m4-max cpu: pass · 21.47 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-08-31mac-studio-m4-max gpu: pass · 85.46 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-08-31raspberry-pi-5 cpu: pass · 2.15 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
granite-4.2-3b-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 7.03 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-31galaxy-s26 gpu: pass · 9.22 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-31mac-studio-m4-max cpu: pass · 21.12 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-08-31mac-studio-m4-max gpu: pass · 70.65 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-08-31raspberry-pi-5 cpu: pass · 1.73 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
granite-docling-258m | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.1 · Android 16 · 2026-08-24galaxy-s26 cpu: fallback · 33.49 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: load_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.1 · Android 16 · 2026-08-24pixel-8a cpu: fallback · 23.25 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05pixel-8a gpu: run_failed stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05 | CARD.md · card.json | — |
granite4h-1b-gpufix | text-generation | — | not measured | not measured | pixel-8a cpu: pass · 4.34 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13pixel-8a gpu: pass · 8.81 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13 | CARD.md · card.json | — |
hsemotion-b0 | image-classification | — | pass · 72.14 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 2.565 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 24.767 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
hy-mt2-1.8b-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 12.27 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 20.84 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05mac-studio-m4-max cpu: pass · 33.97 tok/s decode stale — latest known 0.17.1mac-studio-m4-max · Apple M4 Max · litert-lm 0.16.0 · 2026-08-27mac-studio-m4-max gpu: pass · 105.8 tok/s decode stale — latest known 0.17.1mac-studio-m4-max · Apple M4 Max · litert-lm 0.16.0 · 2026-08-27pixel-8a cpu: fallback · 8.3 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05raspberry-pi-5 cpu: pass · 2.66 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
internvl3-1b | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 81.7 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 cpu: pass · 68.14 tok/s decodeGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm selfbuilt-1dadd00c · Android 16 · 2026-09-26galaxy-s26 gpu: load_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm selfbuilt-1dadd00c · Android 16 · 2026-09-26galaxy-s26 gpu: pass · 85.42 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max cpu: pass · 78.7 tok/s decodeMac Studio (M4 Max) · Apple M4 Max · litert-lm selfbuilt-1dadd00c · macOS 27.0 (26A428) · 2026-10-01mac-studio-m4-max gpu: load_failedMac Studio (M4 Max) · Apple M4 Max · litert-lm selfbuilt-1dadd00c · macOS 27.0 (26A428) · 2026-10-01 | CARD.md · card.json | — |
internvl3-2b | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 43.67 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 34.4 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24 | CARD.md · card.json | — |
internvl3_5-1b | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 26.13 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 43.45 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24 | CARD.md · card.json | — |
jan-nano | text-generation | — | not measured | not measured | mac-studio-m4-max gpu: pass · 68.98 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-23raspberry-pi-5 cpu: pass · 1.5 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
jan-nano-model-block32 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 5.94 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 9.3 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 1.45 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
japanese-zipformer-base | automatic-speech-recognition | — | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | pass · 61.167 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | raspberry-pi-5 cpu_xnnpack: pass · 2641.607 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
l2cs-gaze360 | image-classification | — | pass · 1997.273 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 11.758 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 11.052 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 3.591 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 349.393 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
lfm2.5-1.2b-instruct-int4 | text-generation | — | not measured | not measured | galaxy-s26 gpu: load_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-23mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-06mac-studio-m4-max gpu: load_failed stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-22pixel-8a gpu: load_failed stale — latest known 0.17.1Pixel 8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-12raspberry-pi-5 cpu: pass · 9.29 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm2.5-1.2b-instruct-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 40.96 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-06pixel-8a cpu: fallback · 20.4 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05raspberry-pi-5 cpu: pass · 7.02 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm2.5-1.2b-jp-int4 | text-generation | — | not measured | not measured | galaxy-s26 gpu: load_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · 2026-08-12raspberry-pi-5 cpu: pass · 9.22 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm2.5-1.2b-jp-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 41.32 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: load_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · 2026-08-12raspberry-pi-5 cpu: pass · 7.03 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm2.5-1.2b-thinking-int4 | text-generation | — | not measured | not measured | galaxy-s26 gpu: load_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-06raspberry-pi-5 cpu: pass · 9.25 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm2.5-1.2b-thinking-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 35.55 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: load_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · 2026-08-12raspberry-pi-5 cpu: pass · 7.07 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm2.5-2.6b-int4 | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 25.31 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 4.91 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm2.5-2.6b-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 15.53 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-06galaxy-s26 gpu: pass · 19.72 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 3.5 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm2.5-230m-int4 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 50.68 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-01galaxy-s26 gpu: pass · 41.62 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-01iphone-17-pro cpu: pass · 93.9 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-09-01iphone-17-pro gpu: pass · 161.7 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-09-01mac-studio-m4-max cpu: pass · 149.35 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-01mac-studio-m4-max gpu: pass · 555.27 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-01 | CARD.md · card.json | — |
lfm2.5-230m-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 94.69 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-01galaxy-s26 gpu: pass · 121.69 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-01iphone-17-pro cpu: pass · 86.55 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-09-01iphone-17-pro gpu: pass · 143.19 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-09-01mac-studio-m4-max cpu: pass · 153.82 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-01mac-studio-m4-max gpu: pass · 561.24 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-01pixel-8a cpu: fallback · 58.66 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05pixel-8a gpu: pass · 39.39 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05 | CARD.md · card.json | — |
lfm2.5-vl-3b-int8 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 19.87 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 20.15 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24 | CARD.md · card.json | — |
lfm25-12b-instruct-int4-gpu-093 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 24.09 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-23galaxy-s26 cpu: fallback · 40.7 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 24.74 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-23galaxy-s26 gpu: pass · 54.56 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05pixel-8a gpu: pass · 19.88 tok/s decode stale — latest known 0.17.1Pixel 8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-12raspberry-pi-5 cpu: pass · 9.3 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm25-12b-int4-gpu | text-generation | — | not measured | not measured | iphone-17-pro gpu: pass · 69.53 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-26mac-studio-m4-max gpu: pass · 325.76 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · iOS Version 27.0 (Build 26A5416b) · 2026-08-27mac-studio-m4-max gpu: pass · 346.72 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · 2026-08-12 | CARD.md · card.json | — |
lfm25-12b-jp-int4-gpu-093 | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 54.63 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24iphone-17-pro gpu: pass · 70.02 tok/s decode stale — latest known 0.17.1iphone-17-pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-25pixel-8a gpu: pass · 20.48 tok/s decode stale — latest known 0.17.1Pixel 8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-12raspberry-pi-5 cpu: pass · 9.24 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm25-12b-jp-int8-gpu | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 41.86 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-25raspberry-pi-5 cpu: pass · 7.01 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm25-12b-thinking-int4-gpu-093 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 38.23 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 48.14 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24iphone-17-pro gpu: pass · 69.66 tok/s decode stale — latest known 0.17.1iphone-17-pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-25pixel-8a gpu: pass · 21.48 tok/s decode stale — latest known 0.17.1Pixel 8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-12raspberry-pi-5 cpu: pass · 9.29 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm25-12b-thinking-int8-gpu | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 28.83 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-25raspberry-pi-5 cpu: pass · 7.03 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
lfm25-12b-wi8-composite | text-generation | — | not measured | not measured | mac-studio-m4-max gpu: pass · 262.55 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · 2026-08-12 | CARD.md · card.json | — |
lfm25-12b-wi8-gpu | text-generation | — | not measured | not measured | mac-studio-m4-max gpu: pass · 272 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · 2026-08-12 | CARD.md · card.json | — |
lfm25-encoder-230m | feature-extraction | — | not measured | not measured | not measured | CARD.md · card.json | — |
lfm25-vl-1.6b-int4 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 50.85 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 54.1 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24pixel-8a cpu: pass · 13.64 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13pixel-8a gpu: pass · 22.08 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13 | CARD.md · card.json | — |
lfm25-vl-1.6b-int8 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 41.66 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 42.27 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24pixel-8a cpu: pass · 8.38 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13pixel-8a gpu: pass · 15.91 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13 | CARD.md · card.json | — |
lfm25-vl-3b-int4 | image-text-to-text | — | not measured | not measured | galaxy-s26 gpu: pass · 27.04 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24pixel-8a cpu: pass · 5.77 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13pixel-8a gpu: pass · 10.79 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13 | CARD.md · card.json | — |
lfm25-vl-450m-int4 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 99.25 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 103.02 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24pixel-8a cpu: pass · 22.62 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13pixel-8a gpu: pass · 33.05 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13 | CARD.md · card.json | — |
lfm25-vl-450m-int8 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 70.53 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 97.57 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24pixel-8a cpu: pass · 15.75 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13pixel-8a gpu: pass · 31.08 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13 | CARD.md · card.json | — |
llava-onevision-0.5b | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 69.52 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 86.45 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24 | CARD.md · card.json | — |
m-lsd-tiny | image-segmentation | — | pass · 588.348 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 11.245 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 6.174 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 2.205 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 106.619 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
matcha-tts__dp_g2p_matcha_fp16 | text-to-speech | — | pass · 150.605 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | fallback · 136.315 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 21.997 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
matcha-tts__matcha_decoder_fp16 | text-to-speech | — | pass · 343.072 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 9.553 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 69.679 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
matcha-tts__matcha_textenc_fp16 | text-to-speech | — | pass · 229.993 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 5.992 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 38.679 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
matcha-tts__matcha_vocoder_fp16 | text-to-speech | — | pass · 21979.045 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 103.785 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 5824.518 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
mi-gan-512-places2 | image-to-image | — | pass · 3047.593 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 22.02 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 26.645 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 30.851 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 1788.29 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
mimi__mimi_dec_tx_fp16 | neural-codec | — | pass · 40.158 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 4.683 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 4.097 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 2.088 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 35.364 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
mimi__mimi_deconly_fp16 | neural-codec | — | pass · 1951.97 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 13.545 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 23.902 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 69.131 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 586.3 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
mimi__mimi_enc_conv_fp16 | neural-codec | — | pass · 525.868 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 5.96 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 14.688 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 55.027 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 298.623 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
mimi__mimi_enc_tx_fp16 | neural-codec | — | pass · 44.037 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 4.455 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 4.35 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 2.063 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 36.564 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
minicpm5-1b | text-generation | — | not measured | not measured | mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-06 | CARD.md · card.json | — |
minicpm5-2b-int4 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 15.56 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-08galaxy-s26 gpu: pass · 18.56 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-08iphone-17-pro cpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-09-08iphone-17-pro gpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-09-08mac-studio-m4-max cpu: pass · 31.12 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-08mac-studio-m4-max gpu: pass · 92.79 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-08 | CARD.md · card.json | — |
minicpm5-2b-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 11.67 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-08galaxy-s26 gpu: pass · 10.86 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-08mac-studio-m4-max cpu: pass · 30.02 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-08mac-studio-m4-max gpu: pass · 74.65 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-08 | CARD.md · card.json | — |
ministral3-3b | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 11.26 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max gpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-22pixel-8a gpu: run_failedPixel 8a · Google Tensor G3 · litert-lm gallery-1.0.15 · 2026-07-23pixel-8a gpu: pass · 6.8 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · 2026-08-17raspberry-pi-5 cpu: pass · 1.91 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
ministral3-3b-reasoning | text-generation | — | not measured | not measured | mac-studio-m4-max gpu: pass · 94.65 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.16.0 · 2026-08-12raspberry-pi-5 cpu: pass · 1.9 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
modnet | image-segmentation | — | pass · 480.658 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 20.715 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 602.838 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
mordant-3b-think-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 7.7 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 9.59 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05mac-studio-m4-max cpu: pass · 20.18 tok/s decode stale — latest known 0.17.1mac-studio-m4-max · Apple M4 Max · litert-lm 0.16.0 · 2026-08-25mac-studio-m4-max gpu: pass · 71.85 tok/s decode stale — latest known 0.17.1mac-studio-m4-max · Apple M4 Max · litert-lm 0.16.0 · 2026-08-25 | CARD.md · card.json | — |
movinet-a0-stream | video-classification | — | pass · 7.13 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 13.255 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 4.628 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
nafnet-gopro-width32 | image-to-image | — | pass · 2712.535 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 20.842 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 30.894 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 18.583 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 820.934 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
nafnet-sidd-width32 | image-to-image | — | pass · 2825.957 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 23.618 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 37.258 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 26.295 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 1039.801 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
nanbeige4.1-3b | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 10.58 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05mac-studio-m4-max gpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-22raspberry-pi-5 cpu: pass · 2.49 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
nanbeige4.2-3b | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 4.1 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: load_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-06raspberry-pi-5 cpu: pass · 1.06 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
nanbeige4.2-3b-fp32act | text-generation | — | not measured | not measured | galaxy-s26 cpu: pass · 3.45 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-27galaxy-s26 gpu: pass · 3.31 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-27iphone-17-pro cpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-08-28iphone-17-pro gpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-08-28raspberry-pi-5 cpu: pass · 1.07 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
nemotron-3-diarization__nemotron3_diar_encoder_low_latency_fp16 | voice-activity-detection | gpu_mldrift @ litert 2.2.0: 93.5% · 191 partition(s) | pass · 5593.795 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | pass · 53.978 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | galaxy-s26 gpu_mldrift: output_mismatch · 106.1672395 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36) · 2026-09-24galaxy-s26 gpu_mldrift: pass · 136.183932 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36) · 2026-09-24galaxy-s26 gpu_mldrift: output_mismatch · 80.3983855 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36) · 2026-09-24 | CARD.md · card.json | run it |
nemotron-3-diarization__nemotron3_diar_encoder_offline_fp16 | voice-activity-detection | gpu_mldrift @ litert 2.2.0: 93.5% · 191 partition(s) | pass · 7200.502 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | pass · 58.1 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | galaxy-s26 gpu_mldrift: pass · 172.6847135 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36) · 2026-09-24galaxy-s26 gpu_mldrift: output_mismatch · 87.179922 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36) · 2026-09-24 | CARD.md · card.json | run it |
nemotron-3-diarization__nemotron3_diar_frontend | voice-activity-detection | gpu_mldrift @ litert 2.2.0: 100% · 1 partition(s) | pass · 0.425 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | pass · 0.532 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | galaxy-s26 gpu_mldrift: pass · 0.2066925 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36) · 2026-09-24galaxy-s26 gpu_mldrift: output_mismatch · 0.2169005 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 (SDK 36) · 2026-09-24 | CARD.md · card.json | run it |
nemotron-3-nano-4b-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 12.87 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: run_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05mac-studio-m4-max cpu: pass · 22.73 tok/s decode stale — latest known 0.17.1mac-studio-m4-max · Apple M4 Max · litert-lm 0.16.0 · 2026-08-27mac-studio-m4-max gpu: pass · 83.3 tok/s decode stale — latest known 0.17.1mac-studio-m4-max · Apple M4 Max · litert-lm 0.16.0 · 2026-08-27raspberry-pi-5 cpu: pass · 2.2 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
nemotron-h-4b | text-generation | — | not measured | not measured | raspberry-pi-5 cpu: pass · 1.97 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
north-micro-vision-instruct-wi8 | image-text-to-text | — | not measured | not measured | galaxy-s26 gpu: pass · 10.4 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24iphone-17-pro gpu: pass · 13.64 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-19pixel-8a gpu: pass · 4.3 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.1 · 2026-08-19 | CARD.md · card.json | — |
olmo-2-1b-instruct-q4-block32-ekv4096 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 12.1 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 22.97 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 2.13 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
ormbg | image-segmentation | — | pass · 4525.905 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 65.155 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 2989.129 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
ovis2_5-2b | image-text-to-text | — | not measured | not measured | galaxy-s26 gpu: pass · 26.83 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24 | CARD.md · card.json | — |
ovisocr2-int8 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: run_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 35.18 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05iphone-17-pro cpu: pass · 18.05 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-09-01iphone-17-pro gpu: pass · 48.5 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-09-01mac-studio-m4-max cpu: pass · 48.93 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-01mac-studio-m4-max gpu: pass · 140.9 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-01pixel-8a cpu: run_failed stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05 | CARD.md · card.json | — |
paddleocr-vl-1.6 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: run_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 35.59 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24pixel-8a cpu: run_failed stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05 | CARD.md · card.json | — |
panns-cnn14-audioset | audio-classification | — | pass · 2473.497 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 13.235 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 12.154 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 3.888 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 390.821 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
parakeet-tdt-0.6b-v3__parakeet_tdt_0.6b_v3_30s_i8_stateful | automatic-speech-recognition | — | pass · 7451.368 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | mac-studio-m4-max cpu: passMac Studio (Apple M4 Max, 128 GB) · Apple M4 Max · litert-lm selfbuilt-66058c82+omni-eval-patches · macOS 27.0 (26A428) · 2026-09-25 | CARD.md · card.json | run it |
parakeet-tdt_ctc-0.6b-ja__parakeet_tdt_ctc_0.6b_ja_5s_f32 | automatic-speech-recognition | — | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-13 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-13 | galaxy-s26 gpu_mldrift: pass · 63.606 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-27galaxy-s26 npu_qnn: pass · 30.326 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, AOT host-compiled, SM8850 target) · Android 16 · 2026-08-27 | CARD.md · card.json | — |
parakeet-tdt_ctc-0.6b-ja__parakeet_tdt_ctc_0.6b_ja_5s_f32_stateful | automatic-speech-recognition | — | not measured | not measured | galaxy-s26 gpu_mldrift: pass · 63.033 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-27galaxy-s26 npu_qnn: pass · 30.315 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, AOT host-compiled, SM8850 target) · Android 16 · 2026-08-27 | CARD.md · card.json | — |
parakeet-tdt_ctc-0.6b-ja__parakeet_tdt_ctc_0.6b_ja_5s_i8 | automatic-speech-recognition | — | pass · 1184.507 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-13 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-13 | galaxy-s26 gpu_mldrift: load_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-27galaxy-s26 npu_qnn: load_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, AOT host-compiled, SM8850 target) · Android 16 · 2026-08-27raspberry-pi-5 cpu_xnnpack: pass · 110.356 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31raspberry-pi-5 cpu_xnnpack: pass · 275.894 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
parakeet-tdt_ctc-0.6b-ja__parakeet_tdt_ctc_0.6b_ja_5s_i8_stateful | automatic-speech-recognition | — | not measured | not measured | galaxy-s26 gpu_mldrift: load_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-27galaxy-s26 npu_qnn: load_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, AOT host-compiled, SM8850 target) · Android 16 · 2026-08-27raspberry-pi-5 cpu_xnnpack: pass · 6.894 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31raspberry-pi-5 cpu_xnnpack: pass · 2.033 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31raspberry-pi-5 cpu_xnnpack: pass · 273.607 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | — |
phi4-mini-reasoning | text-generation | — | not measured | not measured | mac-studio-m4-max gpu: pass · 83.68 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-23raspberry-pi-5 cpu: pass · 1.62 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
pidnet-s-cityscapes | image-segmentation | — | pass · 670.503 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 14.763 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 482.334 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
places365-resnet18 | image-classification | — | pass · 226.743 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 2.723 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 3.489 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 0.918 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 33.995 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
plantnet-300k-resnet18 | image-classification | — | pass · 52.538 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 2.665 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 34.147 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
polaris-4b | text-generation | — | not measured | not measured | mac-studio-m4-max gpu: pass · 68.87 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-23raspberry-pi-5 cpu: pass · 1.49 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
pp-ocrv5__ppocr_det_fp16 | text-detection | — | pass · 916.36 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 12.325 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 17.59 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 8.634 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 460.168 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
pp-ocrv5__ppocr_rec_fp16 | text-recognition | — | pass · 449.3 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 15.125 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 7.998 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 5.911 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 86.447 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
pp-ocrv6-small__ppocrv6_small_det_640_fp32 | image-to-text | gpu_mldrift @ litert 2.2.0: 4.5% · 13 partition(s) | pass · 214.418 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | pass · 10.045 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | not measured | CARD.md · card.json | run it |
pp-ocrv6-small__ppocrv6_small_rec_320_fp32 | image-to-text | gpu_mldrift @ litert 2.2.0: 4.6% · 13 partition(s) | pass · 43.815 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | output_mismatch · 13.438 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | not measured | CARD.md · card.json | run it |
pp-ocrv6-small__ppocrv6_small_rec_640_fp32 | image-to-text | gpu_mldrift @ litert 2.2.0: 4.6% · 13 partition(s) | pass · 83.455 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | pass · 23.417 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | not measured | CARD.md · card.json | run it |
pp-ocrv6-small__ppocrv6_small_rec_960_fp32 | image-to-text | gpu_mldrift @ litert 2.2.0: 4.6% · 13 partition(s) | pass · 125.062 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | pass · 34.363 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-09-25 | not measured | CARD.md · card.json | run it |
qwen25-coder-1.5b-int4 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 29.73 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 10.07 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24pixel-8a cpu: pass · 12.57 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · 2026-08-19pixel-8a gpu: pass · 12 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · 2026-08-19raspberry-pi-5 cpu: pass · 5.61 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
qwen3-4b-thinking | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 5.99 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05mac-studio-m4-max gpu: pass · 68.29 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-23raspberry-pi-5 cpu: pass · 1.49 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
qwen3-4b-thinking-dynamic-wi4b32-afp32 | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 11.2 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 1.43 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
qwen3-embedding-0.6b | sentence-similarity | — | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 44.738 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-27galaxy-s26 npu_qnn: pass · 25.44 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, AOT host-compiled, SM8850 target) · Android 16 · 2026-08-27 | CARD.md · card.json | — |
qwen3-reranker-0.6b | text-ranking | — | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | load_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 78.494 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-27galaxy-s26 npu_qnn: pass · 47.508 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, AOT host-compiled, SM8850 target) · Android 16 · 2026-08-27 | CARD.md · card.json | — |
qwen35-0.8b | text-generation | — | not measured | not measured | raspberry-pi-5 cpu: pass · 7.06 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
qwen35-0.8b-vl-int8 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 32.41 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 35.07 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05iphone-17-pro cpu: pass · 26.01 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-31iphone-17-pro gpu: pass · 45.71 tok/s decode stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-28mac-studio-m4-max cpu: pass · 46.63 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-08-28mac-studio-m4-max gpu: pass · 126.17 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-08-28pixel-8a cpu: fallback · 15.77 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05raspberry-pi-5 cpu: pass · 6.91 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
qwen35-08b-v4gpufix | text-generation | — | not measured | not measured | pixel-8a gpu: pass · 7.45 tok/s decode stale — latest known 0.17.1pixel-8a · Google Tensor G3 · litert-lm 0.16.0 · 2026-08-13 | CARD.md · card.json | — |
qwen35-2b | text-generation | — | not measured | not measured | mac-m4-max cpu: pass · 37.6 tok/s decode stale — latest known 0.17.1mac-m4-max · litert-lm 0.16.0 · 2026-08-14mac-m4-max gpu: pass · 114.34 tok/s decode stale — latest known 0.17.1mac-m4-max · litert-lm 0.16.0 · 2026-08-14raspberry-pi-5 cpu: pass · 4.25 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
qwen35-2b-vl-int8 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 18.98 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 17.47 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05raspberry-pi-5 cpu: pass · 4.24 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
qwen35-4b | text-generation | — | not measured | not measured | mac-m4-max cpu: pass · 19.9 tok/s decode stale — latest known 0.17.1mac-m4-max · litert-lm 0.16.0 · 2026-08-14mac-m4-max gpu: pass · 61.98 tok/s decode stale — latest known 0.17.1mac-m4-max · litert-lm 0.16.0 · 2026-08-14raspberry-pi-5 cpu: pass · 1.83 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
qwen35-4b-mixed-int4 | text-generation | — | not measured | not measured | iphone-17-pro cpu: pass · 8.87 tok/s decode stale — latest known 0.17.1iphone-17-pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-27iphone-17-pro gpu: pass · 11.38 tok/s decode stale — latest known 0.17.1iphone-17-pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-27mac-studio-m4-max cpu: pass · 20.07 tok/s decode stale — latest known 0.17.1mac-studio-m4-max · Apple M4 Max · litert-lm 0.16.0 · 2026-08-27mac-studio-m4-max gpu: pass · 68.45 tok/s decode stale — latest known 0.17.1mac-studio-m4-max · Apple M4 Max · litert-lm 0.16.0 · 2026-08-27pixel-8a cpu: fallback · 6.3 tok/s decode stale — latest known 0.17.1pixel-8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-08-27raspberry-pi-5 cpu: pass · 2.37 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
r1-distill-qwen-1.5b | text-generation | — | not measured | not measured | mac-studio-m4-max gpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-22 | CARD.md · card.json | — |
ram-plus__ram_reweight_fp16 | image-classification | — | not measured | not measured | galaxy-s26 gpu_mldrift: load_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 28.303 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 499.316 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | — |
ram-plus__ram_stage3_tail_fp16 | image-classification | — | not measured | not measured | galaxy-s26 gpu_mldrift: pass · 8.005 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 14.568 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 235.099 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | — |
ram-plus__ram_swin_s012_fp16 | image-classification | — | not measured | not measured | galaxy-s26 gpu_mldrift: pass · 102.984 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 396.868 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 3231.892 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | — |
ram-plus__ram_taghead_fp16 | image-classification | — | not measured | not measured | galaxy-s26 gpu_mldrift: pass · 44.03 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 170.827 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 1935.059 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | — |
rf-detr-nano__rfdetr_grapha_fp16 | object-detection | — | pass · 1686.515 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 18.487 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 18.452 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 15.11 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 458.409 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rf-detr-nano__rfdetr_graphb_fp16 | object-detection | — | pass · 134.482 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 4.797 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 7.414 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 12.822 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 64.035 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rf-detr-seg-nano__rfdetrseg_grapha_fp16 | image-segmentation | — | pass · 2194.563 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | output_mismatch · 24.917 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | galaxy-s26 gpu_mldrift: pass · 35.283 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 27.833 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 695.348 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rf-detr-seg-nano__rfdetrseg_graphb_fp16 | image-segmentation | — | pass · 445.383 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | output_mismatch · 16.68 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | galaxy-s26 gpu_mldrift: pass · 22.663 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 64.07 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 324.54 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rt-detrv2-s__rtdetr_grapha_fp16 | object-detection | — | pass · 3315.158 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 52.588 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 23.066 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 21.128 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 523.099 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rt-detrv2-s__rtdetr_graphb_fp16 | object-detection | — | pass · 634.398 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 27.723 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 166.556 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 132.551 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 1199.458 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rtmpose-animal-ap10k | keypoint-detection | — | pass · 335.895 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 6.217 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 5.558 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 1.289 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 58.264 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rtmpose-face-wflw | keypoint-detection | — | pass · 363.63 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 7.4 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 6.769 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 1.903 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 71.582 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rtmpose-hand | keypoint-detection | — | pass · 337.08 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 6.175 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 5.715 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 1.253 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 58.101 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rtmpose-s | keypoint-detection | — | pass · 90.525 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 2.96 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 3.359 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 0.771 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 16.69 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rtmw-m-wholebody | keypoint-detection | — | pass · 561.783 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 13.322 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 11.882 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 2.659 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 109.617 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
rwkv-7-world-0.1b | text-generation | — | pass · 22.328 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 15.07 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | not measured | CARD.md · card.json | run it |
s1-mini-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 12.34 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 25.8 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05iphone-17-pro cpu: pass · 15.53 tok/s decode stale — latest known 0.17.1iphone-17-pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-25iphone-17-pro gpu: pass · 32.02 tok/s decode stale — latest known 0.17.1iphone-17-pro · A19-Pro · litert-lm 0.16.0 · iOS 27.0 · 2026-08-25mac-studio-m4-max cpu: pass · 33.32 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-08-25mac-studio-m4-max gpu: pass · 144.58 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-08-25pixel-8a cpu: fallback · 5.77 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · 2026-08-25pixel-8a gpu: pass · 12.28 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · 2026-08-25 | CARD.md · card.json | — |
sam2.1-hiera-tiny-mask-decoder__sam2_tiny_mask_decoder_fp16 | mask-generation | — | pass · 396.69 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-13 | output_mismatch · 8.33 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-13 | galaxy-s26 gpu_mldrift: pass · 10.077 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 8.08 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26pixel-8a cpu_xnnpack: fallback · 218.668 msPixel 8a · Tensor G3 · litert 2.2.0 · Android 16 · 2026-08-28pixel-8a gpu_mldrift: pass · 30.055 msPixel 8a · Tensor G3 · litert 2.2.0 · Android 16 · 2026-08-28raspberry-pi-5 cpu_xnnpack: pass · 156.218 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
sam2.1-hiera-tiny-mask-decoder__sam2_tiny_mask_decoder_v2_fp16 | mask-generation | — | pass · 398.045 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-13 | output_mismatch · 7.908 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-13 | galaxy-s26 gpu_mldrift: pass · 10.548 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 8.045 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26pixel-8a cpu_xnnpack: fallback · 222.813 msPixel 8a · Tensor G3 · litert 2.2.0 · Android 16 · 2026-08-28pixel-8a gpu_mldrift: pass · 30.875 msPixel 8a · Tensor G3 · litert 2.2.0 · Android 16 · 2026-08-28raspberry-pi-5 cpu_xnnpack: pass · 158.27 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
sarashina2.2-0.5b-instruct-v0.1-int4 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 19.53 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-02galaxy-s26 gpu: pass · 40.3 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-02mac-studio-m4-max cpu: pass · 42.73 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-02mac-studio-m4-max gpu: pass · 197.85 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-02 | CARD.md · card.json | — |
sarashina2.2-0.5b-instruct-v0.1-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 21.04 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-02galaxy-s26 gpu: pass · 36.46 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-02mac-studio-m4-max cpu: pass · 47.05 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-02mac-studio-m4-max gpu: pass · 197.1 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-02pixel-8a cpu: fallback · 8.78 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05pixel-8a gpu: pass · 16.79 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05 | CARD.md · card.json | — |
sarashina2.2-1b-instruct-v0.1-int4 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 13.53 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-02galaxy-s26 gpu: pass · 27.45 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-02mac-studio-m4-max cpu: pass · 34.69 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-02mac-studio-m4-max gpu: pass · 159.36 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-02 | CARD.md · card.json | — |
sarashina2.2-1b-instruct-v0.1-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 13.35 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-02galaxy-s26 gpu: pass · 23.7 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-02mac-studio-m4-max cpu: pass · 35.14 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-02mac-studio-m4-max gpu: pass · 146.4 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-02pixel-8a cpu: fallback · 9.5 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-07 | CARD.md · card.json | — |
shieldstral-1.0-3b-int8 | text-classification | — | not measured | not measured | galaxy-s26 cpu: fallback · 8.3 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 8.63 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24 | CARD.md · card.json | — |
shieldstral-1.0-3b-vision-int4 | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 1.87 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: load_failed stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24 | CARD.md · card.json | — |
shieldstral-1.0-3b-vision-int4-gpu | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: fallback · 1.33 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 11.73 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-28 | CARD.md · card.json | — |
siglip2-base-patch16-224 | image-feature-extraction | — | pass · 2124.707 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-13 | pass · 19.635 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-13 | galaxy-s26 gpu_mldrift: pass · 13.704 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 6.943 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26 | CARD.md · card.json | run it |
silent-face-anti-spoofing | image-classification | — | pass · 1.953 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 1.385 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 2.132 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
sinet-v2-camouflage | image-segmentation | — | pass · 349.405 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 13.072 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 274.669 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
smollm3-3b | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 9.81 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 14.84 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max gpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-22pixel-8a gpu: pass · 7.69 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · 2026-08-17raspberry-pi-5 cpu: pass · 2.46 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
smollm3-3b-int8 | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 14.41 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 1.97 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
smollm3-3b-litert | text-generation | — | not measured | not measured | mac-studio-m4-max cpu: pass stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-06 | CARD.md · card.json | — |
smolvlm2-500m | image-text-to-text | — | not measured | not measured | galaxy-s26 cpu: pass · 72.41 tok/s decodeGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm selfbuilt-1dadd00c · Android 16 · 2026-09-26galaxy-s26 cpu: fallback · 76.72 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 54.48 tok/s decodeGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm selfbuilt-1dadd00c · Android 16 · 2026-09-26galaxy-s26 gpu: pass · 76.73 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max cpu: pass · 95.53 tok/s decodeMac Studio (M4 Max) · Apple M4 Max · litert-lm selfbuilt-1dadd00c · macOS 27.0 (26A428) · 2026-09-24mac-studio-m4-max gpu: run_failedMac Studio (M4 Max) · Apple M4 Max · litert-lm selfbuilt-1dadd00c · macOS 27.0 (26A428) · 2026-09-24 | CARD.md · card.json | — |
spark-x2.5-1.7b-int4 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 13.6 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-07galaxy-s26 gpu: pass · 17.77 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-07iphone-17-pro cpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-09-07iphone-17-pro gpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-09-07mac-studio-m4-max cpu: pass · 38.24 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-07mac-studio-m4-max gpu: pass · 103.62 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-07 | CARD.md · card.json | — |
spark-x2.5-1.7b-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 12.28 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-07galaxy-s26 gpu: pass · 15.82 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-07iphone-17-pro cpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-09-07iphone-17-pro gpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-09-07mac-studio-m4-max cpu: pass · 41 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-07mac-studio-m4-max gpu: pass · 95.78 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-07 | CARD.md · card.json | — |
spark-x2.5-4b-int4 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 5.47 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-07galaxy-s26 gpu: pass · 4.89 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-07iphone-17-pro cpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-09-07iphone-17-pro gpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-09-07mac-studio-m4-max cpu: pass · 18.37 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-07mac-studio-m4-max gpu: pass · 53.63 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-07 | CARD.md · card.json | — |
spark-x2.5-4b-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 4.55 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-07galaxy-s26 gpu: pass stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-07iphone-17-pro cpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-09-07iphone-17-pro gpu: pass stale — latest known 0.17.1iPhone 17 Pro · A19-Pro · litert-lm 0.15.0 · iOS 27.0 · 2026-09-07mac-studio-m4-max cpu: pass · 19.5 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-07mac-studio-m4-max gpu: pass · 49.38 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.17.0 · 2026-09-07 | CARD.md · card.json | — |
speaker-diarization | automatic-speech-recognition# HF card front matter pipeline_tag | — | pass · 1399.142 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 3.852 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 6.05 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 1.993 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 186.062 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
tashkeel-350m-v2-fp16 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 23.69 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05mac-studio-m4-max cpu: pass · 58.18 tok/s decode stale — latest known 0.17.1mac-studio-m4-max · Apple M4 Max · litert-lm 0.16.0 · 2026-08-25pixel-8a cpu: fallback · 14.42 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05 | CARD.md · card.json | — |
tashkeel-350m-v2-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 68.96 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 46.26 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05mac-studio-m4-max cpu: pass · 97.21 tok/s decode stale — latest known 0.17.1mac-studio-m4-max · Apple M4 Max · litert-lm 0.16.0 · 2026-08-25pixel-8a cpu: fallback · 49.06 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05pixel-8a gpu: pass · 18.37 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · Android 16 · 2026-09-05 | CARD.md · card.json | — |
tiger-dnr__tiger_dialog_fp16 | audio-to-audio | — | pass · 27817.165 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 483.59 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 npu_qnn: load_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 42421.191 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
tiger-dnr__tiger_effect_fp16 | audio-to-audio | — | pass · 27916.245 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 498.37 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 npu_qnn: load_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 42412.096 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
tiger-dnr__tiger_music_fp16 | audio-to-audio | — | pass · 28192.605 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 497.43 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 npu_qnn: load_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 42479.118 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
tipsv2-b14-dpt | depth-estimation | — | pass · 148.665 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | output_mismatch · 285.11 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | not measured | CARD.md · card.json | run it |
twinlitenet | image-segmentation | — | pass · 223.485 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 19.31 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 261.197 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
u2net-portrait-sketch | image-to-image | — | pass · 4289.642 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 53.318 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 2871.872 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
ultra-fast-lane-detection | image-segmentation | — | pass · 238.387 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 7.463 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 150.799 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
unisal-saliency | image-segmentation | — | pass · 217.372 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 3.402 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 3.658 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 21.121 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 102.024 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
vibethinker-3b | text-generation | — | not measured | not measured | galaxy-s26 gpu: pass · 13.88 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24mac-studio-m4-max gpu: pass · 93.16 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · Apple M4 Max · litert-lm 0.14.0 · 2026-07-23pixel-8a gpu: pass · 7.58 tok/s decode stale — latest known 0.17.1Pixel 8a · Tensor G3 · litert-lm 0.16.0 · 2026-08-17raspberry-pi-5 cpu: pass · 3.36 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-01 | CARD.md · card.json | — |
vibevoice-asr-bitnet | automatic-speech-recognition | — | not measured | not measured | galaxy-s26 cpu: fallback · 35.43 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.1 · Android 16 · 2026-09-04galaxy-s26 gpu: pass · 36.12 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.1 · Android 16 · 2026-09-04mac-studio-m4-max cpu: pass · 59.29 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-04mac-studio-m4-max gpu: pass · 138.57 tok/s decode stale — latest known 0.17.1Mac Studio (M4 Max) · litert-lm 0.16.0 · 2026-09-04 | CARD.md · card.json | — |
vision-rwkv-s | image-classification | — | pass · 316.283 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | output_mismatch · 27.517 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | raspberry-pi-5 cpu_xnnpack: pass · 1082.624 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
wav2vec2-base-960h__w2v2_asr_frontend_fp16 | automatic-speech-recognition | — | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | pass · 37.113 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | raspberry-pi-5 cpu_xnnpack: pass · 2010.862 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
wav2vec2-base-960h__w2v2_asr_head_fp16 | automatic-speech-recognition | — | run_failedmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | pass · 51.323 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | raspberry-pi-5 cpu_xnnpack: pass · 2820.028 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
wav2vec2-keyword-spotting__w2v2_frontend_fp16 | audio-classification | — | pass · 309.91 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 3.365 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 5.285 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: run_failedGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 106.245 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
wav2vec2-keyword-spotting__w2v2_head_fp16 | audio-classification | — | pass · 685.443 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 12.15 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 9.197 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 5.668 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 106.275 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
xfeat__xfeat | keypoint-detection | — | pass · 189.138 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 12.725 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 4.128 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 607.499 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 32.204 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
xfeat__xfeat_fp16 | keypoint-detection | — | pass · 189.197 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 12.378 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 4.313 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 384.541 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 32.452 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
yolact-resnet50 | image-segmentation | — | pass · 1700.407 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 63.108 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 38.367 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-26galaxy-s26 npu_qnn: pass · 14.344 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-26raspberry-pi-5 cpu_xnnpack: pass · 1095.56 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
yunet-face | object-detection | — | pass · 140.42 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | pass · 6.527 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-11 | galaxy-s26 gpu_mldrift: pass · 3.315 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · Android 16 · 2026-08-25galaxy-s26 npu_qnn: pass · 1.85 msGalaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert 2.2.0 · QAIRT (Hexagon, JIT on-device) · Android 16 · 2026-08-25raspberry-pi-5 cpu_xnnpack: pass · 33.696 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
zamba2-1.2b-instruct-int8 | text-generation | — | not measured | not measured | galaxy-s26 cpu: fallback · 12.21 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-09-05galaxy-s26 gpu: pass · 11.68 tok/s decode stale — latest known 0.17.1Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 · 2026-08-24raspberry-pi-5 cpu: pass · 1.81 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
zamba2-2.7b-instruct | text-generation | — | not measured | not measured | raspberry-pi-5 cpu: pass · 1.03 tok/s decode stale — latest known 0.17.1Raspberry Pi 5 Model B Rev 1.1 · Broadcom BCM2712 · litert-lm 0.16.1 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-09-02 | CARD.md · card.json | — |
zipformer-medium-cr-ctc__zipformer_ctc_fp16 | automatic-speech-recognition | — | pass · 2190.745 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | output_mismatch · 25.19 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | raspberry-pi-5 cpu_xnnpack: pass · 762.79 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
zipformer-medium-cr-ctc__zipformer_ctc_large_fp16 | automatic-speech-recognition | — | pass · 3691.958 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | output_mismatch · 41.163 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | raspberry-pi-5 cpu_xnnpack: pass · 1055.052 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
zipformer-medium-cr-ctc__zipformer_ctc_small_fp16 | automatic-speech-recognition | — | pass · 1433.62 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | output_mismatch · 14.132 msmac-studio-m4-max · chromium 151.0.7922.34 headless · macOS · @litertjs/core 2.5.3 · 2026-08-20 | raspberry-pi-5 cpu_xnnpack: pass · 606.175 msRaspberry Pi 5 Model B Rev 1.1 · litert 2.2.0.dev20260804 · Linux-6.18.34+rpt-rpi-2712-aarch64-with-glibc2.41 · 2026-08-31 | CARD.md · card.json | run it |
One-line prompt for Claude Code / Gemini CLI — re-runs the sweep behind this table on the committed example catalog, locally:
In the edge-compat repo, re-run the LiteRT.js sweep behind this table on the committed example catalog: cd web/sweep && npm ci && npm run sweep -- --catalog ../../data/examples/web_catalog_example.csv --out out/ — then compare the records under out/ with the example rows in this table.