---
family: internvl3
license: apache-2.0
model_id: internvl3-1b
source_url: https://huggingface.co/litert-community/InternVL3-1B
task: image-text-to-text
---

# internvl3-1b

| | |
|---|---|
| **Task** | image-text-to-text |
| **Family** | internvl3 |
| **Source** | https://huggingface.co/litert-community/InternVL3-1B |
| **License** | apache-2.0 |

## Conversion

| | |
|---|---|
| **Tool** | litert-torch (LiteRT-LM fast_vlm bundle: VISION_ENCODER + VISION_ADAPTER + single-token EMBEDDER + PREFILL_DECODE with embeddings input) (HF card Conversion notes) TODO (the HF card names the converter but not its version; no export log in the sources) |
| **Command** | `TODO (the HF card states the bundle layout and rewrites, not the invocation)` |
| **Quantization** | TODO — the HF card states no quantization recipe for this bundle; sections: VISION_ENCODER [1,448,448,3]->[1,256,4096], VISION_ADAPTER [1,256,4096]->[1,256,896], externalized embedder, PREFILL_DECODE (HF card Conversion notes) |

## Artifacts

| File | SHA-256 | Size (MB) |
|---|---|---|
| `InternVL3-1B.litertlm` | `7cf87c35cf364d04bd2e6f957e3a0366830ad0b46eca3dd81e0000891fd1284a` | 703.158 |

## Performance

No benchmark data yet.

## Device runs (NPU / LiteRT-LM)

Model-level on-device results — measured behavior of this exact artifact on the recorded device, only meaningful together with that environment. Throughput is conditional on the measured prompt length (Prompt (tokens); '-' = the source stated none): rows differing only there are different measurements, not re-runs. Full records (failure classes, log evidence): `data/device_runs/0.16.0/2026-08-24/internvl3-1b__galaxy-s26.json`, `data/device_runs/0.16.0/2026-09-05/internvl3-1b__galaxy-s26.json`, `data/device_runs/selfbuilt-1dadd00c/2026-09-26/internvl3-1b__galaxy-s26.json`, `data/device_runs/selfbuilt-1dadd00c/2026-10-01/internvl3-1b__mac-studio-m4-max.json`.

| Device | Accelerator | Status | Full delegation | Output match | Prompt (tokens) | Latency p50 (ms) | Prefill tok/s | Decode tok/s | TTFT (ms) | Peak mem (MB) | Environment | Date | Provenance |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| galaxy-s26 | cpu | fallback | no | - | 239 | - | 358.66 | 81.7 | 680.0 | - | Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 | 2026-09-05 | measured |
| galaxy-s26 | cpu | pass | - | - | 311 | - | 495.39 | 68.14 | 640.0 | 1002.8 | Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm selfbuilt-1dadd00c · Android 16 | 2026-09-26 | measured |
| galaxy-s26 | gpu | load_failed | - | - | - | - | - | - | - | - | Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm selfbuilt-1dadd00c · Android 16 | 2026-09-26 | measured |
| galaxy-s26 | gpu | pass | yes | - | 203 | - | 1455.95 | 85.42 | 150.0 | - | Galaxy S26 (SM-S942Q) · Qualcomm SM8850 · litert-lm 0.16.0 · Android 16 | 2026-08-24 | measured |
| mac-studio-m4-max | cpu | pass | - | - | 311 | - | 736.23 | 78.7 | 440.0 | 1035.9 | Mac Studio (M4 Max) · Apple M4 Max · litert-lm selfbuilt-1dadd00c · macOS 27.0 (26A428) | 2026-10-01 | measured |
| mac-studio-m4-max | gpu | load_failed | - | - | - | - | - | - | - | - | Mac Studio (M4 Max) · Apple M4 Max · litert-lm selfbuilt-1dadd00c · macOS 27.0 (26A428) | 2026-10-01 | measured |

## Pitfalls

- Known limitation — one image per conversation on the GPU backend: on the GPU (Metal) backend a second image in the same conversation truncates the answer; on the CPU backend multi-image works (verified); the truncation reproduces with other fast_vlm models, so it is the runtime's GPU fast_vlm path, not this bundle. For reliable multi-image, run on the CPU backend (HF card Known limitation).
- The vision encoder bakes ImageNet normalization + the NCHW transpose into the graph (the runtime feeds a [0,1] NHWC image), and the InternViT attention is rewritten 4D-clean (qkv split before the head reshape — no GPU-rejected 5D reshape), numerically identical (corr ≈ 1.0) (HF card Conversion notes).
- Decoder exported with an externalized embedder; InternVL's dynamic-NTK rope_scaling is stripped to base RoPE, valid since the export cache <= the base context window (HF card Conversion notes).
- License: MIT (the InternVL model) + Apache-2.0 (the Qwen2.5 language component); converted artifacts released under the same terms (HF card License).
- LiteRT-LM .litertlm bundle: LiteRT.js cannot run it, so delegation stays null and there is no browser block; device rows come from data/device_runs/ (Pi 5 / S26 / Pixel 8a / Mac / iPhone as measured).

---

_Rendered by `edge-card` from `card.json` (the source of truth); edit the inputs, not this file._