{
  "artifacts": [
    {
      "file": "gliner25_multi_s256_wfp16.tflite",
      "sha256": "2b58aebe1a7fee17cc138ff27f6e2e7d5c81a13227de053fef0874fad8b3f503",
      "size_mb": 201.386
    }
  ],
  "benchmarks": [],
  "browser": {
    "backends": [
      {
        "backend": "wasm_xnnpack",
        "date": "2026-10-02",
        "env": {
          "browser": "chromium",
          "browser_version": "151.0.7922.34",
          "headless": true,
          "jspi": true,
          "litertjs_core_version": "2.5.3",
          "machine_label": "mac-studio-m4-max",
          "os": "macOS",
          "os_version": "27.0.0",
          "webgpu_adapter": {
            "architecture": "metal-3",
            "description": "",
            "device": "",
            "vendor": "apple"
          }
        },
        "full_delegation": null,
        "latency_p50_ms": 2648.487,
        "loads": true,
        "max_rel_diff": null,
        "output_match": null,
        "provenance": "measured",
        "runs": true
      },
      {
        "backend": "webgpu_mldrift",
        "date": "2026-10-02",
        "env": {
          "browser": "chromium",
          "browser_version": "151.0.7922.34",
          "headless": true,
          "jspi": true,
          "litertjs_core_version": "2.5.3",
          "machine_label": "mac-studio-m4-max",
          "os": "macOS",
          "os_version": "27.0.0",
          "webgpu_adapter": {
            "architecture": "metal-3",
            "description": "",
            "device": "",
            "vendor": "apple"
          }
        },
        "full_delegation": true,
        "latency_p50_ms": 30.443,
        "loads": true,
        "max_rel_diff": 11.387173024262953,
        "output_match": false,
        "provenance": "measured",
        "runs": true
      }
    ],
    "demo_url": null,
    "sweep_source": "data/sweep/2.5.3/2026-10-02/gliner2.5-multi__gliner25_multi_s256_wfp16.json"
  },
  "conversion": {
    "command": "export_round3.py --seq 256 (unified dense-prefix recipe with --mask-neg -1e4 --ln-shift 3) then quantize_shipment.py --seq 256 (ai-edge-quantizer 0.8.0 FLOAT_CASTING, FULLY_CONNECTED weights only); graph contract graph_contract_s256.json",
    "quantization": "float16 weight storage (ai-edge-quantizer 0.8.0 FLOAT_CASTING, weight-only 16-bit): the 96 FULLY_CONNECTED weight tensors stored as float16 with a DEQUANTIZE to float32; inputs, outputs, activations and every other constant stay float32 (card 'Files and supported configuration').",
    "tool": "litert-torch",
    "tool_version": "0.9.3 (ai-edge-litert 2.1.6; torch 2.12.1; transformers 4.57.6; gliner2 2.0.0; ai-edge-quantizer 0.8.0 for the float16 weight storage)"
  },
  "cross_runtime": [],
  "delegation": {
    "backend": "gpu_mldrift",
    "blocking_ops": [
      "DEQUANTIZE",
      "SQUARED_DIFFERENCE",
      "LOGISTIC"
    ],
    "coverage_ops_pct": 89.0,
    "lint_report_version": "1.1",
    "litert_version": "2.2.0",
    "matched_provenance_counts": {
      "measured": 1119,
      "unmatched": 30
    },
    "partitions": 127
  },
  "device": {
    "records": [
      {
        "device": "galaxy-s26",
        "run": {
          "accelerator": "cpu_xnnpack",
          "context_length": null,
          "date": "2026-10-02",
          "decode_tokens_per_s": null,
          "delegated_ops": 1148,
          "env": {
            "device": "Galaxy S26 (SM-S942Q)",
            "machine_label": "galaxy-s26-gliner25multi-gate",
            "os_build": "Android 16 (SDK 36)",
            "runtime": "litert",
            "runtime_version": "2.2.0",
            "soc": "Qualcomm SM8850",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "Debug gate app com.gliner25multi.gate (android/gate/, Kotlin CompiledModel 2.2.0, Environment.create(context, BuiltinNpuAcceleratorProvider(Qualcomm)) with the Qualcomm dispatch/compiler libraries in jniLibs), one process per (graph, accelerator), inputs pushed as raw float32 files built on the Mac from the float16 host table (rows upcast to float32); timed interval = the five input writes + run + packed-output readback per input, 2 warm-ups + 5 timed repetitions, median per input.",
            "conditions: job start thermal status 0, battery 36.3 C; job end status 1, battery 39.4 C; first timed input at status 0, 36.3 C; screen on (FLAG_KEEP_SCREEN_ON, setShowWhenLocked), USB powered, gate activity top-resumed (foreground).",
            "parity vs the official gliner2 2.0.0 fp32 CPU implementation (whitespace splitter for English / char splitter for Japanese, threshold 0.5): identical span sets on 75/75 inputs, span micro-F1 1.000, max |dconfidence| 0.001408, non-finite inputs 0.",
            "output_match = shared element rule |out - ref| <= max(1e-5, 1e-3 * |ref|) over the packed output (21971850 elements over 75 inputs) against the Mac ai-edge-litert 2.1.6 CPU run of the same graph bytes on the same float16-table inputs (recomputed by scripts/litert_compat_records.py 2026-10-02): 11556 violating elements, max |d| 0.0006289, max |d|/|ref| 5.531.",
            "Reference row: on-device CPU with the same inputs; XNNPACK takes all but one node (the DEQUANTIZE-fed FULLY_CONNECTED weights are float16 constants).",
            "10-02 13:23:12.412 29739 29763 I litert  : [cpu_registry.cc:75] XNNPACK CPU accelerator registered.",
            "10-02 13:23:12.529 29739 29763 I tflite  : Created TensorFlow Lite XNNPACK delegate for CPU.",
            "10-02 13:23:12.531 29739 29763 I tflite  : Replacing 1148 out of 1149 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 3 partitions for subgraph 0 (main)."
          ],
          "failure_class": null,
          "full_delegation": false,
          "latency_p50_ms": 128.523334,
          "loads": true,
          "max_abs_diff": 0.0006289482116699219,
          "max_rel_diff": 5.53131103515625,
          "metrics": {
            "battery_temp_c_end": 39.4,
            "battery_temp_c_first_input": 36.3,
            "battery_temp_c_start": 36.3,
            "element_rule_elements": 21971850.0,
            "element_rule_violations": 11556.0,
            "first_input_median_ms": 74.590625,
            "fixtures": 75.0,
            "identical_span_sets": 75.0,
            "load_compile_ms": 315.453333,
            "max_abs_dconfidence_vs_reference": 0.0014077425003051758,
            "max_ms": 136.178125,
            "min_ms": 72.815678,
            "nonfinite_inputs": 0.0,
            "span_f1": 1.0,
            "spans_fn": 0.0,
            "spans_fp": 0.0,
            "spans_tp": 310.0,
            "sustained_median_ms": 128.523334,
            "thermal_status_end": 1.0,
            "thermal_status_first_input": 0.0,
            "thermal_status_start": 0.0,
            "timed_repetitions_per_input": 5.0,
            "warmups_per_input": 2.0
          },
          "output_match": false,
          "peak_mem_mb": null,
          "prefill_tokens_per_s": null,
          "provenance": "measured",
          "runs": true,
          "signature": "CpuOptions numThreads=4 (XNNPACK); debug gate app com.gliner25multi.gate",
          "total_ops": 1149,
          "ttft_ms": null
        },
        "source": "data/device_runs/2.2.0/2026-10-02/gliner2.5-multi__gliner25_multi_s256_wfp16__galaxy-s26.json"
      },
      {
        "device": "galaxy-s26",
        "run": {
          "accelerator": "gpu_mldrift",
          "context_length": null,
          "date": "2026-10-02",
          "decode_tokens_per_s": null,
          "delegated_ops": 1149,
          "env": {
            "device": "Galaxy S26 (SM-S942Q)",
            "machine_label": "galaxy-s26-gliner25multi-gate",
            "os_build": "Android 16 (SDK 36)",
            "runtime": "litert",
            "runtime_version": "2.2.0",
            "soc": "Qualcomm SM8850",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "Debug gate app com.gliner25multi.gate (android/gate/, Kotlin CompiledModel 2.2.0, Environment.create(context, BuiltinNpuAcceleratorProvider(Qualcomm)) with the Qualcomm dispatch/compiler libraries in jniLibs), one process per (graph, accelerator), inputs pushed as raw float32 files built on the Mac from the float16 host table (rows upcast to float32); timed interval = the five input writes + run + packed-output readback per input, 2 warm-ups + 5 timed repetitions, median per input.",
            "conditions: job start thermal status 0, battery 36.3 C; job end status 0, battery 38.1 C; first timed input at status 0, 36.3 C; screen on (FLAG_KEEP_SCREEN_ON, setShowWhenLocked), USB powered, gate activity top-resumed (foreground).",
            "parity vs the official gliner2 2.0.0 fp32 CPU implementation (whitespace splitter for English / char splitter for Japanese, threshold 0.5): identical span sets on 75/75 inputs, span micro-F1 1.000, max |dconfidence| 0.001416, non-finite inputs 0.",
            "output_match = shared element rule |out - ref| <= max(1e-5, 1e-3 * |ref|) over the packed output (21971850 elements over 75 inputs) against the Mac ai-edge-litert 2.1.6 CPU run of the same graph bytes on the same float16-table inputs (recomputed by scripts/litert_compat_records.py 2026-10-02): 15294 violating elements, max |d| 0.0002632, max |d|/|ref| 7.534.",
            "GPU explicit FP32 is the validated setting of this family (the default precision stays finite but flips a 0.5-threshold span: s128 69/70, see the test row for s128).",
            "10-02 12:28:44.391 18020 18042 I litert  : [npu_registry.cc:30] NPU accelerator registered.",
            "10-02 12:28:44.606 18020 18042 I tflite  : Replacing 1149 out of 1149 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 0 (main)."
          ],
          "failure_class": null,
          "full_delegation": true,
          "latency_p50_ms": 92.95927,
          "loads": true,
          "max_abs_diff": 0.000263214111328125,
          "max_rel_diff": 7.534027099609375,
          "metrics": {
            "battery_temp_c_end": 38.1,
            "battery_temp_c_first_input": 36.3,
            "battery_temp_c_start": 36.3,
            "element_rule_elements": 21971850.0,
            "element_rule_violations": 15294.0,
            "first_input_median_ms": 63.484427,
            "fixtures": 75.0,
            "identical_span_sets": 75.0,
            "load_compile_ms": 1443.680677,
            "max_abs_dconfidence_vs_reference": 0.0014157295227050781,
            "max_ms": 118.556667,
            "min_ms": 60.927604,
            "nonfinite_inputs": 0.0,
            "span_f1": 1.0,
            "spans_fn": 0.0,
            "spans_fp": 0.0,
            "spans_tp": 310.0,
            "sustained_median_ms": 92.95927,
            "thermal_status_end": 0.0,
            "thermal_status_first_input": 0.0,
            "thermal_status_start": 0.0,
            "timed_repetitions_per_input": 5.0,
            "warmups_per_input": 2.0
          },
          "output_match": false,
          "peak_mem_mb": null,
          "prefill_tokens_per_s": null,
          "provenance": "measured",
          "runs": true,
          "signature": "GpuOptions precision=FP32; debug gate app com.gliner25multi.gate",
          "total_ops": 1149,
          "ttft_ms": null
        },
        "source": "data/device_runs/2.2.0/2026-10-02/gliner2.5-multi__gliner25_multi_s256_wfp16__galaxy-s26.json"
      },
      {
        "device": "galaxy-s26",
        "run": {
          "accelerator": "npu_qnn",
          "context_length": null,
          "date": "2026-10-02",
          "decode_tokens_per_s": null,
          "delegated_ops": 1149,
          "env": {
            "device": "Galaxy S26 (SM-S942Q)",
            "machine_label": "galaxy-s26-gliner25multi-gate",
            "os_build": "Android 16 (SDK 36)",
            "runtime": "litert",
            "runtime_version": "2.2.0",
            "soc": "Qualcomm SM8850",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "Debug gate app com.gliner25multi.gate (android/gate/, Kotlin CompiledModel 2.2.0, Environment.create(context, BuiltinNpuAcceleratorProvider(Qualcomm)) with the Qualcomm dispatch/compiler libraries in jniLibs), one process per (graph, accelerator), inputs pushed as raw float32 files built on the Mac from the float16 host table (rows upcast to float32); timed interval = the five input writes + run + packed-output readback per input, 2 warm-ups + 5 timed repetitions, median per input.",
            "conditions: job start thermal status 0, battery 36 C; job end status 2, battery 40.9 C; first timed input at status 2, 39.3 C; screen on (FLAG_KEEP_SCREEN_ON, setShowWhenLocked), USB powered, gate activity top-resumed (foreground).",
            "parity vs the official gliner2 2.0.0 fp32 CPU implementation (whitespace splitter for English / char splitter for Japanese, threshold 0.5): identical span sets on 72/75 inputs, span micro-F1 0.995, max |dconfidence| 0.04781, non-finite inputs 0.",
            "output_match = shared element rule |out - ref| <= max(1e-5, 1e-3 * |ref|) over the packed output (21971850 elements over 75 inputs) against the Mac ai-edge-litert 2.1.6 CPU run of the same graph bytes on the same float16-table inputs (recomputed by scripts/litert_compat_records.py 2026-10-02): 4101136 violating elements, max |d| 2.273, max |d|/|ref| 3.633e+04.",
            "The whole graph ran as one DispatchDelegate node ('Replacing 1 out of 1 node(s) with delegate (DispatchDelegate)' after 'Partitioned subgraph<0>, selected N ops, from a total of N ops'); load_compile_ms is the on-device JIT compile. Every span-set difference is a 0.5-threshold near-tie: official confidences 0.502 (fixture 71 product) and 0.503 (fixture 46 location) dropped, one extra span at NPU confidence 0.519 (fixture 72 location); the work reports the NPU on the card but does not call it a validated path.",
            "10-02 12:50:33.871 21791 21816 I litert  : [npu_registry.cc:30] NPU accelerator registered.",
            "10-02 12:50:34.039 21791 21816 I litert  : [compiler_plugin.cc:741] Partitioned subgraph<0>, selected 1149 ops, from a total of 1149 ops. resulted in 1 partitions.",
            "10-02 12:51:19.486 21791 21816 I tflite  : Replacing 1 out of 1 node(s) with delegate (DispatchDelegate) node, yielding 1 partitions for subgraph 0 (main)."
          ],
          "failure_class": null,
          "full_delegation": true,
          "latency_p50_ms": 34.443021,
          "loads": true,
          "max_abs_diff": 2.273050308227539,
          "max_rel_diff": 36328.03125,
          "metrics": {
            "battery_temp_c_end": 40.9,
            "battery_temp_c_first_input": 39.3,
            "battery_temp_c_start": 36.0,
            "element_rule_elements": 21971850.0,
            "element_rule_violations": 4101136.0,
            "first_input_median_ms": 34.492187,
            "fixtures": 75.0,
            "identical_span_sets": 72.0,
            "load_compile_ms": 45730.0704,
            "max_abs_dconfidence_vs_reference": 0.04780912399291992,
            "max_ms": 39.679167,
            "min_ms": 32.131407,
            "nonfinite_inputs": 0.0,
            "span_f1": 0.9951534733441034,
            "spans_fn": 2.0,
            "spans_fp": 1.0,
            "spans_tp": 308.0,
            "sustained_median_ms": 34.443021,
            "thermal_status_end": 2.0,
            "thermal_status_first_input": 2.0,
            "thermal_status_start": 0.0,
            "timed_repetitions_per_input": 5.0,
            "warmups_per_input": 2.0
          },
          "output_match": false,
          "peak_mem_mb": null,
          "prefill_tokens_per_s": null,
          "provenance": "measured",
          "runs": true,
          "signature": "QualcommOptions htpPerformanceMode=BURST, JIT (first compile, cache dir of a fresh app process); debug gate app com.gliner25multi.gate",
          "total_ops": 1149,
          "ttft_ms": null
        },
        "source": "data/device_runs/2.2.0/2026-10-02/gliner2.5-multi__gliner25_multi_s256_wfp16__galaxy-s26.json"
      }
    ]
  },
  "model": {
    "family": "gliner2.5-multi",
    "id": "gliner2.5-multi__gliner25_multi_s256_wfp16",
    "license": "apache-2.0",
    "source_url": "https://huggingface.co/litert-community/GLiNER2.5-Multi-LiteRT",
    "task": "token-classification"
  },
  "pitfalls": [
    "Weight storage does not set the GPU compute precision: request GpuOptions(precision = FP32). At the default precision the outputs stay finite but one of 70 span sets changes (card 'Measured quality and performance', s128 row 69/70, max confidence drift 3.3e-2).",
    "The graph is the dense prefix of the upstream BoundaryExtractor (mDeBERTa-v3-base encoder, boundary encoder, boundary query head, per-token projections): the host looks up the word-embedding rows before the graph (host_assets/word_embeddings_fp16.bin [250112,768] float16, rows upcast to float32; fp32 table as reference) and runs the upstream gliner2 sparse decoder after it (host_assets/runtime/, 16 decoder tensors); the five inputs are args_0..args_4 = inputs_embeds [1,256,768], attention_mask [1,256], text_routing [1,192,256], query_routing [1,5,256], text_mask [1,192]; one packed float32 output [1,1,1,292958] with 17 logical slices (graph_contract_s256.json).",
    "The caller selects the word splitter per request — official whitespace for space-delimited text such as English, official char for Japanese / CJK; there is no language detector, and capacity counts processed text slots and encoded tokens (text ending in 。 takes one extra slot). Fixed window N=256 / T=192: longer inputs are rejected, not truncated (card 'Files and supported configuration', HOST_CONTRACT.md).",
    "Two fp32-exact rewrites are inside the shipped graph (attention-mask fill -10000 instead of the float32 minimum; each of the 29 active LayerNorms computed on x*2^-3 with eps*2^-6; 60/60 bit-identical comparisons with the stock graph) so the same files stay finite under fp16 delegates — finite, not exact: the Galaxy S26 Hexagon NPU (JIT) matched 69/70, 72/75 and 77/80 span sets with every difference a 0.5-threshold near-tie (max confidence drift 4.8e-2), so the card reports the NPU and does not offer it as a supported path (card 'Measured quality and performance').",
    "Back-to-back requests heat the phone: the s256 and s512 GPU jobs rose from thermal status 0 to 1-2 and their sustained medians (93.0 / 422.5 ms) are 1.5-2.1x the cool opening values (63.5 / 200.9 ms); the card states both with their condition. Latency is a single-device sample (card 'Measured quality and performance').",
    "Validated only for the five fixed labels in that order, threshold 0.5, English (whitespace) and Japanese (char), one window per call, on the Galaxy S26 (card 'Limits'); conversion fidelity to the official gliner2 fp32 implementation (span F1 1.000 on 80 bilingual inputs), not a general accuracy claim — upstream misses carry over (4 of 10 expected organizations on ten early Japanese sentences)."
  ],
  "schema_version": "1.2"
}
