{
  "artifacts": [
    {
      "file": "LFM2-2.6B-Exp_int4.litertlm",
      "sha256": "1d3401ca1b81dc40de154b88a13b654d8ac1838281fd47303aa161f0b825f877",
      "size_mb": 1458.722
    }
  ],
  "benchmarks": [],
  "conversion": {
    "command": "LiquidAI/LFM2-2.6B-Exp rev 2251c865: unquantized export (11 prefill signatures, 1024 down to 1, plus decode, over a 4096-position KV cache) -> post-hoc int4 quantization -> int4 zero-scale fix (746,432 zero block scales in 26 tensors, replaced by each tensor's smallest nonzero scale, block payload zeroed) -> metadata repack with LiteRT-LM's lfm2 configuration (card L111-L112)",
    "quantization": "int4 blockwise-32 + OCTAV on linears, int8 lm_head + embedding (card L28)",
    "tool": "litert-torch 0.9.4; repro = hf-to-litertlm lfm_work/convert_lfm2_26b_exp.sh (card L111)",
    "tool_version": "litert-torch 0.9.4, litert-converter 0.4.0, ai-edge-quantizer 0.9.0, transformers 5.14.1, torch 2.13.0; packed by the litert-lm 0.18.0 CLI"
  },
  "cross_runtime": [],
  "delegation": null,
  "device": {
    "records": [
      {
        "device": "galaxy-s26",
        "run": {
          "accelerator": "cpu",
          "context_length": null,
          "date": "2026-10-12",
          "decode_tokens_per_s": 21.215,
          "delegated_ops": 1394,
          "env": {
            "device": "Galaxy S26 (SM-S942Q)",
            "machine_label": "galaxy-s26-aab1",
            "os_build": "Android 16 (BP4A.251205.006)",
            "runtime": "litert-lm",
            "runtime_version": "prebuilt-adac974b",
            "soc": "Qualcomm SM8850",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "binary: Google's prebuilt litert_lm_advanced_main + 6 .so (gs://litert/binaries/latest/android_arm64/litert_lm/, object dated 2026-09-18, 40,382,152 B, sha256 adac974b…)",
            "r1 hold 2026-10-12 21:47:56-22:07:53 JST: [21:54:50] bundle on device: 1d3401ca1b81dc40de154b88a13b654d8ac1838281fd47303aa161f0b825f877 (1529581168 B, push 42.2 s) = Mac",
            "bench args: --backend=cpu --model_path=/data/local/tmp/aa4_26bexp/LFM2-2.6B-Exp_int4.litertlm --benchmark=true --benchmark_prefill_tokens=1024 --benchmark_decode_tokens=256 --max_num_tokens=2048 --num_iterations=3 --report_peak_memory_footprint=true --metric_proto_file_path=/data/local/tmp/aa4_26bexp/metrics.pb",
            "VERBOSE: Replacing 869 out of 978 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 152 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 795 out of 895 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 156 partitions for subgraph 11 (decode).",
            "VERBOSE: Replacing 1394 out of 1428 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 18 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 1273 out of 1296 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 18 partitions for subgraph 11 (decode).",
            "[21:58:45] parsed: s26_i4_cpu_timing cpu: gate PASS 1/1 | bench prefill 74.035 decode 21.215 init 4765.47 cold 6011.69 peak 3111.75 capped 36/37 | answers: 'Paris'",
            "timing run prompt process: \"Paris\"",
            "check run (hold 2026-10-12 21:47:56-22:07:53 JST): 2 of 2 prompt processes answered with the expected word (\"Paris\")"
          ],
          "failure_class": null,
          "full_delegation": false,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "boot_epoch_s": 1791590918.52,
            "capped_samples": 36.0,
            "cold_init_ms": 6011.69,
            "cpu_capped_samples": 36.0,
            "decode_tok_s_it1": 21.79,
            "decode_tok_s_it2": 22.23,
            "decode_tok_s_it3": 20.2,
            "decode_tokens": 256.0,
            "init_ms": 4765.47,
            "iterations": 3.0,
            "kgsl_ceiling_min_mhz": 461.0,
            "kgsl_temp_max_c": 64.0,
            "max_num_tokens": 2048.0,
            "memavail_at_bench_start_kib": 7074532.0,
            "memavail_min_kib": 5561644.0,
            "prefill_tok_s_it1": 121.11,
            "prefill_tok_s_it2": 80.81,
            "prefill_tok_s_it3": 67.26,
            "prefill_tokens": 1024.0,
            "sampler_samples": 37.0,
            "skin_c_at_bench_start": 40.0,
            "t_1024_256_s": 25.8982,
            "thermal_status_at_bench_start": 1.0,
            "ttft_s_it1": 8.5,
            "ttft_s_it2": 12.72,
            "ttft_s_it3": 15.27
          },
          "output_match": null,
          "peak_mem_mb": 3111.75,
          "prefill_tokens_per_s": 74.035,
          "provenance": "measured",
          "runs": true,
          "total_ops": 1428,
          "ttft_ms": 13995.0
        },
        "source": "data/device_runs/prebuilt-adac974b/2026-10-12/lfm2-2.6b-exp-int4__galaxy-s26.json"
      },
      {
        "device": "galaxy-s26",
        "run": {
          "accelerator": "gpu",
          "context_length": null,
          "date": "2026-10-12",
          "decode_tokens_per_s": 27.615,
          "delegated_ops": 978,
          "env": {
            "device": "Galaxy S26 (SM-S942Q)",
            "machine_label": "galaxy-s26-aab1",
            "os_build": "Android 16 (BP4A.251205.006)",
            "runtime": "litert-lm",
            "runtime_version": "prebuilt-adac974b",
            "soc": "Qualcomm SM8850",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "binary: Google's prebuilt litert_lm_advanced_main + 6 .so (gs://litert/binaries/latest/android_arm64/litert_lm/, object dated 2026-09-18, 40,382,152 B, sha256 adac974b…)",
            "r1 hold 2026-10-12 21:47:56-22:07:53 JST: [22:04:10] bundle on device: 1d3401ca1b81dc40de154b88a13b654d8ac1838281fd47303aa161f0b825f877 (1529581168 B, push 0 s) = Mac",
            "bench args: --backend=gpu --model_path=/data/local/tmp/aa4_26bexp/LFM2-2.6B-Exp_int4.litertlm --benchmark=true --benchmark_prefill_tokens=1024 --benchmark_decode_tokens=256 --max_num_tokens=2048 --num_iterations=3 --report_peak_memory_footprint=true --metric_proto_file_path=/data/local/tmp/aa4_26bexp/metrics.pb",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 1 (prefill_512).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 2 (prefill_256).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 3 (prefill_128).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 4 (prefill_64).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 5 (prefill_32).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 6 (prefill_16).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 7 (prefill_8).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 8 (prefill_4).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 9 (prefill_2).",
            "VERBOSE: Replacing 877 out of 877 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 10 (prefill_1).",
            "VERBOSE: Replacing 895 out of 895 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 11 (decode).",
            "[22:06:50] parsed: s26_i4_gpu_timing gpu: gate PASS 1/1 | bench prefill 664.285 decode 27.615000000000002 init 6526.89 cold 9881.5 peak 1029.22 capped 17/19 | answers: 'Paris'",
            "timing run prompt process: \"Paris\"",
            "check run (hold 2026-10-12 21:47:56-22:07:53 JST): 2 of 2 prompt processes answered with the expected word (\"Paris\")"
          ],
          "failure_class": null,
          "full_delegation": true,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "boot_epoch_s": 1791590918.98,
            "capped_samples": 17.0,
            "cold_init_ms": 9881.5,
            "cpu_capped_samples": 17.0,
            "decode_tok_s_it1": 27.77,
            "decode_tok_s_it2": 27.91,
            "decode_tok_s_it3": 27.32,
            "decode_tokens": 256.0,
            "init_ms": 6526.89,
            "iterations": 3.0,
            "kgsl_ceiling_min_mhz": 726.0,
            "kgsl_temp_max_c": 76.0,
            "max_num_tokens": 2048.0,
            "memavail_at_bench_start_kib": 7809832.0,
            "memavail_min_kib": 4602412.0,
            "prefill_tok_s_it1": 766.47,
            "prefill_tok_s_it2": 718.18,
            "prefill_tok_s_it3": 610.39,
            "prefill_tokens": 1024.0,
            "sampler_samples": 19.0,
            "skin_c_at_bench_start": 42.0,
            "t_1024_256_s": 10.8118,
            "thermal_status_at_bench_start": 2.0,
            "ttft_s_it1": 1.37,
            "ttft_s_it2": 1.46,
            "ttft_s_it3": 1.71
          },
          "output_match": null,
          "peak_mem_mb": 1029.22,
          "prefill_tokens_per_s": 664.285,
          "provenance": "measured",
          "runs": true,
          "total_ops": 978,
          "ttft_ms": 1585.0
        },
        "source": "data/device_runs/prebuilt-adac974b/2026-10-12/lfm2-2.6b-exp-int4__galaxy-s26.json"
      },
      {
        "device": "mac-studio-m4-max",
        "run": {
          "accelerator": "cpu",
          "context_length": null,
          "date": "2026-10-12",
          "decode_tokens_per_s": 48.04,
          "delegated_ops": null,
          "env": {
            "device": "Mac Studio (M4 Max)",
            "machine_label": "mac-studio-m4-max",
            "os_build": "macOS 27.0",
            "runtime": "litert-lm",
            "runtime_version": "0.18.0",
            "soc": "Apple M4 Max",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "Prefill 177.07 / decode 48.04 tok/s, TTFT 5.8085 s, init 8.6964 s",
            "settle_run: quiet after 0 s; run: litert-lm benchmark LFM2-2.6B-Exp_int4.litertlm --backend cpu -p 1024 -d 256 --max-num-tokens 2048 --runs 3 --cache no",
            "2026-10-12 21:21:55 JST cpu int4 exit 0"
          ],
          "failure_class": null,
          "full_delegation": null,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "decode_tokens": 256.0,
            "init_s": 8.6964,
            "iterations": 3.0,
            "max_num_tokens": 2048.0,
            "prefill_tokens": 1024.0,
            "processes": 1.0,
            "t_1024_256_s": 11.1119
          },
          "output_match": null,
          "peak_mem_mb": null,
          "prefill_tokens_per_s": 177.07,
          "provenance": "measured",
          "runs": true,
          "total_ops": null,
          "ttft_ms": 5808.5
        },
        "source": "data/device_runs/0.18.0/2026-10-12/lfm2-2.6b-exp-int4__mac-studio-m4-max.json"
      },
      {
        "device": "mac-studio-m4-max",
        "run": {
          "accelerator": "gpu",
          "context_length": null,
          "date": "2026-10-12",
          "decode_tokens_per_s": 161.77,
          "delegated_ops": null,
          "env": {
            "device": "Mac Studio (M4 Max)",
            "machine_label": "mac-studio-m4-max",
            "os_build": "macOS 27.0",
            "runtime": "litert-lm",
            "runtime_version": "0.18.0",
            "soc": "Apple M4 Max",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "Prefill 2475.63 / decode 161.77 tok/s, TTFT 0.4198 s, init 3.8491 s",
            "settle_run: quiet after 0 s; run: litert-lm benchmark LFM2-2.6B-Exp_int4.litertlm --backend gpu -p 1024 -d 256 --max-num-tokens 2048 --runs 3 --cache no",
            "2026-10-12 21:30:26 JST gpu int4 verbose exit 0 validation_error=0 shape_mismatch=0 replacing=24",
            "2026-10-12 21:29:40 JST gpu int4 exit 0"
          ],
          "failure_class": null,
          "full_delegation": null,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "decode_tokens": 256.0,
            "init_s": 3.8491,
            "iterations": 3.0,
            "max_num_tokens": 2048.0,
            "prefill_tokens": 1024.0,
            "processes": 1.0,
            "t_1024_256_s": 1.9961
          },
          "output_match": null,
          "peak_mem_mb": null,
          "prefill_tokens_per_s": 2475.63,
          "provenance": "measured",
          "runs": true,
          "total_ops": null,
          "ttft_ms": 419.8
        },
        "source": "data/device_runs/0.18.0/2026-10-12/lfm2-2.6b-exp-int4__mac-studio-m4-max.json"
      },
      {
        "device": "pixel-8a",
        "run": {
          "accelerator": "cpu",
          "context_length": null,
          "date": "2026-10-12",
          "decode_tokens_per_s": 8.005,
          "delegated_ops": 1394,
          "env": {
            "device": "Pixel 8a",
            "machine_label": "pixel-8a-aab1",
            "os_build": "Android 16 (CP1A.260505.005)",
            "runtime": "litert-lm",
            "runtime_version": "prebuilt-adac974b",
            "soc": "Tensor G3",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "binary: Google's prebuilt litert_lm_advanced_main + 6 .so (gs://litert/binaries/latest/android_arm64/litert_lm/, object dated 2026-09-18, 40,382,152 B, sha256 adac974b…)",
            "r4 hold 2026-10-12 23:08:20-23:20:38 JST: [23:12:11] bundle on device: 1d3401ca1b81dc40de154b88a13b654d8ac1838281fd47303aa161f0b825f877 (1529581168 B, push 33.4 s) = Mac",
            "bench args: --backend=cpu --model_path=/data/local/tmp/aa4_26bexp/LFM2-2.6B-Exp_int4.litertlm --benchmark=true --benchmark_prefill_tokens=1024 --benchmark_decode_tokens=256 --max_num_tokens=2048 --num_iterations=3 --report_peak_memory_footprint=true --metric_proto_file_path=/data/local/tmp/aa4_26bexp/metrics.pb",
            "VERBOSE: Replacing 869 out of 978 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 152 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 795 out of 895 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 156 partitions for subgraph 11 (decode).",
            "VERBOSE: Replacing 1394 out of 1428 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 18 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 1273 out of 1296 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 18 partitions for subgraph 11 (decode).",
            "[23:20:36] parsed: p8a_i4_cpu_timing cpu: gate PASS 1/1 | bench prefill 30.525 decode 8.004999999999999 init 10843.16 cold 12455.83 peak 2597.15 capped 65/65 | answers: 'Paris'",
            "timing run prompt process: \"Paris\""
          ],
          "failure_class": null,
          "full_delegation": false,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "boot_epoch_s": 1791442100.4,
            "capped_samples": 65.0,
            "cold_init_ms": 12455.83,
            "cpu_capped_samples": 65.0,
            "decode_tok_s_it1": 9.72,
            "decode_tok_s_it2": 8.17,
            "decode_tok_s_it3": 7.84,
            "decode_tokens": 256.0,
            "init_ms": 10843.16,
            "iterations": 3.0,
            "max_num_tokens": 2048.0,
            "memavail_at_bench_start_kib": 4273428.0,
            "memavail_min_kib": 3201924.0,
            "prefill_tok_s_it1": 49.67,
            "prefill_tok_s_it2": 31.63,
            "prefill_tok_s_it3": 29.42,
            "prefill_tokens": 1024.0,
            "sampler_samples": 65.0,
            "t_1024_256_s": 65.5263,
            "thermal_status_at_bench_start": 1.0,
            "ttft_s_it1": 20.72,
            "ttft_s_it2": 32.5,
            "ttft_s_it3": 34.93
          },
          "output_match": null,
          "peak_mem_mb": 2597.15,
          "prefill_tokens_per_s": 30.525,
          "provenance": "measured",
          "runs": true,
          "total_ops": 1428,
          "ttft_ms": 33715.0
        },
        "source": "data/device_runs/prebuilt-adac974b/2026-10-12/lfm2-2.6b-exp-int4__pixel-8a.json"
      },
      {
        "device": "pixel-8a",
        "run": {
          "accelerator": "gpu",
          "context_length": null,
          "date": "2026-10-12",
          "decode_tokens_per_s": 15.9,
          "delegated_ops": 978,
          "env": {
            "device": "Pixel 8a",
            "machine_label": "pixel-8a-aab1",
            "os_build": "Android 16 (CP1A.260505.005)",
            "runtime": "litert-lm",
            "runtime_version": "prebuilt-adac974b",
            "soc": "Tensor G3",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "binary: Google's prebuilt litert_lm_advanced_main + 6 .so (gs://litert/binaries/latest/android_arm64/litert_lm/, object dated 2026-09-18, 40,382,152 B, sha256 adac974b…)",
            "r2 hold 2026-10-12 22:12:38-22:40:16 JST: [22:13:22] bundle on device: 1d3401ca1b81dc40de154b88a13b654d8ac1838281fd47303aa161f0b825f877 (1529581168 B, push 33.7 s) = Mac",
            "bench args: --backend=gpu --model_path=/data/local/tmp/aa4_26bexp/LFM2-2.6B-Exp_int4.litertlm --benchmark=true --benchmark_prefill_tokens=1024 --benchmark_decode_tokens=256 --max_num_tokens=2048 --num_iterations=3 --report_peak_memory_footprint=true --metric_proto_file_path=/data/local/tmp/aa4_26bexp/metrics.pb",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 1 (prefill_512).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 2 (prefill_256).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 3 (prefill_128).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 4 (prefill_64).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 5 (prefill_32).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 6 (prefill_16).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 7 (prefill_8).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 8 (prefill_4).",
            "VERBOSE: Replacing 978 out of 978 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 9 (prefill_2).",
            "VERBOSE: Replacing 877 out of 877 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 10 (prefill_1).",
            "VERBOSE: Replacing 895 out of 895 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 11 (decode).",
            "[22:20:41] parsed: p8a_i4_gpu_timing gpu: gate PASS 1/1 | bench prefill 171.73 decode 15.9 init 12945.07 cold 26290.67 peak 1504.58 capped 0/31 | answers: 'Paris'",
            "timing run prompt process: \"Paris\"",
            "check run (hold 2026-10-12 22:12:38-22:40:16 JST): 1 of 1 prompt processes answered with the expected word (\"Paris\")"
          ],
          "failure_class": null,
          "full_delegation": true,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "boot_epoch_s": 1791442100.57,
            "capped_samples": 0.0,
            "cold_init_ms": 26290.67,
            "cpu_capped_samples": 31.0,
            "decode_tok_s_it1": 15.59,
            "decode_tok_s_it2": 16.03,
            "decode_tok_s_it3": 15.77,
            "decode_tokens": 256.0,
            "init_ms": 12945.07,
            "iterations": 3.0,
            "max_num_tokens": 2048.0,
            "memavail_at_bench_start_kib": 4039020.0,
            "memavail_min_kib": 1209484.0,
            "prefill_tok_s_it1": 172.24,
            "prefill_tok_s_it2": 173.73,
            "prefill_tok_s_it3": 169.73,
            "prefill_tokens": 1024.0,
            "sampler_samples": 31.0,
            "t_1024_256_s": 22.0635,
            "thermal_status_at_bench_start": 1.0,
            "ttft_s_it1": 6.01,
            "ttft_s_it2": 5.96,
            "ttft_s_it3": 6.1
          },
          "output_match": null,
          "peak_mem_mb": 1504.58,
          "prefill_tokens_per_s": 171.73,
          "provenance": "measured",
          "runs": true,
          "total_ops": 978,
          "ttft_ms": 6030.0
        },
        "source": "data/device_runs/prebuilt-adac974b/2026-10-12/lfm2-2.6b-exp-int4__pixel-8a.json"
      }
    ]
  },
  "model": {
    "family": "lfm2",
    "id": "lfm2-2.6b-exp-int4",
    "license": "other (lfm1.0)",
    "source_url": "https://huggingface.co/litert-community/LFM2-2.6B-Exp",
    "task": "text-generation"
  },
  "pitfalls": [
    "Mac CPU repetition: on the Mac CPU this file is not reliable with the card's dates prompt - in 9 runs, 3 repeated lines until the 4096-token context was full (2 of 4 with the bundle's sampler, 1 of 5 with --top-k 1) and 1 kept correcting itself; on the GPU it ended normally in 4 of 4 runs; the cause was not established (card L39, L68).",
    "Runtime: tested on litert-lm 0.18.0 on a Mac; this file was not tried on litert-lm 0.17.1, where the int8 file of the same conversion answered as if no question had been asked (card L21).",
    "Block scales: the plain int4 quantization left 746,432 zero block scales in 26 tensors; this file replaces them by each tensor's smallest nonzero scale with the block payload zeroed (card L112).",
    "Reasoning trace: Liquid AI's card says nothing about reasoning, yet the model sometimes writes a trace between <think> and </think>, which goes to the thought channel; in the card's checks it appeared for 1 of 120 IFEval-lite prompts per row and none for GSM8K, the checks or the phone prompts (card L23, L72).",
    "Template: Liquid AI's chat template (the LFM2-2.6B file) fails at render on litert-lm 0.18.0 (map has no method named get), so the bundle carries LiteRT-LM's lfm2 template (byte-identical to models/lfm2/chat_template.jinja at commit 86a7e6d0), which reads message content as a list of parts; stops <|im_end|> and <|endoftext|>, start token <|startoftext|> (card L72, L113).",
    "Tool calling is declared (model type lfm2): the file returned a parsed get_weather call (Python API, CPU, greedy) and used its result with automatic tool calling; with tools the template omits Liquid AI's tool-list and tool-response markers, wraps the tool result in [ … ] and quotes call arguments with double quotes (card L74).",
    "One Engine per conversation: on the int8 file, a shared Engine changed an answer's wording under the condition of LiteRT-LM issue #3165 (the same system prompt, user messages beginning with the same eight words); the card advises a new Engine for each conversation (card L76).",
    "Conversation preface with tools and no messages: LiteRT-LM renders the chat template with an empty message list, and the template reads messages[0] without checking that the list is non-empty, so the render fails with 'Failed to apply template: undefined value' when the preface is prefilled at creation (prefillPrefaceOnInit, default false; creating the conversation fails) and in the preface render (renderPrefaceIntoString and its C++ and C API forms); the same with extra context (such as enable_thinking) and no messages, and in the preface render with an empty preface (run in the runtime on one Qwen3 template; the other templates rendered with minijinja 2.14 and jinja2); read in the source of LiteRT-LM 0.17.0, 0.18.1 and main, measured with the 0.18.1 PyPI package through its C API on these files' template text; the default path, where the first message is rendered with the preface, is not affected (the 0.18.1 Python API and CLI expose neither the flag nor the preface render); a system message or any initial message in the conversation config avoids it (card L117).",
    "Sampler: the bundle's default sampler is temperature 0.1, top-k 50, top-p 1.0; Liquid AI recommends temperature 0.3, min_p 0.15 and repetition_penalty 1.05, which the bundle does not carry; --top-k 1 gives greedy output (card L70).",
    "Cache: without --cache, `run` writes a compiled-weights cache next to the model (1.51 GB for this file); without --backend, `run` uses the CPU (card L68).",
    "Speed: this file is the faster one on every GPU (Mac 2.00 vs 2.49 s, Galaxy S26 10.81 vs 13.42 s, Pixel 8a 22.06 vs 25.14 s for a 1024-token prefill plus 256 decoded tokens) and the slower on every CPU; 43.8 % smaller than the int8 file; not measured on iOS, not run on the NPU (card L30-L39, L107).",
    "Phone conditions: on the Galaxy S26 the GPU clock ceiling fell from 1300 to 726 MHz inside this file's GPU benchmark and the CPU clock was lowered in 36 of 37 samples of its CPU run; on the Pixel 8a the CPU clock was lowered in 65 of 65 samples of the CPU run (card L98, L107).",
    "Accuracy (greedy, at most 2048 output tokens, litert-lm on the Mac GPU, comparable only within the card's table; Liquid AI publishes no benchmark table for this checkpoint): GSM8K 89 of 100 (bf16 89), IFEval-lite 101 of 120 (bf16 102); 8-question check 7/8 on CPU and GPU, bf16 7/8, the same rhyme question missed (card L43, L49-L57).",
    "License: the LFM Open License v1.0's section 5 conditions commercial use on an annual revenue below 10 million US dollars (card L121)."
  ],
  "schema_version": "1.2"
}
