{
  "artifacts": [
    {
      "file": "G9v3-3B_int8.litertlm",
      "sha256": "8d9f5e8522e553458ab3fb7f4a461359367934d0741c5e82cd777da55ce69dc5",
      "size_mb": 2959.877
    }
  ],
  "benchmarks": [],
  "conversion": {
    "command": "ai9stars/G9v3-3B rev d9553445: export with the int8 recipe (6 prefill signatures, 1024 down to 1, plus decode, over a 4096-position KV cache; the embedding table as its own section; the bundle template embedded) -> metadata edit (stops ids 1 and 130073, thought channel <think> / </think>, thinking declared, max_num_tokens 4096) -> GPU activation type declared fp32 -> the GPU-composite retrofit of that file without re-exporting (card L113, L114, L116)",
    "quantization": "int8 dynamic on linears, float activations; embedding table in its own section; GPU activations declared fp32; GPU-composite graph (card L25)",
    "tool": "litert-torch 0.9.4, then hf-to-litertlm tools/gpu_graph/gpu_graph_retrofit.py; repro = hf-to-litertlm g9v3_work/convert_g9v3_3b.sh + the retrofit (card L113, L114)",
    "tool_version": "litert-torch 0.9.4, litert-converter 0.4.0, ai-edge-quantizer 0.9.0, transformers 5.14.1 (export); packed by the litert-lm 0.18.0 CLI; GPU-composite graph by tools/gpu_graph/gpu_graph_retrofit.py --decomp exporter --mask add_bcast (2026-10-18)"
  },
  "cross_runtime": [],
  "delegation": null,
  "device": {
    "records": [
      {
        "device": "galaxy-s26",
        "run": {
          "accelerator": "cpu",
          "context_length": null,
          "date": "2026-10-13",
          "decode_tokens_per_s": 9.925,
          "delegated_ops": 2830,
          "env": {
            "device": "Galaxy S26 (SM-S942Q)",
            "machine_label": "galaxy-s26-aab1",
            "os_build": "Android 16 (BP4A.251205.006)",
            "runtime": "litert-lm",
            "runtime_version": "prebuilt-adac974b",
            "soc": "Qualcomm SM8850",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "binary: Google's prebuilt litert_lm_advanced_main + 6 .so (gs://litert/binaries/latest/android_arm64/litert_lm/, object dated 2026-09-18, 40,382,152 B, sha256 adac974b…)",
            "r3 hold 2026-10-13 10:43:15-11:01:04 JST: [10:44:48] bundle on device: c8c45d5bc3a5078290b38024651efda7b5a01cb1dce1d3b32284f9994d41afec (3102493024 B, push 83.2 s) = Mac",
            "file pushed: G9v3-3B_int8.litertlm (sha256 = the Hub file)",
            "bench args: --backend=cpu --model_path=/data/local/tmp/aa5_g9v3/G9v3-3B_int8.litertlm --benchmark=true --benchmark_prefill_tokens=1024 --benchmark_decode_tokens=256 --max_num_tokens=2048 --num_iterations=3 --report_peak_memory_footprint=true --metric_proto_file_path=/data/local/tmp/aa5_g9v3/metrics.pb",
            "VERBOSE: Replacing 2109 out of 2323 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 309 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 1877 out of 2092 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 314 partitions for subgraph 6 (decode).",
            "VERBOSE: Replacing 2830 out of 2941 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 105 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 2507 out of 2617 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 106 partitions for subgraph 6 (decode).",
            "[10:52:59] parsed: i8_cpu_rested cpu: gate PASS 1/1 | bench prefill 108.25999999999999 decode 9.925 init 299.0 cold 3295.62 peak 4147.16 capped 45/46 | answers: 'The capital of France is Paris.'",
            "timing run prompt process: \"The capital of France is Paris.\""
          ],
          "failure_class": null,
          "full_delegation": false,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "boot_epoch_s": 1791590918.48,
            "capped_samples": 45.0,
            "cold_init_ms": 3295.62,
            "cpu_capped_samples": 45.0,
            "decode_tok_s_it1": 11.67,
            "decode_tok_s_it2": 9.96,
            "decode_tok_s_it3": 9.89,
            "decode_tokens": 256.0,
            "init_ms": 299.0,
            "iterations": 3.0,
            "kgsl_ceiling_min_mhz": 461.0,
            "kgsl_temp_max_c": 66.3,
            "max_num_tokens": 2048.0,
            "memavail_at_bench_start_kib": 7353408.0,
            "memavail_min_kib": 5860352.0,
            "prefill_tok_s_it1": 201.86,
            "prefill_tok_s_it2": 113.47,
            "prefill_tok_s_it3": 103.05,
            "prefill_tokens": 1024.0,
            "sampler_samples": 46.0,
            "skin_c_at_bench_start": 40.2,
            "t_1024_256_s": 35.2522,
            "thermal_status_at_bench_start": 1.0,
            "ttft_s_it1": 5.16,
            "ttft_s_it2": 9.12,
            "ttft_s_it3": 10.04
          },
          "output_match": null,
          "peak_mem_mb": 4147.16,
          "prefill_tokens_per_s": 108.26,
          "provenance": "measured",
          "runs": true,
          "total_ops": 2941,
          "ttft_ms": 9580.0
        },
        "source": "data/device_runs/prebuilt-adac974b/2026-10-13/g9v3-3b-int8__galaxy-s26.json"
      },
      {
        "device": "galaxy-s26",
        "run": {
          "accelerator": "gpu",
          "context_length": null,
          "date": "2026-10-13",
          "decode_tokens_per_s": 12.225,
          "delegated_ops": 2323,
          "env": {
            "device": "Galaxy S26 (SM-S942Q)",
            "machine_label": "galaxy-s26-aab1",
            "os_build": "Android 16 (BP4A.251205.006)",
            "runtime": "litert-lm",
            "runtime_version": "prebuilt-adac974b",
            "soc": "Qualcomm SM8850",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "binary: Google's prebuilt litert_lm_advanced_main + 6 .so (gs://litert/binaries/latest/android_arm64/litert_lm/, object dated 2026-09-18, 40,382,152 B, sha256 adac974b…)",
            "r3 hold 2026-10-13 10:43:15-11:01:04 JST: [10:53:09] bundle on device: c8c45d5bc3a5078290b38024651efda7b5a01cb1dce1d3b32284f9994d41afec (3102493024 B, push 0 s) = Mac",
            "file pushed: G9v3-3B_int8.litertlm (sha256 = the Hub file)",
            "bench args: --backend=gpu --model_path=/data/local/tmp/aa5_g9v3/G9v3-3B_int8.litertlm --benchmark=true --benchmark_prefill_tokens=1024 --benchmark_decode_tokens=256 --max_num_tokens=2048 --num_iterations=3 --report_peak_memory_footprint=true --metric_proto_file_path=/data/local/tmp/aa5_g9v3/metrics.pb",
            "VERBOSE: Replacing 2323 out of 2323 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 2323 out of 2323 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 1 (prefill_256).",
            "VERBOSE: Replacing 2323 out of 2323 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 2 (prefill_64).",
            "VERBOSE: Replacing 2323 out of 2323 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 3 (prefill_16).",
            "VERBOSE: Replacing 2323 out of 2323 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 4 (prefill_4).",
            "VERBOSE: Replacing 2064 out of 2064 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 5 (prefill_1).",
            "VERBOSE: Replacing 2092 out of 2092 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 6 (decode).",
            "[11:01:02] parsed: i8_gpu_rested gpu: gate PASS 1/1 | bench prefill 113.905 decode 12.225 init 5413.53 cold 8331.68 peak 1001.7 capped 41/46 | answers: 'The capital of France is Paris.'",
            "timing run prompt process: \"The capital of France is Paris.\""
          ],
          "failure_class": null,
          "full_delegation": true,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "boot_epoch_s": 1791590919.38,
            "capped_samples": 41.0,
            "cold_init_ms": 8331.68,
            "cpu_capped_samples": 43.0,
            "decode_tok_s_it1": 12.95,
            "decode_tok_s_it2": 12.75,
            "decode_tok_s_it3": 11.7,
            "decode_tokens": 256.0,
            "init_ms": 5413.53,
            "iterations": 3.0,
            "kgsl_ceiling_min_mhz": 500.0,
            "kgsl_temp_max_c": 91.1,
            "max_num_tokens": 2048.0,
            "memavail_at_bench_start_kib": 7853916.0,
            "memavail_min_kib": 2408624.0,
            "prefill_tok_s_it1": 112.26,
            "prefill_tok_s_it2": 109.88,
            "prefill_tok_s_it3": 117.93,
            "prefill_tokens": 1024.0,
            "sampler_samples": 46.0,
            "skin_c_at_bench_start": 42.0,
            "t_1024_256_s": 29.9306,
            "thermal_status_at_bench_start": 2.0,
            "ttft_s_it1": 9.2,
            "ttft_s_it2": 9.4,
            "ttft_s_it3": 8.77
          },
          "output_match": null,
          "peak_mem_mb": 1001.7,
          "prefill_tokens_per_s": 113.905,
          "provenance": "measured",
          "runs": true,
          "total_ops": 2323,
          "ttft_ms": 9085.0
        },
        "source": "data/device_runs/prebuilt-adac974b/2026-10-13/g9v3-3b-int8__galaxy-s26.json"
      },
      {
        "device": "mac-studio-m4-max",
        "run": {
          "accelerator": "cpu",
          "context_length": null,
          "date": "2026-10-18",
          "decode_tokens_per_s": null,
          "delegated_ops": null,
          "env": {
            "device": "Mac Studio (M4 Max)",
            "machine_label": "mac-studio-m4-max",
            "os_build": "macOS 27.0",
            "runtime": "litert-lm",
            "runtime_version": "0.17.1",
            "soc": "Apple M4 Max",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "### CMD: litert-lm 0.17.1 run ./G9v3-3B_int8.litertlm --prompt \"What is the capital of France? Answer in one sentence.\" --cache no (CPU)",
            "### PATH: G9v3-3B_int8.litertlm (= G9v3-3B_int8_rf.litertlm)",
            "2026-10-18 00:11:29 clone G9v3-3B_int8.litertlm sha256 8d9f5e8522e553458ab3fb7f4a461359367934d0741c5e82cd777da55ce69dc5 (3103656288 B)",
            "### start: 2026-10-18 00:16:08 JST",
            "stdout: The capital of France is Paris.",
            "### EXIT: 0 2026-10-18 00:16:30 JST"
          ],
          "failure_class": null,
          "full_delegation": null,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "answers_with_expect": 1.0,
            "processes": 1.0
          },
          "output_match": null,
          "peak_mem_mb": null,
          "prefill_tokens_per_s": null,
          "provenance": "measured",
          "runs": true,
          "total_ops": null,
          "ttft_ms": null
        },
        "source": "data/device_runs/0.17.1/2026-10-18/g9v3-3b-int8__mac-studio-m4-max.json"
      },
      {
        "device": "mac-studio-m4-max",
        "run": {
          "accelerator": "cpu",
          "context_length": null,
          "date": "2026-10-17",
          "decode_tokens_per_s": 24.86,
          "delegated_ops": null,
          "env": {
            "device": "Mac Studio (M4 Max)",
            "machine_label": "mac-studio-m4-max",
            "os_build": "macOS 27.0",
            "runtime": "litert-lm",
            "runtime_version": "0.18.0",
            "soc": "Apple M4 Max",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "Prefill 261.5 / decode 24.79 tok/s, TTFT 3.9645 s, init 22.5176 s",
            "Prefill 266.1 / decode 24.93 tok/s, TTFT 3.8899 s, init 20.5132 s",
            "settle_run: quiet after 0 s; run: litert-lm benchmark G9v3-3B_int8_rf.litertlm --backend cpu -p 1024 -d 256 --max-num-tokens 2048 --runs 3 --cache no",
            "2026-10-17 20:16:26 JST cpu int8_rf p1 exit 0",
            "2026-10-17 20:29:50 JST cpu int8_rf p2 exit 0",
            "cpu/int8_rf: median prefill 263.8 / decode 24.86 tok/s"
          ],
          "failure_class": null,
          "full_delegation": null,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "decode_tokens": 256.0,
            "init_s": 21.5154,
            "iterations": 3.0,
            "max_num_tokens": 2048.0,
            "pass1_decode_tok_s": 24.79,
            "pass1_init_s": 22.5176,
            "pass1_prefill_tok_s": 261.5,
            "pass1_ttft_s": 3.9645,
            "pass2_decode_tok_s": 24.93,
            "pass2_init_s": 20.5132,
            "pass2_prefill_tok_s": 266.1,
            "pass2_ttft_s": 3.8899,
            "passes": 2.0,
            "prefill_tokens": 1024.0,
            "t_1024_256_s": 14.1798
          },
          "output_match": null,
          "peak_mem_mb": null,
          "prefill_tokens_per_s": 263.8,
          "provenance": "measured",
          "runs": true,
          "total_ops": null,
          "ttft_ms": 3927.2
        },
        "source": "data/device_runs/0.18.0/2026-10-17/g9v3-3b-int8__mac-studio-m4-max.json"
      },
      {
        "device": "mac-studio-m4-max",
        "run": {
          "accelerator": "gpu",
          "context_length": null,
          "date": "2026-10-17",
          "decode_tokens_per_s": 84.17,
          "delegated_ops": null,
          "env": {
            "device": "Mac Studio (M4 Max)",
            "machine_label": "mac-studio-m4-max",
            "os_build": "macOS 27.0",
            "runtime": "litert-lm",
            "runtime_version": "0.18.0",
            "soc": "Apple M4 Max",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "Prefill 1358.21 / decode 84.11 tok/s, TTFT 0.766 s, init 4.1084 s",
            "Prefill 1321.99 / decode 84.23 tok/s, TTFT 0.7876 s, init 4.0888 s",
            "settle_run: quiet after 0 s; run: litert-lm benchmark G9v3-3B_int8_rf.litertlm --backend gpu -p 1024 -d 256 --max-num-tokens 2048 --runs 3 --cache no",
            "2026-10-17 20:24:50 JST gpu int8_rf p1 exit 0",
            "2026-10-17 20:37:50 JST gpu int8_rf p2 exit 0",
            "gpu/int8_rf: median prefill 1340.1 / decode 84.17 tok/s"
          ],
          "failure_class": null,
          "full_delegation": null,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "decode_tokens": 256.0,
            "init_s": 4.0986,
            "iterations": 3.0,
            "max_num_tokens": 2048.0,
            "pass1_decode_tok_s": 84.11,
            "pass1_init_s": 4.1084,
            "pass1_prefill_tok_s": 1358.21,
            "pass1_ttft_s": 0.766,
            "pass2_decode_tok_s": 84.23,
            "pass2_init_s": 4.0888,
            "pass2_prefill_tok_s": 1321.99,
            "pass2_ttft_s": 0.7876,
            "passes": 2.0,
            "prefill_tokens": 1024.0,
            "t_1024_256_s": 3.8057
          },
          "output_match": null,
          "peak_mem_mb": null,
          "prefill_tokens_per_s": 1340.1,
          "provenance": "measured",
          "runs": true,
          "total_ops": null,
          "ttft_ms": 776.8
        },
        "source": "data/device_runs/0.18.0/2026-10-17/g9v3-3b-int8__mac-studio-m4-max.json"
      },
      {
        "device": "pixel-8a",
        "run": {
          "accelerator": "cpu",
          "context_length": null,
          "date": "2026-10-18",
          "decode_tokens_per_s": 4.68,
          "delegated_ops": 2984,
          "env": {
            "device": "Pixel 8a",
            "machine_label": "pixel-8a-aab1",
            "os_build": "Android 16 (CP1A.260505.005)",
            "runtime": "litert-lm",
            "runtime_version": "prebuilt-adac974b",
            "soc": "Tensor G3",
            "vendor_sdk": null
          },
          "error": null,
          "evidence": [
            "binary: Google's prebuilt litert_lm_advanced_main + 6 .so (gs://litert/binaries/latest/android_arm64/litert_lm/, object dated 2026-09-18, 40,382,152 B, sha256 adac974b…)",
            "g2p hold 4 2026-10-18 10:03:35-10:20:58 JST: [10:05:39] bundle on device: 8d9f5e8522e553458ab3fb7f4a461359367934d0741c5e82cd777da55ce69dc5 (3103656288 B, push 0 s) = Mac",
            "file pushed: G9v3-3B_int8_rf.litertlm (sha256 = the Hub file's)",
            "bench args: --backend=cpu --model_path=/data/local/tmp/aa5_g9v3/G9v3-3B_int8_rf.litertlm --benchmark=true --benchmark_prefill_tokens=1024 --benchmark_decode_tokens=256 --max_num_tokens=2048 --num_iterations=3 --report_peak_memory_footprint=true --metric_proto_file_path=/data/local/tmp/aa5_g9v3/metrics.pb",
            "VERBOSE: Replacing 2109 out of 2372 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 411 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 1877 out of 2143 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 418 partitions for subgraph 6 (decode).",
            "VERBOSE: Replacing 2984 out of 3094 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 105 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 2663 out of 2772 node(s) with delegate (TfLiteXNNPackDelegate) node, yielding 106 partitions for subgraph 6 (decode).",
            "[10:12:02] parsed: i8rf_cpu_rested_b cpu: gate PASS 1/1 | bench prefill 34.480000000000004 decode 4.68 init 1511.45 cold 23904.91 peak 3766.36 capped 67/80 | answers: 'The capital of France is Paris.'",
            "timing run prompt process: \"The capital of France is Paris.\""
          ],
          "failure_class": null,
          "full_delegation": false,
          "latency_p50_ms": null,
          "loads": true,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "boot_epoch_s": 1792057755.71,
            "capped_samples": 67.0,
            "cold_init_ms": 23904.91,
            "cpu_capped_samples": 67.0,
            "decode_tok_s_it1": 5.84,
            "decode_tok_s_it2": 4.9,
            "decode_tok_s_it3": 4.46,
            "decode_tokens": 256.0,
            "init_ms": 1511.45,
            "iterations": 3.0,
            "max_num_tokens": 2048.0,
            "memavail_at_bench_start_kib": 4012516.0,
            "memavail_min_kib": 2949976.0,
            "prefill_tok_s_it1": 44.08,
            "prefill_tok_s_it2": 34.85,
            "prefill_tok_s_it3": 34.11,
            "prefill_tokens": 1024.0,
            "sampler_samples": 80.0,
            "t_1024_256_s": 84.3992,
            "thermal_status_at_bench_start": 0.0,
            "ttft_s_it1": 23.4,
            "ttft_s_it2": 29.58,
            "ttft_s_it3": 30.24
          },
          "output_match": null,
          "peak_mem_mb": 3766.36,
          "prefill_tokens_per_s": 34.48,
          "provenance": "measured",
          "runs": true,
          "total_ops": 3094,
          "ttft_ms": 29910.0
        },
        "source": "data/device_runs/prebuilt-adac974b/2026-10-18/g9v3-3b-int8__pixel-8a.json"
      },
      {
        "device": "pixel-8a",
        "run": {
          "accelerator": "gpu",
          "context_length": null,
          "date": "2026-10-13",
          "decode_tokens_per_s": null,
          "delegated_ops": null,
          "env": {
            "device": "Pixel 8a",
            "machine_label": "pixel-8a-aab1",
            "os_build": "Android 16 (CP1A.260505.005)",
            "runtime": "litert-lm",
            "runtime_version": "prebuilt-adac974b",
            "soc": "Tensor G3",
            "vendor_sdk": null
          },
          "error": "GUARD_KILL avail=0 pid=12303 (benchmark process; warm: GUARD_KILL avail=300700 pid=11441; prompt: GUARD_KILL avail=108752 pid=12533)",
          "evidence": [
            "binary: Google's prebuilt litert_lm_advanced_main + 6 .so (gs://litert/binaries/latest/android_arm64/litert_lm/, object dated 2026-09-18, 40,382,152 B, sha256 adac974b…)",
            "r1 hold 2026-10-13 00:03:57-00:16:09 JST: [00:07:52] bundle on device: c8c45d5bc3a5078290b38024651efda7b5a01cb1dce1d3b32284f9994d41afec (3102493024 B, push 67.8 s) = Mac",
            "bench args: --backend=gpu --model_path=/data/local/tmp/aa5_g9v3/G9v3-3B_int8.litertlm --benchmark=true --benchmark_prefill_tokens=1024 --benchmark_decode_tokens=256 --max_num_tokens=2048 --num_iterations=3 --report_peak_memory_footprint=true --metric_proto_file_path=/data/local/tmp/aa5_g9v3/metrics.pb",
            "VERBOSE: Replacing 2323 out of 2323 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 0 (prefill_1024).",
            "VERBOSE: Replacing 2323 out of 2323 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 1 (prefill_256).",
            "VERBOSE: Replacing 2323 out of 2323 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 2 (prefill_64).",
            "VERBOSE: Replacing 2323 out of 2323 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 3 (prefill_16).",
            "VERBOSE: Replacing 2323 out of 2323 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 4 (prefill_4).",
            "VERBOSE: Replacing 2064 out of 2064 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 5 (prefill_1).",
            "VERBOSE: Replacing 2092 out of 2092 node(s) with delegate (LITERT_CL) node, yielding 1 partitions for subgraph 6 (decode).",
            "W0000 00:00:1791817678.628533   11441 gpu_model_builder.cc:4455] Weights preparation on Gpu is disabled for PowerVR, Broadcom, Mali GPUs and non-OpenCL/WebGPU/Metal backends.",
            "[00:10:23] parsed: i8_gpu_timing gpu: gate FAIL 0/1 | bench prefill None decode None init None cold None peak None capped 0/7 | answers: 'Terminated'",
            "warm process: GUARD_KILL avail=300700 pid=11441",
            "bench process: GUARD_KILL avail=0 pid=12303",
            "prompt_1 process: GUARD_KILL avail=108752 pid=12533"
          ],
          "failure_class": "memory_cap_exceeded",
          "full_delegation": null,
          "latency_p50_ms": null,
          "loads": false,
          "max_abs_diff": null,
          "max_rel_diff": null,
          "metrics": {
            "memavail_at_guard_bench_kib": 0.0,
            "memavail_at_guard_prompt_1_kib": 108752.0,
            "memavail_at_guard_warm_kib": 300700.0,
            "memavail_at_start_kib": 4532452.0,
            "processes": 3.0,
            "signatures_compiled": 7.0,
            "uptime_after_s": 375724.37,
            "uptime_before_s": 375574.6
          },
          "output_match": null,
          "peak_mem_mb": null,
          "prefill_tokens_per_s": null,
          "provenance": "measured",
          "runs": false,
          "total_ops": null,
          "ttft_ms": null
        },
        "source": "data/device_runs/prebuilt-adac974b/2026-10-13/g9v3-3b-int8__pixel-8a.json"
      }
    ]
  },
  "model": {
    "family": "g9v3",
    "id": "g9v3-3b-int8",
    "license": "apache-2.0",
    "source_url": "https://huggingface.co/litert-community/G9v3-3B",
    "task": "text-generation"
  },
  "pitfalls": [
    "Graph form: since 2026-10-18 this file carries the GPU-composite graph, rebuilt from the 2026-10-13 int8 file without re-exporting (tools/gpu_graph/gpu_graph_retrofit.py --decomp exporter --mask add_bcast): the two KV-cache writes per layer become one odml.cache_update composite, each attention matmul an odml.runtime_bmm composite, and a param_tensor input is added to every signature; all 470 weight buffers, the metadata, tokenizer and embedding sections and the fp32 activation declaration are byte-identical to the 2026-10-13 file; the decoder section grew by 1,163,264 bytes (card L114).",
    "Composite effect: against the 2026-10-13 file the composite graph shortens the GPU time by 21 % on the Mac and by 20 % on the platform's Galaxy S26, and lengthens the CPU time on that Galaxy S26 by 4-10 % (two session pairs, one in each order); on the Mac CPU the two files are within 4 % (card L37, L98).",
    "GPU precision: this file declares fp32 GPU activations; with the runtime's default fp16 it loses on the GPU (GSM8K 69 against 85 on the CPU and 84 on the Mac GPU with fp32), so it declares fp32 and runs slower on the GPU (card L37, L52-L54).",
    "Galaxy S26: this file's rows ran on the platform's device m1q-36 on Google's Developer Device Platform, one session per row through the litert CLI (a warm-up process, then a measured process of three prefill-and-decode cycles; rates and TTFT are the CLI's summary, the median of cycles 2 and 3); the farm's phone is allocated per session, so these rows are not same-hold pairs with the int4 file's own-phone rows (card L89).",
    "Pixel 8a GPU: no row - the harness stops a process when MemAvailable falls below 400,000 kB and did so for the 2026-10-13 int8 file with fp32 activations (lowest 300,700 kB in the first process, 0 in the benchmark) and with fp16 activations (393,560 kB); this file has the same weights and 1,163,264 bytes more, and the try was not repeated (card L32, L109).",
    "Pixel 8a CPU: the row is one run of a 2026-10-18 hold that ran both files (this file first; the CPU clock lowered in 67 of 80 samples); with the same rest before each run this phone's CPU results move by up to 9 % between holds, so the 2026-10-13 int8 file was not paired with this one on this phone and its earlier card row (121.63 s for the workload) is not comparable (card L100, L109).",
    "Thinking: off by default and switched on per request; with thinking on the trace goes to the bundle's thought channel (<think> … </think>, printed by the CLI between [thought] and [/thought]); a request that does not set the thinking switch is treated as thinking off, where the vendor template leaves it to the model (card L21, L72, L74).",
    "Template: built on LiteRT-LM's models/qwen3 template, reading message content as parts; renders the same text as AI9Stars's template for 10 of 11 conversation shapes; stops ids 1 and 130073, start token <s> (card L74).",
    "Conversation preface with tools and no messages: LiteRT-LM renders the chat template with an empty message list, and the template reads messages[0] without checking that the list is non-empty, so the render fails with 'Failed to apply template: undefined value' when the preface is prefilled at creation (prefillPrefaceOnInit, default false; creating the conversation fails) and in the preface render (renderPrefaceIntoString and its C++ and C API forms); the same with extra context (such as enable_thinking) and no messages, and in the preface render with an empty preface (run in the runtime on one Qwen3 template; the other templates rendered with minijinja 2.14 and jinja2); read in the source of LiteRT-LM 0.17.0, 0.18.1 and main, measured with the 0.18.1 PyPI package through its C API on these files' template text; the default path, where the first message is rendered with the preface, is not affected (the 0.18.1 Python API and CLI expose neither the flag nor the preface render); a system message or any initial message in the conversation config avoids it (card L120).",
    "Tool calling is not declared: with a get_weather tool the file writes the vendor's XML form as text (<function name=\"get_weather\">…), for the app to parse; the template, tool-call and engine-reuse tests ran on the 2026-10-13 file, whose metadata sections (template included), tokenizer section and embedding section this file carries byte for byte (card L76).",
    "Sampler: the bundle sets no sampler, so `run` is greedy unless you pass sampling flags; on the 0.18.0 CLI --temperature and --top-p take effect only together with --top-k (AI9Stars recommends temperature 0.7 / top_p 0.95 with thinking off, 0.9 / 0.95 with thinking on) (card L72).",
    "Cache: without --cache, `run` writes a compiled-weights cache next to the model (2.73 GB for this file); without --backend, `run` uses the CPU (card L72).",
    "iOS not measured: the decoder weights section is 2,823,168,928 bytes, over 2 GiB (card L37).",
    "Runtime: litert-lm 0.18.0 on the Mac; on litert-lm 0.17.1 this file answered a plain `run` with \"The capital of France is Paris.\" (one CPU process, re-run on 2026-10-18) (card L19).",
    "Accuracy: GSM8K questions 0-99, thinking off, greedy, at most 1024 output tokens (litert-lm 0.18.0 Python API): this file 84 on the Mac GPU as shipped, the same 84 questions as the 2026-10-13 file (0 discordant); the CPU row (85) is the 2026-10-13 file's (the CPU path runs the same arithmetic); bf16 82; 8-question check 8/8 on CPU and 7/8 on GPU (the rhyme question), the 2026-10-13 file's answers on both backends; no accuracy measured with thinking on; IFEval-lite not run (card L41, L47-L59)."
  ],
  "schema_version": "1.2"
}
