{"what":"Kev-0.8B on an iPhone 18 Pro (iPhone19,2, iOS 27.0 24A437, Core AI arch h19p) through apps/KevGate (the Kev library, Release, no increased-memory-limit entitlement). Round 8: the first upload's graph (unrolled S = 16) specialized on the device and as an h19p AOT asset (loads, the gate on 434 + 130 questions, the bench) and the one load of Kev-4B's h19p AOT asset, which crashed. Round 13: stage A, the static Metal-kernel graphs (S = 16 / 32 / 64 / 128) against the unrolled S = 16 graph in one session (loads, gates, bench); stage B, the dynamic-length graphs' probes (call lengths, three rows); stage C, the host plans of the dynamic graph and its memory record. Round 15: the published graph (the Metal kernel at S = 128) specialized on the device, its gate on 434 + 130 questions (run 20261004-140048, round 13's stage-C build). Every p re-scored on the Mac from the bit patterns the app wrote.","sources":[{"file":"results/device_kev-0.8b.json","bytes":129831,"sha256":"e1a31261b0c2da354d63d902f6299f2848e89ae180abca4fc2dbd8445cd6ed0d"},{"file":"results/device_r8_mac_check.json","bytes":7231,"sha256":"a187798fc9ae00305b763e2ddaa935d6f533c466d35def087d9485931b545d47"},{"file":"device/20261004-010831/memory.tsv","bytes":210,"sha256":"a13c559711a5b3fbefdfe096c4e43e2fa866499ededd9644459955e08dc8a134"},{"file":"results/r13_device_0_8b.json","bytes":200679,"sha256":"72886d96bad343f7db76e6c91c465ea2eee4bf3bd0d0699f9ca47e2da5f48422"},{"file":"results/r13_c_memory.json","bytes":34859,"sha256":"967473bae0ae46fbffc9b61ae237089c98bb6e09de1e0bb5a985f07c42f1cb84"},{"file":"results/r13_gate_K16.json","bytes":20394,"sha256":"e8f81920571f89b75ae0a93e6f913ce9397d012b89d36a403e8712f1188bead3"},{"file":"results/r13_gate_K32.json","bytes":20071,"sha256":"b8a46092c838becfdfe2b7c10b4635e09e5e0f32e107d8573d0b7c96b9a0cf6c"},{"file":"results/r13_gate_K64.json","bytes":19802,"sha256":"afe5fdd27b414dbce37b0b2cc29dd7779c4a725de74b5f8f1a8ccef8dc4dea2e"},{"file":"results/r13_gate_K128.json","bytes":19821,"sha256":"1915613908b6b65b1adbe5ac570d41634888b72a6a71ee0e70e539c06d0629a6"},{"file":"results/r13_probe_d128_20261004-113230.json","bytes":8716,"sha256":"bda7eb6b9367967b8e1987c4440e356b6a204bdc061377cad32ff78f27caf33e"},{"file":"results/r13_probe_d128_20261004-113253.json","bytes":8690,"sha256":"6c1f9701921909af74175d6e92e3345b8bda16b2c644d8669cb716e612e1639c"},{"file":"results/r13_probe_d128_20261004-113315.json","bytes":8669,"sha256":"7e7c49da2b226eb4ce511066b96c2fa4cb6771d6a12d941a04c9eda2b529ceb6"},{"file":"results/r13_probe_d512_20261004-113858.json","bytes":8676,"sha256":"25e6723eb82d3fc463a45ce7bf1c762702e01e70a77b3cd7f685f90969ca71d3"},{"file":"results/r13_probe_d512_20261004-113921.json","bytes":8630,"sha256":"bd7982852f98e2e9f37954d7261bb9224b8329625883c706b55b7de54b5db8a4"},{"file":"results/r13_probe_d512_20261004-113943.json","bytes":5284,"sha256":"d040b5c2c2a4a4804efb2ed1903acedacb0db8e583640eb15e65d07a1c3198c4"},{"file":"results/r13_c_lengths.json","bytes":16199,"sha256":"805e3f583bf4130916d42753a5cd8f8ef6f78d37ca2881e552a8c9f152db45f1"},{"file":"results/r13_gate_D512L512q16_frozen.json","bytes":29522,"sha256":"210e0217b0dcb2715539aef77113322944355d4c0e206a638828f8c6b1dc4222"},{"file":"results/r13_gate_D512L512q16_diag.json","bytes":22715,"sha256":"a7a77ed28730f503923c45c4b74503bf562821e43fa0424930070839248063a2"},{"file":"results/r15_device_gate_K128.json","bytes":22173,"sha256":"065e68025bfc29b41fdb456695e46179002d64160f4a09008135e3d9ed5a4288"}],"trimmed":{"removed":["nothing but local and device paths (rewritten) and the device's UDID / CoreDevice id; round8.load_4b_memory_samples = the 100 ms memory samples the app wrote during the Kev-4B load, until the crash"],"serialization":"compact json (no indentation)","full_copies":"the source files above, in the lane directory $ZOO_WORK_ROOT/_kev/ (not in the repository)","paths":"local paths rewritten: the lane directory as $ZOO_WORK_ROOT/_kev, the repository relative, the home directory as ~, temporary directories as $TMPDIR, Xcode as $DEVELOPER_DIR, the phone's app container as <app container>","process_ids":"removed (keys pid / pids; 'pid <n>' in text)"},"round8":{"device":{"schema":"kev-device-r8/1","model":"Kev-0.8B (kev_0_8b_decode_fp16_pf16)","bar":{"max_abs_dp":0.02,"mean_of_run_mean_abs_dp":0.002,"near_tie_top2_margin":0.02},"references":{"oracle_fixture":{"path":"$ZOO_WORK_ROOT/_kev/oracle/records_oracle.json","sha256":"1a72a45831eecc2af7ddfc68a86e9250f572d6bf9274362f96cc62bcb803cc6d"},"oracle_heldout":{"path":"$ZOO_WORK_ROOT/_kev/oracle/heldout/records_oracle.json","sha256":"f715653331a81bd0ff48d48d1f9d294b7b9b3343713a855fd0eed16dd1e505e6"},"mac_fixture":{"path":"$ZOO_WORK_ROOT/_kev/swift/gate/fixture_kev-0.8b.json","sha256":"706bf6f7bbf98607fa6910578fd94a73cd3e7af7b7c2320b30c9840f0701762b"},"mac_heldout":{"path":"$ZOO_WORK_ROOT/_kev/swift/gate/heldout_kev-0.8b.json","sha256":"d7f67fa54062ad4652df5443e9749a3a1e8bb90000e57532121cffb129685f3a"}},"runs":[{"result_json":"device/20261004-003915/result.json","result_sha256":"303ea9f62bbd40bdd488c432e7dbe74097d21b0007d0f3dc93eea1763e1b5c80","run_id":"20261004-003915","status":"done","pass":true,"summary":["assets=PASS","load_jit=PASS","warm=PASS","e2e_fixture=PASS","e2e_heldout=PASS","reset=PASS"],"device":{"available_mb":3529.439632,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":10.552944,"free_gb":154.953552099,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"nominal"},"device_end":{"available_mb":3208.88432,"battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":331.108256,"free_gb":154.953552099,"low_power_mode":false,"thermal":"nominal"},"previous_launch":null,"config_env":{"KEV_RUN_ID":"20261004-003915","KEV_STAGES":"assets,load_jit,warm,e2e_fixture,e2e_heldout,reset"},"stages":{"assets":{"aot":[{"bytes":2505674625,"files":8,"name":"kev_0_8b_decode_fp16_pf16.h19p.aimodelc"}],"decoder_bytes":1521415404,"dir":"<app container>/Library/Application Support/KevAssets","free_gb":154.947977443,"md5_checked":25,"md5_checked_bytes":38968151,"md5_deferred":["aot/kev_0_8b_decode_fp16_pf16.h19p.aimodelc/main-h19p-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/resources.bin","decoder/kev_0_8b_decode_fp16_pf16.aimodel/main.mlirb"],"md5_deferred_bytes":4007379617,"md5_mismatch":[],"md5sums_listed":27,"min_free_gb":8,"missing":[],"pass":true,"required_absent":[],"seconds":0.07784675,"t_end_s":0.127067334,"t_start_s":0.048503500000000005,"unlisted_entries":[]},"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder/kev_0_8b_decode_fp16_pf16.aimodel","asset_bytes":1506482046,"asset_main_hash":"4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":6.651493292,"load":{"bundle_name":"kev_0_8b_decode_fp16_pf16","chunk":16,"decoder_function_names":["main"],"decoder_function_s":0.42172058300000004,"decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,16],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,16,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","decoder_model_s":5.87015525,"decoder_options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","head_s":0.001133708,"hidden":1024,"library_wall_s":6.651064291,"max_context_length":4096,"temperature":2.3510958125672174,"tokenizer_s":0.35336862500000005,"wall_s":6.651493292},"cache_bytes_before":0,"cache_bytes_after":2505661047,"cache_bytes_added":2505661047,"footprint_mb_before":23.414408,"footprint_mb_after":317.509464,"available_mb_before":3516.578168,"available_mb_after":3222.483112,"free_gb_before":154.947977443,"free_gb_after":154.947977443,"error":null,"error_detail":null,"pass":true,"partial":null,"decide":null,"decide_error":null,"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"memory":{"peak_footprint_mb":315.559096,"peak_at_s":6.672650416,"min_available_mb":3224.43348,"min_available_at_s":6.672650416,"footprint_mb_start":23.54548,"footprint_mb_end":315.559096,"available_mb_start":3516.447096,"available_mb_end":3224.43348,"samples":66,"duration_s":6.672695291}},"warm":{"kind":"jit","memory":{"available_mb_end":3238.736016,"available_mb_start":3222.319272,"duration_s":3.6605554590000002,"footprint_mb_end":301.25656,"footprint_mb_start":317.673304,"interval_s":0.1,"label":"warm","min_available_at_s":0.105072834,"min_available_mb":3196.743824,"peak_at_s":0.105072834,"peak_footprint_mb":343.248752,"samples":37,"series":[[0,317.673304,3222.319272],[0.11,343.248752,3196.743824],[0.21,304.009072,3235.983504],[0.32,305.565552,3234.427024],[0.42,305.68024,3234.312336],[0.52,306.040688,3233.951888],[0.63,306.712432,3233.280144],[0.73,307.1548,3232.837776],[0.83,307.40056,3232.592016],[0.94,307.744624,3232.247952],[1.04,307.89208,3232.100496],[1.14,318.13208,3221.860496],[1.25,298.9628,3241.029776],[1.35,298.995568,3240.997008],[1.46,299.093872,3240.898704],[1.56,299.241328,3240.751248],[1.67,299.3724,3240.620176],[1.77,299.503472,3240.489104],[1.88,299.716464,3240.276112],[1.98,299.831152,3240.161424],[2.09,299.896688,3240.095888],[2.19,261.017456,3278.97512],[2.3,261.181296,3278.81128],[2.4,261.263216,3278.72936],[2.51,261.377904,3278.614672],[2.61,261.541744,3278.450832],[2.72,261.754736,3278.23784],[2.82,261.820272,3278.172304],[2.93,274.927472,3265.065104],[3.03,275.271536,3264.72104],[3.14,275.320688,3264.671888],[3.24,294.178672,3245.813904],[3.35,300.84696,3239.145616],[3.45,300.84696,3239.145616],[3.56,301.0108,3238.981776],[3.66,301.25656,3238.736016],[3.66,301.25656,3238.736016]],"series_columns":["t_s","footprint_mb","available_mb"],"series_full_s":600},"pass":true,"record":"tv4_000","run":{"answers_json":"{\"answer\": {\"type\": \"choice\", \"choice\": \"c\", \"confidence\": 0.2466, \"probabilities\": {\"a\": 0.1475, \"b\": 0.2054, \"c\": 0.435, \"d\": 0.2121}}}","answers_json_equal_mac":false,"available_mb":3238.768784,"battery_level":0.800000011920929,"calls":6,"footprint_mb":301.223792,"graph_ms":3573.6251669999997,"head_ms":0.520625,"id":"tv4_000","input_tokens":94,"latency_ms":3574.145792,"questions":1,"reset_ms":4.001917000000001,"rows":[{"argmax":2,"argmax_equal":true,"argmax_oracle":2,"calls":6,"decide":93,"hidden_all_zero":false,"hidden_finite":true,"hidden_sha256":"15704b615276c2e39d90229e83a4aebce5b04db41b983b802fe887823d0aad65","ids_equal_oracle":true,"ids_sha256":"2000abddb81002f7b36b029b8aef585cd384badd145187f08d811a1fbadddbda","keys":["a","b","c","d"],"logits":[0.9111251335272367,1.6898212715679728,3.4533721081872226,1.7641779922678285],"mac_argmax_equal":true,"mac_hidden_sha256_equal":false,"mac_max_abs_dp":0.0005543828010559082,"mac_p_bit_equal":false,"max_abs_dp":0.0015176236629486084,"mean_abs_dp":0.0008839406073093414,"near_tie":false,"opts":[55,66,77,92],"p":[0.14752396941184998,0.2054486870765686,0.4349772334098816,0.21205012500286102],"p_bits":[1041698950,1045586212,1054782806,1046029227],"q":0,"qid":"answer","row_len":94,"top2_margin_oracle":0.2241945117712021,"type":"choice"}],"rows_ms":4.587958,"set":"fixture","source":"transfer_v4_dev_head","state_len":30,"t_start_s":0,"thermal":"nominal","wall_ms":3579.143916},"t_end_s":13.74018725,"t_start_s":10.074808292,"thermal_end":"nominal","thermal_start":"nominal","wall_s":3.579146167},"e2e_fixture":{"rows":434,"bar":{"questions":434,"questions_non_near_tie":420,"argmax_equal_non_near_tie":420,"near_tie_questions":14,"argmax_equal_near_tie":13,"max_abs_dp":0.01022389531135559,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.0009760064068069106,"pass":true},"ids_equal_oracle":434,"finite_rows":434,"all_zero_rows":0,"mac":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0027074217796325684,"median_abs_dp":0.00032333284616470337},"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"near_ties":[{"row":"tv4_003:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00031313300132751465,"max_abs_dp":0.0009233355522155762},{"row":"tv4_017:q0","T":76,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005922615528106689,"max_abs_dp":0.00140419602394104},{"row":"tv4_023:q0","T":92,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0018605589866638184,"max_abs_dp":0.0009637773036956787},{"row":"tv4_024:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00026410818099975586,"max_abs_dp":0.00209808349609375},{"row":"tv4_027:q0","T":77,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002703815698623657,"max_abs_dp":0.0009533166885375977},{"row":"tv4_028:q0","T":290,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00032895803451538086,"max_abs_dp":0.00034737586975097656},{"row":"tv4_051:q0","T":136,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005562901496887207,"max_abs_dp":0.0009497106075286865},{"row":"tv4_054:q0","T":113,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":8.824467658996582e-05,"max_abs_dp":0.000864565372467041},{"row":"tv4s_14:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003935694694519043,"max_abs_dp":0.0015472173690795898},{"row":"semif_2175379f4c69e6207626:q0","T":58,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005741864442825317,"max_abs_dp":0.00346258282661438},{"row":"semif_d167e51bb1f499099645:q0","T":69,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.001018434762954712,"max_abs_dp":0.0025302767753601074},{"row":"semif_4089c199b8b796ec3ed8:q0","T":88,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010522305965423584,"max_abs_dp":0.003317892551422119},{"row":"own_t10:q2","T":156,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002541840076446533,"max_abs_dp":0.001361154019832611},{"row":"own_j02:q0","T":332,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00037579238414764404,"max_abs_dp":0.0008358806371688843}],"worst_rows":[{"row":"semif_46b7029b9a704138b77a:q0","T":78,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0018906593322753906,"max_abs_dp":0.01022389531135559},{"row":"semif_942ec65dac0bfb9874f9:q0","T":60,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0013559460639953613,"max_abs_dp":0.007348835468292236},{"row":"tv4_020:q0","T":82,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008106827735900879,"max_abs_dp":0.007071197032928467},{"row":"tv4_045:q0","T":90,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00039130449295043945,"max_abs_dp":0.00692710280418396},{"row":"semif_d7e84e4245a29817da1f:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00044804811477661133,"max_abs_dp":0.00634455680847168},{"row":"semif_8a4c3de28be95c105ca1:q0","T":72,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008483529090881348,"max_abs_dp":0.006049990653991699},{"row":"own_L02:q0","T":1518,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007107853889465332,"max_abs_dp":0.005284249782562256},{"row":"tv4x_legacy_holdout_03:q0","T":77,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":5.245208740234375e-06,"max_abs_dp":0.005261242389678955}],"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder/kev_0_8b_decode_fp16_pf16.aimodel","calls_total":4055,"call_ms_median":30.38,"seconds":150.966169292,"thermal":["nominal","nominal"],"timeline":[[0,"nominal",0.800000011920929,"charging",301.551472,3238.441104],[20.2,"nominal",0.800000011920929,"charging",269.815664,3270.176912],[40,"nominal",0.800000011920929,"charging",271.880048,3268.112528],[60.1,"nominal",0.800000011920929,"charging",268.685168,3271.307408],[80.3,"nominal",0.800000011920929,"charging",325.930912,3214.061664],[100.7,"nominal",0.800000011920929,"charging",326.53712,3213.455456],[134.1,"nominal",0.800000011920929,"charging",357.748664,3182.243912],[150.9,"nominal",0.800000011920929,"charging",358.813624,3181.178952]]},"e2e_heldout":{"rows":130,"bar":{"questions":130,"questions_non_near_tie":125,"argmax_equal_non_near_tie":125,"near_tie_questions":5,"argmax_equal_near_tie":5,"max_abs_dp":0.004946589469909668,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.000828455642883618,"pass":true},"ids_equal_oracle":130,"finite_rows":130,"all_zero_rows":0,"mac":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0012511014938354492,"median_abs_dp":0.00030791759490966797},"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"near_ties":[{"row":"tv4h_03:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005089342594146729,"max_abs_dp":0.00048223137855529785},{"row":"tv4h_07:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":9.328126907348633e-05,"max_abs_dp":0.0008085966110229492},{"row":"tv4h_31:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00012066960334777832,"max_abs_dp":0.0009534955024719238},{"row":"tv4xh_tweet_offensive_03:q0","T":84,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007241964340209961,"max_abs_dp":0.000732421875},{"row":"tv4xh_paws_06:q0","T":91,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002040266990661621,"max_abs_dp":0.0016143321990966797}],"worst_rows":[{"row":"tv4h_11:q0","T":299,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007926225662231445,"max_abs_dp":0.004946589469909668},{"row":"tv4xh_qnli_06:q0","T":48,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0009436309337615967,"max_abs_dp":0.0046653151512146},{"row":"tv4xh_paws_00:q0","T":94,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":9.804964065551758e-05,"max_abs_dp":0.0038979053497314453},{"row":"tv4xh_composition_holdout_09:q0","T":122,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00023353099822998047,"max_abs_dp":0.0037290453910827637},{"row":"tv4h_00:q0","T":59,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00036978721618652344,"max_abs_dp":0.0033771395683288574},{"row":"tv4xh_sciq_09:q0","T":185,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008969306945800781,"max_abs_dp":0.003235042095184326},{"row":"tv4h_14:q0","T":60,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010216832160949707,"max_abs_dp":0.0030779242515563965},{"row":"tv4xh_paws_04:q0","T":76,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00043964385986328125,"max_abs_dp":0.0030721724033355713}],"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder/kev_0_8b_decode_fp16_pf16.aimodel","calls_total":809,"call_ms_median":36.24,"seconds":30.219826417,"thermal":["nominal","nominal"],"timeline":[[0,"nominal",0.800000011920929,"charging",359.174072,3180.818504],[20,"nominal",0.800000011920929,"charging",329.56816,3210.424416],[30.2,"nominal",0.800000011920929,"charging",329.24048,3210.752096]]},"reset":{"hidden_bit_equal":true,"kind":"jit","latency_ms":177.092792,"p_bit_equal":true,"pass":true,"record":"tv4_000","t_end_s":195.270274542,"t_start_s":195.047493667,"thermal":"nominal"}}},{"result_json":"device/20261004-004248/result.json","result_sha256":"b1cd6fa82f98d7f3af97f17a7c1a2e39b6d45648e492dc57af6e1bc1e777c34e","run_id":"20261004-004248","status":"done","pass":true,"summary":["load_jit=PASS","bench=PASS"],"device":{"available_mb":3526.490464,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":13.502112,"free_gb":152.492927155,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"nominal"},"device_end":{"available_mb":3198.202024,"battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":341.790552,"free_gb":152.492927155,"low_power_mode":false,"thermal":"fair"},"previous_launch":{"run_id":"20261004-003915","stage_order":["assets","load_jit","warm","e2e_fixture","e2e_heldout","reset"],"status":"done","updated":"2026-10-03T15:42:31Z"},"config_env":{"KEV_RUN_ID":"20261004-004248","KEV_STAGES":"load_jit,bench"},"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder/kev_0_8b_decode_fp16_pf16.aimodel","asset_bytes":1506482046,"asset_main_hash":"4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":0.6069355830000001,"load":{"bundle_name":"kev_0_8b_decode_fp16_pf16","chunk":16,"decoder_function_names":["main"],"decoder_function_s":0.25024983300000003,"decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,16],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,16,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","decoder_model_s":0.0016028750000000001,"decoder_options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","head_s":0.004023458000000001,"hidden":1024,"library_wall_s":0.606900667,"max_context_length":4096,"temperature":2.3510958125672174,"tokenizer_s":0.347825333,"wall_s":0.6069355830000001},"cache_bytes_before":2505661047,"cache_bytes_after":2505661047,"cache_bytes_added":0,"footprint_mb_before":22.13648,"footprint_mb_after":253.10384,"available_mb_before":3517.856096,"available_mb_after":3286.888736,"free_gb_before":152.492927155,"free_gb_after":152.492927155,"error":null,"error_detail":null,"pass":true,"partial":null,"decide":null,"decide_error":null,"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"memory":{"peak_footprint_mb":216.173872,"peak_at_s":0.6263780830000001,"min_available_mb":3323.818704,"min_available_at_s":0.6263780830000001,"footprint_mb_start":22.365856,"footprint_mb_end":216.173872,"available_mb_start":3517.62672,"available_mb_end":3323.818704,"samples":8,"duration_s":0.626489583}},"bench":{"kind":"jit","pass":true,"items":[{"item":"tv4_000:q0","row_tokens":[94],"input_tokens":94,"reps":5,"summary":{"direct":{"latency_ms":[156.635833,156.525208,156.27550000000002,156.60416700000002,157.288958],"max":157.288958,"median":156.60416700000002,"min":156.27550000000002,"n":5}},"wait_nominal":{"cap_s":300,"polls":0,"reached_nominal":true,"state_after":"nominal","state_before":"nominal","waited_s":1.0420000000000001e-06},"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"timed_runs_end_s":1.052274792,"direct_shared_p_bit_equal_every_rep":null,"p_bits_equal_e2e":{"compared":0,"equal":0},"error":null,"decisions":[{"rep":0,"warmup":true,"mode":"direct","t_start_s":8.33e-07,"t_end_s":0.264366208,"t_bench_s":63.351789792,"latency_ms":257.33358300000003,"graph_ms":257.006166,"calls":6,"call_ms_first":113.02570800000001,"call_ms_median":26.021395500000004,"call_ms_last":25.941750000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":270.634768},{"rep":1,"warmup":false,"mode":"direct","t_start_s":0.26662345800000004,"t_end_s":0.42372950000000004,"t_bench_s":63.508912167,"latency_ms":156.635833,"graph_ms":156.495458,"calls":6,"call_ms_first":26.206000000000003,"call_ms_median":25.990396000000004,"call_ms_last":25.983917,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":270.634768},{"rep":2,"warmup":false,"mode":"direct","t_start_s":0.42375366700000006,"t_end_s":0.580721833,"t_bench_s":63.66590425,"latency_ms":156.525208,"graph_ms":156.385083,"calls":6,"call_ms_first":26.246042,"call_ms_median":25.977041500000002,"call_ms_last":26.027083000000005,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":270.798608},{"rep":3,"warmup":false,"mode":"direct","t_start_s":0.5807315000000001,"t_end_s":0.7374475,"t_bench_s":63.822630042,"latency_ms":156.27550000000002,"graph_ms":156.13575000000003,"calls":6,"call_ms_first":26.145667,"call_ms_median":25.9269795,"call_ms_last":26.034875000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":270.76584},{"rep":4,"warmup":false,"mode":"direct","t_start_s":0.73745775,"t_end_s":0.8945263750000001,"t_bench_s":63.979709,"latency_ms":156.60416700000002,"graph_ms":156.46325,"calls":6,"call_ms_first":26.151917,"call_ms_median":25.9969375,"call_ms_last":25.962000000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":270.84776},{"rep":5,"warmup":false,"mode":"direct","t_start_s":0.8945369580000001,"t_end_s":1.052274792,"t_bench_s":64.137457292,"latency_ms":157.288958,"graph_ms":157.149958,"calls":6,"call_ms_first":26.595708000000002,"call_ms_median":25.962083000000003,"call_ms_last":25.919792,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":270.946064}]},{"item":"own_j03:q0","row_tokens":[380],"input_tokens":380,"reps":5,"summary":{"direct":{"latency_ms":[629.383,629.1521670000001,629.151958,628.895792,630.109542],"max":630.109542,"median":629.1521670000001,"min":628.895792,"n":5}},"wait_nominal":{"cap_s":300,"polls":0,"reached_nominal":true,"state_after":"nominal","state_before":"nominal","waited_s":8.750000000000001e-07},"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"timed_runs_end_s":3.8340581670000002,"direct_shared_p_bit_equal_every_rep":null,"p_bits_equal_e2e":{"compared":0,"equal":0},"error":null,"decisions":[{"rep":0,"warmup":true,"mode":"direct","t_start_s":1.0000000000000002e-06,"t_end_s":0.6828755000000001,"t_bench_s":124.82277025,"latency_ms":675.8604580000001,"graph_ms":675.717875,"calls":24,"call_ms_first":66.22604199999999,"call_ms_median":26.2728125,"call_ms_last":26.456583000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":259.641104},{"rep":1,"warmup":false,"mode":"direct","t_start_s":0.682887042,"t_end_s":1.313163625,"t_bench_s":125.453058167,"latency_ms":629.383,"graph_ms":629.243458,"calls":24,"call_ms_first":26.272458,"call_ms_median":26.191208000000003,"call_ms_last":26.3535,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":259.657488},{"rep":2,"warmup":false,"mode":"direct","t_start_s":1.313173167,"t_end_s":1.943206583,"t_bench_s":126.08310125,"latency_ms":629.1521670000001,"graph_ms":629.012917,"calls":24,"call_ms_first":26.35925,"call_ms_median":26.2186875,"call_ms_last":26.335083,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":259.772176},{"rep":3,"warmup":false,"mode":"direct","t_start_s":1.943216333,"t_end_s":2.573251833,"t_bench_s":126.713146292,"latency_ms":629.151958,"graph_ms":629.0121660000001,"calls":24,"call_ms_first":26.28,"call_ms_median":26.128083500000002,"call_ms_last":26.322375,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":259.608336},{"rep":4,"warmup":false,"mode":"direct","t_start_s":2.5732616249999998,"t_end_s":3.203052458,"t_bench_s":127.342947458,"latency_ms":628.895792,"graph_ms":628.756292,"calls":24,"call_ms_first":26.490584000000002,"call_ms_median":26.192833500000003,"call_ms_last":26.503583,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":259.78856},{"rep":5,"warmup":false,"mode":"direct","t_start_s":3.203063417,"t_end_s":3.8340581670000002,"t_bench_s":127.973952667,"latency_ms":630.109542,"graph_ms":629.971667,"calls":24,"call_ms_first":26.239333000000002,"call_ms_median":26.201667,"call_ms_last":26.5865,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":259.837712}]},{"item":"own_L02:q0","row_tokens":[1518],"input_tokens":1518,"reps":5,"summary":{"direct":{"latency_ms":[2500.7061670000003,2499.660167,2499.365208,2502.498083,2500.048375],"max":2502.498083,"median":2500.048375,"min":2499.365208,"n":5}},"wait_nominal":{"cap_s":300,"polls":0,"reached_nominal":true,"state_after":"nominal","state_before":"nominal","waited_s":8.340000000000001e-07},"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"timed_runs_end_s":15.08483575,"direct_shared_p_bit_equal_every_rep":null,"p_bits_equal_e2e":{"compared":0,"equal":0},"error":null,"decisions":[{"rep":0,"warmup":true,"mode":"direct","t_start_s":9.160000000000001e-07,"t_end_s":2.563471416,"t_bench_s":191.624848292,"latency_ms":2539.4210839999996,"graph_ms":2539.260875,"calls":95,"call_ms_first":56.540375000000004,"call_ms_median":26.370208,"call_ms_last":26.541208000000005,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":265.883408},{"rep":1,"warmup":false,"mode":"direct","t_start_s":2.563493583,"t_end_s":5.068038625,"t_bench_s":194.129415458,"latency_ms":2500.7061670000003,"graph_ms":2500.5454170000003,"calls":95,"call_ms_first":26.1555,"call_ms_median":26.328208000000004,"call_ms_last":26.450334,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":265.883408},{"rep":2,"warmup":false,"mode":"direct","t_start_s":5.068051958,"t_end_s":7.571533916,"t_bench_s":196.632910875,"latency_ms":2499.660167,"graph_ms":2499.499542,"calls":95,"call_ms_first":26.220792000000003,"call_ms_median":26.329125,"call_ms_last":26.285916000000004,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":265.883408},{"rep":3,"warmup":false,"mode":"direct","t_start_s":7.571548041,"t_end_s":10.074691958,"t_bench_s":199.136068792,"latency_ms":2499.365208,"graph_ms":2499.2035,"calls":95,"call_ms_first":26.239625000000004,"call_ms_median":26.319416,"call_ms_last":26.651500000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":265.965328},{"rep":4,"warmup":false,"mode":"direct","t_start_s":10.074705083,"t_end_s":12.580983166,"t_bench_s":201.64235975,"latency_ms":2502.498083,"graph_ms":2502.3375410000003,"calls":95,"call_ms_first":26.252709000000003,"call_ms_median":26.316250000000004,"call_ms_last":26.376708,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":265.817872},{"rep":5,"warmup":false,"mode":"direct","t_start_s":12.580997291,"t_end_s":15.08483575,"t_bench_s":204.146212583,"latency_ms":2500.048375,"graph_ms":2499.88825,"calls":95,"call_ms_first":26.273042000000004,"call_ms_median":26.321542000000004,"call_ms_last":26.530500000000004,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":265.735952}]},{"item":"own_L01:q2","row_tokens":[1802],"input_tokens":1802,"reps":5,"summary":{"direct":{"latency_ms":[2975.929458,2974.096416,2975.2388330000003,2981.388125,2978.197834],"max":2981.388125,"median":2975.929458,"min":2974.096416,"n":5}},"wait_nominal":{"cap_s":300,"polls":0,"reached_nominal":true,"state_after":"nominal","state_before":"nominal","waited_s":1.083e-06},"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"timed_runs_end_s":17.944443375,"direct_shared_p_bit_equal_every_rep":null,"p_bits_equal_e2e":{"compared":0,"equal":0},"error":null,"decisions":[{"rep":0,"warmup":true,"mode":"direct","t_start_s":8.750000000000001e-07,"t_end_s":3.041704459,"t_bench_s":270.166256208,"latency_ms":3023.113042,"graph_ms":3022.931209,"calls":113,"call_ms_first":71.198417,"call_ms_median":26.320167,"call_ms_last":26.463250000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":266.01448},{"rep":1,"warmup":false,"mode":"direct","t_start_s":3.041718084,"t_end_s":6.021193209,"t_bench_s":273.145745375,"latency_ms":2975.929458,"graph_ms":2975.745333,"calls":113,"call_ms_first":26.316333,"call_ms_median":26.342334,"call_ms_last":26.401375,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":265.948944},{"rep":2,"warmup":false,"mode":"direct","t_start_s":6.021206667,"t_end_s":8.998852709,"t_bench_s":276.123404333,"latency_ms":2974.096416,"graph_ms":2973.913208,"calls":113,"call_ms_first":26.077417,"call_ms_median":26.3395,"call_ms_last":26.430875000000004,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":266.030864},{"rep":3,"warmup":false,"mode":"direct","t_start_s":8.998865917,"t_end_s":11.977684709,"t_bench_s":279.102236208,"latency_ms":2975.2388330000003,"graph_ms":2975.056458,"calls":113,"call_ms_first":26.315459000000004,"call_ms_median":26.342458000000004,"call_ms_last":26.597417,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":265.85064},{"rep":4,"warmup":false,"mode":"direct","t_start_s":11.977698209,"t_end_s":14.962656667000001,"t_bench_s":282.087208083,"latency_ms":2981.388125,"graph_ms":2981.196875,"calls":113,"call_ms_first":26.434917000000002,"call_ms_median":26.384791,"call_ms_last":26.459667000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":265.916176},{"rep":5,"warmup":false,"mode":"direct","t_start_s":14.962670584,"t_end_s":17.944443375,"t_bench_s":285.068994792,"latency_ms":2978.197834,"graph_ms":2978.015375,"calls":113,"call_ms_first":26.41075,"call_ms_median":26.355709,"call_ms_last":26.459875,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":265.93256}]},{"item":"own_m01:first5","row_tokens":[156,150,159,169,154],"input_tokens":240,"reps":5,"summary":{"direct":{"latency_ms":[1329.064042,1333.4612080000002,1330.491542,1331.687375,1330.455042],"max":1333.4612080000002,"median":1330.491542,"min":1329.064042,"n":5},"shared":{"latency_ms":[507.42937500000005,508.63004200000006,507.76412500000004,507.106959,508.7622500000001],"max":508.7622500000001,"median":507.76412500000004,"min":507.106959,"n":5}},"wait_nominal":{"cap_s":300,"polls":0,"reached_nominal":true,"state_after":"nominal","state_before":"nominal","waited_s":1.083e-06},"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"timed_runs_end_s":11.096722709,"direct_shared_p_bit_equal_every_rep":true,"p_bits_equal_e2e":{"compared":0,"equal":0},"error":null,"decisions":[{"rep":0,"warmup":true,"mode":"direct","t_start_s":8.340000000000001e-07,"t_end_s":1.382815959,"t_bench_s":346.48715775,"latency_ms":1377.1133340000001,"graph_ms":1376.69,"calls":51,"call_ms_first":68.577416,"call_ms_median":26.014584,"call_ms_last":26.033459,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":259.067664},{"rep":0,"warmup":true,"mode":"shared","t_start_s":1.3828288340000001,"t_end_s":1.8907452500000002,"t_bench_s":346.995087042,"latency_ms":506.82004200000006,"graph_ms":506.404917,"calls":19,"call_ms_first":26.387875,"call_ms_median":26.09975,"call_ms_last":26.09975,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.622976},{"rep":1,"warmup":false,"mode":"shared","t_start_s":1.890756834,"t_end_s":2.399272834,"t_bench_s":347.503614458,"latency_ms":507.42937500000005,"graph_ms":507.009833,"calls":19,"call_ms_first":26.316458,"call_ms_median":26.047542000000004,"call_ms_last":25.983375000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.45916},{"rep":1,"warmup":false,"mode":"direct","t_start_s":2.399284417,"t_end_s":3.729443167,"t_bench_s":348.833785125,"latency_ms":1329.064042,"graph_ms":1328.639042,"calls":51,"call_ms_first":26.197584000000003,"call_ms_median":26.01875,"call_ms_last":26.024959,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.557464},{"rep":2,"warmup":false,"mode":"direct","t_start_s":3.729456459,"t_end_s":5.064023875,"t_bench_s":350.168365417,"latency_ms":1333.4612080000002,"graph_ms":1333.037583,"calls":51,"call_ms_first":26.383583,"call_ms_median":26.049875000000004,"call_ms_last":26.105458000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.573848},{"rep":2,"warmup":false,"mode":"shared","t_start_s":5.064036334,"t_end_s":5.573774584,"t_bench_s":350.678116625,"latency_ms":508.63004200000006,"graph_ms":508.2091670000001,"calls":19,"call_ms_first":26.265125,"call_ms_median":26.149958,"call_ms_last":26.081833000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.47552},{"rep":3,"warmup":false,"mode":"shared","t_start_s":5.573786917,"t_end_s":6.082654042,"t_bench_s":351.186995917,"latency_ms":507.76412500000004,"graph_ms":507.3450420000001,"calls":19,"call_ms_first":26.145833,"call_ms_median":26.078500000000002,"call_ms_last":26.077958000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.573848},{"rep":3,"warmup":false,"mode":"direct","t_start_s":6.082665209,"t_end_s":7.414254209,"t_bench_s":352.518596,"latency_ms":1330.491542,"graph_ms":1330.0672499999998,"calls":51,"call_ms_first":26.374209000000004,"call_ms_median":26.027333000000002,"call_ms_last":25.981792000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.672152},{"rep":4,"warmup":false,"mode":"direct","t_start_s":7.414266875,"t_end_s":8.747060584,"t_bench_s":353.851402208,"latency_ms":1331.687375,"graph_ms":1331.262917,"calls":51,"call_ms_first":26.484333000000003,"call_ms_median":26.034125000000003,"call_ms_last":26.35675,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.672152},{"rep":4,"warmup":false,"mode":"shared","t_start_s":8.747073167,"t_end_s":9.255277084,"t_bench_s":354.359619,"latency_ms":507.106959,"graph_ms":506.682792,"calls":19,"call_ms_first":26.294333,"call_ms_median":26.037000000000003,"call_ms_last":26.205333,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":317.886272},{"rep":5,"warmup":false,"mode":"shared","t_start_s":9.255288667,"t_end_s":9.765152042,"t_bench_s":354.869493958,"latency_ms":508.7622500000001,"graph_ms":508.34375,"calls":19,"call_ms_first":26.333625,"call_ms_median":26.113959,"call_ms_last":26.551875000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.737688},{"rep":5,"warmup":false,"mode":"direct","t_start_s":9.7651635,"t_end_s":11.096722709,"t_bench_s":356.201064708,"latency_ms":1330.455042,"graph_ms":1330.031167,"calls":51,"call_ms_first":26.213959000000003,"call_ms_median":26.004417000000004,"call_ms_last":26.010583,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.491928}]},{"item":"own_m01:all8","row_tokens":[156,150,159,169,154,168,154,169],"input_tokens":320,"reps":3,"summary":{"direct":{"latency_ms":[2163.836083,2182.5800000000004,2167.488958],"max":2182.5800000000004,"median":2167.488958,"min":2163.836083,"n":3},"shared":{"latency_ms":[721.168208,732.9033330000001,722.4250830000001],"max":732.9033330000001,"median":722.4250830000001,"min":721.168208,"n":3}},"wait_nominal":{"cap_s":300,"polls":0,"reached_nominal":true,"state_after":"nominal","state_before":"nominal","waited_s":1.083e-06},"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"timed_runs_end_s":11.642602709,"direct_shared_p_bit_equal_every_rep":true,"p_bits_equal_e2e":{"compared":0,"equal":0},"error":null,"decisions":[{"rep":0,"warmup":true,"mode":"direct","t_start_s":8.750000000000001e-07,"t_end_s":2.219502084,"t_bench_s":419.336008083,"latency_ms":2211.771,"graph_ms":2211.049625,"calls":83,"call_ms_first":69.86262500000001,"call_ms_median":25.992459000000004,"call_ms_last":26.146541000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":320.016216},{"rep":0,"warmup":true,"mode":"shared","t_start_s":2.219518167,"t_end_s":2.94215575,"t_bench_s":420.058662333,"latency_ms":720.9595830000001,"graph_ms":720.240125,"calls":27,"call_ms_first":26.248708000000004,"call_ms_median":26.095417,"call_ms_last":26.082208,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.901504},{"rep":1,"warmup":false,"mode":"shared","t_start_s":2.9421723340000003,"t_end_s":3.665010417,"t_bench_s":420.781516667,"latency_ms":721.168208,"graph_ms":720.451791,"calls":27,"call_ms_first":26.311167000000005,"call_ms_median":26.093917,"call_ms_last":26.056125,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.917912},{"rep":1,"warmup":false,"mode":"direct","t_start_s":3.665022917,"t_end_s":5.830507875,"t_bench_s":422.947013875,"latency_ms":2163.836083,"graph_ms":2163.110125,"calls":83,"call_ms_first":26.314166000000004,"call_ms_median":26.010166,"call_ms_last":26.077625000000005,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.770456},{"rep":2,"warmup":false,"mode":"direct","t_start_s":5.83052425,"t_end_s":8.01479225,"t_bench_s":425.1312985,"latency_ms":2182.5800000000004,"graph_ms":2181.852791,"calls":83,"call_ms_first":26.201791000000004,"call_ms_median":26.201791000000004,"call_ms_last":26.554916000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.688536},{"rep":2,"warmup":false,"mode":"shared","t_start_s":8.014807917,"t_end_s":8.749364625,"t_bench_s":425.86587125,"latency_ms":732.9033330000001,"graph_ms":732.181,"calls":27,"call_ms_first":26.653416000000004,"call_ms_median":26.556208,"call_ms_last":26.150292,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.672128},{"rep":3,"warmup":false,"mode":"shared","t_start_s":8.74937875,"t_end_s":9.473460292,"t_bench_s":426.589966417,"latency_ms":722.4250830000001,"graph_ms":721.693333,"calls":27,"call_ms_first":26.321584,"call_ms_median":26.218042,"call_ms_last":26.239917000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.688536},{"rep":3,"warmup":false,"mode":"direct","t_start_s":9.473474292,"t_end_s":11.642602709,"t_bench_s":428.759109,"latency_ms":2167.488958,"graph_ms":2166.758625,"calls":83,"call_ms_first":26.379792000000002,"call_ms_median":26.058042000000004,"call_ms_last":26.142458,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":319.655768}]},{"item":"own_L02:all4","row_tokens":[1518,1497,1539,1499],"input_tokens":1622,"reps":2,"summary":{"direct":{"latency_ms":[10018.257166,10034.342],"max":10034.342,"median":10026.299583,"min":10018.257166,"n":2},"shared":{"latency_ms":[2752.3962500000002,2771.494625],"max":2771.494625,"median":2761.9454375,"min":2752.3962500000002,"n":2}},"wait_nominal":{"cap_s":300,"polls":0,"reached_nominal":true,"state_after":"nominal","state_before":"nominal","waited_s":8.33e-07},"thermal_start":"nominal","thermal_end":"fair","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"timed_runs_end_s":38.405275875,"direct_shared_p_bit_equal_every_rep":true,"p_bits_equal_e2e":{"compared":0,"equal":0},"error":null,"decisions":[{"rep":0,"warmup":true,"mode":"direct","t_start_s":8.750000000000001e-07,"t_end_s":10.05137625,"t_bench_s":499.179982,"latency_ms":10030.354792,"graph_ms":10029.9525,"calls":380,"call_ms_first":59.593667,"call_ms_median":26.309833500000003,"call_ms_last":26.370333000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":335.368024},{"rep":0,"warmup":true,"mode":"shared","t_start_s":10.051398917,"t_end_s":12.809478667,"t_bench_s":501.938084583,"latency_ms":2753.863042,"graph_ms":2753.4699170000004,"calls":104,"call_ms_first":26.187791,"call_ms_median":26.369396000000002,"call_ms_last":26.438708000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":338.513752},{"rep":1,"warmup":false,"mode":"shared","t_start_s":12.809493417,"t_end_s":15.566201375,"t_bench_s":504.694807333,"latency_ms":2752.3962500000002,"graph_ms":2752.0060829999998,"calls":104,"call_ms_first":26.402250000000002,"call_ms_median":26.367895500000003,"call_ms_last":26.412417,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":338.366296},{"rep":1,"warmup":false,"mode":"direct","t_start_s":15.566215708,"t_end_s":25.588784583,"t_bench_s":514.717390792,"latency_ms":10018.257166,"graph_ms":10017.839875,"calls":380,"call_ms_first":26.259042000000004,"call_ms_median":26.365125000000003,"call_ms_last":26.479958,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":335.466328},{"rep":2,"warmup":false,"mode":"direct","t_start_s":25.588808875,"t_end_s":35.627702458,"t_bench_s":524.756308333,"latency_ms":10034.342,"graph_ms":10033.901208,"calls":380,"call_ms_first":26.446084000000003,"call_ms_median":26.4169165,"call_ms_last":26.608666000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":335.646552},{"rep":2,"warmup":false,"mode":"shared","t_start_s":35.627727625,"t_end_s":38.405275875,"t_bench_s":527.533882083,"latency_ms":2771.494625,"graph_ms":2771.060834,"calls":104,"call_ms_first":27.349833,"call_ms_median":26.4730625,"call_ms_last":26.533792000000002,"thermal":"fair","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":341.102424}]}]}}},{"result_json":"device/20261004-005157/result.json","result_sha256":"2fad993fafa8a49951ef46bbc49dcd44a8d91164563196583d5270d7ec22ac89","run_id":"20261004-005157","status":"done","pass":true,"summary":["load_aot=PASS","e2e_aot=PASS","bench_aot=PASS"],"device":{"available_mb":3529.128288,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":10.864288,"free_gb":152.492927155,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"fair"},"device_end":{"available_mb":3199.447184,"battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":340.545392,"free_gb":152.492927155,"low_power_mode":false,"thermal":"nominal"},"previous_launch":{"run_id":"20261004-004248","stage_order":["load_jit","bench"],"status":"done","updated":"2026-10-03T15:51:40Z"},"config_env":{"KEV_RUN_ID":"20261004-005157","KEV_STAGES":"load_aot,e2e_aot,bench_aot"},"stages":{"load_aot":{"kind":"aot","asset":"<app container>/Library/Application Support/KevAssets/aot/kev_0_8b_decode_fp16_pf16.h19p.aimodelc","asset_bytes":2505674625,"asset_main_hash":"8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416","options":"SpecializationOptions.default","wall_s":4.639015,"load":{"bundle_name":"kev_0_8b_decode_fp16_pf16","chunk":16,"decoder_function_names":["main"],"decoder_function_s":1.216506833,"decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,16],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,16,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","decoder_model_s":3.073185833,"decoder_options":"SpecializationOptions.default","head_s":0.0010950410000000002,"hidden":1024,"library_wall_s":4.638975333,"max_context_length":4096,"temperature":2.3510958125672174,"tokenizer_s":0.343205708,"wall_s":4.639015},"cache_bytes_before":2505661047,"cache_bytes_after":5011342997,"cache_bytes_added":2505681950,"footprint_mb_before":20.809376,"footprint_mb_after":203.0026,"available_mb_before":3519.1832,"available_mb_after":3336.989976,"free_gb_before":152.492927155,"free_gb_after":152.492927155,"error":null,"error_detail":null,"pass":true,"partial":null,"decide":null,"decide_error":null,"thermal_start":"fair","thermal_end":"fair","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"memory":{"peak_footprint_mb":222.530552,"peak_at_s":4.641850625,"min_available_mb":3317.462024,"min_available_at_s":4.641850625,"footprint_mb_start":20.973216,"footprint_mb_end":222.530552,"available_mb_start":3519.01936,"available_mb_end":3317.462024,"samples":46,"duration_s":4.641876416}},"e2e_aot":{"rows":90,"bar":{"questions":90,"questions_non_near_tie":80,"argmax_equal_non_near_tie":80,"near_tie_questions":10,"argmax_equal_near_tie":10,"max_abs_dp":0.007071197032928467,"worst_row":"tv4_020:q0","mean_of_run_mean_abs_dp":0.000775319555897214,"pass":true},"ids_equal_oracle":90,"finite_rows":90,"all_zero_rows":0,"mac":{"rows":90,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0018605589866638184,"median_abs_dp":0.0003903210163116455},"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"near_ties":[{"row":"tv4_003:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00031313300132751465,"max_abs_dp":0.0009233355522155762},{"row":"tv4_017:q0","T":76,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005922615528106689,"max_abs_dp":0.00140419602394104},{"row":"tv4_023:q0","T":92,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0018605589866638184,"max_abs_dp":0.0009637773036956787},{"row":"tv4_024:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00026410818099975586,"max_abs_dp":0.00209808349609375},{"row":"tv4_027:q0","T":77,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002703815698623657,"max_abs_dp":0.0009533166885375977},{"row":"tv4_028:q0","T":290,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00032895803451538086,"max_abs_dp":0.00034737586975097656},{"row":"tv4_051:q0","T":136,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005562901496887207,"max_abs_dp":0.0009497106075286865},{"row":"tv4_054:q0","T":113,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":8.824467658996582e-05,"max_abs_dp":0.000864565372467041},{"row":"tv4h_03:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005089342594146729,"max_abs_dp":0.00048223137855529785},{"row":"tv4h_07:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":9.328126907348633e-05,"max_abs_dp":0.0008085966110229492}],"worst_rows":[{"row":"tv4_020:q0","T":82,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008106827735900879,"max_abs_dp":0.007071197032928467},{"row":"tv4_045:q0","T":90,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00039130449295043945,"max_abs_dp":0.00692710280418396},{"row":"tv4h_11:q0","T":299,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007926225662231445,"max_abs_dp":0.004946589469909668},{"row":"tv4_018:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00022092461585998535,"max_abs_dp":0.003948330879211426},{"row":"tv4_052:q0","T":132,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00038808584213256836,"max_abs_dp":0.0038524866104125977},{"row":"tv4_047:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003370046615600586,"max_abs_dp":0.0034602582454681396},{"row":"tv4h_00:q0","T":59,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00036978721618652344,"max_abs_dp":0.0033771395683288574},{"row":"tv4_005:q0","T":81,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004602670669555664,"max_abs_dp":0.0031245946884155273}],"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"kind":"aot","asset":"<app container>/Library/Application Support/KevAssets/aot/kev_0_8b_decode_fp16_pf16.h19p.aimodelc","calls_total":664,"call_ms_median":26.13,"seconds":18.031175166,"thermal":["fair","fair"],"timeline":[[0,"fair",0.800000011920929,"charging",203.57604,3336.416536],[18,"fair",0.800000011920929,"charging",291.22948,3248.763096]],"vs_p_ref_jit":{"hidden_sha256_equal":90,"max_abs_dp":0,"p_bit_equal":90,"rows_compared":90}},"bench_aot":{"kind":"aot","pass":true,"items":[{"item":"tv4_000:q0","row_tokens":[94],"input_tokens":94,"reps":5,"summary":{"direct":{"latency_ms":[157.18245800000003,156.610042,157.03900000000002,158.98462500000002,157.294125],"max":158.98462500000002,"median":157.18245800000003,"min":156.610042,"n":5}},"wait_nominal":{"cap_s":300,"polls":38,"reached_nominal":true,"state_after":"nominal","state_before":"fair","waited_s":195.823717958},"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"timed_runs_end_s":1.011867375,"direct_shared_p_bit_equal_every_rep":null,"p_bits_equal_e2e":{"compared":6,"equal":6},"error":null,"decisions":[{"rep":0,"warmup":true,"mode":"direct","t_start_s":1.4833000000000002e-05,"t_end_s":0.22240225000000002,"t_bench_s":257.383667,"latency_ms":220.022084,"graph_ms":219.8855,"calls":6,"call_ms_first":80.63725000000001,"call_ms_median":26.817708500000002,"call_ms_last":26.103083,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":286.101288},{"rep":1,"warmup":false,"mode":"direct","t_start_s":0.22244570800000002,"t_end_s":0.38010750000000004,"t_bench_s":257.541342541,"latency_ms":157.18245800000003,"graph_ms":157.049958,"calls":6,"call_ms_first":26.37625,"call_ms_median":26.063375,"call_ms_last":26.014291000000004,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":286.084904},{"rep":2,"warmup":false,"mode":"direct","t_start_s":0.380134666,"t_end_s":0.5371917500000001,"t_bench_s":257.698426416,"latency_ms":156.610042,"graph_ms":156.47670900000003,"calls":6,"call_ms_first":26.289041,"call_ms_median":25.907354,"call_ms_last":25.82175,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":286.06852},{"rep":3,"warmup":false,"mode":"direct","t_start_s":0.537202833,"t_end_s":0.694689208,"t_bench_s":257.855923833,"latency_ms":157.03900000000002,"graph_ms":156.906458,"calls":6,"call_ms_first":26.278458,"call_ms_median":26.0450625,"call_ms_last":25.837583000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":286.06852},{"rep":4,"warmup":false,"mode":"direct","t_start_s":0.6946996660000001,"t_end_s":0.8541173750000001,"t_bench_s":258.015351958,"latency_ms":158.98462500000002,"graph_ms":158.851583,"calls":6,"call_ms_first":26.198166,"call_ms_median":26.3310625,"call_ms_last":26.440625,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":286.084904},{"rep":5,"warmup":false,"mode":"direct","t_start_s":0.8541278330000001,"t_end_s":1.011867375,"t_bench_s":258.173102083,"latency_ms":157.294125,"graph_ms":157.162875,"calls":6,"call_ms_first":25.95025,"call_ms_median":26.027812500000003,"call_ms_last":25.970791000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":286.084904}]},{"item":"own_j03:q0","row_tokens":[380],"input_tokens":380,"reps":5,"summary":{"direct":{"latency_ms":[627.7266250000001,627.081458,627.767542,628.0528330000001,627.952084],"max":628.0528330000001,"median":627.767542,"min":627.081458,"n":5}},"wait_nominal":{"cap_s":300,"polls":0,"reached_nominal":true,"state_after":"nominal","state_before":"nominal","waited_s":1.0420000000000001e-06},"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"timed_runs_end_s":3.834533208,"direct_shared_p_bit_equal_every_rep":null,"p_bits_equal_e2e":{"compared":0,"equal":0},"error":null,"decisions":[{"rep":0,"warmup":true,"mode":"direct","t_start_s":1.125e-06,"t_end_s":0.6913177920000001,"t_bench_s":319.571520875,"latency_ms":685.312208,"graph_ms":685.1752910000001,"calls":24,"call_ms_first":73.526375,"call_ms_median":26.2921665,"call_ms_last":26.289000000000005,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":284.577576},{"rep":1,"warmup":false,"mode":"direct","t_start_s":0.691328375,"t_end_s":1.320006958,"t_bench_s":320.200210041,"latency_ms":627.7266250000001,"graph_ms":627.589542,"calls":24,"call_ms_first":26.043625000000002,"call_ms_median":26.0971875,"call_ms_last":26.341417000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":284.59396},{"rep":2,"warmup":false,"mode":"direct","t_start_s":1.320018042,"t_end_s":1.9480294580000002,"t_bench_s":320.828232458,"latency_ms":627.081458,"graph_ms":626.9495000000001,"calls":24,"call_ms_first":26.151959,"call_ms_median":26.096833500000002,"call_ms_last":26.240416000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":284.59396},{"rep":3,"warmup":false,"mode":"direct","t_start_s":1.9480401250000001,"t_end_s":2.576687042,"t_bench_s":321.456890083,"latency_ms":627.767542,"graph_ms":627.6348750000001,"calls":24,"call_ms_first":26.214625,"call_ms_median":26.1031875,"call_ms_last":26.291917,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":280.284968},{"rep":4,"warmup":false,"mode":"direct","t_start_s":2.5766970000000002,"t_end_s":3.205640917,"t_bench_s":322.085843916,"latency_ms":628.0528330000001,"graph_ms":627.9171660000001,"calls":24,"call_ms_first":26.19975,"call_ms_median":26.1559995,"call_ms_last":26.285041000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":280.563496},{"rep":5,"warmup":false,"mode":"direct","t_start_s":3.20565175,"t_end_s":3.834533208,"t_bench_s":322.714736041,"latency_ms":627.952084,"graph_ms":627.8167500000001,"calls":24,"call_ms_first":26.225,"call_ms_median":26.12725,"call_ms_last":26.678375,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":280.563496}]},{"item":"own_m01:first5","row_tokens":[156,150,159,169,154],"input_tokens":240,"reps":5,"summary":{"shared":{"latency_ms":[508.74158400000005,508.021833,507.594,508.70454200000006,508.24725000000007],"max":508.74158400000005,"median":508.24725000000007,"min":507.594,"n":5}},"wait_nominal":{"cap_s":300,"polls":0,"reached_nominal":true,"state_after":"nominal","state_before":"nominal","waited_s":7.920000000000001e-07},"thermal_start":"nominal","thermal_end":"nominal","battery_start":{"level":0.800000011920929,"power":"USB power","state":"charging"},"battery_end":{"level":0.800000011920929,"power":"USB power","state":"charging"},"timed_runs_end_s":3.120502,"direct_shared_p_bit_equal_every_rep":null,"p_bits_equal_e2e":{"compared":0,"equal":0},"error":null,"decisions":[{"rep":0,"warmup":true,"mode":"shared","t_start_s":8.750000000000001e-07,"t_end_s":0.573568916,"t_bench_s":383.759981375,"latency_ms":567.865375,"graph_ms":567.447542,"calls":19,"call_ms_first":76.79079100000001,"call_ms_median":26.248041000000004,"call_ms_last":26.138875000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":344.526656},{"rep":1,"warmup":false,"mode":"shared","t_start_s":0.573583708,"t_end_s":1.083457333,"t_bench_s":384.26986975,"latency_ms":508.74158400000005,"graph_ms":508.305667,"calls":19,"call_ms_first":26.230375,"call_ms_median":26.087084000000004,"call_ms_last":26.019625,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":344.706928},{"rep":2,"warmup":false,"mode":"shared","t_start_s":1.083470625,"t_end_s":1.5926387910000002,"t_bench_s":384.779051291,"latency_ms":508.021833,"graph_ms":507.578792,"calls":19,"call_ms_first":26.1585,"call_ms_median":26.081917000000004,"call_ms_last":26.058084,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":340.643648},{"rep":3,"warmup":false,"mode":"shared","t_start_s":1.5926515,"t_end_s":2.101363875,"t_bench_s":385.287776208,"latency_ms":507.594,"graph_ms":507.17654200000004,"calls":19,"call_ms_first":26.214750000000002,"call_ms_median":26.036125000000002,"call_ms_last":26.083000000000002,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":340.676464},{"rep":4,"warmup":false,"mode":"shared","t_start_s":2.1013765,"t_end_s":2.611164958,"t_bench_s":385.797577625,"latency_ms":508.70454200000006,"graph_ms":508.28841700000004,"calls":19,"call_ms_first":26.046125000000004,"call_ms_median":26.086709000000003,"call_ms_last":26.156917,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":340.643648},{"rep":5,"warmup":false,"mode":"shared","t_start_s":2.611177208,"t_end_s":3.120502,"t_bench_s":386.306914541,"latency_ms":508.24725000000007,"graph_ms":507.83058300000005,"calls":19,"call_ms_first":26.139667000000003,"call_ms_median":26.110791000000003,"call_ms_last":26.308791000000003,"thermal":"nominal","battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":340.397936}]}]}}},{"result_json":"device/20261004-010831/result.json","result_sha256":"e7602916d2e513ef251931b2a3314c401e7ed2e8e44096e88083db13df214199","run_id":"20261004-010831","status":"running","pass":null,"summary":null,"device":{"available_mb":3528.73512,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":11.257456,"free_gb":136.928127155,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"nominal"},"device_end":null,"previous_launch":{"run_id":"20261004-005157","stage_order":["load_aot","e2e_aot","bench_aot"],"status":"done","updated":"2026-10-03T15:58:50Z"},"config_env":{"KEV_MD5SUMS":"MD5SUMS_4B","KEV_RUN_ID":"20261004-010831","KEV_STAGES":"md5,load_4b","KEV_TRY_4B":"1"},"stages":{"md5":{"bytes":15557759365,"files":["aot/kev_4b_decode_fp16_pf16.h19p.aimodelc/main-h19p-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/manifest.plist","aot/kev_4b_decode_fp16_pf16.h19p.aimodelc/main-h19p-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/original_model_0.mpsgraph","aot/kev_4b_decode_fp16_pf16.h19p.aimodelc/main-h19p-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/resources.bin","aot/kev_4b_decode_fp16_pf16.h19p.aimodelc/main-h19p-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/specialized_model_1.mpsgraph","aot/kev_4b_decode_fp16_pf16.h19p.aimodelc/main-h19p.mlirb","aot/kev_4b_decode_fp16_pf16.h19p.aimodelc/main.hash","aot/kev_4b_decode_fp16_pf16.h19p.aimodelc/metadata.json","aot/kev_4b_decode_fp16_pf16.h19p.aimodelc/stats.json"],"list":"MD5SUMS_4B","md5_mismatch":[],"pass":true,"seconds":19.108168333,"t_end_s":19.159782166,"t_start_s":0.05063083300000001},"load_4b":{"kind":null,"asset":"<app container>/Library/Application Support/KevAssets/aot/kev_4b_decode_fp16_pf16.h19p.aimodelc","asset_bytes":15557759365,"asset_main_hash":"841b5c7722af08ede0edcd264f42d6f235cabd5cb19fc6e6b24a4078e70ff8ac","options":null,"wall_s":null,"load":null,"cache_bytes_before":5011342997,"cache_bytes_after":null,"cache_bytes_added":null,"footprint_mb_before":14.829192,"footprint_mb_after":null,"available_mb_before":3525.163384,"available_mb_after":null,"free_gb_before":136.928146179,"free_gb_after":null,"error":null,"error_detail":null,"pass":null,"partial":true,"decide":null,"decide_error":null,"thermal_start":"nominal","thermal_end":null,"battery_start":null,"battery_end":null,"memory":{"peak_footprint_mb":null,"peak_at_s":null,"min_available_mb":null,"min_available_at_s":null,"footprint_mb_start":null,"footprint_mb_end":null,"available_mb_start":null,"available_mb_end":null,"samples":null,"duration_s":null}}},"crash":[{"file":"device/20261004-010831/crash/KevGate-2026-10-04-010854.ips","capture_time":"2026-10-04 01:08:53.6642 +0900","proc_launch":"2026-10-04 01:08:31.9069 +0900","exception":{"codes":"0x0000000000000001, 0x000000000000002c","rawCodes":[1,44],"type":"EXC_BAD_ACCESS","signal":"SIGSEGV","subtype":"KERN_INVALID_ADDRESS at 0x000000000000002c"},"termination":{"flags":0,"code":11,"namespace":"SIGNAL","indicator":"Segmentation fault: 11","byProc":"exc handler","byPid":7684},"faulting_thread":"llvm-worker-0","frames":["MetalPerformanceShadersGraph | mlir::ForwardIterator::makeIterable(mlir::Operation&)","MetalPerformanceShadersGraph | void mlir::detail::walk<mlir::ForwardIterator>(mlir::Operation*, llvm::function_ref<void (mlir::Operation*)>, mlir::WalkOrder)","MetalPerformanceShadersGraph | -[MPSGraphAICodeCompilerDelegate getInitializedAICodeBytecodeWithPayloadPrefix:delegateId:]","MetalPerformanceShadersGraph | closure #1 in Compiler_coreAI.compile(moduleBytecode:to:with:)","MetalPerformanceShadersGraph | protocol witness for Compiler.Delegates.BinaryGenerator.compile(moduleBytecode:to:with:) in conformance Compiler_coreAI","CoreAICompiler | ?","CoreAICompiler | ?","libODIECompiler.dylib | std::__1::__function::__func<mlir::ODIE::Compiler::capi::detail::set_callback(odiec_external_rewriter_t, void*, odiec_bytecode_blob_t (*)(void*, odiec_external_rewriter_payload_t))::$_0, std::__1::unique_ptr<llvm::MemoryBuffer, std::__1::default_delete<llvm::MemoryBuffer>> (mlir::ODIE::Compiler::ModuleRewriter::Payload&&)>::operator()(mlir::ODIE::Compiler::ModuleRewriter::Payload&&)","libODIECompiler.dylib | mlir::ODIE::Compiler::Serialization::rewriteModule(mlir::ModuleOp, mlir::ODIE::Compiler::ModuleRewriter const&, std::__1::optional<std::__1::__fs::filesystem::path> const&, std::__1::__fs::filesystem::path const&, bool)","libODIECompiler.dylib | mlir::ODIE::Compiler::Transforms::CompileForDelegates::generateCompilationTask() const::'lambda'(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, mlir::ODIE::Compiler::ModuleRewriter const&, mlir::ModuleOp)::operator()(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, mlir::ODIE::Compiler::ModuleRewriter const&, mlir::ModuleOp) const","libODIECompiler.dylib | std::__1::__deferred_assoc_state<llvm::LogicalResult, std::__1::__async_func<std::__1::function<llvm::LogicalResult ()>>>::__execute()","libc++.1.dylib | std::__1::__assoc_sub_state::wait()","libODIECompiler.dylib | llvm::StdThreadPool::processTasks(llvm::ThreadPoolTaskGroup*)","libODIECompiler.dylib | void* llvm::thread::ThreadProxy<std::__1::tuple<llvm::StdThreadPool::grow(int)::$_0>>(void*)","libsystem_pthread.dylib | _pthread_start","libsystem_pthread.dylib | thread_start"],"os_version":{"isEmbedded":true,"train":"iPhone OS 27.0","releaseType":"User","build":"24A437"},"charging":{"externalSourceConnected":true}}]},{"result_json":"device/20261004-011119/result.json","result_sha256":"88aeb2f519a377bfa4c1919118b4ab332fe0620bff8bdb451fb0abf6052e207c","run_id":"20261004-011119","status":"done","pass":true,"summary":["delete=PASS"],"device":{"available_mb":3529.423248,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":10.569328,"free_gb":136.928146179,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"nominal"},"device_end":{"available_mb":3518.577016,"battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":21.41556,"free_gb":136.928146179,"low_power_mode":false,"thermal":"nominal"},"previous_launch":{"copy":"runs/20261004-010831.died.json","died_in_stage":"load_4b","died_stage_record":{"asset":"<app container>/Library/Application Support/KevAssets/aot/kev_4b_decode_fp16_pf16.h19p.aimodelc","asset_bytes":15557759365,"asset_files":8,"asset_main_hash":"841b5c7722af08ede0edcd264f42d6f235cabd5cb19fc6e6b24a4078e70ff8ac","available_mb_after_drop":3516.955,"available_mb_before":3525.163384,"bundle":"<app container>/Library/Application Support/KevAssets/decoder_4b","cache_bytes_before":5011342997,"dropped_decider":null,"footprint_mb_after_drop":23.037576,"footprint_mb_before":14.829192,"footprint_mb_with_previous_decider":23.021192,"free_gb_before":136.928146179,"partial":1,"step":"load","storage":{"before":{"caches":{"bytes":5024156141,"dirs":[{"bytes":5011342997,"dir":"coreai-cache","files":14},{"bytes":5011342997,"dir":"coreai-cache/24A437","files":12},{"bytes":12701280,"dir":"com.daisukemajima.kevgate","files":4},{"bytes":12701280,"dir":"com.daisukemajima.kevgate/com.apple.metal","files":4},{"bytes":111864,"dir":"com.apple.dyld","files":1},{"bytes":0,"dir":"coreai-cache/sync","files":2}],"dirs_total":6,"exists":1,"files":19,"path":"<app container>/Library/Caches"},"coreai_cache":{"bytes":5011342997,"dirs":[{"bytes":5011342997,"dir":"24A437","files":12},{"bytes":5011342997,"dir":"24A437/com.daisukemajima.kevgate","files":12},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416","files":6},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416/3EED337528B9C2FCA4B6816CDCDED1FEC0A9E9EBA265A286147FA655E86F35B1","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":0,"dir":"sync","files":2},{"bytes":0,"dir":"sync/24A437","files":2}],"dirs_total":8,"exists":1,"files":14,"path":"<app container>/Library/Caches/coreai-cache"},"free_gb":136.928146179,"tmp":{"bytes":0,"dirs":[],"dirs_total":0,"exists":1,"files":0,"path":"/private<app container>/tmp"}}},"thermal_start":"nominal","tried":1},"run_id":"20261004-010831","stage_order":["md5","load_4b"],"status":"running","updated":"2026-10-03T16:08:53Z"},"config_env":{"KEV_DELETE":"aot/kev_4b_decode_fp16_pf16.h19p.aimodelc,MD5SUMS_4B,cache:841b5c7722af08ede0edcd264f42d6f235cabd5cb19fc6e6b24a4078e70ff8ac","KEV_RUN_ID":"20261004-011119","KEV_STAGES":"delete"},"stages":{"delete":{"deleted":[{"bytes":15557759365,"deleted":true,"files":8,"main_hash":"841b5c7722af08ede0edcd264f42d6f235cabd5cb19fc6e6b24a4078e70ff8ac","path":"<app container>/Library/Application Support/KevAssets/aot/kev_4b_decode_fp16_pf16.h19p.aimodelc"},{"bytes":0,"deleted":true,"files":0,"path":"<app container>/Library/Application Support/KevAssets/MD5SUMS_4B"},{"cache_entries":[],"path":"cache:841b5c7722af08ede0edcd264f42d6f235cabd5cb19fc6e6b24a4078e70ff8ac"}],"free_gb_after":136.928146179,"free_gb_before":136.928146179,"pass":true,"t_end_s":0.15816870800000002,"t_start_s":0.049441666}}}],"summary":{"loads":{"load_jit":[{"run_id":"20261004-003915","cache_state":"cold (new cache entry)","wall_s":6.651493292,"aimodel_s":5.87015525,"main_s":0.42172058300000004,"tokenizer_s":0.35336862500000005,"cache_bytes_added":2505661047,"peak_footprint_mb":315.559096,"min_available_mb":3224.43348,"available_mb_before":3516.578168,"asset_bytes":1506482046,"pass":true,"error":null},{"run_id":"20261004-004248","cache_state":"warm (entry present)","wall_s":0.6069355830000001,"aimodel_s":0.0016028750000000001,"main_s":0.25024983300000003,"tokenizer_s":0.347825333,"cache_bytes_added":0,"peak_footprint_mb":216.173872,"min_available_mb":3323.818704,"available_mb_before":3517.856096,"asset_bytes":1506482046,"pass":true,"error":null}],"load_aot":[{"run_id":"20261004-005157","cache_state":"cold (new cache entry)","wall_s":4.639015,"aimodel_s":3.073185833,"main_s":1.216506833,"tokenizer_s":0.343205708,"cache_bytes_added":2505681950,"peak_footprint_mb":222.530552,"min_available_mb":3317.462024,"available_mb_before":3519.1832,"asset_bytes":2505674625,"pass":true,"error":null}]},"gate":{"e2e_fixture":{"run_id":"20261004-003915","kind":"jit","rows":434,"argmax_non_near_tie":"420/420","near_tie":"13/14","max_abs_dp":0.01022389531135559,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.0009760064068069106,"bar_pass":true,"ids_equal_oracle":434,"pass":true,"vs_mac":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0027074217796325684,"median_abs_dp":0.00032333284616470337},"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"vs_p_ref_jit":null,"calls":4055,"call_ms_median":30.38,"seconds":150.966169292,"thermal":["nominal","nominal"]},"e2e_heldout":{"run_id":"20261004-003915","kind":"jit","rows":130,"argmax_non_near_tie":"125/125","near_tie":"5/5","max_abs_dp":0.004946589469909668,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.000828455642883618,"bar_pass":true,"ids_equal_oracle":130,"pass":true,"vs_mac":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0012511014938354492,"median_abs_dp":0.00030791759490966797},"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_p_ref_jit":null,"calls":809,"call_ms_median":36.24,"seconds":30.219826417,"thermal":["nominal","nominal"]},"e2e_aot":{"run_id":"20261004-005157","kind":"aot","rows":90,"argmax_non_near_tie":"80/80","near_tie":"10/10","max_abs_dp":0.007071197032928467,"worst_row":"tv4_020:q0","mean_of_run_mean_abs_dp":0.000775319555897214,"bar_pass":true,"ids_equal_oracle":90,"pass":true,"vs_mac":{"rows":90,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0018605589866638184,"median_abs_dp":0.0003903210163116455},"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_p_ref_jit":{"hidden_sha256_equal":90,"max_abs_dp":0,"p_bit_equal":90,"rows_compared":90},"calls":664,"call_ms_median":26.13,"seconds":18.031175166,"thermal":["fair","fair"]}},"bench":{"bench tv4_000:q0 direct":{"run_id":"20261004-004248","kind":"jit","row_tokens":[94],"input_tokens":94,"latency_ms":[156.635833,156.525208,156.27550000000002,156.60416700000002,157.288958],"median":156.60416700000002,"min":156.27550000000002,"max":157.288958,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.0420000000000001e-06,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":1.052274792,"calls":[6],"call_ms_median_range":[25.9269795,25.9969375],"shared_equals_direct_every_rep":null},"bench own_j03:q0 direct":{"run_id":"20261004-004248","kind":"jit","row_tokens":[380],"input_tokens":380,"latency_ms":[629.383,629.1521670000001,629.151958,628.895792,630.109542],"median":629.1521670000001,"min":628.895792,"max":630.109542,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.750000000000001e-07,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":3.8340581670000002,"calls":[24],"call_ms_median_range":[26.128083500000002,26.2186875],"shared_equals_direct_every_rep":null},"bench own_L02:q0 direct":{"run_id":"20261004-004248","kind":"jit","row_tokens":[1518],"input_tokens":1518,"latency_ms":[2500.7061670000003,2499.660167,2499.365208,2502.498083,2500.048375],"median":2500.048375,"min":2499.365208,"max":2502.498083,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.340000000000001e-07,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":15.08483575,"calls":[95],"call_ms_median_range":[26.316250000000004,26.329125],"shared_equals_direct_every_rep":null},"bench own_L01:q2 direct":{"run_id":"20261004-004248","kind":"jit","row_tokens":[1802],"input_tokens":1802,"latency_ms":[2975.929458,2974.096416,2975.2388330000003,2981.388125,2978.197834],"median":2975.929458,"min":2974.096416,"max":2981.388125,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.083e-06,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":17.944443375,"calls":[113],"call_ms_median_range":[26.3395,26.384791],"shared_equals_direct_every_rep":null},"bench own_m01:first5 direct":{"run_id":"20261004-004248","kind":"jit","row_tokens":[156,150,159,169,154],"input_tokens":240,"latency_ms":[1329.064042,1333.4612080000002,1330.491542,1331.687375,1330.455042],"median":1330.491542,"min":1329.064042,"max":1333.4612080000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.083e-06,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":11.096722709,"calls":[51],"call_ms_median_range":[26.004417000000004,26.049875000000004],"shared_equals_direct_every_rep":true},"bench own_m01:first5 shared":{"run_id":"20261004-004248","kind":"jit","row_tokens":[156,150,159,169,154],"input_tokens":240,"latency_ms":[507.42937500000005,508.63004200000006,507.76412500000004,507.106959,508.7622500000001],"median":507.76412500000004,"min":507.106959,"max":508.7622500000001,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.083e-06,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":11.096722709,"calls":[19],"call_ms_median_range":[26.037000000000003,26.149958],"shared_equals_direct_every_rep":true},"bench own_m01:all8 direct":{"run_id":"20261004-004248","kind":"jit","row_tokens":[156,150,159,169,154,168,154,169],"input_tokens":320,"latency_ms":[2163.836083,2182.5800000000004,2167.488958],"median":2167.488958,"min":2163.836083,"max":2182.5800000000004,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.083e-06,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":11.642602709,"calls":[83],"call_ms_median_range":[26.010166,26.201791000000004],"shared_equals_direct_every_rep":true},"bench own_m01:all8 shared":{"run_id":"20261004-004248","kind":"jit","row_tokens":[156,150,159,169,154,168,154,169],"input_tokens":320,"latency_ms":[721.168208,732.9033330000001,722.4250830000001],"median":722.4250830000001,"min":721.168208,"max":732.9033330000001,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.083e-06,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":11.642602709,"calls":[27],"call_ms_median_range":[26.093917,26.556208],"shared_equals_direct_every_rep":true},"bench own_L02:all4 direct":{"run_id":"20261004-004248","kind":"jit","row_tokens":[1518,1497,1539,1499],"input_tokens":1622,"latency_ms":[10018.257166,10034.342],"median":10026.299583,"min":10018.257166,"max":10034.342,"thermal":["nominal","fair"],"waited_for_nominal_s":8.33e-07,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":38.405275875,"calls":[380],"call_ms_median_range":[26.365125000000003,26.4169165],"shared_equals_direct_every_rep":true},"bench own_L02:all4 shared":{"run_id":"20261004-004248","kind":"jit","row_tokens":[1518,1497,1539,1499],"input_tokens":1622,"latency_ms":[2752.3962500000002,2771.494625],"median":2761.9454375,"min":2752.3962500000002,"max":2771.494625,"thermal":["nominal","fair"],"waited_for_nominal_s":8.33e-07,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":38.405275875,"calls":[104],"call_ms_median_range":[26.367895500000003,26.4730625],"shared_equals_direct_every_rep":true},"bench_aot tv4_000:q0 direct":{"run_id":"20261004-005157","kind":"aot","row_tokens":[94],"input_tokens":94,"latency_ms":[157.18245800000003,156.610042,157.03900000000002,158.98462500000002,157.294125],"median":157.18245800000003,"min":156.610042,"max":158.98462500000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":195.823717958,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":1.011867375,"calls":[6],"call_ms_median_range":[25.907354,26.3310625],"shared_equals_direct_every_rep":null},"bench_aot own_j03:q0 direct":{"run_id":"20261004-005157","kind":"aot","row_tokens":[380],"input_tokens":380,"latency_ms":[627.7266250000001,627.081458,627.767542,628.0528330000001,627.952084],"median":627.767542,"min":627.081458,"max":628.0528330000001,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.0420000000000001e-06,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":3.834533208,"calls":[24],"call_ms_median_range":[26.096833500000002,26.1559995],"shared_equals_direct_every_rep":null},"bench_aot own_m01:first5 shared":{"run_id":"20261004-005157","kind":"aot","row_tokens":[156,150,159,169,154],"input_tokens":240,"latency_ms":[508.74158400000005,508.021833,507.594,508.70454200000006,508.24725000000007],"median":508.24725000000007,"min":507.594,"max":508.74158400000005,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.920000000000001e-07,"started_nominal":true,"battery":[0.800000011920929,0.800000011920929,"USB power"],"timed_runs_end_s":3.120502,"calls":[19],"call_ms_median_range":[26.036125000000002,26.110791000000003],"shared_equals_direct_every_rep":null}},"load_4b":{"run_id":"20261004-010831","asset":"<app container>/Library/Application Support/KevAssets/aot/kev_4b_decode_fp16_pf16.h19p.aimodelc","asset_bytes":15557759365,"result":"crash (the app died inside the load; the stage stayed partial)","crash":[{"file":"device/20261004-010831/crash/KevGate-2026-10-04-010854.ips","capture_time":"2026-10-04 01:08:53.6642 +0900","proc_launch":"2026-10-04 01:08:31.9069 +0900","exception":{"codes":"0x0000000000000001, 0x000000000000002c","rawCodes":[1,44],"type":"EXC_BAD_ACCESS","signal":"SIGSEGV","subtype":"KERN_INVALID_ADDRESS at 0x000000000000002c"},"termination":{"flags":0,"code":11,"namespace":"SIGNAL","indicator":"Segmentation fault: 11","byProc":"exc handler","byPid":7684},"faulting_thread":"llvm-worker-0","frames":["MetalPerformanceShadersGraph | mlir::ForwardIterator::makeIterable(mlir::Operation&)","MetalPerformanceShadersGraph | void mlir::detail::walk<mlir::ForwardIterator>(mlir::Operation*, llvm::function_ref<void (mlir::Operation*)>, mlir::WalkOrder)","MetalPerformanceShadersGraph | -[MPSGraphAICodeCompilerDelegate getInitializedAICodeBytecodeWithPayloadPrefix:delegateId:]","MetalPerformanceShadersGraph | closure #1 in Compiler_coreAI.compile(moduleBytecode:to:with:)","MetalPerformanceShadersGraph | protocol witness for Compiler.Delegates.BinaryGenerator.compile(moduleBytecode:to:with:) in conformance Compiler_coreAI","CoreAICompiler | ?","CoreAICompiler | ?","libODIECompiler.dylib | std::__1::__function::__func<mlir::ODIE::Compiler::capi::detail::set_callback(odiec_external_rewriter_t, void*, odiec_bytecode_blob_t (*)(void*, odiec_external_rewriter_payload_t))::$_0, std::__1::unique_ptr<llvm::MemoryBuffer, std::__1::default_delete<llvm::MemoryBuffer>> (mlir::ODIE::Compiler::ModuleRewriter::Payload&&)>::operator()(mlir::ODIE::Compiler::ModuleRewriter::Payload&&)","libODIECompiler.dylib | mlir::ODIE::Compiler::Serialization::rewriteModule(mlir::ModuleOp, mlir::ODIE::Compiler::ModuleRewriter const&, std::__1::optional<std::__1::__fs::filesystem::path> const&, std::__1::__fs::filesystem::path const&, bool)","libODIECompiler.dylib | mlir::ODIE::Compiler::Transforms::CompileForDelegates::generateCompilationTask() const::'lambda'(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, mlir::ODIE::Compiler::ModuleRewriter const&, mlir::ModuleOp)::operator()(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, mlir::ODIE::Compiler::ModuleRewriter const&, mlir::ModuleOp) const","libODIECompiler.dylib | std::__1::__deferred_assoc_state<llvm::LogicalResult, std::__1::__async_func<std::__1::function<llvm::LogicalResult ()>>>::__execute()","libc++.1.dylib | std::__1::__assoc_sub_state::wait()","libODIECompiler.dylib | llvm::StdThreadPool::processTasks(llvm::ThreadPoolTaskGroup*)","libODIECompiler.dylib | void* llvm::thread::ThreadProxy<std::__1::tuple<llvm::StdThreadPool::grow(int)::$_0>>(void*)","libsystem_pthread.dylib | _pthread_start","libsystem_pthread.dylib | thread_start"],"os_version":{"isEmbedded":true,"train":"iPhone OS 27.0","releaseType":"User","build":"24A437"},"charging":{"externalSourceConnected":true}}],"memory_before":{"footprint_mb":14.829192,"available_mb":3525.163384}},"device":{"machine":"iPhone19,2","hw_model":"V63AP","os":"iOS 27.0.0","os_build":"24A437","coreai_architecture":"h19p","physical_memory_gb":11.272796630859375,"available_mb":3529.439632,"free_gb":154.953552099,"battery_level":0.800000011920929,"battery_state":"charging","power_source":"USB power","low_power_mode":false}},"mac_harness_check":{"path":"$ZOO_WORK_ROOT/_kev/results/device_r8_mac_check.json","pass":true,"harness_equals_round7":{"questions":true,"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true,"worst_row":true,"pass":true},"red_arm":{"row":{"row":"tv4_000:q0","probs_before":[0.1469845324754715,0.20422020554542542,0.4364948570728302,0.2123003453016281],"probs_after":[0.2123003453016281,0.4364948570728302,0.20422020554542542,0.1469845324754715]},"red":true,"app_bar_pass":false},"bar_20":{"questions":20,"questions_non_near_tie":18,"argmax_equal_non_near_tie":18,"near_tie_questions":2,"argmax_equal_near_tie":2,"max_abs_dp":0.003740847110748291,"worst_row":"tv4_018:q0","mean_of_run_mean_abs_dp":0.0007028491032542661,"pass":true}}},"mac_harness_check":{"result_json":"apps/KevGate/_work/mac_runs/mac-20261004-003551/result.json","result_sha256":"3e504304beae5e2e4f7a03352664093895a42c3ecb91cf62798ad17cd3c89776","run_id":"mac-20261004-003551","records":["tv4_000","tv4_001","tv4_002","tv4_003","tv4_004","tv4_005","tv4_006","tv4_007","tv4_008","tv4_009","tv4_010","tv4_011","tv4_012","tv4_013","tv4_014","tv4_015","tv4_016","tv4_017","tv4_018","tv4_019"],"harness":{"rows":20,"bar":{"questions":20,"questions_non_near_tie":18,"argmax_equal_non_near_tie":18,"near_tie_questions":2,"argmax_equal_near_tie":2,"max_abs_dp":0.003740847110748291,"worst_row":"tv4_018:q0","mean_of_run_mean_abs_dp":0.0007028491032542661,"pass":true},"ids_equal_oracle":20,"finite_rows":20,"all_zero_rows":0,"mac":{"rows":20,"hidden_sha256_equal":20,"p_bit_equal":20,"max_abs_dp":0.0,"median_abs_dp":0.0},"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"near_ties":[{"row":"tv4_003:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":true,"mac_p_bit_equal":true,"mac_max_abs_dp":0.0,"max_abs_dp":0.0006102025508880615},{"row":"tv4_017:q0","T":76,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":true,"mac_p_bit_equal":true,"mac_max_abs_dp":0.0,"max_abs_dp":0.001124560832977295}],"worst_rows":[{"row":"tv4_018:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":true,"mac_p_bit_equal":true,"mac_max_abs_dp":0.0,"max_abs_dp":0.003740847110748291},{"row":"tv4_012:q0","T":83,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":true,"mac_p_bit_equal":true,"mac_max_abs_dp":0.0,"max_abs_dp":0.002833157777786255},{"row":"tv4_006:q0","T":237,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":true,"mac_p_bit_equal":true,"mac_max_abs_dp":0.0,"max_abs_dp":0.0028274357318878174},{"row":"tv4_005:q0","T":81,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":true,"mac_p_bit_equal":true,"mac_max_abs_dp":0.0,"max_abs_dp":0.002664327621459961},{"row":"tv4_010:q0","T":64,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":true,"mac_p_bit_equal":true,"mac_max_abs_dp":0.0,"max_abs_dp":0.0022004246711730957},{"row":"tv4_014:q0","T":87,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":true,"mac_p_bit_equal":true,"mac_max_abs_dp":0.0,"max_abs_dp":0.0017955303192138672},{"row":"tv4_016:q0","T":82,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":true,"mac_p_bit_equal":true,"mac_max_abs_dp":0.0,"max_abs_dp":0.0013839900493621826},{"row":"tv4_002:q0","T":96,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":true,"mac_p_bit_equal":true,"mac_max_abs_dp":0.0,"max_abs_dp":0.0012099742889404297}],"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true}},"round7_same_rows":{"questions":20,"questions_non_near_tie":18,"argmax_equal_non_near_tie":18,"near_tie_questions":2,"argmax_equal_near_tie":2,"max_abs_dp":0.003740847110748291,"mean_of_run_mean_abs_dp":0.0007028491032542661,"worst_row":"tv4_018:q0","pass":true},"harness_equals_round7":{"questions":true,"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true,"worst_row":true,"pass":true},"load":{"bundle_name":"kev_0_8b_decode_fp16_pf16","chunk":16,"decoder_function_names":["main"],"decoder_function_s":1.76468975,"decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,16],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,16,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","decoder_model_s":2.9748161250000003,"decoder_options":"SpecializationOptions.default","head_s":0.001233708,"hidden":1024,"library_wall_s":5.227169208,"max_context_length":4096,"temperature":2.3510958125672174,"tokenizer_s":0.48263770800000005,"wall_s":5.227284542},"environment":{"available_mb":-1,"battery_level":-1,"battery_state":"unknown","coreai_architecture":"h16c","cpu":"Apple M4 Max","footprint_mb":24.298384,"free_gb":323.681586404,"hw_model":"Mac16,9","low_power_mode":false,"machine":"arm64","os":"macOS 27.0.0","os_build":"26A428","os_version_string":"Version 27.0 (Build 26A428)","physical_memory_gb":128,"power_source":"unknown","processor_count":16,"thermal":"nominal"},"red_arm":{"result_json":"apps/KevGate/_work/mac_runs/mac-20261004-003610-red/result.json","row":{"row":"tv4_000:q0","probs_before":[0.1469845324754715,0.20422020554542542,0.4364948570728302,0.2123003453016281],"probs_after":[0.2123003453016281,0.4364948570728302,0.20422020554542542,0.1469845324754715]},"bar":{"questions":20,"questions_non_near_tie":18,"argmax_equal_non_near_tie":18,"near_tie_questions":2,"argmax_equal_near_tie":2,"max_abs_dp":0.23136259615421295,"worst_row":"tv4_000:q0","mean_of_run_mean_abs_dp":0.008064375518006272,"pass":false},"app_bar_pass":false,"app_stage_pass":false,"red":true},"pass":true},"load_4b_memory_samples":[{"t_app_s":"21.26","label":"load_4b","t_s":"0.00","footprint_mb":"15.1","available_mb":"3524.9","thermal":"nominal"},{"t_app_s":"21.37","label":"load_4b","t_s":"0.11","footprint_mb":"92.6","available_mb":"3447.4","thermal":"nominal"},{"t_app_s":"21.47","label":"load_4b","t_s":"0.21","footprint_mb":"115.4","available_mb":"3424.6","thermal":"nominal"},{"t_app_s":"21.58","label":"load_4b","t_s":"0.32","footprint_mb":"175.9","available_mb":"3364.1","thermal":"nominal"}]},"round13":{"summary":{"schema":"kev-device-r13/1","model":"Kev-0.8B","device":{"available_mb":3529.439608,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":10.552968,"free_gb":146.401250505,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"nominal"},"rules_fixed_at":".lane-notes.md ## r13 10:28","gate":{"K64":{"run_id":"20261004-102254","pass":true,"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k64/kev_0_8b_decode_fp16_metal_pf64.aimodel","asset_bytes":1505385873,"asset_main_hash":"b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":3.578463833,"aimodel_s":2.725888292,"main_s":0.500222375,"tokenizer_s":0.34703495900000003,"chunk":64,"bundle_name":"kev_0_8b_decode_fp16_metal_pf64","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,64],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,64,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":5011342997,"cache_bytes_after":7513399533,"cache_bytes_added":2502056536,"cache_state":"cold (new cache entry)","peak_footprint_mb":193.877192,"min_available_mb":3346.115384,"available_mb_before":3523.03344,"free_gb_before":146.401250505,"free_gb_after":146.401250505,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm":{"record":"tv4_000","latency_ms":1057.5988750000001,"calls":2,"pass":true,"error":null},"e2e_fixture":{"rows":434,"bar":{"questions":434,"questions_non_near_tie":420,"argmax_equal_non_near_tie":420,"near_tie_questions":14,"argmax_equal_near_tie":13,"max_abs_dp":0.009762495756149292,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.0009469738836215484,"pass":true},"ids_equal_oracle":434,"finite_rows":434,"pass":true,"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"vs_mac_same_form_r11_python":{"rows":434,"missing":0,"max_abs_dp":0.0022717714309692383,"median_abs_dp":0.00029152631759643555,"argmax_equal":434,"p_bit_equal":0,"worst_row":"semif_eafc22c8c40df3932a8e:q0"},"vs_mac_u16_r7_swift_reference":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0024412572383880615,"median_abs_dp":0.00035731494426727295},"calls_total":1207,"call_ms_median":24.18,"seconds":35.740915666,"thermal":["nominal","nominal"]},"e2e_heldout":{"rows":130,"bar":{"questions":130,"questions_non_near_tie":125,"argmax_equal_non_near_tie":125,"near_tie_questions":5,"argmax_equal_near_tie":5,"max_abs_dp":0.005734503269195557,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.0008491584911676816,"pass":true},"ids_equal_oracle":130,"finite_rows":130,"pass":true,"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":130,"missing":0,"max_abs_dp":0.0015630125999450684,"median_abs_dp":0.0003191940486431122,"argmax_equal":130,"p_bit_equal":0,"worst_row":"tv4xh_paws_05:q0"},"vs_mac_u16_r7_swift_reference":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0017009973526000977,"median_abs_dp":0.00030865520238876343},"calls_total":247,"call_ms_median":24.28,"seconds":6.808297833,"thermal":["nominal","nominal"]},"reset":{"record":"tv4_000","kind":"jit","hidden_bit_equal":true,"p_bit_equal":true,"latency_ms":58.141125,"thermal":"nominal","pass":true,"error":null}},"result_json":"$ZOO_WORK_ROOT/_kev/device_r13/_work/device_runs/20261004-102254/result.json"},"K128":{"run_id":"20261004-102347","pass":true,"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k128/kev_0_8b_decode_fp16_metal_pf128.aimodel","asset_bytes":1505385870,"asset_main_hash":"19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":4.26010325,"aimodel_s":3.600256959,"main_s":0.300160125,"tokenizer_s":0.35231850000000003,"chunk":128,"bundle_name":"kev_0_8b_decode_fp16_metal_pf128","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,128],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,128,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":7513399533,"cache_bytes_after":10015455996,"cache_bytes_added":2502056463,"cache_state":"cold (new cache entry)","peak_footprint_mb":232.541344,"min_available_mb":3307.451232,"available_mb_before":3518.052728,"free_gb_before":143.945477321,"free_gb_after":143.945477321,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm":{"record":"tv4_000","latency_ms":788.866875,"calls":1,"pass":true,"error":null},"e2e_fixture":{"rows":434,"bar":{"questions":434,"questions_non_near_tie":420,"argmax_equal_non_near_tie":420,"near_tie_questions":14,"argmax_equal_near_tie":13,"max_abs_dp":0.01100119948387146,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.0009723608388956548,"pass":true},"ids_equal_oracle":434,"finite_rows":434,"pass":true,"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"vs_mac_same_form_r11_python":{"rows":434,"missing":0,"max_abs_dp":0.0026472806930541992,"median_abs_dp":0.0002929568290710449,"argmax_equal":434,"p_bit_equal":0,"worst_row":"semif_2175379f4c69e6207626:q0"},"vs_mac_u16_r7_swift_reference":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0031995177268981934,"median_abs_dp":0.0003325529396533966},"calls_total":681,"call_ms_median":36.12,"seconds":34.992179375,"thermal":["nominal","fair"]},"e2e_heldout":{"rows":130,"bar":{"questions":130,"questions_non_near_tie":125,"argmax_equal_non_near_tie":125,"near_tie_questions":5,"argmax_equal_near_tie":5,"max_abs_dp":0.005920350551605225,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.0008314862770240348,"pass":true},"ids_equal_oracle":130,"finite_rows":130,"pass":true,"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":130,"missing":0,"max_abs_dp":0.001957237720489502,"median_abs_dp":0.0003131479024887085,"argmax_equal":130,"p_bit_equal":0,"worst_row":"tv4xh_sciq_02:q0"},"vs_mac_u16_r7_swift_reference":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0026790499687194824,"median_abs_dp":0.0002968907356262207},"calls_total":143,"call_ms_median":49.3,"seconds":7.864761459,"thermal":["fair","fair"]},"reset":{"record":"tv4_000","kind":"jit","hidden_bit_equal":true,"p_bit_equal":true,"latency_ms":45.321875000000006,"thermal":"fair","pass":true,"error":null}},"result_json":"$ZOO_WORK_ROOT/_kev/device_r13/_work/device_runs/20261004-102347/result.json"},"K32":{"run_id":"20261004-102441","pass":true,"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k32/kev_0_8b_decode_fp16_metal_pf32.aimodel","asset_bytes":1505385803,"asset_main_hash":"f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":4.253016666,"aimodel_s":3.654366834,"main_s":0.23674804100000002,"tokenizer_s":0.354761625,"chunk":32,"bundle_name":"kev_0_8b_decode_fp16_metal_pf32","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,32],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,32,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":10015455996,"cache_bytes_after":12517512362,"cache_bytes_added":2502056366,"cache_state":"cold (new cache entry)","peak_footprint_mb":236.719288,"min_available_mb":3303.273288,"available_mb_before":3517.741408,"free_gb_before":141.487881417,"free_gb_after":141.487881417,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm":{"record":"tv4_000","latency_ms":544.5680000000001,"calls":3,"pass":true,"error":null},"e2e_fixture":{"rows":434,"bar":{"questions":434,"questions_non_near_tie":420,"argmax_equal_non_near_tie":420,"near_tie_questions":14,"argmax_equal_near_tie":13,"max_abs_dp":0.013274610042572021,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.0009549277293839077,"pass":true},"ids_equal_oracle":434,"finite_rows":434,"pass":true,"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"vs_mac_same_form_r11_python":{"rows":434,"missing":0,"max_abs_dp":0.0031354129314422607,"median_abs_dp":0.00031206756830215454,"argmax_equal":434,"p_bit_equal":0,"worst_row":"semif_eafc22c8c40df3932a8e:q0"},"vs_mac_u16_r7_swift_reference":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.002329528331756592,"median_abs_dp":0.00031382590532302856},"calls_total":2147,"call_ms_median":29.82,"seconds":75.645598542,"thermal":["fair","fair"]},"e2e_heldout":{"rows":130,"bar":{"questions":130,"questions_non_near_tie":125,"argmax_equal_non_near_tie":125,"near_tie_questions":5,"argmax_equal_near_tie":5,"max_abs_dp":0.0053359270095825195,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.00082612175241453,"pass":true},"ids_equal_oracle":130,"finite_rows":130,"pass":true,"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":130,"missing":0,"max_abs_dp":0.0013680458068847656,"median_abs_dp":0.0003041103482246399,"argmax_equal":130,"p_bit_equal":0,"worst_row":"tv4xh_sciq_03:q0"},"vs_mac_u16_r7_swift_reference":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0014801621437072754,"median_abs_dp":0.00028318166732788086},"calls_total":440,"call_ms_median":33.474999999999994,"seconds":15.803598083,"thermal":["fair","fair"]},"reset":{"record":"tv4_000","kind":"jit","hidden_bit_equal":true,"p_bit_equal":true,"latency_ms":90.89662500000001,"thermal":"fair","pass":true,"error":null}},"result_json":"$ZOO_WORK_ROOT/_kev/device_r13/_work/device_runs/20261004-102441/result.json"},"K16":{"run_id":"20261004-102627","pass":true,"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k16/kev_0_8b_decode_fp16_metal_pf16.aimodel","asset_bytes":1505385650,"asset_main_hash":"8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":4.219022,"aimodel_s":3.639298458,"main_s":0.220327125,"tokenizer_s":0.35222804100000005,"chunk":16,"bundle_name":"kev_0_8b_decode_fp16_metal_pf16","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,16],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,16,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":12517512362,"cache_bytes_after":15019568821,"cache_bytes_added":2502056459,"cache_state":"cold (new cache entry)","peak_footprint_mb":226.168064,"min_available_mb":3313.824512,"available_mb_before":3517.561232,"free_gb_before":139.030281417,"free_gb_after":139.030281417,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm":{"record":"tv4_000","latency_ms":317.195,"calls":6,"pass":true,"error":null},"e2e_fixture":{"rows":434,"bar":{"questions":434,"questions_non_near_tie":420,"argmax_equal_non_near_tie":420,"near_tie_questions":14,"argmax_equal_near_tie":13,"max_abs_dp":0.01097959280014038,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.000941137191822847,"pass":true},"ids_equal_oracle":434,"finite_rows":434,"pass":true,"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"vs_mac_same_form_r11_python":{"rows":434,"missing":0,"max_abs_dp":0.002144530415534973,"median_abs_dp":0.00032667815685272217,"argmax_equal":434,"p_bit_equal":0,"worst_row":"semif_834f3b3e10cc61b33d25:q0"},"vs_mac_u16_r7_swift_reference":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0024800002574920654,"median_abs_dp":0.0003177523612976074},"calls_total":4055,"call_ms_median":24.88,"seconds":114.93419425,"thermal":["fair","fair"]},"e2e_heldout":{"rows":130,"bar":{"questions":130,"questions_non_near_tie":125,"argmax_equal_non_near_tie":125,"near_tie_questions":5,"argmax_equal_near_tie":5,"max_abs_dp":0.005504608154296875,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.0008310439554341614,"pass":true},"ids_equal_oracle":130,"finite_rows":130,"pass":true,"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":130,"missing":0,"max_abs_dp":0.0019264817237854004,"median_abs_dp":0.0002781003713607788,"argmax_equal":130,"p_bit_equal":0,"worst_row":"tv4xh_qnli_01:q0"},"vs_mac_u16_r7_swift_reference":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.001141369342803955,"median_abs_dp":0.0002872049808502197},"calls_total":809,"call_ms_median":25.57,"seconds":22.317195125,"thermal":["fair","fair"]},"reset":{"record":"tv4_000","kind":"jit","hidden_bit_equal":true,"p_bit_equal":true,"latency_ms":150.104125,"thermal":"fair","pass":true,"error":null}},"result_json":"$ZOO_WORK_ROOT/_kev/device_r13/_work/device_runs/20261004-102627/result.json"}},"loads_bench_launches":[{"form":"U16","run_id":"20261004-102923","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder/kev_0_8b_decode_fp16_pf16.aimodel","asset_bytes":1506482046,"asset_main_hash":"4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":1.591829583,"aimodel_s":0.0023306660000000003,"main_s":1.228695291,"tokenizer_s":0.35195620800000005,"chunk":16,"bundle_name":"kev_0_8b_decode_fp16_pf16","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,16],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,16,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":15019568821,"cache_bytes_after":15019568821,"cache_bytes_added":0,"cache_state":"warm (entry present)","peak_footprint_mb":216.354,"min_available_mb":3323.638576,"available_mb_before":3517.69228,"free_gb_before":136.572681417,"free_gb_after":136.572681417,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},{"form":"K64","run_id":"20261004-104553","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k64/kev_0_8b_decode_fp16_metal_pf64.aimodel","asset_bytes":1505385873,"asset_main_hash":"b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":1.5197690000000001,"aimodel_s":0.001800125,"main_s":1.156495292,"tokenizer_s":0.352613208,"chunk":64,"bundle_name":"kev_0_8b_decode_fp16_metal_pf64","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,64],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,64,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":15019568821,"cache_bytes_after":15019568821,"cache_bytes_added":0,"cache_state":"warm (entry present)","peak_footprint_mb":194.038848,"min_available_mb":3345.953728,"available_mb_before":3519.117664,"free_gb_before":136.572716689,"free_gb_after":136.572716689,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},{"form":"K128","run_id":"20261004-105704","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k128/kev_0_8b_decode_fp16_metal_pf128.aimodel","asset_bytes":1505385870,"asset_main_hash":"19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":1.476739667,"aimodel_s":0.0018732500000000001,"main_s":1.117512125,"tokenizer_s":0.348385333,"chunk":128,"bundle_name":"kev_0_8b_decode_fp16_metal_pf128","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,128],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,128,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":15019568821,"cache_bytes_after":15019568821,"cache_bytes_added":0,"cache_state":"warm (entry present)","peak_footprint_mb":194.4158,"min_available_mb":3345.576776,"available_mb_before":3519.052128,"free_gb_before":136.572585617,"free_gb_after":136.572585617,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},{"form":"K32","run_id":"20261004-110446","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k32/kev_0_8b_decode_fp16_metal_pf32.aimodel","asset_bytes":1505385803,"asset_main_hash":"f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":1.427613333,"aimodel_s":0.0018662910000000002,"main_s":1.072757708,"tokenizer_s":0.344634708,"chunk":32,"bundle_name":"kev_0_8b_decode_fp16_metal_pf32","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,32],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,32,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":15019568821,"cache_bytes_after":15019568821,"cache_bytes_added":0,"cache_state":"warm (entry present)","peak_footprint_mb":194.137176,"min_available_mb":3345.8554,"available_mb_before":3519.052176,"free_gb_before":136.572585617,"free_gb_after":136.572585617,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},{"form":"K16","run_id":"20261004-111239","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k16/kev_0_8b_decode_fp16_metal_pf16.aimodel","asset_bytes":1505385650,"asset_main_hash":"8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":1.469612084,"aimodel_s":0.0016211670000000002,"main_s":1.111369375,"tokenizer_s":0.34913275000000005,"chunk":16,"bundle_name":"kev_0_8b_decode_fp16_metal_pf16","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,16],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,16,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":15019568821,"cache_bytes_after":15019568821,"cache_bytes_added":0,"cache_state":"warm (entry present)","peak_footprint_mb":194.071568,"min_available_mb":3345.921008,"available_mb_before":3519.052128,"free_gb_before":136.572585617,"free_gb_after":136.572585617,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},{"form":"U16","run_id":"20261004-112053","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder/kev_0_8b_decode_fp16_pf16.aimodel","asset_bytes":1506482046,"asset_main_hash":"4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":1.507988542,"aimodel_s":0.0018481250000000002,"main_s":1.145820666,"tokenizer_s":0.353028667,"chunk":16,"bundle_name":"kev_0_8b_decode_fp16_pf16","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,16],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,16,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":15019568821,"cache_bytes_after":15019568821,"cache_bytes_added":0,"cache_state":"warm (entry present)","peak_footprint_mb":215.469192,"min_available_mb":3324.523384,"available_mb_before":3519.035768,"free_gb_before":136.572585617,"free_gb_after":136.572585617,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null}],"bench_table":{"U16":{"20261004-102923":{"tv4_000:q0 direct":{"median_ms":157.09858300000002,"runs_ms":[157.17325000000002,157.387334,157.09858300000002,157.01795900000002,157.025042],"min_ms":157.01795900000002,"max_ms":157.387334,"calls":[6],"call_ms_median":26.058354,"thermal":["nominal","nominal"],"waited_for_nominal_s":278.175016208,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":1.064181333,"shared_equals_direct_every_rep":null},"own_j03:q0 direct":{"median_ms":630.319375,"runs_ms":[629.2149170000001,630.7464160000001,630.6271250000001,629.6735830000001,630.319375],"min_ms":629.2149170000001,"max_ms":630.7464160000001,"calls":[24],"call_ms_median":26.246188000000004,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.920000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.840663042,"shared_equals_direct_every_rep":null},"own_L02:q0 direct":{"median_ms":2509.593541,"runs_ms":[2514.1348749999997,2509.4575,2509.398125,2509.593541,2513.8181250000002],"min_ms":2509.398125,"max_ms":2514.1348749999997,"calls":[95],"call_ms_median":26.436541000000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.5e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":15.138220542,"shared_equals_direct_every_rep":null},"own_L01:q2 direct":{"median_ms":2988.215,"runs_ms":[2983.7856250000004,2987.728583,2989.228625,2988.215,2989.7955],"min_ms":2983.7856250000004,"max_ms":2989.7955,"calls":[113],"call_ms_median":26.443958000000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.91e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":18.000772375,"shared_equals_direct_every_rep":null},"own_m01:first5 direct":{"median_ms":1335.552333,"runs_ms":[1334.708042,1338.5721660000002,1334.131792,1335.552333,1336.187083],"min_ms":1334.131792,"max_ms":1338.5721660000002,"calls":[51],"call_ms_median":26.129500000000004,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.0000000000000002e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":11.135692666,"shared_equals_direct_every_rep":true},"own_m01:first5 shared":{"median_ms":509.14620900000006,"runs_ms":[508.27462500000007,509.82562500000006,508.91025,509.578458,509.14620900000006],"min_ms":508.27462500000007,"max_ms":509.82562500000006,"calls":[19],"call_ms_median":26.175,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.0000000000000002e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":11.135692666,"shared_equals_direct_every_rep":true},"own_m01:all8 direct":{"median_ms":2171.875167,"runs_ms":[2171.674166,2171.875167,2174.6232499999996],"min_ms":2171.674166,"max_ms":2174.6232499999996,"calls":[83],"call_ms_median":26.109667,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.125e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":11.652711583,"shared_equals_direct_every_rep":true},"own_m01:all8 shared":{"median_ms":723.980375,"runs_ms":[724.635167,723.4723340000002,723.980375],"min_ms":723.4723340000002,"max_ms":724.635167,"calls":[27],"call_ms_median":26.206667000000003,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.125e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":11.652711583,"shared_equals_direct_every_rep":true},"own_L02:all4 direct":{"median_ms":10069.081083000001,"runs_ms":[10067.001708,10071.160458],"min_ms":10067.001708,"max_ms":10071.160458,"calls":[380],"call_ms_median":26.50164575,"thermal":["nominal","fair"],"waited_for_nominal_s":170.041761083,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":38.553207541,"shared_equals_direct_every_rep":true},"own_L02:all4 shared":{"median_ms":2771.0909995,"runs_ms":[2760.346541,2781.835458],"min_ms":2760.346541,"max_ms":2781.835458,"calls":[104],"call_ms_median":26.51533325,"thermal":["nominal","fair"],"waited_for_nominal_s":170.041761083,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":38.553207541,"shared_equals_direct_every_rep":true}},"20261004-112053":{"tv4_000:q0 direct":{"median_ms":157.134125,"runs_ms":[157.281875,157.682292,156.99591600000002,157.134125,157.05966600000002],"min_ms":156.99591600000002,"max_ms":157.682292,"calls":[6],"call_ms_median":26.048500000000004,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.920000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":1.051377625,"shared_equals_direct_every_rep":null},"own_j03:q0 direct":{"median_ms":629.709958,"runs_ms":[629.617958,629.9515,629.760833,629.709958,629.3441250000001],"min_ms":629.3441250000001,"max_ms":629.9515,"calls":[24],"call_ms_median":26.204854000000005,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.0420000000000001e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.83769475,"shared_equals_direct_every_rep":null},"own_L02:q0 direct":{"median_ms":2508.154208,"runs_ms":[2507.392833,2508.2235,2507.657708,2508.154208,2508.183417],"min_ms":2507.392833,"max_ms":2508.2235,"calls":[95],"call_ms_median":26.394041000000005,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.920000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":15.121543875,"shared_equals_direct_every_rep":null},"own_L01:q2 direct":{"median_ms":2987.277,"runs_ms":[2987.29475,2986.0208749999997,2986.2947090000002,2987.277,2987.8896250000003],"min_ms":2986.0208749999997,"max_ms":2987.8896250000003,"calls":[113],"call_ms_median":26.440875000000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.0000000000000002e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":17.990192084,"shared_equals_direct_every_rep":null},"own_m01:first5 direct":{"median_ms":1334.199042,"runs_ms":[1333.56925,1334.104459,1335.2753750000002,1334.199042,1336.14525],"min_ms":1333.56925,"max_ms":1336.14525,"calls":[51],"call_ms_median":26.093375,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.33e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":11.12588125,"shared_equals_direct_every_rep":true},"own_m01:first5 shared":{"median_ms":509.171583,"runs_ms":[508.5867500000001,508.3945000000001,509.171583,509.3813340000001,510.163625],"min_ms":508.3945000000001,"max_ms":510.163625,"calls":[19],"call_ms_median":26.199542,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.33e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":11.12588125,"shared_equals_direct_every_rep":true},"own_m01:all8 direct":{"median_ms":2171.494417,"runs_ms":[2170.746916,2171.494417,2173.0822500000004],"min_ms":2170.746916,"max_ms":2173.0822500000004,"calls":[83],"call_ms_median":26.104375,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.0000000000000002e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":11.645985125,"shared_equals_direct_every_rep":true},"own_m01:all8 shared":{"median_ms":724.4135,"runs_ms":[723.0645420000001,724.4578750000001,724.4135],"min_ms":723.0645420000001,"max_ms":724.4578750000001,"calls":[27],"call_ms_median":26.200084,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.0000000000000002e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":11.645985125,"shared_equals_direct_every_rep":true},"own_L02:all4 direct":{"median_ms":10070.1685625,"runs_ms":[10054.541041,10085.796084],"min_ms":10054.541041,"max_ms":10085.796084,"calls":[380],"call_ms_median":26.512000000000004,"thermal":["nominal","fair"],"waited_for_nominal_s":1.0420000000000001e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":38.562745417,"shared_equals_direct_every_rep":true},"own_L02:all4 shared":{"median_ms":2773.5913545000003,"runs_ms":[2764.799625,2782.383084],"min_ms":2764.799625,"max_ms":2782.383084,"calls":[104],"call_ms_median":26.53013525,"thermal":["nominal","fair"],"waited_for_nominal_s":1.0420000000000001e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":38.562745417,"shared_equals_direct_every_rep":true}}},"K64":{"20261004-104553":{"tv4_000:q0 direct":{"median_ms":49.285625,"runs_ms":[49.2595,49.285625,49.42904200000001,49.299,48.533666000000004],"min_ms":48.533666000000004,"max_ms":49.42904200000001,"calls":[2],"call_ms_median":24.226333000000004,"thermal":["nominal","nominal"],"waited_for_nominal_s":206.19486125,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":0.378078709,"shared_equals_direct_every_rep":null},"own_j03:q0 direct":{"median_ms":144.426958,"runs_ms":[147.709041,144.426958,144.237084,144.217125,144.466167],"min_ms":144.217125,"max_ms":147.709041,"calls":[6],"call_ms_median":23.9689165,"thermal":["nominal","nominal"],"waited_for_nominal_s":6.25e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":0.940867125,"shared_equals_direct_every_rep":null},"own_L02:q0 direct":{"median_ms":581.3843750000001,"runs_ms":[580.458333,581.120167,586.589959,587.681875,581.3843750000001],"min_ms":580.458333,"max_ms":587.681875,"calls":[24],"call_ms_median":24.123,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.920000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.589233083,"shared_equals_direct_every_rep":null},"own_L01:q2 direct":{"median_ms":706.1799579999999,"runs_ms":[705.104709,705.402041,706.2152500000001,706.1799579999999,706.9585000000001],"min_ms":705.104709,"max_ms":706.9585000000001,"calls":[29],"call_ms_median":24.147000000000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.09e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":4.3257015,"shared_equals_direct_every_rep":null},"own_m01:first5 direct":{"median_ms":360.26050000000004,"runs_ms":[360.15920900000003,359.766417,360.516292,360.26050000000004,360.42212500000005],"min_ms":359.766417,"max_ms":360.516292,"calls":[15],"call_ms_median":23.805209,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.920000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.323942375,"shared_equals_direct_every_rep":true},"own_m01:first5 shared":{"median_ms":180.285875,"runs_ms":[180.285875,180.59441700000002,180.49200000000002,180.0945,180.26254200000002],"min_ms":180.0945,"max_ms":180.59441700000002,"calls":[7],"call_ms_median":24.214333,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.920000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.323942375,"shared_equals_direct_every_rep":true},"own_m01:all8 direct":{"median_ms":576.2822080000001,"runs_ms":[575.9141670000001,576.2822080000001,576.9742920000001],"min_ms":575.9141670000001,"max_ms":576.9742920000001,"calls":[24],"call_ms_median":23.805937500000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":5.000000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.410794917,"shared_equals_direct_every_rep":true},"own_m01:all8 shared":{"median_ms":256.99775,"runs_ms":[256.848709,256.99775,257.322833],"min_ms":256.848709,"max_ms":257.322833,"calls":[10],"call_ms_median":24.189542000000003,"thermal":["nominal","nominal"],"waited_for_nominal_s":5.000000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.410794917,"shared_equals_direct_every_rep":true},"own_L02:all4 direct":{"median_ms":2353.986479,"runs_ms":[2352.36075,2355.612208],"min_ms":2352.36075,"max_ms":2355.612208,"calls":[97],"call_ms_median":24.195812500000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.5e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":9.226117833,"shared_equals_direct_every_rep":true},"own_L02:all4 shared":{"median_ms":692.167,"runs_ms":[691.149125,693.184875],"min_ms":691.149125,"max_ms":693.184875,"calls":[28],"call_ms_median":24.20135425,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.5e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":9.226117833,"shared_equals_direct_every_rep":true}}},"K128":{"20261004-105704":{"tv4_000:q0 direct":{"median_ms":36.484833,"runs_ms":[36.482792,36.431167,36.577084,36.602333,36.484833],"min_ms":36.431167,"max_ms":36.602333,"calls":[1],"call_ms_median":35.644958,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.33e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":0.30172254200000004,"shared_equals_direct_every_rep":null},"own_j03:q0 direct":{"median_ms":107.54587500000001,"runs_ms":[109.97662500000001,107.66650000000001,106.43629200000001,107.54587500000001,106.522875],"min_ms":106.43629200000001,"max_ms":109.97662500000001,"calls":[3],"call_ms_median":35.338334,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.5e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":0.724057167,"shared_equals_direct_every_rep":null},"own_L02:q0 direct":{"median_ms":443.477167,"runs_ms":[443.377834,442.52729100000005,443.477167,444.41033300000004,448.59258300000005],"min_ms":442.52729100000005,"max_ms":448.59258300000005,"calls":[12],"call_ms_median":36.293583,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.666e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":2.7686832910000003,"shared_equals_direct_every_rep":null},"own_L01:q2 direct":{"median_ms":560.40725,"runs_ms":[560.40725,564.2875,559.004083,564.2270410000001,559.454458],"min_ms":559.004083,"max_ms":564.2875,"calls":[15],"call_ms_median":36.689541000000006,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.33e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.469561625,"shared_equals_direct_every_rep":null},"own_m01:first5 direct":{"median_ms":365.487459,"runs_ms":[362.299167,365.487459,372.091583,367.500459,358.38666700000005],"min_ms":358.38666700000005,"max_ms":372.091583,"calls":[10],"call_ms_median":35.0740835,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.08e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.618209083,"shared_equals_direct_every_rep":true},"own_m01:first5 shared":{"median_ms":224.360834,"runs_ms":[223.93087500000004,224.329459,224.360834,224.71412500000002,224.43412500000002],"min_ms":223.93087500000004,"max_ms":224.71412500000002,"calls":[6],"call_ms_median":35.464417,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.08e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.618209083,"shared_equals_direct_every_rep":true},"own_m01:all8 direct":{"median_ms":583.447792,"runs_ms":[582.683166,584.8766670000001,583.447792],"min_ms":582.683166,"max_ms":584.8766670000001,"calls":[16],"call_ms_median":35.06860400000001,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.920000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.747438792,"shared_equals_direct_every_rep":true},"own_m01:all8 shared":{"median_ms":335.64479200000005,"runs_ms":[334.853333,335.64479200000005,336.20508400000006],"min_ms":334.853333,"max_ms":336.20508400000006,"calls":[9],"call_ms_median":35.51708300000001,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.920000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":3.747438792,"shared_equals_direct_every_rep":true},"own_L02:all4 direct":{"median_ms":1832.5829375,"runs_ms":[1830.860625,1834.3052500000001],"min_ms":1830.860625,"max_ms":1834.3052500000001,"calls":[49],"call_ms_median":36.606375,"thermal":["nominal","nominal"],"waited_for_nominal_s":6.67e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":7.401891834,"shared_equals_direct_every_rep":true},"own_L02:all4 shared":{"median_ms":609.5127915,"runs_ms":[603.452416,615.5731670000001],"min_ms":603.452416,"max_ms":615.5731670000001,"calls":[16],"call_ms_median":36.8726355,"thermal":["nominal","nominal"],"waited_for_nominal_s":6.67e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":7.401891834,"shared_equals_direct_every_rep":true}}},"K32":{"20261004-110446":{"tv4_000:q0 direct":{"median_ms":58.487291000000006,"runs_ms":[58.648375,58.487291000000006,59.176958,58.097708000000004,57.48125],"min_ms":57.48125,"max_ms":59.176958,"calls":[3],"call_ms_median":19.194625,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.167e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":0.43016779200000005,"shared_equals_direct_every_rep":null},"own_j03:q0 direct":{"median_ms":229.91054200000002,"runs_ms":[233.69691600000002,230.16991600000003,229.91054200000002,229.430542,229.700333],"min_ms":229.430542,"max_ms":233.69691600000002,"calls":[12],"call_ms_median":19.112583,"thermal":["nominal","nominal"],"waited_for_nominal_s":9.170000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":1.45289275,"shared_equals_direct_every_rep":null},"own_L02:q0 direct":{"median_ms":924.3074170000001,"runs_ms":[923.6247500000001,923.4207080000001,924.3074170000001,924.8217500000001,924.9799160000001],"min_ms":923.4207080000001,"max_ms":924.9799160000001,"calls":[48],"call_ms_median":19.2636665,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.750000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":5.638048667,"shared_equals_direct_every_rep":null},"own_L01:q2 direct":{"median_ms":1099.146917,"runs_ms":[1097.080334,1098.0041250000002,1099.146917,1099.478125,1101.5181249999998],"min_ms":1097.080334,"max_ms":1101.5181249999998,"calls":[57],"call_ms_median":19.289125000000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.33e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":6.676634792,"shared_equals_direct_every_rep":null},"own_m01:first5 direct":{"median_ms":496.72800000000007,"runs_ms":[496.00779200000005,496.54545800000005,496.72800000000007,496.760375,497.13916700000004],"min_ms":496.00779200000005,"max_ms":497.13916700000004,"calls":[26],"call_ms_median":18.971729000000003,"thermal":["nominal","nominal"],"waited_for_nominal_s":9.58e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":4.278844125,"shared_equals_direct_every_rep":true},"own_m01:first5 shared":{"median_ms":203.498167,"runs_ms":[203.81658300000004,203.47050000000002,203.498167,203.49058300000002,203.60920900000002],"min_ms":203.47050000000002,"max_ms":203.81658300000004,"calls":[10],"call_ms_median":19.333875000000003,"thermal":["nominal","nominal"],"waited_for_nominal_s":9.58e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":4.278844125,"shared_equals_direct_every_rep":true},"own_m01:all8 direct":{"median_ms":820.8409590000001,"runs_ms":[820.256042,820.8409590000001,821.9277500000001],"min_ms":820.256042,"max_ms":821.9277500000001,"calls":[43],"call_ms_median":18.976583,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.125e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":4.583707625,"shared_equals_direct_every_rep":true},"own_m01:all8 shared":{"median_ms":303.908541,"runs_ms":[303.908541,304.117292,303.82025],"min_ms":303.82025,"max_ms":304.117292,"calls":[15],"call_ms_median":19.34525,"thermal":["nominal","nominal"],"waited_for_nominal_s":1.125e-06,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":4.583707625,"shared_equals_direct_every_rep":true},"own_L02:all4 direct":{"median_ms":3688.7295835000004,"runs_ms":[3685.609875,3691.8492920000003],"min_ms":3685.609875,"max_ms":3691.8492920000003,"calls":[191],"call_ms_median":19.3210215,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.750000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":14.255232708,"shared_equals_direct_every_rep":true},"own_L02:all4 shared":{"median_ms":1035.463687,"runs_ms":[1034.023583,1036.9037910000002],"min_ms":1034.023583,"max_ms":1036.9037910000002,"calls":[53],"call_ms_median":19.343208500000003,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.750000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":14.255232708,"shared_equals_direct_every_rep":true}}},"K16":{"20261004-111239":{"tv4_000:q0 direct":{"median_ms":92.425667,"runs_ms":[94.80354200000001,93.72891700000001,92.425667,92.06066700000001,92.089083],"min_ms":92.06066700000001,"max_ms":94.80354200000001,"calls":[6],"call_ms_median":15.116167,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.33e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":0.638616917,"shared_equals_direct_every_rep":null},"own_j03:q0 direct":{"median_ms":365.612125,"runs_ms":[366.053125,364.655958,365.21345800000006,365.678083,365.612125],"min_ms":364.655958,"max_ms":366.053125,"calls":[24],"call_ms_median":15.208563000000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.08e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":2.263138334,"shared_equals_direct_every_rep":null},"own_L02:q0 direct":{"median_ms":1456.288459,"runs_ms":[1455.086708,1456.288459,1459.162,1455.263834,1458.4196660000002],"min_ms":1455.086708,"max_ms":1459.162,"calls":[95],"call_ms_median":15.304667,"thermal":["nominal","nominal"],"waited_for_nominal_s":6.67e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":8.83989675,"shared_equals_direct_every_rep":null},"own_L01:q2 direct":{"median_ms":1734.114208,"runs_ms":[1734.114208,1738.776625,1736.709292,1730.847125,1731.731],"min_ms":1730.847125,"max_ms":1738.776625,"calls":[113],"call_ms_median":15.329459000000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":5.000000000000001e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":10.514048208,"shared_equals_direct_every_rep":null},"own_m01:first5 direct":{"median_ms":774.593709,"runs_ms":[774.593709,772.41975,774.8387910000001,778.2135420000001,772.5329160000001],"min_ms":772.41975,"max_ms":778.2135420000001,"calls":[51],"call_ms_median":15.097500000000002,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.33e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":6.561751292,"shared_equals_direct_every_rep":true},"own_m01:first5 shared":{"median_ms":305.63308300000006,"runs_ms":[306.08275000000003,305.11333300000007,307.118625,305.63308300000006,303.138291],"min_ms":303.138291,"max_ms":307.118625,"calls":[19],"call_ms_median":15.175291,"thermal":["nominal","nominal"],"waited_for_nominal_s":8.33e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":6.561751292,"shared_equals_direct_every_rep":true},"own_m01:all8 direct":{"median_ms":1259.658458,"runs_ms":[1257.5894999999998,1259.658458,1260.231584],"min_ms":1257.5894999999998,"max_ms":1260.231584,"calls":[83],"call_ms_median":15.097625000000003,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.91e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":6.832932625,"shared_equals_direct_every_rep":true},"own_m01:all8 shared":{"median_ms":428.29729100000003,"runs_ms":[427.99979200000007,428.29729100000003,429.31612500000006],"min_ms":427.99979200000007,"max_ms":429.31612500000006,"calls":[27],"call_ms_median":15.271,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.91e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":6.832932625,"shared_equals_direct_every_rep":true},"own_L02:all4 direct":{"median_ms":5827.9250415,"runs_ms":[5828.698375,5827.151707999999],"min_ms":5827.151707999999,"max_ms":5828.698375,"calls":[380],"call_ms_median":15.3271145,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.09e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":22.396361708,"shared_equals_direct_every_rep":true},"own_L02:all4 shared":{"median_ms":1609.0466044999998,"runs_ms":[1610.162042,1607.931167],"min_ms":1607.931167,"max_ms":1610.162042,"calls":[104],"call_ms_median":15.3312185,"thermal":["nominal","nominal"],"waited_for_nominal_s":7.09e-07,"battery":[0.800000011920929,0.800000011920929,"USB power"],"started_nominal":true,"timed_runs_end_s":22.396361708,"shared_equals_direct_every_rep":true}}}},"bench_summary_ms":{"U16":{"tv4_000:q0 direct":{"ms":157.116354,"runs":[157.09858300000002,157.134125]},"own_j03:q0 direct":{"ms":630.0146665,"runs":[630.319375,629.709958]},"own_L02:q0 direct":{"ms":2508.8738745,"runs":[2509.593541,2508.154208]},"own_L01:q2 direct":{"ms":2987.746,"runs":[2988.215,2987.277]},"own_m01:first5 direct":{"ms":1334.8756875,"runs":[1335.552333,1334.199042]},"own_m01:first5 shared":{"ms":509.158896,"runs":[509.14620900000006,509.171583]},"own_m01:all8 direct":{"ms":2171.684792,"runs":[2171.875167,2171.494417]},"own_m01:all8 shared":{"ms":724.1969375,"runs":[723.980375,724.4135]},"own_L02:all4 direct":{"ms":10069.62482275,"runs":[10069.081083000001,10070.1685625]},"own_L02:all4 shared":{"ms":2772.3411770000002,"runs":[2771.0909995,2773.5913545000003]}},"K64":{"tv4_000:q0 direct":{"ms":49.285625,"runs":[49.285625]},"own_j03:q0 direct":{"ms":144.426958,"runs":[144.426958]},"own_L02:q0 direct":{"ms":581.3843750000001,"runs":[581.3843750000001]},"own_L01:q2 direct":{"ms":706.1799579999999,"runs":[706.1799579999999]},"own_m01:first5 direct":{"ms":360.26050000000004,"runs":[360.26050000000004]},"own_m01:first5 shared":{"ms":180.285875,"runs":[180.285875]},"own_m01:all8 direct":{"ms":576.2822080000001,"runs":[576.2822080000001]},"own_m01:all8 shared":{"ms":256.99775,"runs":[256.99775]},"own_L02:all4 direct":{"ms":2353.986479,"runs":[2353.986479]},"own_L02:all4 shared":{"ms":692.167,"runs":[692.167]}},"K128":{"tv4_000:q0 direct":{"ms":36.484833,"runs":[36.484833]},"own_j03:q0 direct":{"ms":107.54587500000001,"runs":[107.54587500000001]},"own_L02:q0 direct":{"ms":443.477167,"runs":[443.477167]},"own_L01:q2 direct":{"ms":560.40725,"runs":[560.40725]},"own_m01:first5 direct":{"ms":365.487459,"runs":[365.487459]},"own_m01:first5 shared":{"ms":224.360834,"runs":[224.360834]},"own_m01:all8 direct":{"ms":583.447792,"runs":[583.447792]},"own_m01:all8 shared":{"ms":335.64479200000005,"runs":[335.64479200000005]},"own_L02:all4 direct":{"ms":1832.5829375,"runs":[1832.5829375]},"own_L02:all4 shared":{"ms":609.5127915,"runs":[609.5127915]}},"K32":{"tv4_000:q0 direct":{"ms":58.487291000000006,"runs":[58.487291000000006]},"own_j03:q0 direct":{"ms":229.91054200000002,"runs":[229.91054200000002]},"own_L02:q0 direct":{"ms":924.3074170000001,"runs":[924.3074170000001]},"own_L01:q2 direct":{"ms":1099.146917,"runs":[1099.146917]},"own_m01:first5 direct":{"ms":496.72800000000007,"runs":[496.72800000000007]},"own_m01:first5 shared":{"ms":203.498167,"runs":[203.498167]},"own_m01:all8 direct":{"ms":820.8409590000001,"runs":[820.8409590000001]},"own_m01:all8 shared":{"ms":303.908541,"runs":[303.908541]},"own_L02:all4 direct":{"ms":3688.7295835000004,"runs":[3688.7295835000004]},"own_L02:all4 shared":{"ms":1035.463687,"runs":[1035.463687]}},"K16":{"tv4_000:q0 direct":{"ms":92.425667,"runs":[92.425667]},"own_j03:q0 direct":{"ms":365.612125,"runs":[365.612125]},"own_L02:q0 direct":{"ms":1456.288459,"runs":[1456.288459]},"own_L01:q2 direct":{"ms":1734.114208,"runs":[1734.114208]},"own_m01:first5 direct":{"ms":774.593709,"runs":[774.593709]},"own_m01:first5 shared":{"ms":305.63308300000006,"runs":[305.63308300000006]},"own_m01:all8 direct":{"ms":1259.658458,"runs":[1259.658458]},"own_m01:all8 shared":{"ms":428.29729100000003,"runs":[428.29729100000003]},"own_L02:all4 direct":{"ms":5827.9250415,"runs":[5827.9250415]},"own_L02:all4 shared":{"ms":1609.0466044999998,"runs":[1609.0466044999998]}}},"ratio_to_u16_mean":{"U16":{"tv4_000:q0 direct":1.0,"own_j03:q0 direct":1.0,"own_L02:q0 direct":1.0,"own_L01:q2 direct":1.0,"own_m01:first5 direct":1.0,"own_m01:first5 shared":1.0,"own_m01:all8 direct":1.0,"own_m01:all8 shared":1.0,"own_L02:all4 direct":1.0,"own_L02:all4 shared":1.0},"K64":{"tv4_000:q0 direct":0.31368870105017843,"own_j03:q0 direct":0.22924380285042145,"own_L02:q0 direct":0.23173120853509055,"own_L01:q2 direct":0.23635876610662349,"own_m01:first5 direct":0.26988318341066503,"own_m01:first5 shared":0.3540856821246623,"own_m01:all8 direct":0.265361810389286,"own_m01:all8 shared":0.35487273791460905,"own_L02:all4 direct":0.23377102130773625,"own_L02:all4 shared":0.24966876578625372},"K128":{"tv4_000:q0 direct":0.2322153746006606,"own_j03:q0 direct":0.1707037640845144,"own_L02:q0 direct":0.17676343618045834,"own_L01:q2 direct":0.18756857175944674,"own_m01:first5 direct":0.2737988731254048,"own_m01:first5 shared":0.44064993416122106,"own_m01:all8 direct":0.26866136105446375,"own_m01:all8 shared":0.4634717086193147,"own_L02:all4 direct":0.18199118336163833,"own_L02:all4 shared":0.21985489973480274},"K32":{"tv4_000:q0 direct":0.37225463493125616,"own_j03:q0 direct":0.3649288726518877,"own_L02:q0 direct":0.36841525849289963,"own_L01:q2 direct":0.36788499323570345,"own_m01:first5 direct":0.37211554952378295,"own_m01:first5 shared":0.39967516741571374,"own_m01:all8 direct":0.3779742631268563,"own_m01:all8 shared":0.4196490281346985,"own_L02:all4 direct":0.3663224448209992,"own_L02:all4 shared":0.3734979286064977},"K16":{"tv4_000:q0 direct":0.5882625496770375,"own_j03:q0 direct":0.5803231963330809,"own_L02:q0 direct":0.5804550295658955,"own_L01:q2 direct":0.5804088459996264,"own_m01:first5 direct":0.5802740406866539,"own_m01:first5 shared":0.6002705351926131,"own_m01:all8 direct":0.5800374265364382,"own_m01:all8 shared":0.5914099726498775,"own_L02:all4 direct":0.5787628778713924,"own_L02:all4 shared":0.5803927084620868}},"excluded_not_nominal":[],"fit_k":{"a_ms":12.813157641304347,"b_ms_per_token":0.18077080910326093,"points":{"K16":15.289271,"K32":19.248031,"K64":24.1355625,"K128":35.96476025},"residuals_ms":{"K16":-0.4162195869565224,"K32":0.6502074673913043,"K64":-0.2469269239130476,"K128":0.01293904347825503}},"ranking":{"order":["K128","K64","K32","K16"],"groups":[{"tied_on_94_token_item":["K128"],"order":["K128"]},{"tied_on_94_token_item":["K64"],"order":["K64"]},{"tied_on_94_token_item":["K32"],"order":["K32"]},{"tied_on_94_token_item":["K16"],"order":["K16"]}],"slower_than_u16_by_5pct":{"K128":[],"K64":[],"K32":[],"K16":[]}},"u16_two_runs_5pct_differences":[],"regression_new_binary":{"form":"K128","a2_run":"20261004-102347","new_binary_run":"20261004-113447","rows_compared":10,"p_bits_equal":10,"hidden_sha256_equal":10,"load_jit":{"wall_s":1.536250917,"cache_bytes_added":0,"pass":true},"warm_latency_ms":66.799209,"reset":{"hidden_bit_equal":true,"p_bit_equal":true,"pass":true},"status":"done","pass":true},"stage_c":{"rules_fixed_at":".lane-notes.md ## r13 11:45","forms_in_order":["U16","D512L128q16","D512L256q16","D512L512q16","K128"],"call_lengths":{"U16":1,"D512L128q16":8,"D512L256q16":16,"D512L512q16":32,"K128":1},"bench_table":{"U16":{"tv4_000:q0 direct":{"median_ms":156.701042,"runs_ms":[157.06104200000001,157.058916,156.69875,156.65116600000002,156.701042],"calls":[6],"call_ms_median":25.977,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.0420000000000001e-06,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"]},"own_j03:q0 direct":{"median_ms":627.8575830000001,"runs_ms":[629.614,627.444417,627.983708,627.8575830000001,627.853917],"calls":[24],"call_ms_median":26.148583000000002,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.08e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"]},"own_L02:q0 direct":{"median_ms":2500.871375,"runs_ms":[2499.114333,2502.731292,2500.859708,2500.871375,2501.7795],"calls":[95],"call_ms_median":26.328125,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.750000000000001e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"]},"own_L01:q2 direct":{"median_ms":2977.783541,"runs_ms":[2973.4955000000004,2975.994042,2977.783541,2980.198584,2979.779375],"calls":[113],"call_ms_median":26.363,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.340000000000001e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"]},"own_m01:first5 direct":{"median_ms":1331.423583,"runs_ms":[1330.039917,1330.033125,1331.423583,1331.96025,1332.5390000000002],"calls":[51],"call_ms_median":26.026084,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.750000000000001e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"]},"own_m01:first5 shared":{"median_ms":507.4475420000001,"runs_ms":[506.959959,507.4385840000001,507.4475420000001,508.187791,507.468833],"calls":[19],"call_ms_median":26.117625,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.750000000000001e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"]},"own_m01:first5 prepared":{"median_ms":295.51800000000003,"runs_ms":[294.671125,295.26825,295.64337500000005,295.51800000000003,295.63029100000006],"calls":[11],"call_ms_median":26.249875000000003,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.750000000000001e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"],"prepare_ms":[211.638125,211.58158300000002,212.78991600000003,211.60229200000003,211.57279100000002],"prepare_ms_median":211.60229200000003,"questions":5,"per_question_ms":59.10360000000001},"own_m01:all8 direct":{"median_ms":2167.40375,"runs_ms":[2166.3895,2167.40375,2169.676333],"calls":[83],"call_ms_median":26.04425,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.920000000000001e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"]},"own_m01:all8 shared":{"median_ms":723.3197920000001,"runs_ms":[723.593334,722.3413330000001,723.3197920000001],"calls":[27],"call_ms_median":26.226125000000003,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.920000000000001e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"]},"own_L02:all4 direct":{"median_ms":10061.6257295,"runs_ms":[10059.692292,10063.559167],"calls":[380],"call_ms_median":26.48307325,"thermal":["nominal","fair"],"started_nominal":true,"waited_for_nominal_s":5.000000000000001e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"]},"own_L02:all4 shared":{"median_ms":2769.7865415,"runs_ms":[2762.588708,2776.984375],"calls":[104],"call_ms_median":26.50778125,"thermal":["nominal","fair"],"started_nominal":true,"waited_for_nominal_s":5.000000000000001e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"]},"own_L02:all4 prepared":{"median_ms":342.41172900000004,"runs_ms":[324.92787500000003,359.89558300000004],"calls":[12],"call_ms_median":27.861687500000002,"thermal":["nominal","fair"],"started_nominal":true,"waited_for_nominal_s":5.000000000000001e-07,"run_id":"20261004-115603","battery":[0.800000011920929,"USB power"],"prepare_ms":[2432.579291,2470.263791],"prepare_ms_median":2451.4215409999997,"questions":4,"per_question_ms":85.60293225000001}},"D512L128q16":{"tv4_000:q0 direct":{"median_ms":32.669250000000005,"runs_ms":[35.38275,33.424125,32.669250000000005,32.505459,32.120125],"calls":[1],"call_ms_median":31.758292,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":293.595295292,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"]},"own_j03:q0 direct":{"median_ms":109.46533300000002,"runs_ms":[113.614417,109.46533300000002,109.68783300000001,109.20179200000001,109.333417],"calls":[3],"call_ms_median":36.234,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.0000000000000002e-06,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"]},"own_L02:q0 direct":{"median_ms":455.27095800000006,"runs_ms":[455.27095800000006,454.16566600000004,456.02850000000007,455.818667,455.14145800000006],"calls":[12],"call_ms_median":37.0834995,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.750000000000001e-07,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"]},"own_L01:q2 direct":{"median_ms":561.356209,"runs_ms":[562.08775,561.3329160000001,558.472042,561.356209,564.9523750000001],"calls":[15],"call_ms_median":37.839708,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.875e-06,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"]},"own_m01:first5 direct":{"median_ms":287.812958,"runs_ms":[287.422541,287.812958,288.10225,287.62675,288.01333300000005],"calls":[10],"call_ms_median":29.342125000000003,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.5e-07,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"]},"own_m01:first5 shared":{"median_ms":149.35937500000003,"runs_ms":[149.616041,148.996167,149.35937500000003,149.20083300000002,150.135708],"calls":[6],"call_ms_median":19.825479,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.5e-07,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"]},"own_m01:first5 prepared":{"median_ms":108.22570900000001,"runs_ms":[108.21795800000001,108.22570900000001,108.558042,108.090875,108.691291],"calls":[5],"call_ms_median":19.670208000000002,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.5e-07,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"],"prepare_ms":[40.391000000000005,40.418,41.012709,40.898916,40.84504200000001],"prepare_ms_median":40.84504200000001,"questions":5,"per_question_ms":21.6451418},"own_m01:all8 direct":{"median_ms":464.480792,"runs_ms":[463.71891700000003,465.05600000000004,464.480792],"calls":[16],"call_ms_median":29.421958000000004,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":4.5800000000000005e-07,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"]},"own_m01:all8 shared":{"median_ms":217.742875,"runs_ms":[217.742875,217.64629200000002,217.80283400000002],"calls":[9],"call_ms_median":20.042292,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":4.5800000000000005e-07,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"]},"own_L02:all4 direct":{"median_ms":1851.217521,"runs_ms":[1853.037708,1849.397334],"calls":[49],"call_ms_median":37.350688000000005,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.340000000000001e-07,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"]},"own_L02:all4 shared":{"median_ms":557.6985420000001,"runs_ms":[561.717834,553.67925],"calls":[16],"call_ms_median":37.002792,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.340000000000001e-07,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"]},"own_L02:all4 prepared":{"median_ms":99.615771,"runs_ms":[99.50450000000001,99.727042],"calls":[4],"call_ms_median":21.704333750000004,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.340000000000001e-07,"run_id":"20261004-120519","battery":[0.800000011920929,"USB power"],"prepare_ms":[451.46837500000004,455.399875],"prepare_ms_median":453.434125,"questions":4,"per_question_ms":24.90394275}},"D512L256q16":{"tv4_000:q0 direct":{"median_ms":32.461375000000004,"runs_ms":[34.377417,33.337458,32.448291000000005,32.461375000000004,32.33925],"calls":[1],"call_ms_median":31.542832999999998,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.6250000000000001e-06,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"]},"own_j03:q0 direct":{"median_ms":120.582667,"runs_ms":[118.177833,120.582667,121.64675000000001,120.91245900000001,118.15575],"calls":[2],"call_ms_median":57.84793750000001,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.340000000000001e-07,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"]},"own_L02:q0 direct":{"median_ms":445.081,"runs_ms":[442.68345800000003,445.081,444.426541,445.804208,445.41629200000006],"calls":[6],"call_ms_median":72.27947900000001,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.33e-07,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"]},"own_L01:q2 direct":{"median_ms":544.410625,"runs_ms":[544.410625,544.1676659999999,545.3173330000001,543.0754590000001,544.429625],"calls":[8],"call_ms_median":73.4857705,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":9.58e-07,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"]},"own_m01:first5 direct":{"median_ms":283.42870800000003,"runs_ms":[284.003458,282.92179100000004,283.42870800000003,283.14754200000004,285.368791],"calls":[5],"call_ms_median":53.481167000000006,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.08e-07,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"]},"own_m01:first5 shared":{"median_ms":148.728792,"runs_ms":[149.019833,148.62704200000002,148.54541700000001,148.96204200000003,148.728792],"calls":[6],"call_ms_median":19.777479000000003,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.08e-07,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"]},"own_m01:first5 prepared":{"median_ms":107.73275,"runs_ms":[107.99279100000001,107.73275,108.04345900000001,107.528125,107.63720800000002],"calls":[5],"call_ms_median":19.57825,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.08e-07,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"],"prepare_ms":[41.000958000000004,40.080625000000005,40.406584,40.63975,40.997667],"prepare_ms_median":40.63975,"questions":5,"per_question_ms":21.54655},"own_m01:all8 direct":{"median_ms":459.71575,"runs_ms":[459.71575,456.4635,465.680833],"calls":[8],"call_ms_median":54.461708,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.920000000000001e-07,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"]},"own_m01:all8 shared":{"median_ms":217.12537500000002,"runs_ms":[216.935125,217.138458,217.12537500000002],"calls":[9],"call_ms_median":19.879625,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.920000000000001e-07,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"]},"own_L02:all4 direct":{"median_ms":1805.1692705,"runs_ms":[1806.579291,1803.75925],"calls":[25],"call_ms_median":73.05852050000001,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.083e-06,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"]},"own_L02:all4 shared":{"median_ms":537.984854,"runs_ms":[543.187333,532.782375],"calls":[10],"call_ms_median":68.03221875,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.083e-06,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"]},"own_L02:all4 prepared":{"median_ms":98.95637500000001,"runs_ms":[98.81275000000001,99.10000000000001],"calls":[4],"call_ms_median":21.526677,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.083e-06,"run_id":"20261004-121755","battery":[0.800000011920929,"USB power"],"prepare_ms":[451.535208,444.111625],"prepare_ms_median":447.8234165,"questions":4,"per_question_ms":24.739093750000002}},"D512L512q16":{"tv4_000:q0 direct":{"median_ms":32.622083,"runs_ms":[32.759167000000005,32.622083,32.629208,32.605375,32.564708],"calls":[1],"call_ms_median":31.695958000000005,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.750000000000001e-07,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"]},"own_j03:q0 direct":{"median_ms":108.818416,"runs_ms":[113.45112500000002,109.92525,108.818416,108.550584,107.85070900000001],"calls":[1],"call_ms_median":106.205875,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.041e-06,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"]},"own_L02:q0 direct":{"median_ms":434.03366700000004,"runs_ms":[435.289584,435.02087500000005,429.96920800000004,430.43012500000003,434.03366700000004],"calls":[3],"call_ms_median":146.079708,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.709e-06,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"]},"own_L01:q2 direct":{"median_ms":532.385292,"runs_ms":[532.5293340000001,532.385292,535.3102080000001,528.878959,530.3613750000001],"calls":[4],"call_ms_median":141.1939165,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.1660000000000001e-06,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"]},"own_m01:first5 direct":{"median_ms":283.322959,"runs_ms":[283.322959,281.99179200000003,280.335875,285.20075,284.904709],"calls":[5],"call_ms_median":53.61987500000001,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.08e-07,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"]},"own_m01:first5 shared":{"median_ms":148.692917,"runs_ms":[148.99729200000002,148.692917,148.671042,150.174416,148.55175],"calls":[6],"call_ms_median":19.7521875,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.08e-07,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"]},"own_m01:first5 prepared":{"median_ms":107.707417,"runs_ms":[107.943458,107.707417,107.42175000000002,107.76600000000002,107.672875],"calls":[5],"call_ms_median":19.602709000000004,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.08e-07,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"],"prepare_ms":[40.46641700000001,40.13700000000001,40.048542,40.400875,40.018292],"prepare_ms_median":40.13700000000001,"questions":5,"per_question_ms":21.5414834},"own_m01:all8 direct":{"median_ms":461.135375,"runs_ms":[466.337292,458.42262500000004,461.135375],"calls":[8],"call_ms_median":55.0467915,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.0840000000000001e-06,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"]},"own_m01:all8 shared":{"median_ms":217.33916600000003,"runs_ms":[217.33916600000003,217.71804200000003,216.05633300000002],"calls":[9],"call_ms_median":19.862417,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.0840000000000001e-06,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"]},"own_L02:all4 direct":{"median_ms":1758.520479,"runs_ms":[1757.71,1759.330958],"calls":[13],"call_ms_median":144.25287500000002,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.2080000000000001e-06,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"]},"own_L02:all4 shared":{"median_ms":534.2315834999999,"runs_ms":[533.878333,534.584834],"calls":[7],"call_ms_median":30.143437000000002,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.2080000000000001e-06,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"]},"own_L02:all4 prepared":{"median_ms":99.16837450000001,"runs_ms":[99.21895800000001,99.11779100000001],"calls":[4],"call_ms_median":21.5108855,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.2080000000000001e-06,"run_id":"20261004-122538","battery":[0.800000011920929,"USB power"],"prepare_ms":[437.15545800000007,439.45120800000007],"prepare_ms_median":438.30333300000007,"questions":4,"per_question_ms":24.792093625000003}},"K128":{"tv4_000:q0 direct":{"median_ms":37.824250000000006,"runs_ms":[39.75579200000001,38.273917000000004,37.824250000000006,37.011708000000006,36.118500000000004],"calls":[1],"call_ms_median":36.200375,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":5.84e-07,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"]},"own_j03:q0 direct":{"median_ms":110.56412500000002,"runs_ms":[109.16704200000001,110.166417,110.98833300000001,110.56412500000002,110.57366700000001],"calls":[3],"call_ms_median":35.351083,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.4590000000000001e-06,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"]},"own_L02:q0 direct":{"median_ms":444.076083,"runs_ms":[442.48795900000005,440.25658300000003,445.41420800000003,444.58554200000003,444.076083],"calls":[12],"call_ms_median":36.18118750000001,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.0000000000000002e-06,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"]},"own_L01:q2 direct":{"median_ms":559.077625,"runs_ms":[558.8084170000001,559.851458,550.839958,559.077625,561.2125],"calls":[15],"call_ms_median":36.53270800000001,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.0420000000000001e-06,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"]},"own_m01:first5 direct":{"median_ms":361.86379100000005,"runs_ms":[360.57708400000007,360.99825000000004,368.993083,361.86379100000005,364.82616700000005],"calls":[10],"call_ms_median":34.9936245,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.0840000000000001e-06,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"]},"own_m01:first5 shared":{"median_ms":223.22158400000004,"runs_ms":[223.451625,223.17420800000002,222.90583300000003,229.05141700000001,223.22158400000004],"calls":[6],"call_ms_median":35.285041500000005,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.0840000000000001e-06,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"]},"own_m01:first5 prepared":{"median_ms":183.4085,"runs_ms":[183.221125,183.58554200000003,183.4085,183.47695800000002,183.356667],"calls":[5],"call_ms_median":35.250583,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":1.0840000000000001e-06,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"],"prepare_ms":[38.74254200000001,39.061167,38.581167,39.052375,38.804542000000005],"prepare_ms_median":38.804542000000005,"questions":5,"per_question_ms":36.6817},"own_m01:all8 direct":{"median_ms":583.2052080000001,"runs_ms":[570.952584,583.2052080000001,584.275667],"calls":[16],"call_ms_median":34.995104,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.750000000000001e-07,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"]},"own_m01:all8 shared":{"median_ms":333.412625,"runs_ms":[333.412625,333.70383300000003,333.071375],"calls":[9],"call_ms_median":35.313083,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":8.750000000000001e-07,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"]},"own_L02:all4 direct":{"median_ms":1822.2179380000002,"runs_ms":[1820.3297920000002,1824.106084],"calls":[49],"call_ms_median":36.407979000000005,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.5e-07,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"]},"own_L02:all4 shared":{"median_ms":613.883354,"runs_ms":[613.074958,614.6917500000001],"calls":[16],"call_ms_median":37.0689165,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.5e-07,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"]},"own_L02:all4 prepared":{"median_ms":196.506458,"runs_ms":[200.136,192.87691600000002],"calls":[5],"call_ms_median":37.417646000000005,"thermal":["nominal","nominal"],"started_nominal":true,"waited_for_nominal_s":7.5e-07,"run_id":"20261004-123321","battery":[0.800000011920929,"USB power"],"prepare_ms":[414.175084,416.442042],"prepare_ms_median":415.30856300000005,"questions":4,"per_question_ms":49.1266145}}},"ratio_to_u16":{"U16":{"tv4_000:q0 direct":1.0,"own_j03:q0 direct":1.0,"own_L02:q0 direct":1.0,"own_L01:q2 direct":1.0,"own_m01:first5 direct":1.0,"own_m01:first5 shared":1.0,"own_m01:all8 direct":1.0,"own_m01:all8 shared":1.0,"own_L02:all4 direct":1.0,"own_L02:all4 shared":1.0,"own_m01:first5 prepared":1.0,"own_L02:all4 prepared":1.0},"D512L128q16":{"tv4_000:q0 direct":0.20848138329546018,"own_j03:q0 direct":0.17434739336420502,"own_L02:q0 direct":0.1820449314391469,"own_L01:q2 direct":0.18851477995995816,"own_m01:first5 direct":0.21616934060270432,"own_m01:first5 shared":0.2943346112414512,"own_m01:all8 direct":0.21430284597412919,"own_m01:all8 shared":0.30103265168223126,"own_L02:all4 direct":0.18398791316321345,"own_L02:all4 shared":0.2013507299728498,"own_m01:first5 prepared":0.36622374610006836,"own_L02:all4 prepared":0.29092394495633644},"D512L256q16":{"tv4_000:q0 direct":0.20715481266550864,"own_j03:q0 direct":0.1920541700298298,"own_L02:q0 direct":0.1779703684280844,"own_L01:q2 direct":0.1828241097797108,"own_m01:first5 direct":0.21287643663436598,"own_m01:first5 shared":0.2930919547147988,"own_m01:all8 direct":0.21210434373383363,"own_m01:all8 shared":0.3001789490643441,"own_L02:all4 direct":0.17941129187576188,"own_L02:all4 shared":0.19423332662619194,"own_m01:first5 prepared":0.3645556277451796,"own_L02:all4 prepared":0.2889982048482924},"D512L512q16":{"tv4_000:q0 direct":0.20818038338251768,"own_j03:q0 direct":0.17331703708992233,"own_L02:q0 direct":0.1735529749105949,"own_L01:q2 direct":0.17878575949856124,"own_m01:first5 direct":0.21279701112219224,"own_m01:first5 shared":0.2930212577519983,"own_m01:all8 direct":0.21275933245017226,"own_m01:all8 shared":0.3004745181920862,"own_L02:all4 direct":0.17477498430935848,"own_L02:all4 shared":0.19287825090329255,"own_m01:first5 prepared":0.3644699036945296,"own_L02:all4 prepared":0.28961734105784676},"K128":{"tv4_000:q0 direct":0.241378420444709,"own_j03:q0 direct":0.17609745903156512,"own_L02:q0 direct":0.17756854168479574,"own_L01:q2 direct":0.18774958532152086,"own_m01:first5 direct":0.2717871274178866,"own_m01:first5 shared":0.439890955270407,"own_m01:all8 direct":0.2690800954829021,"own_m01:all8 shared":0.4609477421848287,"own_L02:all4 direct":0.18110571660973054,"own_L02:all4 shared":0.22163561877499288,"own_m01:first5 prepared":0.6206339376958425,"own_L02:all4 prepared":0.5738893891686753}},"excluded_not_nominal":[],"ranking_v2":{"candidates":["U16","D512L128q16","D512L256q16","D512L512q16","K128"],"dominated":{"U16":{"by":"D512L128q16","faster_items":["tv4_000:q0 direct","own_j03:q0 direct","own_L02:q0 direct","own_L01:q2 direct","own_m01:first5 direct","own_m01:first5 shared","own_m01:all8 direct","own_m01:all8 shared","own_L02:all4 direct","own_L02:all4 shared"]},"D512L128q16":{"by":"D512L512q16","faster_items":["own_L02:q0 direct","own_L01:q2 direct","own_L02:all4 direct","own_L02:all4 shared"]},"D512L256q16":{"by":"D512L512q16","faster_items":["own_j03:q0 direct"]},"K128":{"by":"D512L128q16","faster_items":["tv4_000:q0 direct","own_m01:first5 direct","own_m01:first5 shared","own_m01:all8 direct","own_m01:all8 shared","own_L02:all4 shared"]}},"groups":[["D512L512q16"]],"order":["D512L512q16"]},"new_binary_vs_stage_a":{"U16":{"items":[{"item":"tv4_000:q0 direct","stage_a_ms":157.116354,"stage_c_ms":156.701042,"diff":-0.0026433403616277916},{"item":"own_j03:q0 direct","stage_a_ms":630.0146665,"stage_c_ms":627.8575830000001,"diff":-0.0034238623554327767},{"item":"own_L02:q0 direct","stage_a_ms":2508.8738745,"stage_c_ms":2500.871375,"diff":-0.003189677879520637},{"item":"own_L01:q2 direct","stage_a_ms":2987.746,"stage_c_ms":2977.783541,"diff":-0.0033344397415310096},{"item":"own_m01:first5 direct","stage_a_ms":1334.8756875,"stage_c_ms":1331.423583,"diff":-0.002586086878595506},{"item":"own_m01:first5 shared","stage_a_ms":509.158896,"stage_c_ms":507.4475420000001,"diff":-0.003361139348530433},{"item":"own_m01:all8 direct","stage_a_ms":2171.684792,"stage_c_ms":2167.40375,"diff":-0.001971299893875239},{"item":"own_m01:all8 shared","stage_a_ms":724.1969375,"stage_c_ms":723.3197920000001,"diff":-0.0012111974720962827},{"item":"own_L02:all4 direct","stage_a_ms":10069.62482275,"stage_c_ms":10061.6257295,"diff":-0.0007943784789209158},{"item":"own_L02:all4 shared","stage_a_ms":2772.3411770000002,"stage_c_ms":2769.7865415,"diff":-0.0009214722636571549}],"over_3pct":[]},"K128":{"items":[{"item":"tv4_000:q0 direct","stage_a_ms":36.484833,"stage_c_ms":37.824250000000006,"diff":0.03671161109604104},{"item":"own_j03:q0 direct","stage_a_ms":107.54587500000001,"stage_c_ms":110.56412500000002,"diff":0.028064767709593777},{"item":"own_L02:q0 direct","stage_a_ms":443.477167,"stage_c_ms":444.076083,"diff":0.0013505001938464494},{"item":"own_L01:q2 direct","stage_a_ms":560.40725,"stage_c_ms":559.077625,"diff":-0.002372604922580792},{"item":"own_m01:first5 direct","stage_a_ms":365.487459,"stage_c_ms":361.86379100000005,"diff":-0.009914616523134799},{"item":"own_m01:first5 shared","stage_a_ms":224.360834,"stage_c_ms":223.22158400000004,"diff":-0.005077757912060425},{"item":"own_m01:all8 direct","stage_a_ms":583.447792,"stage_c_ms":583.2052080000001,"diff":-0.0004157767041476185},{"item":"own_m01:all8 shared","stage_a_ms":335.64479200000005,"stage_c_ms":333.412625,"diff":-0.006650384731725736},{"item":"own_L02:all4 direct","stage_a_ms":1832.5829375,"stage_c_ms":1822.2179380000002,"diff":-0.005655951110261737},{"item":"own_L02:all4 shared","stage_a_ms":609.5127915,"stage_c_ms":613.883354,"diff":0.007170583720226986}],"over_3pct":[{"item":"tv4_000:q0 direct","stage_a_ms":36.484833,"stage_c_ms":37.824250000000006,"diff":0.03671161109604104}]}},"loads_and_warm_up":[{"run_id":"20261004-115502","form":"D512L512q16","stages":["delete","load_jit","warm_up"],"delete":[{"path":"cache:ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2","cache_entries":[["ab60bacd00d9674c",2502232663]]}],"load_jit":{"wall_s":4.161696208,"aimodel_s":3.331103667,"main_s":0.482790125,"tokenizer_s":0.34346329200000003,"cache_bytes_added":2502232663,"peak_footprint_mb":220.892272,"min_available_mb":3319.100304,"shape":{"call_lengths":32,"call_max":512,"dynamic":true,"graph_max":512,"graph_min":2,"multiple":16},"pass":true,"error":null},"warm_up":{"lengths":[{"length":16,"ms":69.12920900000002},{"length":32,"ms":25.370125},{"length":48,"ms":22.317084},{"length":64,"ms":25.709333},{"length":80,"ms":31.548},{"length":96,"ms":31.437125},{"length":112,"ms":36.9025},{"length":128,"ms":37.905708000000004},{"length":144,"ms":51.913292000000006},{"length":160,"ms":54.01716700000001},{"length":176,"ms":56.904417},{"length":192,"ms":59.86383300000001},{"length":208,"ms":63.17441700000001},{"length":224,"ms":65.227417},{"length":240,"ms":69.509208},{"length":256,"ms":71.8615},{"length":272,"ms":88.49037500000001},{"length":288,"ms":96.90908300000001},{"length":304,"ms":95.443208},{"length":320,"ms":102.44158300000001},{"length":336,"ms":110.697709},{"length":352,"ms":106.17408400000001},{"length":368,"ms":107.889917},{"length":384,"ms":111.76},{"length":400,"ms":123.799667},{"length":416,"ms":128.170375},{"length":432,"ms":129.4695},{"length":448,"ms":136.90891700000003},{"length":464,"ms":139.481084},{"length":480,"ms":141.87870800000002},{"length":496,"ms":143.933375},{"length":512,"ms":146.34612500000003}],"ms_total":2682.5840450000005,"ms_max":146.34612500000003,"wall_s":2.754640833,"metal_cache_bytes":[16173872,16157488],"thermal":["nominal","nominal"],"pass":true,"error":null}},{"run_id":"20261004-115524","form":"D512L512q16","stages":["load_jit","warm_up"],"load_jit":{"wall_s":0.863493375,"aimodel_s":0.0019147920000000002,"main_s":0.508553875,"tokenizer_s":0.3458375,"cache_bytes_added":0,"peak_footprint_mb":199.446288,"min_available_mb":3340.546288,"shape":{"call_lengths":32,"call_max":512,"dynamic":true,"graph_max":512,"graph_min":2,"multiple":16},"pass":true,"error":null},"warm_up":{"lengths":[{"length":16,"ms":44.536667},{"length":32,"ms":21.004250000000003},{"length":48,"ms":22.550458000000003},{"length":64,"ms":25.697375},{"length":80,"ms":29.281333000000004},{"length":96,"ms":31.567791000000003},{"length":112,"ms":35.157917000000005},{"length":128,"ms":37.417125000000006},{"length":144,"ms":51.920291},{"length":160,"ms":53.962250000000004},{"length":176,"ms":56.62637500000001},{"length":192,"ms":60.26545900000001},{"length":208,"ms":62.168583000000005},{"length":224,"ms":66.563125},{"length":240,"ms":67.818584},{"length":256,"ms":74.522709},{"length":272,"ms":88.037},{"length":288,"ms":98.403583},{"length":304,"ms":93.50008300000002},{"length":320,"ms":103.370417},{"length":336,"ms":106.05983300000001},{"length":352,"ms":108.61358300000002},{"length":368,"ms":110.71283300000002},{"length":384,"ms":109.62370900000002},{"length":400,"ms":121.54920800000001},{"length":416,"ms":125.468833},{"length":432,"ms":129.860709},{"length":448,"ms":131.012166},{"length":464,"ms":139.09941700000002},{"length":480,"ms":141.79925000000003},{"length":496,"ms":145.328125},{"length":512,"ms":145.81475000000003}],"ms_total":2639.313791,"ms_max":145.81475000000003,"wall_s":2.711239042,"metal_cache_bytes":[16157488,16157488],"thermal":["nominal","nominal"],"pass":true,"error":null}}],"gate":{"D512L512q16":{"path":"$ZOO_WORK_ROOT/_kev/results/r13_gate_D512L512q16_diag.json","pass":true,"run_id":"20261004-125820","stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_ship/kev_0_8b_decode_fp16_metal_dyn512.aimodel","asset_bytes":1505417274,"asset_main_hash":"ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":1.332896833,"aimodel_s":0.001341708,"main_s":0.9813785,"tokenizer_s":0.346105916,"chunk":512,"shape":{"call_lengths":32,"call_max":512,"dynamic":true,"graph_max":512,"graph_min":2,"multiple":16},"bundle_name":"kev_0_8b_decode_fp16_metal_dyn512","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,-1],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,-1,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":20024034127,"cache_bytes_after":20024034127,"cache_bytes_added":0,"cache_state":"warm (entry present)","peak_footprint_mb":199.249008,"min_available_mb":3340.743568,"available_mb_before":3518.01996,"free_gb_before":126.723938018,"free_gb_after":126.723938018,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm_up":{"call_lengths":[16,32,48,64,80,96,112,128,144,160,176,192,208,224,240,256,272,288,304,320,336,352,368,384,400,416,432,448,464,480,496,512],"kind":"jit","lengths":[{"length":16,"ms":58.912667},{"length":32,"ms":21.473875},{"length":48,"ms":22.062333},{"length":64,"ms":25.616708000000003},{"length":80,"ms":30.463667000000004},{"length":96,"ms":31.218042},{"length":112,"ms":37.854541000000005},{"length":128,"ms":37.427},{"length":144,"ms":51.830959},{"length":160,"ms":53.992333},{"length":176,"ms":56.334541},{"length":192,"ms":60.043000000000006},{"length":208,"ms":62.016375000000004},{"length":224,"ms":66.31108400000001},{"length":240,"ms":67.705583},{"length":256,"ms":78.486417},{"length":272,"ms":87.764666},{"length":288,"ms":97.287542},{"length":304,"ms":93.458709},{"length":320,"ms":104.07737500000002},{"length":336,"ms":106.13162500000001},{"length":352,"ms":110.50291700000001},{"length":368,"ms":109.47525000000002},{"length":384,"ms":109.288791},{"length":400,"ms":125.281208},{"length":416,"ms":127.22529200000002},{"length":432,"ms":126.960083},{"length":448,"ms":132.07637499999998},{"length":464,"ms":140.02283400000002},{"length":480,"ms":143.341666},{"length":496,"ms":144.95408300000003},{"length":512,"ms":143.013291}],"memory":{"min_available_mb":2169.221384,"peak_footprint_mb":1370.771192},"ms_max":144.95408300000003,"ms_total":2662.6108320000003,"pass":true,"storage_after":{"caches":{"bytes":20040369239,"dirs":[{"bytes":20024034127,"dir":"coreai-cache","files":57},{"bytes":20024034127,"dir":"coreai-cache/24A437","files":48},{"bytes":16223192,"dir":"com.daisukemajima.kevgate","files":5},{"bytes":16223192,"dir":"com.daisukemajima.kevgate/com.apple.metal","files":4},{"bytes":111920,"dir":"com.apple.dyld","files":1},{"bytes":0,"dir":"com.daisukemajima.kevgate/com.apple.metalfe","files":1},{"bytes":0,"dir":"coreai-cache/sync","files":9}],"dirs_total":7,"exists":true,"files":63,"path":"<app container>/Library/Caches"},"coreai_cache":{"bytes":20024034127,"dirs":[{"bytes":20024034127,"dir":"24A437","files":48},{"bytes":20024034127,"dir":"24A437/com.daisukemajima.kevgate","files":48},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416","files":6},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416/3EED337528B9C2FCA4B6816CDCDED1FEC0A9E9EBA265A286147FA655E86F35B1","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":0,"dir":"sync","files":9},{"bytes":0,"dir":"sync/24A437","files":9}],"dirs_total":20,"exists":true,"files":57,"path":"<app container>/Library/Caches/coreai-cache"},"free_gb":126.723938018,"tmp":{"bytes":0,"dirs":[],"dirs_total":0,"exists":true,"files":0,"path":"/private<app container>/tmp"}},"storage_before":{"caches":{"bytes":20040434775,"dirs":[{"bytes":20024034127,"dir":"coreai-cache","files":57},{"bytes":20024034127,"dir":"coreai-cache/24A437","files":48},{"bytes":16288728,"dir":"com.daisukemajima.kevgate","files":5},{"bytes":16288728,"dir":"com.daisukemajima.kevgate/com.apple.metal","files":4},{"bytes":111920,"dir":"com.apple.dyld","files":1},{"bytes":0,"dir":"com.daisukemajima.kevgate/com.apple.metalfe","files":1},{"bytes":0,"dir":"coreai-cache/sync","files":9}],"dirs_total":7,"exists":true,"files":63,"path":"<app container>/Library/Caches"},"coreai_cache":{"bytes":20024034127,"dirs":[{"bytes":20024034127,"dir":"24A437","files":48},{"bytes":20024034127,"dir":"24A437/com.daisukemajima.kevgate","files":48},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416","files":6},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416/3EED337528B9C2FCA4B6816CDCDED1FEC0A9E9EBA265A286147FA655E86F35B1","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":0,"dir":"sync","files":9},{"bytes":0,"dir":"sync/24A437","files":9}],"dirs_total":20,"exists":true,"files":57,"path":"<app container>/Library/Caches/coreai-cache"},"free_gb":126.723938018,"tmp":{"bytes":0,"dirs":[],"dirs_total":0,"exists":true,"files":0,"path":"/private<app container>/tmp"}},"t_end_s":7.79897475,"t_start_s":4.81689775,"thermal_end":"nominal","thermal_start":"nominal","wall_s":2.736473375},"e2e_fixture":{"rows":39,"bar":{"questions":39,"questions_non_near_tie":38,"argmax_equal_non_near_tie":38,"near_tie_questions":1,"argmax_equal_near_tie":1,"max_abs_dp":0.0033832192420959473,"worst_row":"tv4_006:q0","mean_of_run_mean_abs_dp":0.0005623065916706509,"pass":true},"ids_equal_oracle":39,"finite_rows":39,"pass":true,"shared":{"records":7,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"shared_bar":{"questions":29,"questions_non_near_tie":29,"argmax_equal_non_near_tie":29,"near_tie_questions":0,"argmax_equal_near_tie":0,"max_abs_dp":0.003066152334213257,"worst_row":"own_t04:q2","mean_of_run_mean_abs_dp":0.0005104245226493806,"pass":true},"prepared_equal_shared":{"records":7,"equal":7},"shared_max_abs_dp_direct":0.0008350014686584473,"vs_mac_same_form_r11_python":{"rows":39,"missing":0,"max_abs_dp":0.0014469623565673828,"median_abs_dp":0.00020110979676246643,"argmax_equal":39,"p_bit_equal":0,"worst_row":"own_t05:q1"},"vs_mac_u16_r7_swift_reference":{"rows":39,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0015651285648345947,"median_abs_dp":0.0002314448356628418},"calls_total":39,"call_ms_median":64.53,"seconds":40.974244458,"thermal":["nominal","nominal"]}}}},"gate_status":"held: run 20261004-124130 (D512 L512 q16) stopped writing at 26 s (e2e_fixture 373/384, footprint 3,495 MB, available 44.7 MB; no jetsam report), terminated at 12:52, not retried; its 385 questions are inside the bar (373/373, near-tie 11/12, max|dp| 0.0107); held-out and reset not reached. The supervisor holds the device gate until the memory workaround is chosen.","memory":{"path":"results/r13_c_memory.json","gate_frozen":{"warm_up_mb_per_call":36.384375,"warm_up_calls":32,"e2e_records":370,"e2e_calls":439,"e2e_mb_per_call_mean":4.83872437357631,"last_samples":[[25.45,"e2e_fixture",17.81,3452.7,87.3,"nominal"],[25.56,"e2e_fixture",17.92,3496.9,43.1,"nominal"],[25.66,"e2e_fixture",18.02,3495.3,44.7,"nominal"]]},"diag_pause":{"run":"20261004-125820","pause_s":2.0,"kept_mb_one_call_records":[-32.80000000000018,0.3000000000001819,0.3999999999998636,0.0,0.40000000000009095,0.3999999999998636,32.40000000000009,13.299999999999955,15.100000000000136,44.09999999999991],"kept_mb_shared_prepared_records":[116.70000000000005,149.89999999999986,134.80000000000018,66.29999999999995,87.5,134.79999999999995,102.09999999999991]},"bench_first_last_mb":{"U16":[254.857,332.337032,3842],"D512L128q16":[296.603384,3089.027048,619],"D512L256q16":[536.383224,2091.519976,383],"D512L512q16":[1355.976464,3069.071312,290],"K128":[224.317176,308.596568,622]}},"call_length_diag":{"path":"results/r13_c_lengths.json","readings":[{"run":"20261004-130144","call_max":"512","multiple":"16","calls":20,"call_lengths_used":[64,80,96,112,144,176,192,240,336],"footprint_mb":{"e2e_first_sample":205.8,"e2e_last_sample":490.6,"e2e_max":498.0,"first_record":256.970488,"last_record":490.557176},"mb_per_call":12.294036210526318,"mean_delta_when_length_changed":13.809784470588237,"n_changed":17,"bar":{"questions":20,"argmax_equal_non_near_tie":18,"questions_non_near_tie":18,"argmax_equal_near_tie":2,"near_tie_questions":2,"max_abs_dp":0.0033832192420959473,"mean_of_run_mean_abs_dp":0.0007263973267981783,"bar_pass":true},"rows_padded_to_96_ms":{"n":6,"median":32.0651875,"values":[31.996709000000006,32.262416,32.923084,32.037625,31.903875000000006,32.09275]},"call_ms_median":31.39},{"run":"20261004-130156","call_max":"128","multiple":"128","calls":26,"call_lengths_used":[128],"footprint_mb":{"e2e_first_sample":205.6,"e2e_last_sample":265.7,"e2e_max":295.7,"first_record":280.465144,"last_record":265.670392},"mb_per_call":-0.5917900800000007,"mean_delta_when_length_changed":null,"n_changed":0,"bar":{"questions":20,"argmax_equal_non_near_tie":18,"questions_non_near_tie":18,"argmax_equal_near_tie":2,"near_tie_questions":2,"max_abs_dp":0.0034315288066864014,"mean_of_run_mean_abs_dp":0.0007403169816825539,"bar_pass":true},"rows_padded_to_96_ms":{"n":6,"median":37.870458500000005,"values":[37.95441700000001,39.501875000000005,39.393792000000005,37.786500000000004,37.727375,37.592042000000006]},"call_ms_median":37.135},{"run":"20261004-130253","call_max":"512","multiple":"512","calls":20,"call_lengths_used":[512],"footprint_mb":{"e2e_first_sample":205.7,"e2e_last_sample":282.2,"e2e_max":350.3,"first_record":337.46508,"last_record":282.00524},"mb_per_call":-2.9189389473684204,"mean_delta_when_length_changed":null,"n_changed":0,"bar":{"questions":20,"argmax_equal_non_near_tie":18,"questions_non_near_tie":18,"argmax_equal_near_tie":2,"near_tie_questions":2,"max_abs_dp":0.0033832192420959473,"mean_of_run_mean_abs_dp":0.0007244711567182093,"bar_pass":true},"rows_padded_to_96_ms":{"n":6,"median":139.0887705,"values":[141.865833,138.955458,139.007958,137.12358300000002,139.219167,139.16958300000002]},"call_ms_median":135.725}]}},"device_end":{"note":"see stage_c loads and the cleanup log logs/r13_cleanup.txt"},"probe_dynamic":[{"label":"D128 launch 1 (cold lengths, rows L128)","schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113230/probe_dyn_20261004-113230.json","bin":"_work/device_runs/20261004-113230/probe_dyn_20261004-113230_hidden.bin","bin_sha256":"e9c5cd802db59cfea4aecf3ace0cf93a5a46f35ece47347636998b6478460743","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":4.149053416,"load_aimodel_s":3.733344125,"load_main_s":0.415698958,"cache_bytes_before":15019568821,"cache_bytes_after_load":17521801464,"cache_bytes_added_by_load":2502232643,"cache_bytes_after_lengths":17521801464,"cache_bytes_end":17521801464,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440"},"load_memory":{"peak_footprint_mb":94.081792,"min_available_mb":3445.910784},"passes_memory":{"peak_footprint_mb":333.811424,"min_available_mb":3206.181152,"duration_s":10.387019041},"lengths":[{"s":16,"first_ms":472.77908300000007,"second_ms":16.091834000000002,"warm_median_ms":15.542208000000002,"finite":true,"first_hidden_sha256":"b4aeda4756f76f40ea31aab33d7284db1bded0de6ad06574ab9a5763cf10edd1","error":null},{"s":32,"first_ms":22.797792,"second_ms":31.690792000000002,"warm_median_ms":19.363375,"finite":true,"first_hidden_sha256":"0c589dc1fa309f1f593b7c2befece46148bc91fb66fd51eef269393f2c9683f5","error":null},{"s":48,"first_ms":204.745167,"second_ms":127.80758300000001,"warm_median_ms":22.180084000000004,"finite":true,"first_hidden_sha256":"a30dfc79830aa74cd73f6b1087ea79a1670b87be1d44f1ac55aee433a55d2aa2","error":null},{"s":64,"first_ms":25.845792000000003,"second_ms":24.430833000000003,"warm_median_ms":24.571375000000003,"finite":true,"first_hidden_sha256":"8e990d9636e309c8ed531c1b66480a6a4aa52c3e1143b3f7a127da7c0bf15dec","error":null},{"s":80,"first_ms":214.77266700000004,"second_ms":28.376834000000002,"warm_median_ms":28.580709000000002,"finite":true,"first_hidden_sha256":"ed6108ff6745ab21a0858268cae2f8b23cc0a5897ca6ebde155962b8606db37f","error":null},{"s":96,"first_ms":32.031000000000006,"second_ms":31.189167000000005,"warm_median_ms":31.341208,"finite":true,"first_hidden_sha256":"55f78ce314ff3ca8962443c2a7c1f0c07600ac821a05e06d00b1a0847e8f872f","error":null},{"s":112,"first_ms":127.275583,"second_ms":34.248958,"warm_median_ms":34.403541000000004,"finite":true,"first_hidden_sha256":"bad30599baea0434804d2573e61fea60986723d4142f15e99039a14c6083f6ff","error":null},{"s":128,"first_ms":40.858417,"second_ms":36.84308300000001,"warm_median_ms":37.598792,"finite":true,"first_hidden_sha256":"93f9af11d244bf589d7fbf46221c5bb0ca9c3e37d9236c6ab481b28b82118a26","error":null},{"s":8,"first_ms":617.050959,"second_ms":112.296875,"warm_median_ms":15.310291000000001,"finite":true,"first_hidden_sha256":"136b7b6bb08ed5f2d1ac27daef33d850c7de36fd5d9719ef1f1c5267f69a0edb","error":null},{"s":24,"first_ms":405.1775,"second_ms":17.741208,"warm_median_ms":17.716916,"finite":true,"first_hidden_sha256":"db04b9aa810a475d872a858cba07efacbdca89ce288f04c621143ea728bb2e45","error":null},{"s":94,"first_ms":560.351708,"second_ms":31.034250000000004,"warm_median_ms":31.171833000000003,"finite":true,"first_hidden_sha256":"977df1bba8d711d3525ee84e4565b688a32928474d744ca728212ecd4ec1c84e","error":null},{"s":127,"first_ms":217.36633400000002,"second_ms":37.057917,"warm_median_ms":37.267,"finite":true,"first_hidden_sha256":"036a6040bd20b34a3cbecfb064fd43e9142361b3d1a9df53ba3a09bb20c5abfa","error":null},{"s":2,"first_ms":370.9356250000001,"second_ms":13.445625000000001,"warm_median_ms":13.192166000000002,"finite":true,"first_hidden_sha256":"5dc3e839ae7e7838748c31d3517d656e3aa557fde99e5424e6c0102c9c93262c","error":null}],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":30.925416000000002,"graph_ms_timed":[30.9125,30.882166,31.071916,30.925416000000002,30.962958000000004],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[128,128,128],"p":[0.3404892086982727,0.22809110581874847,0.1520783007144928,0.27934136986732483],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.0005775392055511475,"mean_abs_dp":0.00038537755608558655,"finite":true,"graph_ms_median":109.530375,"graph_ms_timed":[109.530375,109.46891700000002,109.65437500000002,109.68441700000001,109.26787500000002],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":9.676814079284668e-05,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[128,128,128,128,128,128,128,128,128,128,128,112],"p":[0.17661789059638977,0.030022727325558662,0.07260291278362274,0.6022560596466064,0.11850042641162872],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.005452513694763184,"mean_abs_dp":0.0021810151636600496,"finite":true,"graph_ms_median":461.48483400000003,"graph_ms_timed":[454.75950000000006,461.48483400000003,465.1733750000001,464.061125,461.12504200000006],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0003300309181213379,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.005452513694763184,"mean_of_row_mean_abs_dp":0.0012095195551713308,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]},{"label":"D128 launch 2","schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113253/probe_dyn_20261004-113253.json","bin":"_work/device_runs/20261004-113253/probe_dyn_20261004-113253_hidden.bin","bin_sha256":"e9c5cd802db59cfea4aecf3ace0cf93a5a46f35ece47347636998b6478460743","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":0.32152579200000003,"load_aimodel_s":0.002305333,"load_main_s":0.319210667,"cache_bytes_before":17521801464,"cache_bytes_after_load":17521801464,"cache_bytes_added_by_load":0,"cache_bytes_after_lengths":17521801464,"cache_bytes_end":17521801464,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440"},"load_memory":{"peak_footprint_mb":30.36384,"min_available_mb":3509.628736},"passes_memory":{"peak_footprint_mb":339.218192,"min_available_mb":3200.774384,"duration_s":6.820368709},"lengths":[{"s":16,"first_ms":41.817542,"second_ms":15.630792000000001,"warm_median_ms":15.419292,"finite":true,"first_hidden_sha256":"b4aeda4756f76f40ea31aab33d7284db1bded0de6ad06574ab9a5763cf10edd1","error":null},{"s":32,"first_ms":21.088500000000003,"second_ms":19.551417,"warm_median_ms":19.373208,"finite":true,"first_hidden_sha256":"0c589dc1fa309f1f593b7c2befece46148bc91fb66fd51eef269393f2c9683f5","error":null},{"s":48,"first_ms":22.971542,"second_ms":22.064125,"warm_median_ms":22.059041,"finite":true,"first_hidden_sha256":"a30dfc79830aa74cd73f6b1087ea79a1670b87be1d44f1ac55aee433a55d2aa2","error":null},{"s":64,"first_ms":25.954708000000004,"second_ms":24.416334000000003,"warm_median_ms":24.534292000000004,"finite":true,"first_hidden_sha256":"8e990d9636e309c8ed531c1b66480a6a4aa52c3e1143b3f7a127da7c0bf15dec","error":null},{"s":80,"first_ms":29.483833,"second_ms":28.319667000000003,"warm_median_ms":28.585084000000002,"finite":true,"first_hidden_sha256":"ed6108ff6745ab21a0858268cae2f8b23cc0a5897ca6ebde155962b8606db37f","error":null},{"s":96,"first_ms":32.135417,"second_ms":31.095458000000004,"warm_median_ms":31.307792,"finite":true,"first_hidden_sha256":"55f78ce314ff3ca8962443c2a7c1f0c07600ac821a05e06d00b1a0847e8f872f","error":null},{"s":112,"first_ms":35.362083000000005,"second_ms":34.127375,"warm_median_ms":34.468125,"finite":true,"first_hidden_sha256":"bad30599baea0434804d2573e61fea60986723d4142f15e99039a14c6083f6ff","error":null},{"s":128,"first_ms":39.003833,"second_ms":36.304125,"warm_median_ms":37.012625,"finite":true,"first_hidden_sha256":"93f9af11d244bf589d7fbf46221c5bb0ca9c3e37d9236c6ab481b28b82118a26","error":null},{"s":8,"first_ms":16.233125,"second_ms":14.781,"warm_median_ms":14.7615,"finite":true,"first_hidden_sha256":"136b7b6bb08ed5f2d1ac27daef33d850c7de36fd5d9719ef1f1c5267f69a0edb","error":null},{"s":24,"first_ms":18.907833000000004,"second_ms":17.763709000000002,"warm_median_ms":17.685125000000003,"finite":true,"first_hidden_sha256":"db04b9aa810a475d872a858cba07efacbdca89ce288f04c621143ea728bb2e45","error":null},{"s":94,"first_ms":32.92879200000001,"second_ms":30.966333000000002,"warm_median_ms":31.105334000000003,"finite":true,"first_hidden_sha256":"977df1bba8d711d3525ee84e4565b688a32928474d744ca728212ecd4ec1c84e","error":null},{"s":127,"first_ms":38.144333,"second_ms":36.8145,"warm_median_ms":37.409000000000006,"finite":true,"first_hidden_sha256":"036a6040bd20b34a3cbecfb064fd43e9142361b3d1a9df53ba3a09bb20c5abfa","error":null},{"s":2,"first_ms":15.194625000000002,"second_ms":13.219166000000001,"warm_median_ms":13.180916000000002,"finite":true,"first_hidden_sha256":"5dc3e839ae7e7838748c31d3517d656e3aa557fde99e5424e6c0102c9c93262c","error":null}],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":31.096125,"graph_ms_timed":[31.103792000000002,31.036417000000004,31.095625000000002,31.097000000000005,31.096125],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[128,128,128],"p":[0.3404892086982727,0.22809110581874847,0.1520783007144928,0.27934136986732483],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.0005775392055511475,"mean_abs_dp":0.00038537755608558655,"finite":true,"graph_ms_median":109.98808300000002,"graph_ms_timed":[110.00129200000002,109.66120800000002,109.682333,109.98808300000002,110.04008300000001],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":9.676814079284668e-05,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[128,128,128,128,128,128,128,128,128,128,128,112],"p":[0.17661789059638977,0.030022727325558662,0.07260291278362274,0.6022560596466064,0.11850042641162872],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.005452513694763184,"mean_abs_dp":0.0021810151636600496,"finite":true,"graph_ms_median":461.45858300000003,"graph_ms_timed":[474.67595800000004,461.243959,461.45858300000003,467.71595800000006,460.99716700000005],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0003300309181213379,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.005452513694763184,"mean_of_row_mean_abs_dp":0.0012095195551713308,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]},{"label":"D128 launch 3","schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113315/probe_dyn_20261004-113315.json","bin":"_work/device_runs/20261004-113315/probe_dyn_20261004-113315_hidden.bin","bin_sha256":"e9c5cd802db59cfea4aecf3ace0cf93a5a46f35ece47347636998b6478460743","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":0.17225779200000002,"load_aimodel_s":0.001215958,"load_main_s":0.17103200000000002,"cache_bytes_before":17521801464,"cache_bytes_after_load":17521801464,"cache_bytes_added_by_load":0,"cache_bytes_after_lengths":17521801464,"cache_bytes_end":17521801464,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440"},"load_memory":{"peak_footprint_mb":29.904392,"min_available_mb":3510.088184},"passes_memory":{"peak_footprint_mb":341.413624,"min_available_mb":3198.578952,"duration_s":6.711107333},"lengths":[{"s":16,"first_ms":39.0525,"second_ms":15.637542000000002,"warm_median_ms":15.389542,"finite":true,"first_hidden_sha256":"b4aeda4756f76f40ea31aab33d7284db1bded0de6ad06574ab9a5763cf10edd1","error":null},{"s":32,"first_ms":20.871584000000002,"second_ms":19.414083,"warm_median_ms":19.176416000000003,"finite":true,"first_hidden_sha256":"0c589dc1fa309f1f593b7c2befece46148bc91fb66fd51eef269393f2c9683f5","error":null},{"s":48,"first_ms":22.8305,"second_ms":21.913417000000003,"warm_median_ms":21.941583,"finite":true,"first_hidden_sha256":"a30dfc79830aa74cd73f6b1087ea79a1670b87be1d44f1ac55aee433a55d2aa2","error":null},{"s":64,"first_ms":25.860375,"second_ms":24.279958,"warm_median_ms":24.442125,"finite":true,"first_hidden_sha256":"8e990d9636e309c8ed531c1b66480a6a4aa52c3e1143b3f7a127da7c0bf15dec","error":null},{"s":80,"first_ms":29.535208000000004,"second_ms":28.331084000000004,"warm_median_ms":28.488041000000003,"finite":true,"first_hidden_sha256":"ed6108ff6745ab21a0858268cae2f8b23cc0a5897ca6ebde155962b8606db37f","error":null},{"s":96,"first_ms":31.718208000000004,"second_ms":30.925500000000003,"warm_median_ms":31.142417000000002,"finite":true,"first_hidden_sha256":"55f78ce314ff3ca8962443c2a7c1f0c07600ac821a05e06d00b1a0847e8f872f","error":null},{"s":112,"first_ms":35.244333000000005,"second_ms":34.084,"warm_median_ms":34.362125,"finite":true,"first_hidden_sha256":"bad30599baea0434804d2573e61fea60986723d4142f15e99039a14c6083f6ff","error":null},{"s":128,"first_ms":37.55266700000001,"second_ms":36.165334,"warm_median_ms":36.946459000000004,"finite":true,"first_hidden_sha256":"93f9af11d244bf589d7fbf46221c5bb0ca9c3e37d9236c6ab481b28b82118a26","error":null},{"s":8,"first_ms":16.7785,"second_ms":15.207666000000001,"warm_median_ms":14.564583,"finite":true,"first_hidden_sha256":"136b7b6bb08ed5f2d1ac27daef33d850c7de36fd5d9719ef1f1c5267f69a0edb","error":null},{"s":24,"first_ms":18.735041000000002,"second_ms":17.632,"warm_median_ms":17.609417,"finite":true,"first_hidden_sha256":"db04b9aa810a475d872a858cba07efacbdca89ce288f04c621143ea728bb2e45","error":null},{"s":94,"first_ms":32.68225,"second_ms":30.912666,"warm_median_ms":31.032416000000005,"finite":true,"first_hidden_sha256":"977df1bba8d711d3525ee84e4565b688a32928474d744ca728212ecd4ec1c84e","error":null},{"s":127,"first_ms":37.759750000000004,"second_ms":36.710958000000005,"warm_median_ms":37.384833,"finite":true,"first_hidden_sha256":"036a6040bd20b34a3cbecfb064fd43e9142361b3d1a9df53ba3a09bb20c5abfa","error":null},{"s":2,"first_ms":14.982333,"second_ms":13.293833000000001,"warm_median_ms":13.1465,"finite":true,"first_hidden_sha256":"5dc3e839ae7e7838748c31d3517d656e3aa557fde99e5424e6c0102c9c93262c","error":null}],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":30.989917000000002,"graph_ms_timed":[30.989917000000002,31.107750000000003,31.007333000000003,30.940666000000004,30.960084000000002],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[128,128,128],"p":[0.3404892086982727,0.22809110581874847,0.1520783007144928,0.27934136986732483],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.0005775392055511475,"mean_abs_dp":0.00038537755608558655,"finite":true,"graph_ms_median":109.45929100000001,"graph_ms_timed":[109.45929100000001,109.306959,109.558833,109.49950000000001,109.37162500000001],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":9.676814079284668e-05,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[128,128,128,128,128,128,128,128,128,128,128,112],"p":[0.17661789059638977,0.030022727325558662,0.07260291278362274,0.6022560596466064,0.11850042641162872],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.005452513694763184,"mean_abs_dp":0.0021810151636600496,"finite":true,"graph_ms_median":459.962083,"graph_ms_timed":[459.962083,459.515416,465.404375,459.745292,465.64666600000004],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0003300309181213379,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.005452513694763184,"mean_of_row_mean_abs_dp":0.0012095195551713308,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]},{"label":"D512 launch 1 (lengths, rows L128)","schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113858/probe_dyn_20261004-113858.json","bin":"_work/device_runs/20261004-113858/probe_dyn_20261004-113858_hidden.bin","bin_sha256":"e9c5cd802db59cfea4aecf3ace0cf93a5a46f35ece47347636998b6478460743","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":5.081608125,"load_aimodel_s":4.617166125,"load_main_s":0.46443166700000005,"cache_bytes_before":17521801464,"cache_bytes_after_load":20024034127,"cache_bytes_added_by_load":2502232663,"cache_bytes_after_lengths":20024034127,"cache_bytes_end":20024034127,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2"},"load_memory":{"peak_footprint_mb":89.674496,"min_available_mb":3450.31808},"passes_memory":{"peak_footprint_mb":510.480072,"min_available_mb":3029.512504,"duration_s":10.387466875},"lengths":[{"s":16,"first_ms":276.80241700000005,"second_ms":17.37975,"warm_median_ms":15.648458,"finite":true,"first_hidden_sha256":"b4aeda4756f76f40ea31aab33d7284db1bded0de6ad06574ab9a5763cf10edd1","error":null},{"s":32,"first_ms":23.245667,"second_ms":20.174833000000003,"warm_median_ms":19.568125000000002,"finite":true,"first_hidden_sha256":"0c589dc1fa309f1f593b7c2befece46148bc91fb66fd51eef269393f2c9683f5","error":null},{"s":48,"first_ms":22.939375000000002,"second_ms":22.090833,"warm_median_ms":22.144666,"finite":true,"first_hidden_sha256":"a30dfc79830aa74cd73f6b1087ea79a1670b87be1d44f1ac55aee433a55d2aa2","error":null},{"s":64,"first_ms":25.986541000000003,"second_ms":24.282,"warm_median_ms":24.490167,"finite":true,"first_hidden_sha256":"8e990d9636e309c8ed531c1b66480a6a4aa52c3e1143b3f7a127da7c0bf15dec","error":null},{"s":80,"first_ms":29.892833,"second_ms":28.487375000000004,"warm_median_ms":28.64025,"finite":true,"first_hidden_sha256":"ed6108ff6745ab21a0858268cae2f8b23cc0a5897ca6ebde155962b8606db37f","error":null},{"s":96,"first_ms":32.005292000000004,"second_ms":31.073458000000002,"warm_median_ms":31.314500000000002,"finite":true,"first_hidden_sha256":"55f78ce314ff3ca8962443c2a7c1f0c07600ac821a05e06d00b1a0847e8f872f","error":null},{"s":112,"first_ms":35.676542000000005,"second_ms":34.205209,"warm_median_ms":34.45725,"finite":true,"first_hidden_sha256":"bad30599baea0434804d2573e61fea60986723d4142f15e99039a14c6083f6ff","error":null},{"s":128,"first_ms":38.903458,"second_ms":37.138042000000006,"warm_median_ms":38.25083300000001,"finite":true,"first_hidden_sha256":"93f9af11d244bf589d7fbf46221c5bb0ca9c3e37d9236c6ab481b28b82118a26","error":null},{"s":192,"first_ms":398.854959,"second_ms":67.18004200000001,"warm_median_ms":62.117125,"finite":true,"first_hidden_sha256":"84a12b2d4877c805dcbcd595154afb226ea219a9322136e8aafd95519ec1979d","error":null},{"s":256,"first_ms":404.89829100000003,"second_ms":71.99900000000001,"warm_median_ms":76.03945900000001,"finite":true,"first_hidden_sha256":"7c76ed26aad05f45f1f107d97174cb62a0474d7944e1204744460138910d57ba","error":null},{"s":384,"first_ms":111.544083,"second_ms":114.21370900000001,"warm_median_ms":118.241625,"finite":true,"first_hidden_sha256":"80206de3c13c5926af8186f42a9b707eaca0e0380a9ebffcd9284a67016fb4c7","error":null},{"s":512,"first_ms":419.836125,"second_ms":140.16441600000002,"warm_median_ms":157.81900000000002,"finite":true,"first_hidden_sha256":"35d2d6c9955e61bd667002184503bd02d79e4cc335c1082b22d29d52d9acf417","error":null},{"s":94,"first_ms":36.445417,"second_ms":30.979292,"warm_median_ms":31.005667,"finite":true,"first_hidden_sha256":"977df1bba8d711d3525ee84e4565b688a32928474d744ca728212ecd4ec1c84e","error":null}],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":30.986750000000004,"graph_ms_timed":[31.051541,30.986750000000004,31.016292,30.906208,30.889125000000003],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[128,128,128],"p":[0.3404892086982727,0.22809110581874847,0.1520783007144928,0.27934136986732483],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.0005775392055511475,"mean_abs_dp":0.00038537755608558655,"finite":true,"graph_ms_median":111.01875000000001,"graph_ms_timed":[110.5705,110.56179200000001,111.01875000000001,111.155292,115.742042],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":9.676814079284668e-05,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[128,128,128,128,128,128,128,128,128,128,128,112],"p":[0.17661789059638977,0.030022727325558662,0.07260291278362274,0.6022560596466064,0.11850042641162872],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.005452513694763184,"mean_abs_dp":0.0021810151636600496,"finite":true,"graph_ms_median":469.1306670000001,"graph_ms_timed":[470.64654200000007,469.1306670000001,462.082666,470.637666,463.06075000000004],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0003300309181213379,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.005452513694763184,"mean_of_row_mean_abs_dp":0.0012095195551713308,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]},{"label":"D512 launch 2 (lengths again, rows L256)","schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113921/probe_dyn_20261004-113921.json","bin":"_work/device_runs/20261004-113921/probe_dyn_20261004-113921_hidden.bin","bin_sha256":"c1b6225a62f5e04e91280c4652ff5d4618434430068370ffcae9c66f2d1b88db","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":0.432769834,"load_aimodel_s":0.0015051250000000002,"load_main_s":0.43125391700000004,"cache_bytes_before":20024034127,"cache_bytes_after_load":20024034127,"cache_bytes_added_by_load":0,"cache_bytes_after_lengths":20024034127,"cache_bytes_end":20024034127,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2"},"load_memory":{"peak_footprint_mb":30.002816,"min_available_mb":3509.98976},"passes_memory":{"peak_footprint_mb":568.086288,"min_available_mb":2971.906288,"duration_s":9.316710292},"lengths":[{"s":16,"first_ms":40.344792000000005,"second_ms":16.582708,"warm_median_ms":15.465708000000001,"finite":true,"first_hidden_sha256":"b4aeda4756f76f40ea31aab33d7284db1bded0de6ad06574ab9a5763cf10edd1","error":null},{"s":32,"first_ms":21.138125000000002,"second_ms":19.611625,"warm_median_ms":19.483834,"finite":true,"first_hidden_sha256":"0c589dc1fa309f1f593b7c2befece46148bc91fb66fd51eef269393f2c9683f5","error":null},{"s":48,"first_ms":22.874542,"second_ms":22.201,"warm_median_ms":22.165292000000004,"finite":true,"first_hidden_sha256":"a30dfc79830aa74cd73f6b1087ea79a1670b87be1d44f1ac55aee433a55d2aa2","error":null},{"s":64,"first_ms":26.052834,"second_ms":24.466167000000002,"warm_median_ms":24.633833,"finite":true,"first_hidden_sha256":"8e990d9636e309c8ed531c1b66480a6a4aa52c3e1143b3f7a127da7c0bf15dec","error":null},{"s":80,"first_ms":29.666833000000004,"second_ms":28.390583,"warm_median_ms":28.527458000000003,"finite":true,"first_hidden_sha256":"ed6108ff6745ab21a0858268cae2f8b23cc0a5897ca6ebde155962b8606db37f","error":null},{"s":96,"first_ms":32.080042000000006,"second_ms":31.122709,"warm_median_ms":31.310291000000003,"finite":true,"first_hidden_sha256":"55f78ce314ff3ca8962443c2a7c1f0c07600ac821a05e06d00b1a0847e8f872f","error":null},{"s":112,"first_ms":35.50854100000001,"second_ms":34.203875000000004,"warm_median_ms":34.527,"finite":true,"first_hidden_sha256":"bad30599baea0434804d2573e61fea60986723d4142f15e99039a14c6083f6ff","error":null},{"s":128,"first_ms":37.64600000000001,"second_ms":36.591417,"warm_median_ms":37.074916,"finite":true,"first_hidden_sha256":"93f9af11d244bf589d7fbf46221c5bb0ca9c3e37d9236c6ab481b28b82118a26","error":null},{"s":192,"first_ms":61.03191700000001,"second_ms":60.081458000000005,"warm_median_ms":65.82541700000002,"finite":true,"first_hidden_sha256":"84a12b2d4877c805dcbcd595154afb226ea219a9322136e8aafd95519ec1979d","error":null},{"s":256,"first_ms":71.91391700000001,"second_ms":71.400375,"warm_median_ms":76.77708400000002,"finite":true,"first_hidden_sha256":"7c76ed26aad05f45f1f107d97174cb62a0474d7944e1204744460138910d57ba","error":null},{"s":384,"first_ms":109.05212500000002,"second_ms":110.253,"warm_median_ms":118.359791,"finite":true,"first_hidden_sha256":"80206de3c13c5926af8186f42a9b707eaca0e0380a9ebffcd9284a67016fb4c7","error":null},{"s":512,"first_ms":141.986584,"second_ms":147.36875000000003,"warm_median_ms":158.429292,"finite":true,"first_hidden_sha256":"35d2d6c9955e61bd667002184503bd02d79e4cc335c1082b22d29d52d9acf417","error":null},{"s":94,"first_ms":33.296125,"second_ms":30.934250000000002,"warm_median_ms":31.244209,"finite":true,"first_hidden_sha256":"977df1bba8d711d3525ee84e4565b688a32928474d744ca728212ecd4ec1c84e","error":null}],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":31.005417000000005,"graph_ms_timed":[31.230167,31.018041000000004,31.005417000000005,30.987750000000002,30.959708000000003],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[256,128],"p":[0.34047847986221313,0.22795036435127258,0.15229539573192596,0.2792757451534271],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.000794634222984314,"mean_abs_dp":0.00046111270785331726,"finite":true,"graph_ms_median":113.24854200000001,"graph_ms_timed":[112.851708,116.234209,116.411333,109.690375,113.24854200000001],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.00018796324729919434,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[256,256,256,256,256,240],"p":[0.17663322389125824,0.029993826523423195,0.0724891647696495,0.6023768186569214,0.11850697547197342],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.005331754684448242,"mean_abs_dp":0.0021327100694179535,"finite":true,"graph_ms_median":446.222708,"graph_ms_timed":[441.3982500000001,447.11175000000003,446.222708,449.88833300000005,445.31333300000006],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0002964586019515991,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.005331754684448242,"mean_of_row_mean_abs_dp":0.0012186629076798756,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]},{"label":"D512 launch 3 (rows L512)","schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113943/probe_dyn_20261004-113943.json","bin":"_work/device_runs/20261004-113943/probe_dyn_20261004-113943_hidden.bin","bin_sha256":"ae038097b0349bec058b793f337b7ccbf49c512b6ea0673b0ef960ea7e36a625","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":0.17929887500000002,"load_aimodel_s":0.001400917,"load_main_s":0.177887666,"cache_bytes_before":20024034127,"cache_bytes_after_load":20024034127,"cache_bytes_added_by_load":0,"cache_bytes_after_lengths":20024034127,"cache_bytes_end":20024034127,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2"},"load_memory":{"peak_footprint_mb":29.642032,"min_available_mb":3510.350544},"passes_memory":{"peak_footprint_mb":449.253136,"min_available_mb":3090.73944,"duration_s":4.617102375},"lengths":[],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":30.914375,"graph_ms_timed":[31.044709000000005,30.866125,30.914375,30.853417,30.953500000000002],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[384],"p":[0.34054088592529297,0.22806283831596375,0.15224213898181915,0.27915412187576294],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.0007413774728775024,"mean_abs_dp":0.0003736726939678192,"finite":true,"graph_ms_median":107.65325,"graph_ms_timed":[107.65325,110.47708300000001,108.456042,106.143917,106.640083],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0001347064971923828,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[512,512,496],"p":[0.17624886333942413,0.029838068410754204,0.07244009524583817,0.60317063331604,0.1183023452758789],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.00453794002532959,"mean_abs_dp":0.0018151834607124328,"finite":true,"graph_ms_median":434.215459,"graph_ms_timed":[435.467292,432.768791,434.215459,433.16283300000003,437.38170800000006],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0005845427513122559,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.00453794002532959,"mean_of_row_mean_abs_dp":0.0010836740334828694,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]}]},"memory_stage_c":{"schema":"kev-device-r13-memory/1","gate_frozen":{"run":"20261004-124130","status":"running","stage_order":["load_jit","warm_up","e2e_fixture"],"stages":{"load_jit":{"t_s":[2.22,3.58],"footprint_mb":[21.3,199.3],"peak_mb":199.3,"available_mb":[3518.7,3340.7],"min_available_mb":3340.7,"samples":15},"warm_up":{"t_s":[4.7,7.54],"footprint_mb":[206.2,1370.5],"peak_mb":1381.4,"available_mb":[3333.7,2169.5],"min_available_mb":2158.6,"samples":29},"e2e_fixture":{"t_s":[7.64,25.66],"footprint_mb":[1371.1,3495.3],"peak_mb":3496.9,"available_mb":[2168.9,44.7],"min_available_mb":43.1,"samples":173}},"warm_up_mb_per_call":36.384375,"warm_up_calls":32,"e2e_records":370,"e2e_calls":439,"e2e_mb_per_call_mean":4.83872437357631,"last_samples":[[25.45,"e2e_fixture",17.81,3452.7,87.3,"nominal"],[25.56,"e2e_fixture",17.92,3496.9,43.1,"nominal"],[25.66,"e2e_fixture",18.02,3495.3,44.7,"nominal"]]},"diag_pause":{"run":"20261004-125820","pause_s":2.0,"warm_up":{"min_available_mb":2169.221384,"peak_footprint_mb":1370.771192},"records":[{"record":"tv4_000","calls":1,"shared":false,"prepared":false,"footprint_start_mb":1359.4,"after_direct_mb":1375.129336,"after_rest_mb":1326.6,"kept_mb":-32.80000000000018},{"record":"tv4_001","calls":1,"shared":false,"prepared":false,"footprint_start_mb":1326.6,"after_direct_mb":1356.435192,"after_rest_mb":1326.9,"kept_mb":0.3000000000001819},{"record":"tv4_002","calls":1,"shared":false,"prepared":false,"footprint_start_mb":1326.9,"after_direct_mb":1356.975864,"after_rest_mb":1327.3,"kept_mb":0.3999999999998636},{"record":"tv4_003","calls":1,"shared":false,"prepared":false,"footprint_start_mb":1327.3,"after_direct_mb":1353.748216,"after_rest_mb":1327.3,"kept_mb":0.0},{"record":"tv4_004","calls":1,"shared":false,"prepared":false,"footprint_start_mb":1327.3,"after_direct_mb":1353.830136,"after_rest_mb":1327.7,"kept_mb":0.40000000000009095},{"record":"tv4_005","calls":1,"shared":false,"prepared":false,"footprint_start_mb":1327.7,"after_direct_mb":1357.926136,"after_rest_mb":1328.1,"kept_mb":0.3999999999998636},{"record":"tv4_006","calls":1,"shared":false,"prepared":false,"footprint_start_mb":1328.1,"after_direct_mb":1391.69356,"after_rest_mb":1360.5,"kept_mb":32.40000000000009},{"record":"tv4_007","calls":1,"shared":false,"prepared":false,"footprint_start_mb":1360.5,"after_direct_mb":1400.62284,"after_rest_mb":1373.8,"kept_mb":13.299999999999955},{"record":"tv4_008","calls":1,"shared":false,"prepared":false,"footprint_start_mb":1373.8,"after_direct_mb":1419.349752,"after_rest_mb":1388.9,"kept_mb":15.100000000000136},{"record":"tv4_009","calls":1,"shared":false,"prepared":false,"footprint_start_mb":1388.9,"after_direct_mb":1466.126072,"after_rest_mb":1433.0,"kept_mb":44.09999999999991},{"record":"own_t01","calls":14,"shared":true,"prepared":true,"footprint_start_mb":1433.0,"after_direct_mb":1465.388792,"after_rest_mb":1549.7,"kept_mb":116.70000000000005},{"record":"own_t02","calls":11,"shared":true,"prepared":true,"footprint_start_mb":1549.7,"after_direct_mb":1659.16248,"after_rest_mb":1699.6,"kept_mb":149.89999999999986},{"record":"own_t03","calls":11,"shared":true,"prepared":true,"footprint_start_mb":1699.6,"after_direct_mb":1801.899936,"after_rest_mb":1834.4,"kept_mb":134.80000000000018},{"record":"own_t04","calls":14,"shared":true,"prepared":true,"footprint_start_mb":1834.4,"after_direct_mb":1893.486496,"after_rest_mb":1900.7,"kept_mb":66.29999999999995},{"record":"own_t05","calls":14,"shared":true,"prepared":true,"footprint_start_mb":1900.7,"after_direct_mb":1974.439816,"after_rest_mb":1988.2,"kept_mb":87.5},{"record":"own_j03","calls":11,"shared":true,"prepared":true,"footprint_start_mb":1988.2,"after_direct_mb":2078.396296,"after_rest_mb":2123.0,"kept_mb":134.79999999999995},{"record":"own_m01","calls":26,"shared":true,"prepared":true,"footprint_start_mb":2123.0,"after_direct_mb":2204.438432,"after_rest_mb":2225.1,"kept_mb":102.09999999999991}],"kept_mb_one_call_records":[-32.80000000000018,0.3000000000001819,0.3999999999998636,0.0,0.40000000000009095,0.3999999999998636,32.40000000000009,13.299999999999955,15.100000000000136,44.09999999999991],"kept_mb_shared_prepared_records":[116.70000000000005,149.89999999999986,134.80000000000018,66.29999999999995,87.5,134.79999999999995,102.09999999999991],"bar":{"bar_pass":true,"max_abs_dp":0.0033832192420959473,"questions":39}},"bench":[{"run":"20261004-115603","form":"U16","warm_up_peak_mb":263.802664,"first_decision_mb":254.857,"last_decision_mb":332.337032,"calls":3842,"items":[{"item":"tv4_000:q0","decisions":[[0,"direct",6,254.857],[1,"direct",6,255.250216],[2,"direct",6,255.381288],[3,"direct",6,255.446824],[4,"direct",6,255.463208],[5,"direct",6,255.610664]],"first_mb":254.857,"last_mb":255.610664,"calls":36,"across_rest_mb":null},{"item":"own_j03:q0","decisions":[[0,"direct",24,252.202792],[1,"direct",24,252.366632],[2,"direct",24,252.64516],[3,"direct",24,252.759848],[4,"direct",24,252.694312],[5,"direct",24,252.694312]],"first_mb":252.202792,"last_mb":252.694312,"calls":144,"across_rest_mb":-3.407872000000026},{"item":"own_L02:q0","decisions":[[0,"direct",95,259.378984],[1,"direct",95,259.346216],[2,"direct",95,259.28068],[3,"direct",95,258.592552],[4,"direct",95,259.44452],[5,"direct",95,259.44452]],"first_mb":259.378984,"last_mb":259.44452,"calls":570,"across_rest_mb":6.684672000000006},{"item":"own_L01:q2","decisions":[[0,"direct",113,259.804968],[1,"direct",113,259.804968],[2,"direct",113,259.837736],[3,"direct",113,259.837736],[4,"direct",113,259.93604],[5,"direct",113,259.93604]],"first_mb":259.804968,"last_mb":259.93604,"calls":678,"across_rest_mb":0.3604479999999626},{"item":"own_m01:first5","decisions":[[0,"direct",51,253.005608],[0,"shared",19,313.511768],[0,"prepared",11,313.741144],[1,"prepared",11,313.64284],[1,"shared",19,313.64284],[1,"direct",51,313.64284],[2,"direct",51,313.610072],[2,"shared",19,313.593688],[2,"prepared",11,313.691992],[3,"prepared",11,313.593688],[3,"shared",19,313.56092],[3,"direct",51,313.216856],[4,"direct",51,313.31516],[4,"shared",19,313.31516],[4,"prepared",11,313.31516],[5,"prepared",11,313.31516],[5,"shared",19,313.331544],[5,"direct",51,313.31516]],"first_mb":253.005608,"last_mb":313.31516,"calls":486,"across_rest_mb":-6.930431999999996},{"item":"own_m01:all8","decisions":[[0,"direct",83,313.855832],[0,"shared",27,313.855832],[1,"shared",27,313.855832],[1,"direct",83,313.773912],[2,"direct",83,313.741144],[2,"shared",27,313.64284],[3,"shared",27,313.577304],[3,"direct",83,313.675608]],"first_mb":313.855832,"last_mb":313.675608,"calls":440,"across_rest_mb":0.5406720000000291},{"item":"own_L02:all4","decisions":[[0,"direct",380,329.387864],[0,"shared",104,332.287832],[0,"prepared",12,332.369752],[1,"prepared",12,332.304264],[1,"shared",104,332.38616],[1,"direct",380,328.699736],[2,"direct",380,328.126296],[2,"shared",104,332.12404],[2,"prepared",12,332.337032]],"first_mb":329.387864,"last_mb":332.337032,"calls":1488,"across_rest_mb":15.712255999999968}]},{"run":"20261004-120519","form":"D512L128q16","warm_up_peak_mb":349.884152,"first_decision_mb":296.603384,"last_decision_mb":3089.027048,"calls":619,"items":[{"item":"tv4_000:q0","decisions":[[0,"direct",1,296.603384],[1,"direct",1,296.652536],[2,"direct",1,297.225976],[3,"direct",1,297.193208],[4,"direct",1,297.193208],[5,"direct",1,297.193208]],"first_mb":296.603384,"last_mb":297.193208,"calls":6,"across_rest_mb":null},{"item":"own_j03:q0","decisions":[[0,"direct",3,296.324856],[1,"direct",3,296.144632],[2,"direct",3,297.16044],[3,"direct",3,297.16044],[4,"direct",3,297.16044],[5,"direct",3,297.16044]],"first_mb":296.324856,"last_mb":297.16044,"calls":18,"across_rest_mb":-0.8683520000000158},{"item":"own_L02:q0","decisions":[[0,"direct",12,302.845688],[1,"direct",12,303.501048],[2,"direct",12,303.566584],[3,"direct",12,303.63212],[4,"direct",12,303.615736],[5,"direct",12,303.648504]],"first_mb":302.845688,"last_mb":303.648504,"calls":72,"across_rest_mb":5.685248000000001},{"item":"own_L01:q2","decisions":[[0,"direct",15,313.62636],[1,"direct",15,334.909176],[2,"direct",15,359.517944],[3,"direct",15,384.110328],[4,"direct",15,408.751864],[5,"direct",15,433.360632]],"first_mb":313.62636,"last_mb":433.360632,"calls":90,"across_rest_mb":9.977855999999974},{"item":"own_m01:first5","decisions":[[0,"direct",10,560.500472],[0,"shared",6,657.9526],[0,"prepared",5,693.948248],[1,"prepared",5,729.927512],[1,"shared",6,765.939568],[1,"direct",10,900.435848],[2,"direct",10,1034.948512],[2,"shared",6,1070.911368],[2,"prepared",5,1106.907016],[3,"prepared",5,1142.902664],[3,"shared",6,1178.881952],[3,"direct",10,1313.312672],[4,"direct",10,1447.727008],[4,"shared",6,1483.67348],[4,"prepared",5,1519.63636],[5,"prepared",5,1555.615624],[5,"shared",6,1591.594912],[5,"direct",10,1726.042016]],"first_mb":560.500472,"last_mb":1726.042016,"calls":126,"across_rest_mb":127.13983999999994},{"item":"own_m01:all8","decisions":[[0,"direct",16,1944.014752],[0,"shared",9,1981.828976],[1,"shared",9,2017.85744],[1,"direct",16,2235.568032],[2,"direct",16,2453.311392],[2,"shared",9,2489.339784],[3,"shared",9,2525.122464],[3,"direct",16,2743.046048]],"first_mb":1944.014752,"last_mb":2743.046048,"calls":100,"across_rest_mb":217.97273599999994},{"item":"own_L02:all4","decisions":[[0,"direct",49,2801.324008],[0,"shared",16,2831.27396],[0,"prepared",4,2873.085928],[1,"prepared",4,2914.783208],[1,"shared",16,2956.480512],[1,"direct",49,2999.1936],[2,"direct",49,3023.736832],[2,"shared",16,3047.444456],[2,"prepared",4,3089.027048]],"first_mb":2801.324008,"last_mb":3089.027048,"calls":207,"across_rest_mb":58.277959999999894}]},{"run":"20261004-121755","form":"D512L256q16","warm_up_peak_mb":580.27596,"first_decision_mb":536.383224,"last_decision_mb":2091.519976,"calls":383,"items":[{"item":"tv4_000:q0","decisions":[[0,"direct",1,536.383224],[1,"direct",1,536.415992],[2,"direct",1,537.005816],[3,"direct",1,537.005816],[4,"direct",1,537.005816],[5,"direct",1,537.005816]],"first_mb":536.383224,"last_mb":537.005816,"calls":6,"across_rest_mb":null},{"item":"own_j03:q0","decisions":[[0,"direct",2,572.755704],[1,"direct",2,573.509368],[2,"direct",2,572.90316],[3,"direct",2,572.90316],[4,"direct",2,572.919544],[5,"direct",2,573.263608]],"first_mb":572.755704,"last_mb":573.263608,"calls":12,"across_rest_mb":35.749888000000055},{"item":"own_L02:q0","decisions":[[0,"direct",6,580.325112],[1,"direct",6,580.423416],[2,"direct",6,580.4398],[3,"direct",6,580.4398],[4,"direct",6,580.407032],[5,"direct",6,580.4398]],"first_mb":580.325112,"last_mb":580.4398,"calls":36,"across_rest_mb":7.0615040000000135},{"item":"own_L01:q2","decisions":[[0,"direct",8,590.548728],[1,"direct",8,630.296312],[2,"direct",8,670.076664],[3,"direct",8,709.8734],[4,"direct",8,749.637368],[5,"direct",8,789.450488]],"first_mb":590.548728,"last_mb":789.450488,"calls":48,"across_rest_mb":10.108927999999992},{"item":"own_m01:first5","decisions":[[0,"direct",5,831.377144],[0,"shared",6,909.610816],[0,"prepared",5,945.59008],[1,"prepared",5,981.864256],[1,"shared",6,1017.892696],[1,"direct",5,1064.75096],[2,"direct",5,1064.66904],[2,"shared",6,1082.265408],[2,"prepared",5,1118.228288],[3,"prepared",5,1154.305856],[3,"shared",6,1190.301552],[3,"direct",5,1237.077896],[4,"direct",5,1237.09428],[4,"shared",6,1254.788952],[4,"prepared",5,1290.768216],[5,"prepared",5,1326.731096],[5,"shared",6,1362.726792],[5,"direct",5,1409.896328]],"first_mb":831.377144,"last_mb":1409.896328,"calls":96,"across_rest_mb":41.926656000000094},{"item":"own_m01:all8","decisions":[[0,"direct",8,1410.76468],[0,"shared",9,1428.623216],[1,"shared",9,1464.700808],[1,"direct",8,1512.198024],[2,"direct",8,1512.116104],[2,"shared",9,1529.220976],[3,"shared",9,1565.118368],[3,"direct",8,1612.631968]],"first_mb":1410.76468,"last_mb":1612.631968,"calls":68,"across_rest_mb":0.8683519999999589},{"item":"own_L02:all4","decisions":[[0,"direct",25,1698.320336],[0,"shared",10,1727.385552],[0,"prepared",4,1784.43464],[1,"prepared",4,1841.28712],[1,"shared",10,1898.156008],[1,"direct",25,1971.998696],[2,"direct",25,2011.58244],[2,"shared",10,2034.552808],[2,"prepared",4,2091.519976]],"first_mb":1698.320336,"last_mb":2091.519976,"calls":117,"across_rest_mb":85.68836800000008}]},{"run":"20261004-122538","form":"D512L512q16","warm_up_peak_mb":1399.443216,"first_decision_mb":1355.976464,"last_decision_mb":3069.071312,"calls":290,"items":[{"item":"tv4_000:q0","decisions":[[0,"direct",1,1355.976464],[1,"direct",1,1355.992848],[2,"direct",1,1356.582672],[3,"direct",1,1356.582672],[4,"direct",1,1356.582672],[5,"direct",1,1356.582672]],"first_mb":1355.976464,"last_mb":1356.582672,"calls":6,"across_rest_mb":null},{"item":"own_j03:q0","decisions":[[0,"direct",1,1416.449808],[1,"direct",1,1416.269584],[2,"direct",1,1416.843024],[3,"direct",1,1416.843024],[4,"direct",1,1416.843024],[5,"direct",1,1416.843024]],"first_mb":1416.449808,"last_mb":1416.843024,"calls":6,"across_rest_mb":59.86713600000007},{"item":"own_L02:q0","decisions":[[0,"direct",3,1489.702672],[1,"direct",3,1489.751824],[2,"direct",3,1489.9812],[3,"direct",3,1489.833744],[4,"direct",3,1489.81736],[5,"direct",3,1489.850128]],"first_mb":1489.702672,"last_mb":1489.850128,"calls":18,"across_rest_mb":72.85964799999988},{"item":"own_L01:q2","decisions":[[0,"direct",4,1492.4388],[1,"direct",4,1492.455184],[2,"direct",4,1492.553488],[3,"direct",4,1492.324112],[4,"direct",4,1491.734288],[5,"direct",4,1491.980048]],"first_mb":1492.4388,"last_mb":1491.980048,"calls":24,"across_rest_mb":2.5886719999998604},{"item":"own_m01:first5","decisions":[[0,"direct",5,1528.270608],[0,"shared",6,1606.471488],[0,"prepared",5,1641.66432],[1,"prepared",5,1678.430016],[1,"shared",6,1714.45848],[1,"direct",5,1761.185648],[2,"direct",5,1761.283952],[2,"shared",6,1779.011416],[2,"prepared",5,1814.99068],[3,"prepared",5,1850.986328],[3,"shared",6,1886.982024],[3,"direct",5,1934.184328],[4,"direct",5,1933.98772],[4,"shared",6,1951.436656],[4,"prepared",5,1987.399536],[5,"prepared",5,2023.3788],[5,"shared",6,2059.358088],[5,"direct",5,2106.068872]],"first_mb":1528.270608,"last_mb":2106.068872,"calls":96,"across_rest_mb":36.29056000000014},{"item":"own_m01:all8","decisions":[[0,"direct",8,2107.33044],[0,"shared",9,2124.009304],[1,"shared",9,2160.856944],[1,"direct",8,2208.370544],[2,"direct",8,2208.288624],[2,"shared",9,2225.3116],[3,"shared",9,2261.27448],[3,"direct",8,2308.771696]],"first_mb":2107.33044,"last_mb":2308.771696,"calls":68,"across_rest_mb":1.2615680000003522},{"item":"own_L02:all4","decisions":[[0,"direct",13,2462.748552],[0,"shared",7,2492.551096],[0,"prepared",4,2579.943352],[1,"prepared",4,2667.040696],[1,"shared",7,2754.334648],[1,"direct",13,2888.765368],[2,"direct",13,2958.806968],[2,"shared",7,2981.77736],[2,"prepared",4,3069.071312]],"first_mb":2462.748552,"last_mb":3069.071312,"calls":72,"across_rest_mb":153.97685600000023}]},{"run":"20261004-123321","form":"K128","warm_up_peak_mb":271.879928,"first_decision_mb":224.317176,"last_decision_mb":308.596568,"calls":622,"items":[{"item":"tv4_000:q0","decisions":[[0,"direct",1,224.317176],[1,"direct",1,223.989496],[2,"direct",1,224.57932],[3,"direct",1,224.57932],[4,"direct",1,223.891192],[5,"direct",1,224.16972]],"first_mb":224.317176,"last_mb":224.16972,"calls":6,"across_rest_mb":null},{"item":"own_j03:q0","decisions":[[0,"direct",3,224.612088],[1,"direct",3,225.300216],[2,"direct",3,224.874232],[3,"direct",3,224.874232],[4,"direct",3,224.890616],[5,"direct",3,225.038072]],"first_mb":224.612088,"last_mb":225.038072,"calls":18,"across_rest_mb":0.44236799999998766},{"item":"own_L02:q0","decisions":[[0,"direct",12,233.557752],[1,"direct",12,233.557752],[2,"direct",12,233.574136],[3,"direct",12,234.589944],[4,"direct",12,233.606904],[5,"direct",12,234.508024]],"first_mb":233.557752,"last_mb":234.508024,"calls":72,"across_rest_mb":8.519679999999994},{"item":"own_L01:q2","decisions":[[0,"direct",15,234.393336],[1,"direct",15,234.40972],[2,"direct",15,234.753784],[3,"direct",15,234.40972],[4,"direct",15,234.40972],[5,"direct",15,234.65548]],"first_mb":234.393336,"last_mb":234.65548,"calls":90,"across_rest_mb":-0.11468800000000101},{"item":"own_m01:first5","decisions":[[0,"direct",10,225.23468],[0,"shared",6,286.412584],[0,"prepared",5,286.412584],[1,"prepared",5,286.412584],[1,"shared",6,286.412584],[1,"direct",10,286.3962],[2,"direct",10,286.412584],[2,"shared",6,286.3962],[2,"prepared",5,286.412584],[3,"prepared",5,286.412584],[3,"shared",6,286.412584],[3,"direct",10,286.412584],[4,"direct",10,286.412584],[4,"shared",6,286.412584],[4,"prepared",5,286.412584],[5,"prepared",5,286.412584],[5,"shared",6,286.412584],[5,"direct",10,286.3962]],"first_mb":225.23468,"last_mb":286.3962,"calls":126,"across_rest_mb":-9.420800000000014},{"item":"own_m01:all8","decisions":[[0,"direct",16,287.54308],[0,"shared",9,288.591656],[1,"shared",9,288.591656],[1,"direct",16,288.640808],[2,"direct",16,288.624424],[2,"shared",9,288.640808],[3,"shared",9,288.640808],[3,"direct",16,288.640808]],"first_mb":287.54308,"last_mb":288.640808,"calls":100,"across_rest_mb":1.1468799999999533},{"item":"own_L02:all4","decisions":[[0,"direct",49,306.581288],[0,"shared",16,310.988632],[0,"prepared",5,307.99036],[1,"prepared",5,308.006744],[1,"shared",16,308.481856],[1,"direct",49,304.697152],[2,"direct",49,304.697152],[2,"shared",16,308.64572],[2,"prepared",5,308.596568]],"first_mb":306.581288,"last_mb":308.596568,"calls":210,"across_rest_mb":17.94047999999998}]}]},"gates_stage_a":{"K16":{"schema":"kev-device-r13-gate/1","form":"K16","S":16,"result_json":"$ZOO_WORK_ROOT/_kev/device_r13/_work/device_runs/20261004-102627/result.json","result_sha256":"1b6d56de0495d2ca389ef387bfcc77dca123a080433f16a72fa2fdd7c30f7d89","run_id":"20261004-102627","status":"done","app_pass":true,"app_summary":["load_jit=PASS","warm=PASS","e2e_fixture=PASS","e2e_heldout=PASS","reset=PASS"],"device":{"available_mb":3526.392208,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":13.600368,"free_gb":139.030281417,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"fair"},"device_end":{"available_mb":3250.811048,"battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":289.181528,"free_gb":139.030281417,"low_power_mode":false,"thermal":"fair"},"previous_launch":{"run_id":"20261004-102441","stage_order":["load_jit","warm","e2e_fixture","e2e_heldout","reset"],"status":"done","updated":"2026-10-04T01:26:21Z"},"config_env":{"KEV_DECODER":"decoder_k16","KEV_R13_FORM":"K16","KEV_RUN_ID":"20261004-102627","KEV_STAGES":"load_jit,warm,e2e_fixture,e2e_heldout,reset"},"bar":{"max_abs_dp":0.02,"mean_of_run_mean_abs_dp":0.002,"near_tie_top2_margin":0.02},"mac_same_form_source":["$ZOO_WORK_ROOT/_kev/results/r11_full_K16.json","$ZOO_WORK_ROOT/_kev/results/r11_heldout_K16.json"],"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k16/kev_0_8b_decode_fp16_metal_pf16.aimodel","asset_bytes":1505385650,"asset_main_hash":"8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":4.219022,"aimodel_s":3.639298458,"main_s":0.220327125,"tokenizer_s":0.35222804100000005,"chunk":16,"bundle_name":"kev_0_8b_decode_fp16_metal_pf16","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,16],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,16,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":12517512362,"cache_bytes_after":15019568821,"cache_bytes_added":2502056459,"cache_state":"cold (new cache entry)","peak_footprint_mb":226.168064,"min_available_mb":3313.824512,"available_mb_before":3517.561232,"free_gb_before":139.030281417,"free_gb_after":139.030281417,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm":{"record":"tv4_000","latency_ms":317.195,"calls":6,"pass":true,"error":null},"e2e_fixture":{"set":"fixture","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k16/kev_0_8b_decode_fp16_metal_pf16.aimodel","rows":434,"bar":{"questions":434,"questions_non_near_tie":420,"argmax_equal_non_near_tie":420,"near_tie_questions":14,"argmax_equal_near_tie":13,"max_abs_dp":0.01097959280014038,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.000941137191822847,"pass":true},"ids_equal_oracle":434,"finite_rows":434,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"vs_mac_same_form_r11_python":{"rows":434,"missing":0,"max_abs_dp":0.002144530415534973,"median_abs_dp":0.00032667815685272217,"argmax_equal":434,"p_bit_equal":0,"worst_row":"semif_834f3b3e10cc61b33d25:q0"},"vs_mac_u16_r7_swift_reference":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0024800002574920654,"median_abs_dp":0.0003177523612976074},"near_ties":[{"row":"tv4_003:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006347000598907471,"max_abs_dp":0.0012449026107788086},{"row":"tv4_017:q0","T":76,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.000769495964050293,"max_abs_dp":0.0010818243026733398},{"row":"tv4_023:q0","T":92,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.001623302698135376,"max_abs_dp":0.0010861754417419434},{"row":"tv4_024:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00021389126777648926,"max_abs_dp":0.0019825398921966553},{"row":"tv4_027:q0","T":77,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006315708160400391,"max_abs_dp":0.0013576149940490723},{"row":"tv4_028:q0","T":290,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00038219988346099854,"max_abs_dp":0.0007702112197875977},{"row":"tv4_051:q0","T":136,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00020954012870788574,"max_abs_dp":0.0010040700435638428},{"row":"tv4_054:q0","T":113,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00044727325439453125,"max_abs_dp":0.0010915398597717285},{"row":"tv4s_14:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":7.206201553344727e-05,"max_abs_dp":0.0011271834373474121},{"row":"semif_2175379f4c69e6207626:q0","T":58,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006713569164276123,"max_abs_dp":0.003931790590286255},{"row":"semif_d167e51bb1f499099645:q0","T":69,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005191266536712646,"max_abs_dp":0.0018132030963897705},{"row":"semif_4089c199b8b796ec3ed8:q0","T":88,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007974803447723389,"max_abs_dp":0.0031510591506958008},{"row":"own_t10:q2","T":156,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007261037826538086,"max_abs_dp":0.0013325214385986328},{"row":"own_j02:q0","T":332,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004868060350418091,"max_abs_dp":0.0007849782705307007}],"worst_rows":[{"row":"semif_46b7029b9a704138b77a:q0","T":78,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010443925857543945,"max_abs_dp":0.01097959280014038},{"row":"semif_942ec65dac0bfb9874f9:q0","T":60,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008150637149810791,"max_abs_dp":0.006807953119277954},{"row":"semif_d7e84e4245a29817da1f:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":9.451806545257568e-05,"max_abs_dp":0.006781518459320068},{"row":"tv4_045:q0","T":90,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010633468627929688,"max_abs_dp":0.006255060434341431},{"row":"semif_eafc22c8c40df3932a8e:q0","T":72,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008483231067657471,"max_abs_dp":0.006120085716247559},{"row":"semif_97d2ed2591fc7638806c:q0","T":82,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006537139415740967,"max_abs_dp":0.006089210510253906},{"row":"semif_8a4c3de28be95c105ca1:q0","T":72,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008245110511779785,"max_abs_dp":0.006026148796081543},{"row":"own_L02:q0","T":1518,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0012316107749938965,"max_abs_dp":0.005805075168609619}],"calls_total":4055,"call_ms_median":24.88,"call_ms_p90":26.43,"call_ms_median_recomputed":24.88,"seconds":114.93419425,"thermal":["fair","fair"],"timeline":[[0,"fair",0.800000011920929,"charging",272.66636,3267.326216],[20.1,"fair",0.800000011920929,"charging",221.941496,3318.05108],[40,"fair",0.800000011920929,"charging",222.842616,3317.14996],[61.2,"fair",0.800000011920929,"charging",281.841448,3258.151128],[89.7,"fair",0.800000011920929,"charging",310.726512,3229.266064],[102.5,"fair",0.800000011920929,"charging",313.74112,3226.251456],[114.9,"fair",0.800000011920929,"charging",313.102192,3226.890384]],"memory":{"peak_footprint_mb":342.069104,"min_available_mb":3197.923472},"errors":0},"e2e_heldout":{"set":"heldout","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k16/kev_0_8b_decode_fp16_metal_pf16.aimodel","rows":130,"bar":{"questions":130,"questions_non_near_tie":125,"argmax_equal_non_near_tie":125,"near_tie_questions":5,"argmax_equal_near_tie":5,"max_abs_dp":0.005504608154296875,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.0008310439554341614,"pass":true},"ids_equal_oracle":130,"finite_rows":130,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":130,"missing":0,"max_abs_dp":0.0019264817237854004,"median_abs_dp":0.0002781003713607788,"argmax_equal":130,"p_bit_equal":0,"worst_row":"tv4xh_qnli_01:q0"},"vs_mac_u16_r7_swift_reference":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.001141369342803955,"median_abs_dp":0.0002872049808502197},"near_ties":[{"row":"tv4h_03:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003510117530822754,"max_abs_dp":0.00042501091957092285},{"row":"tv4h_07:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00010988116264343262,"max_abs_dp":0.0007911622524261475},{"row":"tv4h_31:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.000540316104888916,"max_abs_dp":0.0013956129550933838},{"row":"tv4xh_tweet_offensive_03:q0","T":84,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00011491775512695312,"max_abs_dp":0.00012317299842834473},{"row":"tv4xh_paws_06:q0","T":91,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006015598773956299,"max_abs_dp":0.0020118355751037598}],"worst_rows":[{"row":"tv4h_11:q0","T":299,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002346038818359375,"max_abs_dp":0.005504608154296875},{"row":"tv4xh_qnli_06:q0","T":48,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010690391063690186,"max_abs_dp":0.0047907233238220215},{"row":"tv4xh_paws_00:q0","T":94,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":1.2993812561035156e-05,"max_abs_dp":0.0038128793239593506},{"row":"tv4h_00:q0","T":59,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005249232053756714,"max_abs_dp":0.003645777702331543},{"row":"tv4xh_qnli_01:q0","T":59,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.000929713249206543,"max_abs_dp":0.003309696912765503},{"row":"tv4xh_paws_04:q0","T":76,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.000205308198928833,"max_abs_dp":0.0033065080642700195},{"row":"tv4xh_paws_09:q0","T":102,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0011119246482849121,"max_abs_dp":0.0028978586196899414},{"row":"tv4sh_00:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003268122673034668,"max_abs_dp":0.0027714967727661133}],"calls_total":809,"call_ms_median":25.57,"call_ms_p90":27.794,"call_ms_median_recomputed":25.57,"seconds":22.317195125,"thermal":["fair","fair"],"timeline":[[0,"fair",0.800000011920929,"charging",314.576752,3225.415824],[20.2,"fair",0.800000011920929,"charging",286.101336,3253.89124],[22.3,"fair",0.800000011920929,"charging",286.543704,3253.448872]],"memory":{"peak_footprint_mb":317.411184,"min_available_mb":3222.581392},"errors":0},"reset":{"record":"tv4_000","kind":"jit","hidden_bit_equal":true,"p_bit_equal":true,"latency_ms":150.104125,"thermal":"fair","pass":true,"error":null}},"pass":true},"K32":{"schema":"kev-device-r13-gate/1","form":"K32","S":32,"result_json":"$ZOO_WORK_ROOT/_kev/device_r13/_work/device_runs/20261004-102441/result.json","result_sha256":"3c5374da33a8c355f72610a11e285f26076f01429b2ef642d51df1d40503132d","run_id":"20261004-102441","status":"done","app_pass":true,"app_summary":["load_jit=PASS","warm=PASS","e2e_fixture=PASS","e2e_heldout=PASS","reset=PASS"],"device":{"available_mb":3526.588768,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":13.403808,"free_gb":141.487881417,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"fair"},"device_end":{"available_mb":3252.105408,"battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":287.887168,"free_gb":141.487881417,"low_power_mode":false,"thermal":"fair"},"previous_launch":{"run_id":"20261004-102347","stage_order":["load_jit","warm","e2e_fixture","e2e_heldout","reset"],"status":"done","updated":"2026-10-04T01:24:39Z"},"config_env":{"KEV_DECODER":"decoder_k32","KEV_R13_FORM":"K32","KEV_RUN_ID":"20261004-102441","KEV_STAGES":"load_jit,warm,e2e_fixture,e2e_heldout,reset"},"bar":{"max_abs_dp":0.02,"mean_of_run_mean_abs_dp":0.002,"near_tie_top2_margin":0.02},"mac_same_form_source":["$ZOO_WORK_ROOT/_kev/results/r11_full_K32.json","$ZOO_WORK_ROOT/_kev/results/r11_heldout_K32.json"],"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k32/kev_0_8b_decode_fp16_metal_pf32.aimodel","asset_bytes":1505385803,"asset_main_hash":"f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":4.253016666,"aimodel_s":3.654366834,"main_s":0.23674804100000002,"tokenizer_s":0.354761625,"chunk":32,"bundle_name":"kev_0_8b_decode_fp16_metal_pf32","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,32],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,32,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":10015455996,"cache_bytes_after":12517512362,"cache_bytes_added":2502056366,"cache_state":"cold (new cache entry)","peak_footprint_mb":236.719288,"min_available_mb":3303.273288,"available_mb_before":3517.741408,"free_gb_before":141.487881417,"free_gb_after":141.487881417,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm":{"record":"tv4_000","latency_ms":544.5680000000001,"calls":3,"pass":true,"error":null},"e2e_fixture":{"set":"fixture","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k32/kev_0_8b_decode_fp16_metal_pf32.aimodel","rows":434,"bar":{"questions":434,"questions_non_near_tie":420,"argmax_equal_non_near_tie":420,"near_tie_questions":14,"argmax_equal_near_tie":13,"max_abs_dp":0.013274610042572021,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.0009549277293839077,"pass":true},"ids_equal_oracle":434,"finite_rows":434,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"vs_mac_same_form_r11_python":{"rows":434,"missing":0,"max_abs_dp":0.0031354129314422607,"median_abs_dp":0.00031206756830215454,"argmax_equal":434,"p_bit_equal":0,"worst_row":"semif_eafc22c8c40df3932a8e:q0"},"vs_mac_u16_r7_swift_reference":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.002329528331756592,"median_abs_dp":0.00031382590532302856},"near_ties":[{"row":"tv4_003:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004348680377006531,"max_abs_dp":0.0008710026741027832},{"row":"tv4_017:q0","T":76,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003825575113296509,"max_abs_dp":0.0012165307998657227},{"row":"tv4_023:q0","T":92,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.002163410186767578,"max_abs_dp":0.0011820793151855469},{"row":"tv4_024:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00015407800674438477,"max_abs_dp":0.0022537708282470703},{"row":"tv4_027:q0","T":77,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00039127469062805176,"max_abs_dp":0.0010747909545898438},{"row":"tv4_028:q0","T":290,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005045533180236816,"max_abs_dp":0.0004994571208953857},{"row":"tv4_051:q0","T":136,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005983412265777588,"max_abs_dp":0.0012436509132385254},{"row":"tv4_054:q0","T":113,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005204081535339355,"max_abs_dp":0.0009204596281051636},{"row":"tv4s_14:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00024065375328063965,"max_abs_dp":0.0009129941463470459},{"row":"semif_2175379f4c69e6207626:q0","T":58,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007651150226593018,"max_abs_dp":0.004025548696517944},{"row":"semif_d167e51bb1f499099645:q0","T":69,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004750490188598633,"max_abs_dp":0.0013044774532318115},{"row":"semif_4089c199b8b796ec3ed8:q0","T":88,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007905066013336182,"max_abs_dp":0.003056168556213379},{"row":"own_t10:q2","T":156,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00048106908798217773,"max_abs_dp":0.0014063194394111633},{"row":"own_j02:q0","T":332,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004897415637969971,"max_abs_dp":0.0007772892713546753}],"worst_rows":[{"row":"semif_46b7029b9a704138b77a:q0","T":78,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0015956461429595947,"max_abs_dp":0.013274610042572021},{"row":"semif_942ec65dac0bfb9874f9:q0","T":60,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0014244914054870605,"max_abs_dp":0.0074173808097839355},{"row":"semif_d7e84e4245a29817da1f:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":2.0109117031097412e-05,"max_abs_dp":0.006808638572692871},{"row":"semif_8a4c3de28be95c105ca1:q0","T":72,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.001298069953918457,"max_abs_dp":0.0064997076988220215},{"row":"tv4_045:q0","T":90,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.001269996166229248,"max_abs_dp":0.006104916334152222},{"row":"tv4_020:q0","T":82,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007234811782836914,"max_abs_dp":0.00554269552230835},{"row":"tv4x_legacy_holdout_03:q0","T":77,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00014445185661315918,"max_abs_dp":0.005111575126647949},{"row":"own_L02:q0","T":1518,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005063414573669434,"max_abs_dp":0.005079805850982666}],"calls_total":2147,"call_ms_median":29.82,"call_ms_p90":31.68,"call_ms_median_recomputed":29.82,"seconds":75.645598542,"thermal":["fair","fair"],"timeline":[[0,"fair",0.800000011920929,"charging",240.996112,3298.996464],[20,"fair",0.800000011920929,"charging",224.15336,3315.839216],[40.1,"fair",0.800000011920929,"charging",284.086056,3255.90652],[60.1,"fair",0.800000011920929,"charging",310.67736,3229.315216],[75.6,"fair",0.800000011920929,"charging",312.954712,3227.037864]],"memory":{"peak_footprint_mb":349.982576,"min_available_mb":3190.01},"errors":0},"e2e_heldout":{"set":"heldout","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k32/kev_0_8b_decode_fp16_metal_pf32.aimodel","rows":130,"bar":{"questions":130,"questions_non_near_tie":125,"argmax_equal_non_near_tie":125,"near_tie_questions":5,"argmax_equal_near_tie":5,"max_abs_dp":0.0053359270095825195,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.00082612175241453,"pass":true},"ids_equal_oracle":130,"finite_rows":130,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":130,"missing":0,"max_abs_dp":0.0013680458068847656,"median_abs_dp":0.0003041103482246399,"argmax_equal":130,"p_bit_equal":0,"worst_row":"tv4xh_sciq_03:q0"},"vs_mac_u16_r7_swift_reference":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0014801621437072754,"median_abs_dp":0.00028318166732788086},"near_ties":[{"row":"tv4h_03:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00042182207107543945,"max_abs_dp":0.0004958212375640869},{"row":"tv4h_07:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005813837051391602,"max_abs_dp":0.0010322034358978271},{"row":"tv4h_31:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00019568949937820435,"max_abs_dp":0.0010994300246238708},{"row":"tv4xh_tweet_offensive_03:q0","T":84,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00018489360809326172,"max_abs_dp":0.00019314885139465332},{"row":"tv4xh_paws_06:q0","T":91,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002302229404449463,"max_abs_dp":0.0016404986381530762}],"worst_rows":[{"row":"tv4h_11:q0","T":299,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00040328502655029297,"max_abs_dp":0.0053359270095825195},{"row":"tv4xh_qnli_06:q0","T":48,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003210604190826416,"max_abs_dp":0.0040427446365356445},{"row":"tv4xh_composition_holdout_09:q0","T":122,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002875328063964844,"max_abs_dp":0.0037830471992492676},{"row":"tv4xh_paws_00:q0","T":94,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00019913911819458008,"max_abs_dp":0.003600776195526123},{"row":"tv4xh_paws_04:q0","T":76,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":8.726119995117188e-05,"max_abs_dp":0.0035990476608276367},{"row":"tv4h_00:q0","T":59,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00030231475830078125,"max_abs_dp":0.0034839510917663574},{"row":"tv4sh_00:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00013028085231781006,"max_abs_dp":0.003091752529144287},{"row":"tv4xh_qnli_03:q0","T":65,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00046312808990478516,"max_abs_dp":0.002697378396987915}],"calls_total":440,"call_ms_median":33.474999999999994,"call_ms_p90":34.631,"call_ms_median_recomputed":33.474999999999994,"seconds":15.803598083,"thermal":["fair","fair"],"timeline":[[0,"fair",0.800000011920929,"charging",315.871064,3224.121512],[15.7,"fair",0.800000011920929,"charging",287.805248,3252.187328]],"memory":{"peak_footprint_mb":318.017368,"min_available_mb":3221.975208},"errors":0},"reset":{"record":"tv4_000","kind":"jit","hidden_bit_equal":true,"p_bit_equal":true,"latency_ms":90.89662500000001,"thermal":"fair","pass":true,"error":null}},"pass":true},"K64":{"schema":"kev-device-r13-gate/1","form":"K64","S":64,"result_json":"$ZOO_WORK_ROOT/_kev/device_r13/_work/device_runs/20261004-102254/result.json","result_sha256":"6c027689b2877bb16245aa0a5f729dd6bb2f61884aa765684b355866b1cc3a26","run_id":"20261004-102254","status":"done","app_pass":true,"app_summary":["load_jit=PASS","warm=PASS","e2e_fixture=PASS","e2e_heldout=PASS","reset=PASS"],"device":{"available_mb":3529.439608,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":10.552968,"free_gb":146.401250505,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"nominal"},"device_end":{"available_mb":3246.239912,"battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":293.752664,"free_gb":146.401250505,"low_power_mode":false,"thermal":"nominal"},"previous_launch":{"run_id":"20261004-102213","stage_order":["md5"],"status":"done","updated":"2026-10-04T01:22:20Z"},"config_env":{"KEV_DECODER":"decoder_k64","KEV_R13_FORM":"K64","KEV_RUN_ID":"20261004-102254","KEV_STAGES":"load_jit,warm,e2e_fixture,e2e_heldout,reset"},"bar":{"max_abs_dp":0.02,"mean_of_run_mean_abs_dp":0.002,"near_tie_top2_margin":0.02},"mac_same_form_source":["$ZOO_WORK_ROOT/_kev/results/r11_full_K64.json","$ZOO_WORK_ROOT/_kev/results/r11_heldout_K64.json"],"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k64/kev_0_8b_decode_fp16_metal_pf64.aimodel","asset_bytes":1505385873,"asset_main_hash":"b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":3.578463833,"aimodel_s":2.725888292,"main_s":0.500222375,"tokenizer_s":0.34703495900000003,"chunk":64,"bundle_name":"kev_0_8b_decode_fp16_metal_pf64","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,64],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,64,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":5011342997,"cache_bytes_after":7513399533,"cache_bytes_added":2502056536,"cache_state":"cold (new cache entry)","peak_footprint_mb":193.877192,"min_available_mb":3346.115384,"available_mb_before":3523.03344,"free_gb_before":146.401250505,"free_gb_after":146.401250505,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm":{"record":"tv4_000","latency_ms":1057.5988750000001,"calls":2,"pass":true,"error":null},"e2e_fixture":{"set":"fixture","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k64/kev_0_8b_decode_fp16_metal_pf64.aimodel","rows":434,"bar":{"questions":434,"questions_non_near_tie":420,"argmax_equal_non_near_tie":420,"near_tie_questions":14,"argmax_equal_near_tie":13,"max_abs_dp":0.009762495756149292,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.0009469738836215484,"pass":true},"ids_equal_oracle":434,"finite_rows":434,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"vs_mac_same_form_r11_python":{"rows":434,"missing":0,"max_abs_dp":0.0022717714309692383,"median_abs_dp":0.00029152631759643555,"argmax_equal":434,"p_bit_equal":0,"worst_row":"semif_eafc22c8c40df3932a8e:q0"},"vs_mac_u16_r7_swift_reference":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0024412572383880615,"median_abs_dp":0.00035731494426727295},"near_ties":[{"row":"tv4_003:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006008446216583252,"max_abs_dp":0.0012110471725463867},{"row":"tv4_017:q0","T":76,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005065202713012695,"max_abs_dp":0.00112992525100708},{"row":"tv4_023:q0","T":92,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0023115575313568115,"max_abs_dp":0.0015844255685806274},{"row":"tv4_024:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00040394067764282227,"max_abs_dp":0.001938939094543457},{"row":"tv4_027:q0","T":77,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008315145969390869,"max_abs_dp":0.0015927553176879883},{"row":"tv4_028:q0","T":290,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006568729877471924,"max_abs_dp":0.00020244717597961426},{"row":"tv4_051:q0","T":136,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.000739753246307373,"max_abs_dp":0.0011295974254608154},{"row":"tv4_054:q0","T":113,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002487301826477051,"max_abs_dp":0.0009823441505432129},{"row":"tv4s_14:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00015118718147277832,"max_abs_dp":0.0010620951652526855},{"row":"semif_2175379f4c69e6207626:q0","T":58,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005307793617248535,"max_abs_dp":0.0027763843536376953},{"row":"semif_d167e51bb1f499099645:q0","T":69,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005688071250915527,"max_abs_dp":0.0021874606609344482},{"row":"semif_4089c199b8b796ec3ed8:q0","T":88,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010977685451507568,"max_abs_dp":0.0033634305000305176},{"row":"own_t10:q2","T":156,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005759596824645996,"max_abs_dp":0.0015064701437950134},{"row":"own_j02:q0","T":332,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.000454142689704895,"max_abs_dp":0.0008589029312133789}],"worst_rows":[{"row":"semif_46b7029b9a704138b77a:q0","T":78,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00229567289352417,"max_abs_dp":0.009762495756149292},{"row":"semif_d7e84e4245a29817da1f:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002003312110900879,"max_abs_dp":0.006782174110412598},{"row":"semif_942ec65dac0bfb9874f9:q0","T":60,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004864335060119629,"max_abs_dp":0.006479322910308838},{"row":"semif_7ada97b6f99f4788e5c7:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0015850961208343506,"max_abs_dp":0.005663514137268066},{"row":"own_L02:q0","T":1518,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0009106993675231934,"max_abs_dp":0.005484163761138916},{"row":"semif_33d6e5da58f0fee2490d:q0","T":73,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00048530101776123047,"max_abs_dp":0.005433976650238037},{"row":"tv4_045:q0","T":90,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.002142786979675293,"max_abs_dp":0.005242019891738892},{"row":"semif_42384af9ae56beb37ff5:q0","T":84,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00017595291137695312,"max_abs_dp":0.00507509708404541}],"calls_total":1207,"call_ms_median":24.18,"call_ms_p90":24.54,"call_ms_median_recomputed":24.18,"seconds":35.740915666,"thermal":["nominal","nominal"],"timeline":[[0,"nominal",0.800000011920929,"charging",228.57704,3311.415536],[20.1,"nominal",0.800000011920929,"charging",290.017064,3249.975512],[35.6,"nominal",0.800000011920929,"charging",317.787992,3222.204584]],"memory":{"peak_footprint_mb":322.932592,"min_available_mb":3217.059984},"errors":0},"e2e_heldout":{"set":"heldout","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k64/kev_0_8b_decode_fp16_metal_pf64.aimodel","rows":130,"bar":{"questions":130,"questions_non_near_tie":125,"argmax_equal_non_near_tie":125,"near_tie_questions":5,"argmax_equal_near_tie":5,"max_abs_dp":0.005734503269195557,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.0008491584911676816,"pass":true},"ids_equal_oracle":130,"finite_rows":130,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":130,"missing":0,"max_abs_dp":0.0015630125999450684,"median_abs_dp":0.0003191940486431122,"argmax_equal":130,"p_bit_equal":0,"worst_row":"tv4xh_paws_05:q0"},"vs_mac_u16_r7_swift_reference":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0017009973526000977,"median_abs_dp":0.00030865520238876343},"near_ties":[{"row":"tv4h_03:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00035162270069122314,"max_abs_dp":0.00046794116497039795},{"row":"tv4h_07:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00016298890113830566,"max_abs_dp":0.0009154081344604492},{"row":"tv4h_31:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004290938377380371,"max_abs_dp":0.0012375116348266602},{"row":"tv4xh_tweet_offensive_03:q0","T":84,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004496574401855469,"max_abs_dp":0.0004579126834869385},{"row":"tv4xh_paws_06:q0","T":91,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":4.2110681533813477e-05,"max_abs_dp":0.0014523863792419434}],"worst_rows":[{"row":"tv4h_11:q0","T":299,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":2.7567148208618164e-05,"max_abs_dp":0.005734503269195557},{"row":"tv4xh_paws_00:q0","T":94,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006052851676940918,"max_abs_dp":0.004405170679092407},{"row":"tv4xh_qnli_06:q0","T":48,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005288124084472656,"max_abs_dp":0.004250466823577881},{"row":"tv4sh_00:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004997849464416504,"max_abs_dp":0.0035980939865112305},{"row":"tv4h_00:q0","T":59,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003781840205192566,"max_abs_dp":0.0034750699996948242},{"row":"tv4xh_paws_04:q0","T":76,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":7.960200309753418e-05,"max_abs_dp":0.0034322142601013184},{"row":"tv4xh_composition_holdout_09:q0","T":122,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0001690685749053955,"max_abs_dp":0.0033264756202697754},{"row":"tv4xh_emotion_06:q0","T":43,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0009676218032836914,"max_abs_dp":0.0030605196952819824}],"calls_total":247,"call_ms_median":24.28,"call_ms_p90":24.61,"call_ms_median_recomputed":24.28,"seconds":6.808297833,"thermal":["nominal","nominal"],"timeline":[[0,"nominal",0.800000011920929,"charging",318.8038,3221.188776],[6.8,"nominal",0.800000011920929,"charging",290.951,3249.041576]],"memory":{"peak_footprint_mb":323.194712,"min_available_mb":3216.797864},"errors":0},"reset":{"record":"tv4_000","kind":"jit","hidden_bit_equal":true,"p_bit_equal":true,"latency_ms":58.141125,"thermal":"nominal","pass":true,"error":null}},"pass":true},"K128":{"schema":"kev-device-r13-gate/1","form":"K128","S":128,"result_json":"$ZOO_WORK_ROOT/_kev/device_r13/_work/device_runs/20261004-102347/result.json","result_sha256":"6037875470b96564359ad59524aaec5a92c06a09aed36aa72921211ea4ba18c1","run_id":"20261004-102347","status":"done","app_pass":true,"app_summary":["load_jit=PASS","warm=PASS","e2e_fixture=PASS","e2e_heldout=PASS","reset=PASS"],"device":{"available_mb":3526.703504,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":13.289072,"free_gb":143.945477321,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"nominal"},"device_end":{"available_mb":3230.675136,"battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":309.31744,"free_gb":143.945477321,"low_power_mode":false,"thermal":"fair"},"previous_launch":{"run_id":"20261004-102254","stage_order":["load_jit","warm","e2e_fixture","e2e_heldout","reset"],"status":"done","updated":"2026-10-04T01:23:45Z"},"config_env":{"KEV_DECODER":"decoder_k128","KEV_R13_FORM":"K128","KEV_RUN_ID":"20261004-102347","KEV_STAGES":"load_jit,warm,e2e_fixture,e2e_heldout,reset"},"bar":{"max_abs_dp":0.02,"mean_of_run_mean_abs_dp":0.002,"near_tie_top2_margin":0.02},"mac_same_form_source":["$ZOO_WORK_ROOT/_kev/results/r11_full_K128.json","$ZOO_WORK_ROOT/_kev/results/r11_heldout_K128.json"],"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k128/kev_0_8b_decode_fp16_metal_pf128.aimodel","asset_bytes":1505385870,"asset_main_hash":"19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":4.26010325,"aimodel_s":3.600256959,"main_s":0.300160125,"tokenizer_s":0.35231850000000003,"chunk":128,"bundle_name":"kev_0_8b_decode_fp16_metal_pf128","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,128],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,128,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":7513399533,"cache_bytes_after":10015455996,"cache_bytes_added":2502056463,"cache_state":"cold (new cache entry)","peak_footprint_mb":232.541344,"min_available_mb":3307.451232,"available_mb_before":3518.052728,"free_gb_before":143.945477321,"free_gb_after":143.945477321,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm":{"record":"tv4_000","latency_ms":788.866875,"calls":1,"pass":true,"error":null},"e2e_fixture":{"set":"fixture","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k128/kev_0_8b_decode_fp16_metal_pf128.aimodel","rows":434,"bar":{"questions":434,"questions_non_near_tie":420,"argmax_equal_non_near_tie":420,"near_tie_questions":14,"argmax_equal_near_tie":13,"max_abs_dp":0.01100119948387146,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.0009723608388956548,"pass":true},"ids_equal_oracle":434,"finite_rows":434,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"vs_mac_same_form_r11_python":{"rows":434,"missing":0,"max_abs_dp":0.0026472806930541992,"median_abs_dp":0.0002929568290710449,"argmax_equal":434,"p_bit_equal":0,"worst_row":"semif_2175379f4c69e6207626:q0"},"vs_mac_u16_r7_swift_reference":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0031995177268981934,"median_abs_dp":0.0003325529396533966},"near_ties":[{"row":"tv4_003:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.001380622386932373,"max_abs_dp":0.0019908249378204346},{"row":"tv4_017:q0","T":76,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003791004419326782,"max_abs_dp":0.0012992620468139648},{"row":"tv4_023:q0","T":92,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010398030281066895,"max_abs_dp":0.0016767680644989014},{"row":"tv4_024:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00010263919830322266,"max_abs_dp":0.0020470023155212402},{"row":"tv4_027:q0","T":77,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003451108932495117,"max_abs_dp":0.001106351613998413},{"row":"tv4_028:q0","T":290,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006859898567199707,"max_abs_dp":0.0003826320171356201},{"row":"tv4_051:q0","T":136,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008180439472198486,"max_abs_dp":0.001276850700378418},{"row":"tv4_054:q0","T":113,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007375776767730713,"max_abs_dp":0.001546025276184082},{"row":"tv4s_14:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00030072033405303955,"max_abs_dp":0.001337289810180664},{"row":"semif_2175379f4c69e6207626:q0","T":58,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.002010136842727661,"max_abs_dp":0.005270570516586304},{"row":"semif_d167e51bb1f499099645:q0","T":69,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004182755947113037,"max_abs_dp":0.00209847092628479},{"row":"semif_4089c199b8b796ec3ed8:q0","T":88,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007336139678955078,"max_abs_dp":0.0029992759227752686},{"row":"own_t10:q2","T":156,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006840825080871582,"max_abs_dp":0.0014229565858840942},{"row":"own_j02:q0","T":332,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005596131086349487,"max_abs_dp":0.0010422766208648682}],"worst_rows":[{"row":"semif_46b7029b9a704138b77a:q0","T":78,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0009321868419647217,"max_abs_dp":0.01100119948387146},{"row":"semif_d7e84e4245a29817da1f:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.000786125659942627,"max_abs_dp":0.007578730583190918},{"row":"semif_942ec65dac0bfb9874f9:q0","T":60,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0009017288684844971,"max_abs_dp":0.006894618272781372},{"row":"semif_8a4c3de28be95c105ca1:q0","T":72,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010104179382324219,"max_abs_dp":0.006212055683135986},{"row":"tv4_045:q0","T":90,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0011489391326904297,"max_abs_dp":0.00616946816444397},{"row":"tv4_020:q0","T":82,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008234381675720215,"max_abs_dp":0.005565941333770752},{"row":"semif_eafc22c8c40df3932a8e:q0","T":72,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00019440054893493652,"max_abs_dp":0.005371183156967163},{"row":"semif_7ada97b6f99f4788e5c7:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0015981495380401611,"max_abs_dp":0.005364537239074707}],"calls_total":681,"call_ms_median":36.12,"call_ms_p90":47.97,"call_ms_median_recomputed":36.12,"seconds":34.992179375,"thermal":["nominal","fair"],"timeline":[[0,"nominal",0.800000011920929,"charging",265.473808,3274.518768],[20,"fair",0.800000011920929,"charging",305.647448,3234.345128],[34.9,"fair",0.800000011920929,"charging",340.201304,3199.791272]],"memory":{"peak_footprint_mb":344.510296,"min_available_mb":3195.48228},"errors":0},"e2e_heldout":{"set":"heldout","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k128/kev_0_8b_decode_fp16_metal_pf128.aimodel","rows":130,"bar":{"questions":130,"questions_non_near_tie":125,"argmax_equal_non_near_tie":125,"near_tie_questions":5,"argmax_equal_near_tie":5,"max_abs_dp":0.005920350551605225,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.0008314862770240348,"pass":true},"ids_equal_oracle":130,"finite_rows":130,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":130,"missing":0,"max_abs_dp":0.001957237720489502,"median_abs_dp":0.0003131479024887085,"argmax_equal":130,"p_bit_equal":0,"worst_row":"tv4xh_sciq_02:q0"},"vs_mac_u16_r7_swift_reference":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0026790499687194824,"median_abs_dp":0.0002968907356262207},"near_ties":[{"row":"tv4h_03:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005450248718261719,"max_abs_dp":0.0005183219909667969},{"row":"tv4h_07:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00027507543563842773,"max_abs_dp":0.0007052123546600342},{"row":"tv4h_31:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0013050734996795654,"max_abs_dp":0.0020380616188049316},{"row":"tv4xh_tweet_offensive_03:q0","T":84,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006586909294128418,"max_abs_dp":0.0006669461727142334},{"row":"tv4xh_paws_06:q0","T":91,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00024080276489257812,"max_abs_dp":0.0011695027351379395}],"worst_rows":[{"row":"tv4h_11:q0","T":299,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0001811385154724121,"max_abs_dp":0.005920350551605225},{"row":"tv4xh_paws_00:q0","T":94,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008548498153686523,"max_abs_dp":0.004654735326766968},{"row":"tv4xh_qnli_06:q0","T":48,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00034373998641967773,"max_abs_dp":0.003377974033355713},{"row":"tv4h_00:q0","T":59,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00013728439807891846,"max_abs_dp":0.003296196460723877},{"row":"tv4h_14:q0","T":60,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0009775757789611816,"max_abs_dp":0.0030338168144226074},{"row":"tv4xh_paws_04:q0","T":76,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005544722080230713,"max_abs_dp":0.0029573440551757812},{"row":"tv4sh_00:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00014978647232055664,"max_abs_dp":0.0029485225677490234},{"row":"tv4xh_composition_holdout_09:q0","T":122,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006534159183502197,"max_abs_dp":0.002842128276824951}],"calls_total":143,"call_ms_median":49.3,"call_ms_p90":50.436,"call_ms_median_recomputed":49.3,"seconds":7.864761459,"thermal":["fair","fair"],"timeline":[[0,"fair",0.800000011920929,"charging",340.905816,3199.08676],[7.8,"fair",0.800000011920929,"charging",308.645696,3231.34688]],"memory":{"peak_footprint_mb":349.867864,"min_available_mb":3190.124712},"errors":0},"reset":{"record":"tv4_000","kind":"jit","hidden_bit_equal":true,"p_bit_equal":true,"latency_ms":45.321875000000006,"thermal":"fair","pass":true,"error":null}},"pass":true}},"probes_stage_b":{"r13_probe_d128_20261004-113230":{"schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113230/probe_dyn_20261004-113230.json","bin":"_work/device_runs/20261004-113230/probe_dyn_20261004-113230_hidden.bin","bin_sha256":"e9c5cd802db59cfea4aecf3ace0cf93a5a46f35ece47347636998b6478460743","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":4.149053416,"load_aimodel_s":3.733344125,"load_main_s":0.415698958,"cache_bytes_before":15019568821,"cache_bytes_after_load":17521801464,"cache_bytes_added_by_load":2502232643,"cache_bytes_after_lengths":17521801464,"cache_bytes_end":17521801464,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440"},"load_memory":{"peak_footprint_mb":94.081792,"min_available_mb":3445.910784},"passes_memory":{"peak_footprint_mb":333.811424,"min_available_mb":3206.181152,"duration_s":10.387019041},"lengths":[{"s":16,"first_ms":472.77908300000007,"second_ms":16.091834000000002,"warm_median_ms":15.542208000000002,"finite":true,"first_hidden_sha256":"b4aeda4756f76f40ea31aab33d7284db1bded0de6ad06574ab9a5763cf10edd1","error":null},{"s":32,"first_ms":22.797792,"second_ms":31.690792000000002,"warm_median_ms":19.363375,"finite":true,"first_hidden_sha256":"0c589dc1fa309f1f593b7c2befece46148bc91fb66fd51eef269393f2c9683f5","error":null},{"s":48,"first_ms":204.745167,"second_ms":127.80758300000001,"warm_median_ms":22.180084000000004,"finite":true,"first_hidden_sha256":"a30dfc79830aa74cd73f6b1087ea79a1670b87be1d44f1ac55aee433a55d2aa2","error":null},{"s":64,"first_ms":25.845792000000003,"second_ms":24.430833000000003,"warm_median_ms":24.571375000000003,"finite":true,"first_hidden_sha256":"8e990d9636e309c8ed531c1b66480a6a4aa52c3e1143b3f7a127da7c0bf15dec","error":null},{"s":80,"first_ms":214.77266700000004,"second_ms":28.376834000000002,"warm_median_ms":28.580709000000002,"finite":true,"first_hidden_sha256":"ed6108ff6745ab21a0858268cae2f8b23cc0a5897ca6ebde155962b8606db37f","error":null},{"s":96,"first_ms":32.031000000000006,"second_ms":31.189167000000005,"warm_median_ms":31.341208,"finite":true,"first_hidden_sha256":"55f78ce314ff3ca8962443c2a7c1f0c07600ac821a05e06d00b1a0847e8f872f","error":null},{"s":112,"first_ms":127.275583,"second_ms":34.248958,"warm_median_ms":34.403541000000004,"finite":true,"first_hidden_sha256":"bad30599baea0434804d2573e61fea60986723d4142f15e99039a14c6083f6ff","error":null},{"s":128,"first_ms":40.858417,"second_ms":36.84308300000001,"warm_median_ms":37.598792,"finite":true,"first_hidden_sha256":"93f9af11d244bf589d7fbf46221c5bb0ca9c3e37d9236c6ab481b28b82118a26","error":null},{"s":8,"first_ms":617.050959,"second_ms":112.296875,"warm_median_ms":15.310291000000001,"finite":true,"first_hidden_sha256":"136b7b6bb08ed5f2d1ac27daef33d850c7de36fd5d9719ef1f1c5267f69a0edb","error":null},{"s":24,"first_ms":405.1775,"second_ms":17.741208,"warm_median_ms":17.716916,"finite":true,"first_hidden_sha256":"db04b9aa810a475d872a858cba07efacbdca89ce288f04c621143ea728bb2e45","error":null},{"s":94,"first_ms":560.351708,"second_ms":31.034250000000004,"warm_median_ms":31.171833000000003,"finite":true,"first_hidden_sha256":"977df1bba8d711d3525ee84e4565b688a32928474d744ca728212ecd4ec1c84e","error":null},{"s":127,"first_ms":217.36633400000002,"second_ms":37.057917,"warm_median_ms":37.267,"finite":true,"first_hidden_sha256":"036a6040bd20b34a3cbecfb064fd43e9142361b3d1a9df53ba3a09bb20c5abfa","error":null},{"s":2,"first_ms":370.9356250000001,"second_ms":13.445625000000001,"warm_median_ms":13.192166000000002,"finite":true,"first_hidden_sha256":"5dc3e839ae7e7838748c31d3517d656e3aa557fde99e5424e6c0102c9c93262c","error":null}],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":30.925416000000002,"graph_ms_timed":[30.9125,30.882166,31.071916,30.925416000000002,30.962958000000004],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[128,128,128],"p":[0.3404892086982727,0.22809110581874847,0.1520783007144928,0.27934136986732483],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.0005775392055511475,"mean_abs_dp":0.00038537755608558655,"finite":true,"graph_ms_median":109.530375,"graph_ms_timed":[109.530375,109.46891700000002,109.65437500000002,109.68441700000001,109.26787500000002],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":9.676814079284668e-05,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[128,128,128,128,128,128,128,128,128,128,128,112],"p":[0.17661789059638977,0.030022727325558662,0.07260291278362274,0.6022560596466064,0.11850042641162872],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.005452513694763184,"mean_abs_dp":0.0021810151636600496,"finite":true,"graph_ms_median":461.48483400000003,"graph_ms_timed":[454.75950000000006,461.48483400000003,465.1733750000001,464.061125,461.12504200000006],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0003300309181213379,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.005452513694763184,"mean_of_row_mean_abs_dp":0.0012095195551713308,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]},"r13_probe_d128_20261004-113253":{"schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113253/probe_dyn_20261004-113253.json","bin":"_work/device_runs/20261004-113253/probe_dyn_20261004-113253_hidden.bin","bin_sha256":"e9c5cd802db59cfea4aecf3ace0cf93a5a46f35ece47347636998b6478460743","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":0.32152579200000003,"load_aimodel_s":0.002305333,"load_main_s":0.319210667,"cache_bytes_before":17521801464,"cache_bytes_after_load":17521801464,"cache_bytes_added_by_load":0,"cache_bytes_after_lengths":17521801464,"cache_bytes_end":17521801464,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440"},"load_memory":{"peak_footprint_mb":30.36384,"min_available_mb":3509.628736},"passes_memory":{"peak_footprint_mb":339.218192,"min_available_mb":3200.774384,"duration_s":6.820368709},"lengths":[{"s":16,"first_ms":41.817542,"second_ms":15.630792000000001,"warm_median_ms":15.419292,"finite":true,"first_hidden_sha256":"b4aeda4756f76f40ea31aab33d7284db1bded0de6ad06574ab9a5763cf10edd1","error":null},{"s":32,"first_ms":21.088500000000003,"second_ms":19.551417,"warm_median_ms":19.373208,"finite":true,"first_hidden_sha256":"0c589dc1fa309f1f593b7c2befece46148bc91fb66fd51eef269393f2c9683f5","error":null},{"s":48,"first_ms":22.971542,"second_ms":22.064125,"warm_median_ms":22.059041,"finite":true,"first_hidden_sha256":"a30dfc79830aa74cd73f6b1087ea79a1670b87be1d44f1ac55aee433a55d2aa2","error":null},{"s":64,"first_ms":25.954708000000004,"second_ms":24.416334000000003,"warm_median_ms":24.534292000000004,"finite":true,"first_hidden_sha256":"8e990d9636e309c8ed531c1b66480a6a4aa52c3e1143b3f7a127da7c0bf15dec","error":null},{"s":80,"first_ms":29.483833,"second_ms":28.319667000000003,"warm_median_ms":28.585084000000002,"finite":true,"first_hidden_sha256":"ed6108ff6745ab21a0858268cae2f8b23cc0a5897ca6ebde155962b8606db37f","error":null},{"s":96,"first_ms":32.135417,"second_ms":31.095458000000004,"warm_median_ms":31.307792,"finite":true,"first_hidden_sha256":"55f78ce314ff3ca8962443c2a7c1f0c07600ac821a05e06d00b1a0847e8f872f","error":null},{"s":112,"first_ms":35.362083000000005,"second_ms":34.127375,"warm_median_ms":34.468125,"finite":true,"first_hidden_sha256":"bad30599baea0434804d2573e61fea60986723d4142f15e99039a14c6083f6ff","error":null},{"s":128,"first_ms":39.003833,"second_ms":36.304125,"warm_median_ms":37.012625,"finite":true,"first_hidden_sha256":"93f9af11d244bf589d7fbf46221c5bb0ca9c3e37d9236c6ab481b28b82118a26","error":null},{"s":8,"first_ms":16.233125,"second_ms":14.781,"warm_median_ms":14.7615,"finite":true,"first_hidden_sha256":"136b7b6bb08ed5f2d1ac27daef33d850c7de36fd5d9719ef1f1c5267f69a0edb","error":null},{"s":24,"first_ms":18.907833000000004,"second_ms":17.763709000000002,"warm_median_ms":17.685125000000003,"finite":true,"first_hidden_sha256":"db04b9aa810a475d872a858cba07efacbdca89ce288f04c621143ea728bb2e45","error":null},{"s":94,"first_ms":32.92879200000001,"second_ms":30.966333000000002,"warm_median_ms":31.105334000000003,"finite":true,"first_hidden_sha256":"977df1bba8d711d3525ee84e4565b688a32928474d744ca728212ecd4ec1c84e","error":null},{"s":127,"first_ms":38.144333,"second_ms":36.8145,"warm_median_ms":37.409000000000006,"finite":true,"first_hidden_sha256":"036a6040bd20b34a3cbecfb064fd43e9142361b3d1a9df53ba3a09bb20c5abfa","error":null},{"s":2,"first_ms":15.194625000000002,"second_ms":13.219166000000001,"warm_median_ms":13.180916000000002,"finite":true,"first_hidden_sha256":"5dc3e839ae7e7838748c31d3517d656e3aa557fde99e5424e6c0102c9c93262c","error":null}],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":31.096125,"graph_ms_timed":[31.103792000000002,31.036417000000004,31.095625000000002,31.097000000000005,31.096125],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[128,128,128],"p":[0.3404892086982727,0.22809110581874847,0.1520783007144928,0.27934136986732483],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.0005775392055511475,"mean_abs_dp":0.00038537755608558655,"finite":true,"graph_ms_median":109.98808300000002,"graph_ms_timed":[110.00129200000002,109.66120800000002,109.682333,109.98808300000002,110.04008300000001],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":9.676814079284668e-05,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[128,128,128,128,128,128,128,128,128,128,128,112],"p":[0.17661789059638977,0.030022727325558662,0.07260291278362274,0.6022560596466064,0.11850042641162872],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.005452513694763184,"mean_abs_dp":0.0021810151636600496,"finite":true,"graph_ms_median":461.45858300000003,"graph_ms_timed":[474.67595800000004,461.243959,461.45858300000003,467.71595800000006,460.99716700000005],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0003300309181213379,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.005452513694763184,"mean_of_row_mean_abs_dp":0.0012095195551713308,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]},"r13_probe_d128_20261004-113315":{"schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113315/probe_dyn_20261004-113315.json","bin":"_work/device_runs/20261004-113315/probe_dyn_20261004-113315_hidden.bin","bin_sha256":"e9c5cd802db59cfea4aecf3ace0cf93a5a46f35ece47347636998b6478460743","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":0.17225779200000002,"load_aimodel_s":0.001215958,"load_main_s":0.17103200000000002,"cache_bytes_before":17521801464,"cache_bytes_after_load":17521801464,"cache_bytes_added_by_load":0,"cache_bytes_after_lengths":17521801464,"cache_bytes_end":17521801464,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440"},"load_memory":{"peak_footprint_mb":29.904392,"min_available_mb":3510.088184},"passes_memory":{"peak_footprint_mb":341.413624,"min_available_mb":3198.578952,"duration_s":6.711107333},"lengths":[{"s":16,"first_ms":39.0525,"second_ms":15.637542000000002,"warm_median_ms":15.389542,"finite":true,"first_hidden_sha256":"b4aeda4756f76f40ea31aab33d7284db1bded0de6ad06574ab9a5763cf10edd1","error":null},{"s":32,"first_ms":20.871584000000002,"second_ms":19.414083,"warm_median_ms":19.176416000000003,"finite":true,"first_hidden_sha256":"0c589dc1fa309f1f593b7c2befece46148bc91fb66fd51eef269393f2c9683f5","error":null},{"s":48,"first_ms":22.8305,"second_ms":21.913417000000003,"warm_median_ms":21.941583,"finite":true,"first_hidden_sha256":"a30dfc79830aa74cd73f6b1087ea79a1670b87be1d44f1ac55aee433a55d2aa2","error":null},{"s":64,"first_ms":25.860375,"second_ms":24.279958,"warm_median_ms":24.442125,"finite":true,"first_hidden_sha256":"8e990d9636e309c8ed531c1b66480a6a4aa52c3e1143b3f7a127da7c0bf15dec","error":null},{"s":80,"first_ms":29.535208000000004,"second_ms":28.331084000000004,"warm_median_ms":28.488041000000003,"finite":true,"first_hidden_sha256":"ed6108ff6745ab21a0858268cae2f8b23cc0a5897ca6ebde155962b8606db37f","error":null},{"s":96,"first_ms":31.718208000000004,"second_ms":30.925500000000003,"warm_median_ms":31.142417000000002,"finite":true,"first_hidden_sha256":"55f78ce314ff3ca8962443c2a7c1f0c07600ac821a05e06d00b1a0847e8f872f","error":null},{"s":112,"first_ms":35.244333000000005,"second_ms":34.084,"warm_median_ms":34.362125,"finite":true,"first_hidden_sha256":"bad30599baea0434804d2573e61fea60986723d4142f15e99039a14c6083f6ff","error":null},{"s":128,"first_ms":37.55266700000001,"second_ms":36.165334,"warm_median_ms":36.946459000000004,"finite":true,"first_hidden_sha256":"93f9af11d244bf589d7fbf46221c5bb0ca9c3e37d9236c6ab481b28b82118a26","error":null},{"s":8,"first_ms":16.7785,"second_ms":15.207666000000001,"warm_median_ms":14.564583,"finite":true,"first_hidden_sha256":"136b7b6bb08ed5f2d1ac27daef33d850c7de36fd5d9719ef1f1c5267f69a0edb","error":null},{"s":24,"first_ms":18.735041000000002,"second_ms":17.632,"warm_median_ms":17.609417,"finite":true,"first_hidden_sha256":"db04b9aa810a475d872a858cba07efacbdca89ce288f04c621143ea728bb2e45","error":null},{"s":94,"first_ms":32.68225,"second_ms":30.912666,"warm_median_ms":31.032416000000005,"finite":true,"first_hidden_sha256":"977df1bba8d711d3525ee84e4565b688a32928474d744ca728212ecd4ec1c84e","error":null},{"s":127,"first_ms":37.759750000000004,"second_ms":36.710958000000005,"warm_median_ms":37.384833,"finite":true,"first_hidden_sha256":"036a6040bd20b34a3cbecfb064fd43e9142361b3d1a9df53ba3a09bb20c5abfa","error":null},{"s":2,"first_ms":14.982333,"second_ms":13.293833000000001,"warm_median_ms":13.1465,"finite":true,"first_hidden_sha256":"5dc3e839ae7e7838748c31d3517d656e3aa557fde99e5424e6c0102c9c93262c","error":null}],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":30.989917000000002,"graph_ms_timed":[30.989917000000002,31.107750000000003,31.007333000000003,30.940666000000004,30.960084000000002],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[128,128,128],"p":[0.3404892086982727,0.22809110581874847,0.1520783007144928,0.27934136986732483],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.0005775392055511475,"mean_abs_dp":0.00038537755608558655,"finite":true,"graph_ms_median":109.45929100000001,"graph_ms_timed":[109.45929100000001,109.306959,109.558833,109.49950000000001,109.37162500000001],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":9.676814079284668e-05,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[128,128,128,128,128,128,128,128,128,128,128,112],"p":[0.17661789059638977,0.030022727325558662,0.07260291278362274,0.6022560596466064,0.11850042641162872],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.005452513694763184,"mean_abs_dp":0.0021810151636600496,"finite":true,"graph_ms_median":459.962083,"graph_ms_timed":[459.962083,459.515416,465.404375,459.745292,465.64666600000004],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0003300309181213379,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.005452513694763184,"mean_of_row_mean_abs_dp":0.0012095195551713308,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["fair","fair"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]},"r13_probe_d512_20261004-113858":{"schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113858/probe_dyn_20261004-113858.json","bin":"_work/device_runs/20261004-113858/probe_dyn_20261004-113858_hidden.bin","bin_sha256":"e9c5cd802db59cfea4aecf3ace0cf93a5a46f35ece47347636998b6478460743","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":5.081608125,"load_aimodel_s":4.617166125,"load_main_s":0.46443166700000005,"cache_bytes_before":17521801464,"cache_bytes_after_load":20024034127,"cache_bytes_added_by_load":2502232663,"cache_bytes_after_lengths":20024034127,"cache_bytes_end":20024034127,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2"},"load_memory":{"peak_footprint_mb":89.674496,"min_available_mb":3450.31808},"passes_memory":{"peak_footprint_mb":510.480072,"min_available_mb":3029.512504,"duration_s":10.387466875},"lengths":[{"s":16,"first_ms":276.80241700000005,"second_ms":17.37975,"warm_median_ms":15.648458,"finite":true,"first_hidden_sha256":"b4aeda4756f76f40ea31aab33d7284db1bded0de6ad06574ab9a5763cf10edd1","error":null},{"s":32,"first_ms":23.245667,"second_ms":20.174833000000003,"warm_median_ms":19.568125000000002,"finite":true,"first_hidden_sha256":"0c589dc1fa309f1f593b7c2befece46148bc91fb66fd51eef269393f2c9683f5","error":null},{"s":48,"first_ms":22.939375000000002,"second_ms":22.090833,"warm_median_ms":22.144666,"finite":true,"first_hidden_sha256":"a30dfc79830aa74cd73f6b1087ea79a1670b87be1d44f1ac55aee433a55d2aa2","error":null},{"s":64,"first_ms":25.986541000000003,"second_ms":24.282,"warm_median_ms":24.490167,"finite":true,"first_hidden_sha256":"8e990d9636e309c8ed531c1b66480a6a4aa52c3e1143b3f7a127da7c0bf15dec","error":null},{"s":80,"first_ms":29.892833,"second_ms":28.487375000000004,"warm_median_ms":28.64025,"finite":true,"first_hidden_sha256":"ed6108ff6745ab21a0858268cae2f8b23cc0a5897ca6ebde155962b8606db37f","error":null},{"s":96,"first_ms":32.005292000000004,"second_ms":31.073458000000002,"warm_median_ms":31.314500000000002,"finite":true,"first_hidden_sha256":"55f78ce314ff3ca8962443c2a7c1f0c07600ac821a05e06d00b1a0847e8f872f","error":null},{"s":112,"first_ms":35.676542000000005,"second_ms":34.205209,"warm_median_ms":34.45725,"finite":true,"first_hidden_sha256":"bad30599baea0434804d2573e61fea60986723d4142f15e99039a14c6083f6ff","error":null},{"s":128,"first_ms":38.903458,"second_ms":37.138042000000006,"warm_median_ms":38.25083300000001,"finite":true,"first_hidden_sha256":"93f9af11d244bf589d7fbf46221c5bb0ca9c3e37d9236c6ab481b28b82118a26","error":null},{"s":192,"first_ms":398.854959,"second_ms":67.18004200000001,"warm_median_ms":62.117125,"finite":true,"first_hidden_sha256":"84a12b2d4877c805dcbcd595154afb226ea219a9322136e8aafd95519ec1979d","error":null},{"s":256,"first_ms":404.89829100000003,"second_ms":71.99900000000001,"warm_median_ms":76.03945900000001,"finite":true,"first_hidden_sha256":"7c76ed26aad05f45f1f107d97174cb62a0474d7944e1204744460138910d57ba","error":null},{"s":384,"first_ms":111.544083,"second_ms":114.21370900000001,"warm_median_ms":118.241625,"finite":true,"first_hidden_sha256":"80206de3c13c5926af8186f42a9b707eaca0e0380a9ebffcd9284a67016fb4c7","error":null},{"s":512,"first_ms":419.836125,"second_ms":140.16441600000002,"warm_median_ms":157.81900000000002,"finite":true,"first_hidden_sha256":"35d2d6c9955e61bd667002184503bd02d79e4cc335c1082b22d29d52d9acf417","error":null},{"s":94,"first_ms":36.445417,"second_ms":30.979292,"warm_median_ms":31.005667,"finite":true,"first_hidden_sha256":"977df1bba8d711d3525ee84e4565b688a32928474d744ca728212ecd4ec1c84e","error":null}],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":30.986750000000004,"graph_ms_timed":[31.051541,30.986750000000004,31.016292,30.906208,30.889125000000003],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[128,128,128],"p":[0.3404892086982727,0.22809110581874847,0.1520783007144928,0.27934136986732483],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.0005775392055511475,"mean_abs_dp":0.00038537755608558655,"finite":true,"graph_ms_median":111.01875000000001,"graph_ms_timed":[110.5705,110.56179200000001,111.01875000000001,111.155292,115.742042],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":9.676814079284668e-05,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[128,128,128,128,128,128,128,128,128,128,128,112],"p":[0.17661789059638977,0.030022727325558662,0.07260291278362274,0.6022560596466064,0.11850042641162872],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.005452513694763184,"mean_abs_dp":0.0021810151636600496,"finite":true,"graph_ms_median":469.1306670000001,"graph_ms_timed":[470.64654200000007,469.1306670000001,462.082666,470.637666,463.06075000000004],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0003300309181213379,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.005452513694763184,"mean_of_row_mean_abs_dp":0.0012095195551713308,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]},"r13_probe_d512_20261004-113921":{"schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113921/probe_dyn_20261004-113921.json","bin":"_work/device_runs/20261004-113921/probe_dyn_20261004-113921_hidden.bin","bin_sha256":"c1b6225a62f5e04e91280c4652ff5d4618434430068370ffcae9c66f2d1b88db","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":0.432769834,"load_aimodel_s":0.0015051250000000002,"load_main_s":0.43125391700000004,"cache_bytes_before":20024034127,"cache_bytes_after_load":20024034127,"cache_bytes_added_by_load":0,"cache_bytes_after_lengths":20024034127,"cache_bytes_end":20024034127,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2"},"load_memory":{"peak_footprint_mb":30.002816,"min_available_mb":3509.98976},"passes_memory":{"peak_footprint_mb":568.086288,"min_available_mb":2971.906288,"duration_s":9.316710292},"lengths":[{"s":16,"first_ms":40.344792000000005,"second_ms":16.582708,"warm_median_ms":15.465708000000001,"finite":true,"first_hidden_sha256":"b4aeda4756f76f40ea31aab33d7284db1bded0de6ad06574ab9a5763cf10edd1","error":null},{"s":32,"first_ms":21.138125000000002,"second_ms":19.611625,"warm_median_ms":19.483834,"finite":true,"first_hidden_sha256":"0c589dc1fa309f1f593b7c2befece46148bc91fb66fd51eef269393f2c9683f5","error":null},{"s":48,"first_ms":22.874542,"second_ms":22.201,"warm_median_ms":22.165292000000004,"finite":true,"first_hidden_sha256":"a30dfc79830aa74cd73f6b1087ea79a1670b87be1d44f1ac55aee433a55d2aa2","error":null},{"s":64,"first_ms":26.052834,"second_ms":24.466167000000002,"warm_median_ms":24.633833,"finite":true,"first_hidden_sha256":"8e990d9636e309c8ed531c1b66480a6a4aa52c3e1143b3f7a127da7c0bf15dec","error":null},{"s":80,"first_ms":29.666833000000004,"second_ms":28.390583,"warm_median_ms":28.527458000000003,"finite":true,"first_hidden_sha256":"ed6108ff6745ab21a0858268cae2f8b23cc0a5897ca6ebde155962b8606db37f","error":null},{"s":96,"first_ms":32.080042000000006,"second_ms":31.122709,"warm_median_ms":31.310291000000003,"finite":true,"first_hidden_sha256":"55f78ce314ff3ca8962443c2a7c1f0c07600ac821a05e06d00b1a0847e8f872f","error":null},{"s":112,"first_ms":35.50854100000001,"second_ms":34.203875000000004,"warm_median_ms":34.527,"finite":true,"first_hidden_sha256":"bad30599baea0434804d2573e61fea60986723d4142f15e99039a14c6083f6ff","error":null},{"s":128,"first_ms":37.64600000000001,"second_ms":36.591417,"warm_median_ms":37.074916,"finite":true,"first_hidden_sha256":"93f9af11d244bf589d7fbf46221c5bb0ca9c3e37d9236c6ab481b28b82118a26","error":null},{"s":192,"first_ms":61.03191700000001,"second_ms":60.081458000000005,"warm_median_ms":65.82541700000002,"finite":true,"first_hidden_sha256":"84a12b2d4877c805dcbcd595154afb226ea219a9322136e8aafd95519ec1979d","error":null},{"s":256,"first_ms":71.91391700000001,"second_ms":71.400375,"warm_median_ms":76.77708400000002,"finite":true,"first_hidden_sha256":"7c76ed26aad05f45f1f107d97174cb62a0474d7944e1204744460138910d57ba","error":null},{"s":384,"first_ms":109.05212500000002,"second_ms":110.253,"warm_median_ms":118.359791,"finite":true,"first_hidden_sha256":"80206de3c13c5926af8186f42a9b707eaca0e0380a9ebffcd9284a67016fb4c7","error":null},{"s":512,"first_ms":141.986584,"second_ms":147.36875000000003,"warm_median_ms":158.429292,"finite":true,"first_hidden_sha256":"35d2d6c9955e61bd667002184503bd02d79e4cc335c1082b22d29d52d9acf417","error":null},{"s":94,"first_ms":33.296125,"second_ms":30.934250000000002,"warm_median_ms":31.244209,"finite":true,"first_hidden_sha256":"977df1bba8d711d3525ee84e4565b688a32928474d744ca728212ecd4ec1c84e","error":null}],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":31.005417000000005,"graph_ms_timed":[31.230167,31.018041000000004,31.005417000000005,30.987750000000002,30.959708000000003],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[256,128],"p":[0.34047847986221313,0.22795036435127258,0.15229539573192596,0.2792757451534271],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.000794634222984314,"mean_abs_dp":0.00046111270785331726,"finite":true,"graph_ms_median":113.24854200000001,"graph_ms_timed":[112.851708,116.234209,116.411333,109.690375,113.24854200000001],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.00018796324729919434,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[256,256,256,256,256,240],"p":[0.17663322389125824,0.029993826523423195,0.0724891647696495,0.6023768186569214,0.11850697547197342],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.005331754684448242,"mean_abs_dp":0.0021327100694179535,"finite":true,"graph_ms_median":446.222708,"graph_ms_timed":[441.3982500000001,447.11175000000003,446.222708,449.88833300000005,445.31333300000006],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0002964586019515991,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.005331754684448242,"mean_of_row_mean_abs_dp":0.0012186629076798756,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]},"r13_probe_d512_20261004-113943":{"schema":"kev-device-r13-probe/1","probe_json":"_work/device_runs/20261004-113943/probe_dyn_20261004-113943.json","bin":"_work/device_runs/20261004-113943/probe_dyn_20261004-113943_hidden.bin","bin_sha256":"ae038097b0349bec058b793f337b7ccbf49c512b6ea0673b0ef960ea7e36a625","head":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_0_8b_decode_fp16_metal_dyn128/head","load":{"load_wall_s":0.17929887500000002,"load_aimodel_s":0.001400917,"load_main_s":0.177887666,"cache_bytes_before":20024034127,"cache_bytes_after_load":20024034127,"cache_bytes_added_by_load":0,"cache_bytes_after_lengths":20024034127,"cache_bytes_end":20024034127,"options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","output_view":false,"asset_main_hash":"ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2"},"load_memory":{"peak_footprint_mb":29.642032,"min_available_mb":3510.350544},"passes_memory":{"peak_footprint_mb":449.253136,"min_available_mb":3090.73944,"duration_s":4.617102375},"lengths":[],"rows":[{"row":"tv4_000:q0","T":94,"pieces":[96],"p":[0.14803270995616913,0.20520484447479248,0.4343705475330353,0.21239188313484192],"argmax":2,"argmax_oracle":2,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.2241945117712021,"max_abs_dp":0.002124309539794922,"mean_abs_dp":0.0010621659457683563,"finite":true,"graph_ms_median":30.914375,"graph_ms_timed":[31.044709000000005,30.866125,30.914375,30.853417,30.953500000000002],"passes_bit_equal":true},{"row":"own_j03:q0","T":380,"pieces":[384],"p":[0.34054088592529297,0.22806283831596375,0.15224213898181915,0.27915412187576294],"argmax":0,"argmax_oracle":0,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.06177407503128052,"max_abs_dp":0.0007413774728775024,"mean_abs_dp":0.0003736726939678192,"finite":true,"graph_ms_median":107.65325,"graph_ms_timed":[107.65325,110.47708300000001,108.456042,106.143917,106.640083],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0001347064971923828,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}},{"row":"own_L02:q0","T":1518,"pieces":[512,512,496],"p":[0.17624886333942413,0.029838068410754204,0.07244009524583817,0.60317063331604,0.1183023452758789],"argmax":3,"argmax_oracle":3,"argmax_equal":true,"near_tie":false,"oracle_top2_margin":0.43417489528656006,"max_abs_dp":0.00453794002532959,"mean_abs_dp":0.0018151834607124328,"finite":true,"graph_ms_median":434.215459,"graph_ms_timed":[435.467292,432.768791,434.215459,433.16283300000003,437.38170800000006],"passes_bit_equal":true,"mac_d128":{"source":"r14_s80_D128.json","max_abs_dp":0.0005845427513122559,"argmax_equal":true,"note":"Mac pieces q = 1, the probe's q = 16"}}],"summary":{"rows":3,"argmax_equal_non_near_tie":3,"questions_non_near_tie":3,"max_abs_dp":0.00453794002532959,"mean_of_row_mean_abs_dp":0.0010836740334828694,"all_finite":true,"reset":[{"hidden_bit_equal":true,"row":"tv4_000:q0"},{"hidden_bit_equal":true,"row":"own_j03:q0"},{"hidden_bit_equal":true,"row":"own_L02:q0"}],"within_bar_rows":true},"pass":true,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}]}},"call_lengths_stage_c":{"schema":"kev-device-r13-lengths/1","readings":[{"run":"20261004-130144","call_max":"512","multiple":"16","records":20,"calls":20,"call_lengths_used":[64,80,96,112,144,176,192,240,336],"footprint_mb":{"e2e_first_sample":205.8,"e2e_last_sample":490.6,"e2e_max":498.0,"first_record":256.970488,"last_record":490.557176},"mb_per_call":12.294036210526318,"mean_delta_when_length_changed":13.809784470588237,"n_changed":17,"mean_delta_when_same_length":-0.589823999999993,"n_same":2,"bar":{"questions":20,"argmax_equal_non_near_tie":18,"questions_non_near_tie":18,"argmax_equal_near_tie":2,"near_tie_questions":2,"max_abs_dp":0.0033832192420959473,"mean_of_run_mean_abs_dp":0.0007263973267981783,"bar_pass":true},"rows_padded_to_96_ms":{"n":6,"median":32.0651875,"values":[31.996709000000006,32.262416,32.923084,32.037625,31.903875000000006,32.09275]},"tv4_000_first_record_ms":61.20300000000001,"call_ms_median":31.39,"records_seq":[{"record":"tv4_000","call_lengths":[96],"footprint_mb":256.970488,"delta_mb":null,"length_changed":false,"latency_ms":61.20300000000001},{"record":"tv4_001","call_lengths":[64],"footprint_mb":257.75692,"delta_mb":0.7864319999999907,"length_changed":true,"latency_ms":26.036792000000002},{"record":"tv4_002","call_lengths":[96],"footprint_mb":257.478392,"delta_mb":-0.27852799999999434,"length_changed":true,"latency_ms":31.996709000000006},{"record":"tv4_003","call_lengths":[80],"footprint_mb":258.592504,"delta_mb":1.1141120000000342,"length_changed":true,"latency_ms":29.556042},{"record":"tv4_004","call_lengths":[80],"footprint_mb":258.182904,"delta_mb":-0.40960000000001173,"length_changed":false,"latency_ms":29.459542000000003},{"record":"tv4_005","call_lengths":[96],"footprint_mb":258.445048,"delta_mb":0.26214399999997795,"length_changed":true,"latency_ms":32.262416},{"record":"tv4_006","call_lengths":[240],"footprint_mb":296.947448,"delta_mb":38.50240000000002,"length_changed":true,"latency_ms":69.561417},{"record":"tv4_007","call_lengths":[80],"footprint_mb":310.251256,"delta_mb":13.303808000000004,"length_changed":true,"latency_ms":30.57075},{"record":"tv4_008","call_lengths":[96],"footprint_mb":325.046008,"delta_mb":14.79475199999996,"length_changed":true,"latency_ms":32.923084},{"record":"tv4_009","call_lengths":[336],"footprint_mb":375.115512,"delta_mb":50.06950400000005,"length_changed":true,"latency_ms":99.25875},{"record":"tv4_010","call_lengths":[64],"footprint_mb":387.43628,"delta_mb":12.320767999999987,"length_changed":true,"latency_ms":27.341917},{"record":"tv4_011","call_lengths":[112],"footprint_mb":403.98412,"delta_mb":16.547840000000008,"length_changed":true,"latency_ms":35.167416},{"record":"tv4_012","call_lengths":[96],"footprint_mb":404.049656,"delta_mb":0.0655360000000087,"length_changed":true,"latency_ms":32.037625},{"record":"tv4_013","call_lengths":[176],"footprint_mb":430.03468,"delta_mb":25.985023999999953,"length_changed":true,"latency_ms":57.477958},{"record":"tv4_014","call_lengths":[96],"footprint_mb":429.428472,"delta_mb":-0.606207999999981,"length_changed":true,"latency_ms":31.903875000000006},{"record":"tv4_015","call_lengths":[192],"footprint_mb":457.281272,"delta_mb":27.852800000000002,"length_changed":true,"latency_ms":60.537625000000006},{"record":"tv4_016","call_lengths":[96],"footprint_mb":456.134392,"delta_mb":-1.1468800000000101,"length_changed":true,"latency_ms":32.09275},{"record":"tv4_017","call_lengths":[80],"footprint_mb":470.224632,"delta_mb":14.090239999999994,"length_changed":true,"latency_ms":29.590459000000003},{"record":"tv4_018","call_lengths":[80],"footprint_mb":469.454584,"delta_mb":-0.7700479999999743,"length_changed":false,"latency_ms":29.346},{"record":"tv4_019","call_lengths":[144],"footprint_mb":490.557176,"delta_mb":21.102592000000016,"length_changed":true,"latency_ms":52.16225}]},{"run":"20261004-130156","call_max":"128","multiple":"128","records":20,"calls":26,"call_lengths_used":[128],"footprint_mb":{"e2e_first_sample":205.6,"e2e_last_sample":265.7,"e2e_max":295.7,"first_record":280.465144,"last_record":265.670392},"mb_per_call":-0.5917900800000007,"mean_delta_when_length_changed":null,"n_changed":0,"mean_delta_when_same_length":-0.7786711578947377,"n_same":19,"bar":{"questions":20,"argmax_equal_non_near_tie":18,"questions_non_near_tie":18,"argmax_equal_near_tie":2,"near_tie_questions":2,"max_abs_dp":0.0034315288066864014,"mean_of_run_mean_abs_dp":0.0007403169816825539,"bar_pass":true},"rows_padded_to_96_ms":{"n":6,"median":37.870458500000005,"values":[37.95441700000001,39.501875000000005,39.393792000000005,37.786500000000004,37.727375,37.592042000000006]},"tv4_000_first_record_ms":64.461792,"call_ms_median":37.135,"records_seq":[{"record":"tv4_000","call_lengths":[128],"footprint_mb":280.465144,"delta_mb":null,"length_changed":false,"latency_ms":64.461792},{"record":"tv4_001","call_lengths":[128],"footprint_mb":282.218232,"delta_mb":1.753087999999991,"length_changed":false,"latency_ms":38.38358300000001},{"record":"tv4_002","call_lengths":[128],"footprint_mb":282.529528,"delta_mb":0.3112960000000271,"length_changed":false,"latency_ms":37.95441700000001},{"record":"tv4_003","call_lengths":[128],"footprint_mb":282.218232,"delta_mb":-0.3112960000000271,"length_changed":false,"latency_ms":37.812917},{"record":"tv4_004","call_lengths":[128],"footprint_mb":282.136312,"delta_mb":-0.08192000000002508,"length_changed":false,"latency_ms":37.890333000000005},{"record":"tv4_005","call_lengths":[128],"footprint_mb":282.251,"delta_mb":0.11468800000000101,"length_changed":false,"latency_ms":39.501875000000005},{"record":"tv4_006","call_lengths":[128,128],"footprint_mb":283.578104,"delta_mb":1.3271040000000198,"length_changed":false,"latency_ms":76.243084},{"record":"tv4_007","call_lengths":[128],"footprint_mb":283.774712,"delta_mb":0.1966080000000261,"length_changed":false,"latency_ms":38.336875},{"record":"tv4_008","call_lengths":[128],"footprint_mb":284.05324,"delta_mb":0.27852799999999434,"length_changed":false,"latency_ms":39.393792000000005},{"record":"tv4_009","call_lengths":[128,128,128],"footprint_mb":284.724984,"delta_mb":0.6717439999999897,"length_changed":false,"latency_ms":113.58995800000001},{"record":"tv4_010","call_lengths":[128],"footprint_mb":284.446456,"delta_mb":-0.27852799999999434,"length_changed":false,"latency_ms":38.680875},{"record":"tv4_011","call_lengths":[128],"footprint_mb":285.265656,"delta_mb":0.8191999999999666,"length_changed":false,"latency_ms":37.84545800000001},{"record":"tv4_012","call_lengths":[128],"footprint_mb":285.429496,"delta_mb":0.16383999999999332,"length_changed":false,"latency_ms":37.786500000000004},{"record":"tv4_013","call_lengths":[128,128],"footprint_mb":284.774136,"delta_mb":-0.6553599999999733,"length_changed":false,"latency_ms":74.321959},{"record":"tv4_014","call_lengths":[128],"footprint_mb":285.642488,"delta_mb":0.8683520000000158,"length_changed":false,"latency_ms":37.727375},{"record":"tv4_015","call_lengths":[128,128],"footprint_mb":285.675256,"delta_mb":0.03276799999997593,"length_changed":false,"latency_ms":74.704166},{"record":"tv4_016","call_lengths":[128],"footprint_mb":285.593336,"delta_mb":-0.08191999999996824,"length_changed":false,"latency_ms":37.592042000000006},{"record":"tv4_017","call_lengths":[128],"footprint_mb":265.70316,"delta_mb":-19.890175999999997,"length_changed":false,"latency_ms":37.724208000000004},{"record":"tv4_018","call_lengths":[128],"footprint_mb":264.851192,"delta_mb":-0.8519679999999994,"length_changed":false,"latency_ms":37.585},{"record":"tv4_019","call_lengths":[128,128],"footprint_mb":265.670392,"delta_mb":0.8191999999999666,"length_changed":false,"latency_ms":74.238709}]},{"run":"20261004-130253","call_max":"512","multiple":"512","records":20,"calls":20,"call_lengths_used":[512],"footprint_mb":{"e2e_first_sample":205.7,"e2e_last_sample":282.2,"e2e_max":350.3,"first_record":337.46508,"last_record":282.00524},"mb_per_call":-2.9189389473684204,"mean_delta_when_length_changed":null,"n_changed":0,"mean_delta_when_same_length":-2.9189389473684204,"n_same":19,"bar":{"questions":20,"argmax_equal_non_near_tie":18,"questions_non_near_tie":18,"argmax_equal_near_tie":2,"near_tie_questions":2,"max_abs_dp":0.0033832192420959473,"mean_of_run_mean_abs_dp":0.0007244711567182093,"bar_pass":true},"rows_padded_to_96_ms":{"n":6,"median":139.0887705,"values":[141.865833,138.955458,139.007958,137.12358300000002,139.219167,139.16958300000002]},"tv4_000_first_record_ms":163.086417,"call_ms_median":135.725,"records_seq":[{"record":"tv4_000","call_lengths":[512],"footprint_mb":337.46508,"delta_mb":null,"length_changed":false,"latency_ms":163.086417},{"record":"tv4_001","call_lengths":[512],"footprint_mb":337.071864,"delta_mb":-0.39321599999999535,"length_changed":false,"latency_ms":140.126208},{"record":"tv4_002","call_lengths":[512],"footprint_mb":338.480888,"delta_mb":1.409023999999988,"length_changed":false,"latency_ms":141.865833},{"record":"tv4_003","call_lengths":[512],"footprint_mb":338.546424,"delta_mb":0.0655360000000087,"length_changed":false,"latency_ms":139.79825000000002},{"record":"tv4_004","call_lengths":[512],"footprint_mb":338.85772,"delta_mb":0.31129599999997026,"length_changed":false,"latency_ms":139.639416},{"record":"tv4_005","call_lengths":[512],"footprint_mb":338.841336,"delta_mb":-0.016383999999959542,"length_changed":false,"latency_ms":138.955458},{"record":"tv4_006","call_lengths":[512],"footprint_mb":308.973304,"delta_mb":-29.868032000000028,"length_changed":false,"latency_ms":139.197542},{"record":"tv4_007","call_lengths":[512],"footprint_mb":309.169912,"delta_mb":0.1966080000000261,"length_changed":false,"latency_ms":140.402041},{"record":"tv4_008","call_lengths":[512],"footprint_mb":309.464824,"delta_mb":0.2949120000000107,"length_changed":false,"latency_ms":139.007958},{"record":"tv4_009","call_lengths":[512],"footprint_mb":310.02188,"delta_mb":0.5570559999999887,"length_changed":false,"latency_ms":138.37079200000002},{"record":"tv4_010","call_lengths":[512],"footprint_mb":310.120184,"delta_mb":0.09830399999998463,"length_changed":false,"latency_ms":138.279209},{"record":"tv4_011","call_lengths":[512],"footprint_mb":310.529784,"delta_mb":0.40960000000001173,"length_changed":false,"latency_ms":139.45162500000004},{"record":"tv4_012","call_lengths":[512],"footprint_mb":310.415096,"delta_mb":-0.11468800000000101,"length_changed":false,"latency_ms":137.12358300000002},{"record":"tv4_013","call_lengths":[512],"footprint_mb":291.2622,"delta_mb":-19.152896,"length_changed":false,"latency_ms":141.50925},{"record":"tv4_014","call_lengths":[512],"footprint_mb":291.311352,"delta_mb":0.04915199999999231,"length_changed":false,"latency_ms":139.219167},{"record":"tv4_015","call_lengths":[512],"footprint_mb":290.754296,"delta_mb":-0.5570559999999887,"length_changed":false,"latency_ms":138.75958300000002},{"record":"tv4_016","call_lengths":[512],"footprint_mb":291.360504,"delta_mb":0.606207999999981,"length_changed":false,"latency_ms":139.16958300000002},{"record":"tv4_017","call_lengths":[512],"footprint_mb":290.213624,"delta_mb":-1.1468800000000101,"length_changed":false,"latency_ms":144.540375},{"record":"tv4_018","call_lengths":[512],"footprint_mb":291.294968,"delta_mb":1.0813440000000014,"length_changed":false,"latency_ms":145.213916},{"record":"tv4_019","call_lengths":[512],"footprint_mb":282.00524,"delta_mb":-9.289727999999968,"length_changed":false,"latency_ms":141.606917}]}]},"gate_stage_c_frozen":{"schema":"kev-device-r13-gate/1","form":"D512L512q16","S":512,"result_json":"_work/device_runs/20261004-124130/result.json","result_sha256":"c8ec35803fb96949853e0c959f39e490298b544daea4ea8b58bbbf5ccf08bbf3","run_id":"20261004-124130","status":"running","app_pass":null,"app_summary":null,"device":{"available_mb":3528.98088,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":11.011696,"free_gb":126.723938018,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"nominal"},"device_end":null,"previous_launch":{"run_id":"20261004-123321","stage_order":["load_jit","warm_up","bench"],"status":"done","updated":"2026-10-04T03:41:02Z"},"config_env":{"KEV_CALL_MAX":"512","KEV_DECODER":"decoder_ship","KEV_MULTIPLE":"16","KEV_R13_FORM":"D512L512q16","KEV_RUN_ID":"20261004-124130","KEV_STAGES":"load_jit,warm_up,e2e_fixture,e2e_heldout,reset"},"bar":{"max_abs_dp":0.02,"mean_of_run_mean_abs_dp":0.002,"near_tie_top2_margin":0.02},"mac_same_form_source":["$ZOO_WORK_ROOT/_kev/results/r14_full_D512L512q16.json","$ZOO_WORK_ROOT/_kev/results/r14_heldout_D512L512q16.json","$ZOO_WORK_ROOT/_kev/results/r14_longrow_D512L512q16.json","$ZOO_WORK_ROOT/_kev/results/r14_red_D512L512q16.json","$ZOO_WORK_ROOT/_kev/results/r14_shared_own_D512L512q16.json"],"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_ship/kev_0_8b_decode_fp16_metal_dyn512.aimodel","asset_bytes":1505417274,"asset_main_hash":"ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":1.353284125,"aimodel_s":0.0014899160000000002,"main_s":0.9988408750000001,"tokenizer_s":0.34415279200000004,"chunk":512,"shape":{"call_lengths":32,"call_max":512,"dynamic":true,"graph_max":512,"graph_min":2,"multiple":16},"bundle_name":"kev_0_8b_decode_fp16_metal_dyn512","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,-1],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,-1,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":20024034127,"cache_bytes_after":20024034127,"cache_bytes_added":0,"cache_state":"warm (entry present)","peak_footprint_mb":199.330784,"min_available_mb":3340.661792,"available_mb_before":3518.790008,"free_gb_before":126.723938018,"free_gb_after":126.723938018,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm_up":{"call_lengths":[16,32,48,64,80,96,112,128,144,160,176,192,208,224,240,256,272,288,304,320,336,352,368,384,400,416,432,448,464,480,496,512],"kind":"jit","lengths":[{"length":16,"ms":43.29008400000001},{"length":32,"ms":21.623833},{"length":48,"ms":22.288375000000002},{"length":64,"ms":25.651917000000005},{"length":80,"ms":29.217625},{"length":96,"ms":31.134166},{"length":112,"ms":35.122916000000004},{"length":128,"ms":37.766166000000005},{"length":144,"ms":51.789959},{"length":160,"ms":53.763334},{"length":176,"ms":56.430583000000006},{"length":192,"ms":60.911292},{"length":208,"ms":61.978875},{"length":224,"ms":66.64966600000001},{"length":240,"ms":68.015291},{"length":256,"ms":71.246041},{"length":272,"ms":88.082041},{"length":288,"ms":98.71975},{"length":304,"ms":93.6025},{"length":320,"ms":102.14816700000002},{"length":336,"ms":105.46745800000001},{"length":352,"ms":109.3675},{"length":368,"ms":110.66141700000001},{"length":384,"ms":109.44579200000001},{"length":400,"ms":121.86795900000001},{"length":416,"ms":129.83433399999998},{"length":432,"ms":132.65316600000003},{"length":448,"ms":138.68233400000003},{"length":464,"ms":142.008042},{"length":480,"ms":145.526292},{"length":496,"ms":145.862875},{"length":512,"ms":153.74437500000002}],"memory":{"min_available_mb":2158.63732,"peak_footprint_mb":1381.355256},"ms_max":153.74437500000002,"ms_total":2664.554125,"pass":true,"storage_after":{"caches":{"bytes":20040303535,"dirs":[{"bytes":20024034127,"dir":"coreai-cache","files":57},{"bytes":20024034127,"dir":"coreai-cache/24A437","files":48},{"bytes":16157488,"dir":"com.daisukemajima.kevgate","files":5},{"bytes":16157488,"dir":"com.daisukemajima.kevgate/com.apple.metal","files":4},{"bytes":111920,"dir":"com.apple.dyld","files":1},{"bytes":0,"dir":"com.daisukemajima.kevgate/com.apple.metalfe","files":1},{"bytes":0,"dir":"coreai-cache/sync","files":9}],"dirs_total":7,"exists":true,"files":63,"path":"<app container>/Library/Caches"},"coreai_cache":{"bytes":20024034127,"dirs":[{"bytes":20024034127,"dir":"24A437","files":48},{"bytes":20024034127,"dir":"24A437/com.daisukemajima.kevgate","files":48},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416","files":6},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416/3EED337528B9C2FCA4B6816CDCDED1FEC0A9E9EBA265A286147FA655E86F35B1","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":0,"dir":"sync","files":9},{"bytes":0,"dir":"sync/24A437","files":9}],"dirs_total":20,"exists":true,"files":57,"path":"<app container>/Library/Caches/coreai-cache"},"free_gb":126.723938018,"tmp":{"bytes":0,"dirs":[],"dirs_total":0,"exists":true,"files":0,"path":"/private<app container>/tmp"}},"storage_before":{"caches":{"bytes":20040303535,"dirs":[{"bytes":20024034127,"dir":"coreai-cache","files":57},{"bytes":20024034127,"dir":"coreai-cache/24A437","files":48},{"bytes":16157488,"dir":"com.daisukemajima.kevgate","files":5},{"bytes":16157488,"dir":"com.daisukemajima.kevgate/com.apple.metal","files":4},{"bytes":111920,"dir":"com.apple.dyld","files":1},{"bytes":0,"dir":"com.daisukemajima.kevgate/com.apple.metalfe","files":1},{"bytes":0,"dir":"coreai-cache/sync","files":9}],"dirs_total":7,"exists":true,"files":63,"path":"<app container>/Library/Caches"},"coreai_cache":{"bytes":20024034127,"dirs":[{"bytes":20024034127,"dir":"24A437","files":48},{"bytes":20024034127,"dir":"24A437/com.daisukemajima.kevgate","files":48},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416","files":6},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416/3EED337528B9C2FCA4B6816CDCDED1FEC0A9E9EBA265A286147FA655E86F35B1","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":0,"dir":"sync","files":9},{"bytes":0,"dir":"sync/24A437","files":9}],"dirs_total":20,"exists":true,"files":57,"path":"<app container>/Library/Caches/coreai-cache"},"free_gb":126.723938018,"tmp":{"bytes":0,"dirs":[],"dirs_total":0,"exists":true,"files":0,"path":"/private<app container>/tmp"}},"t_end_s":7.634517625,"t_start_s":4.65261175,"thermal_end":"nominal","thermal_start":"nominal","wall_s":2.74117925},"e2e_fixture":{"set":"fixture","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_ship/kev_0_8b_decode_fp16_metal_dyn512.aimodel","rows":385,"bar":{"questions":385,"questions_non_near_tie":373,"argmax_equal_non_near_tie":373,"near_tie_questions":12,"argmax_equal_near_tie":11,"max_abs_dp":0.010714828968048096,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.0009713930675096696,"pass":true},"ids_equal_oracle":385,"finite_rows":385,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":6,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":385,"missing":0,"max_abs_dp":0.0023432374000549316,"median_abs_dp":0.0002843588590621948,"argmax_equal":384,"p_bit_equal":0,"worst_row":"semif_eafc22c8c40df3932a8e:q0"},"vs_mac_u16_r7_swift_reference":{"rows":385,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0022128820419311523,"median_abs_dp":0.0003351867198944092},"near_ties":[{"row":"tv4_003:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007186233997344971,"max_abs_dp":0.0013288259506225586},{"row":"tv4_017:q0","T":76,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003402531147003174,"max_abs_dp":0.0014648139476776123},{"row":"tv4_023:q0","T":92,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0022128820419311523,"max_abs_dp":0.0016424208879470825},{"row":"tv4_024:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002605319023132324,"max_abs_dp":0.0018637776374816895},{"row":"tv4_027:q0","T":77,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0009069442749023438,"max_abs_dp":0.00148850679397583},{"row":"tv4_028:q0","T":290,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005552470684051514,"max_abs_dp":0.00014609098434448242},{"row":"tv4_051:q0","T":136,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006972402334213257,"max_abs_dp":0.0006610453128814697},{"row":"tv4_054:q0","T":113,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.000675499439239502,"max_abs_dp":0.0012507736682891846},{"row":"tv4s_14:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":5.951523780822754e-05,"max_abs_dp":0.0011747181415557861},{"row":"semif_2175379f4c69e6207626:q0","T":58,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008013546466827393,"max_abs_dp":0.004061788320541382},{"row":"semif_d167e51bb1f499099645:q0","T":69,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00040158629417419434,"max_abs_dp":0.0020157992839813232},{"row":"semif_4089c199b8b796ec3ed8:q0","T":88,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005905628204345703,"max_abs_dp":0.0029332637786865234}],"worst_rows":[{"row":"semif_46b7029b9a704138b77a:q0","T":78,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0014007091522216797,"max_abs_dp":0.010714828968048096},{"row":"semif_d7e84e4245a29817da1f:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005477666854858398,"max_abs_dp":0.007340371608734131},{"row":"semif_942ec65dac0bfb9874f9:q0","T":60,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008921325206756592,"max_abs_dp":0.006885021924972534},{"row":"semif_8a4c3de28be95c105ca1:q0","T":72,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010706186294555664,"max_abs_dp":0.006272256374359131},{"row":"semif_eafc22c8c40df3932a8e:q0","T":72,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006956160068511963,"max_abs_dp":0.005967378616333008},{"row":"tv4_045:q0","T":90,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0014505982398986816,"max_abs_dp":0.005867809057235718},{"row":"semif_97d2ed2591fc7638806c:q0","T":82,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":8.133798837661743e-05,"max_abs_dp":0.005653262138366699},{"row":"tv4_020:q0","T":82,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.001029282808303833,"max_abs_dp":0.005258142948150635}],"calls_total":null,"call_ms_median":null,"call_ms_p90":null,"call_ms_median_recomputed":29.23,"seconds":null,"thermal":["nominal",null],"timeline":[[0,"nominal",0.800000011920929,"charging",1371.115256,2168.87732]],"memory":{"peak_footprint_mb":null,"min_available_mb":null},"errors":null,"shared_bar":{"questions":21,"questions_non_near_tie":21,"argmax_equal_non_near_tie":21,"near_tie_questions":0,"argmax_equal_near_tie":0,"max_abs_dp":0.0038254261016845703,"worst_row":"own_t06:q0","mean_of_run_mean_abs_dp":0.0005791600860123123,"pass":true},"prepared_equal_shared":{"records":6,"equal":6},"shared_max_abs_dp_direct":0.0007582902908325195}},"dynamic":true,"crash":[{"file":"_work/device_runs/20261004-124130/crash/JetsamEvent-2026-10-04-113908.ips","bug_type":"298","name":null,"timestamp":"2026-10-04 11:39:08.00 +0900","note":"not a crash report (no threads)"},{"file":"_work/device_runs/20261004-124130/crash/KevGate-2026-10-04-010854.ips","capture_time":"2026-10-04 01:08:53.6642 +0900","proc_launch":"2026-10-04 01:08:31.9069 +0900","exception":{"codes":"0x0000000000000001, 0x000000000000002c","rawCodes":[1,44],"type":"EXC_BAD_ACCESS","signal":"SIGSEGV","subtype":"KERN_INVALID_ADDRESS at 0x000000000000002c"},"termination":{"flags":0,"code":11,"namespace":"SIGNAL","indicator":"Segmentation fault: 11","byProc":"exc handler","byPid":7684},"faulting_thread":"llvm-worker-0","frames":["MetalPerformanceShadersGraph | mlir::ForwardIterator::makeIterable(mlir::Operation&)","MetalPerformanceShadersGraph | void mlir::detail::walk<mlir::ForwardIterator>(mlir::Operation*, llvm::function_ref<void (mlir::Operation*)>, mlir::WalkOrder)","MetalPerformanceShadersGraph | -[MPSGraphAICodeCompilerDelegate getInitializedAICodeBytecodeWithPayloadPrefix:delegateId:]","MetalPerformanceShadersGraph | closure #1 in Compiler_coreAI.compile(moduleBytecode:to:with:)","MetalPerformanceShadersGraph | protocol witness for Compiler.Delegates.BinaryGenerator.compile(moduleBytecode:to:with:) in conformance Compiler_coreAI","CoreAICompiler | ?","CoreAICompiler | ?","libODIECompiler.dylib | std::__1::__function::__func<mlir::ODIE::Compiler::capi::detail::set_callback(odiec_external_rewriter_t, void*, odiec_bytecode_blob_t (*)(void*, odiec_external_rewriter_payload_t))::$_0, std::__1::unique_ptr<llvm::MemoryBuffer, std::__1::default_delete<llvm::MemoryBuffer>> (mlir::ODIE::Compiler::ModuleRewriter::Payload&&)>::operator()(mlir::ODIE::Compiler::ModuleRewriter::Payload&&)","libODIECompiler.dylib | mlir::ODIE::Compiler::Serialization::rewriteModule(mlir::ModuleOp, mlir::ODIE::Compiler::ModuleRewriter const&, std::__1::optional<std::__1::__fs::filesystem::path> const&, std::__1::__fs::filesystem::path const&, bool)","libODIECompiler.dylib | mlir::ODIE::Compiler::Transforms::CompileForDelegates::generateCompilationTask() const::'lambda'(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, mlir::ODIE::Compiler::ModuleRewriter const&, mlir::ModuleOp)::operator()(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, mlir::ODIE::Compiler::ModuleRewriter const&, mlir::ModuleOp) const","libODIECompiler.dylib | std::__1::__deferred_assoc_state<llvm::LogicalResult, std::__1::__async_func<std::__1::function<llvm::LogicalResult ()>>>::__execute()","libc++.1.dylib | std::__1::__assoc_sub_state::wait()","libODIECompiler.dylib | llvm::StdThreadPool::processTasks(llvm::ThreadPoolTaskGroup*)","libODIECompiler.dylib | void* llvm::thread::ThreadProxy<std::__1::tuple<llvm::StdThreadPool::grow(int)::$_0>>(void*)","libsystem_pthread.dylib | _pthread_start","libsystem_pthread.dylib | thread_start"],"os_version":{"isEmbedded":true,"train":"iPhone OS 27.0","releaseType":"User","build":"24A437"},"charging":{"externalSourceConnected":true}},{"file":"_work/device_runs/20261004-124130/crash/KevGate.diskwrites_resource-2026-10-04-102302.ips","bug_type":"145","name":"KevGate","timestamp":"2026-10-04 10:23:02.00 +0900","note":"not a crash report (no threads)"}],"pass":true},"gate_stage_c_diag":{"schema":"kev-device-r13-gate/1","form":"D512L512q16","S":512,"result_json":"_work/device_runs/20261004-125820/result.json","result_sha256":"4f14c014a2ded6a39c82e40ada9954f756f3493840debf08415fe6c3af4266aa","run_id":"20261004-125820","status":"done","app_pass":true,"app_summary":["load_jit=PASS","warm_up=PASS","e2e_fixture=PASS"],"device":{"available_mb":3527.391632,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":12.600944,"free_gb":126.723938018,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"nominal"},"device_end":{"available_mb":1313.861752,"battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":2226.130824,"free_gb":126.723938018,"low_power_mode":false,"thermal":"nominal"},"previous_launch":{"run_id":"20261004-125809","stage_order":["md5"],"status":"done","updated":"2026-10-04T03:58:11Z"},"config_env":{"KEV_CALL_MAX":"512","KEV_DECODER":"decoder_ship","KEV_IDS":"tv4_000,tv4_001,tv4_002,tv4_003,tv4_004,tv4_005,tv4_006,tv4_007,tv4_008,tv4_009,own_t01,own_t02,own_t03,own_t04,own_t05,own_m01,own_j03","KEV_MULTIPLE":"16","KEV_R13_FORM":"D512L512q16","KEV_R13_PHASE":"diag-pause","KEV_RECORD_PAUSE":"2","KEV_RUN_ID":"20261004-125820","KEV_STAGES":"load_jit,warm_up,e2e_fixture"},"bar":{"max_abs_dp":0.02,"mean_of_run_mean_abs_dp":0.002,"near_tie_top2_margin":0.02},"mac_same_form_source":["$ZOO_WORK_ROOT/_kev/results/r14_full_D512L512q16.json","$ZOO_WORK_ROOT/_kev/results/r14_heldout_D512L512q16.json","$ZOO_WORK_ROOT/_kev/results/r14_longrow_D512L512q16.json","$ZOO_WORK_ROOT/_kev/results/r14_red_D512L512q16.json","$ZOO_WORK_ROOT/_kev/results/r14_shared_own_D512L512q16.json"],"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_ship/kev_0_8b_decode_fp16_metal_dyn512.aimodel","asset_bytes":1505417274,"asset_main_hash":"ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":1.332896833,"aimodel_s":0.001341708,"main_s":0.9813785,"tokenizer_s":0.346105916,"chunk":512,"shape":{"call_lengths":32,"call_max":512,"dynamic":true,"graph_max":512,"graph_min":2,"multiple":16},"bundle_name":"kev_0_8b_decode_fp16_metal_dyn512","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,-1],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,-1,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":20024034127,"cache_bytes_after":20024034127,"cache_bytes_added":0,"cache_state":"warm (entry present)","peak_footprint_mb":199.249008,"min_available_mb":3340.743568,"available_mb_before":3518.01996,"free_gb_before":126.723938018,"free_gb_after":126.723938018,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm_up":{"call_lengths":[16,32,48,64,80,96,112,128,144,160,176,192,208,224,240,256,272,288,304,320,336,352,368,384,400,416,432,448,464,480,496,512],"kind":"jit","lengths":[{"length":16,"ms":58.912667},{"length":32,"ms":21.473875},{"length":48,"ms":22.062333},{"length":64,"ms":25.616708000000003},{"length":80,"ms":30.463667000000004},{"length":96,"ms":31.218042},{"length":112,"ms":37.854541000000005},{"length":128,"ms":37.427},{"length":144,"ms":51.830959},{"length":160,"ms":53.992333},{"length":176,"ms":56.334541},{"length":192,"ms":60.043000000000006},{"length":208,"ms":62.016375000000004},{"length":224,"ms":66.31108400000001},{"length":240,"ms":67.705583},{"length":256,"ms":78.486417},{"length":272,"ms":87.764666},{"length":288,"ms":97.287542},{"length":304,"ms":93.458709},{"length":320,"ms":104.07737500000002},{"length":336,"ms":106.13162500000001},{"length":352,"ms":110.50291700000001},{"length":368,"ms":109.47525000000002},{"length":384,"ms":109.288791},{"length":400,"ms":125.281208},{"length":416,"ms":127.22529200000002},{"length":432,"ms":126.960083},{"length":448,"ms":132.07637499999998},{"length":464,"ms":140.02283400000002},{"length":480,"ms":143.341666},{"length":496,"ms":144.95408300000003},{"length":512,"ms":143.013291}],"memory":{"min_available_mb":2169.221384,"peak_footprint_mb":1370.771192},"ms_max":144.95408300000003,"ms_total":2662.6108320000003,"pass":true,"storage_after":{"caches":{"bytes":20040369239,"dirs":[{"bytes":20024034127,"dir":"coreai-cache","files":57},{"bytes":20024034127,"dir":"coreai-cache/24A437","files":48},{"bytes":16223192,"dir":"com.daisukemajima.kevgate","files":5},{"bytes":16223192,"dir":"com.daisukemajima.kevgate/com.apple.metal","files":4},{"bytes":111920,"dir":"com.apple.dyld","files":1},{"bytes":0,"dir":"com.daisukemajima.kevgate/com.apple.metalfe","files":1},{"bytes":0,"dir":"coreai-cache/sync","files":9}],"dirs_total":7,"exists":true,"files":63,"path":"<app container>/Library/Caches"},"coreai_cache":{"bytes":20024034127,"dirs":[{"bytes":20024034127,"dir":"24A437","files":48},{"bytes":20024034127,"dir":"24A437/com.daisukemajima.kevgate","files":48},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416","files":6},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416/3EED337528B9C2FCA4B6816CDCDED1FEC0A9E9EBA265A286147FA655E86F35B1","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":0,"dir":"sync","files":9},{"bytes":0,"dir":"sync/24A437","files":9}],"dirs_total":20,"exists":true,"files":57,"path":"<app container>/Library/Caches/coreai-cache"},"free_gb":126.723938018,"tmp":{"bytes":0,"dirs":[],"dirs_total":0,"exists":true,"files":0,"path":"/private<app container>/tmp"}},"storage_before":{"caches":{"bytes":20040434775,"dirs":[{"bytes":20024034127,"dir":"coreai-cache","files":57},{"bytes":20024034127,"dir":"coreai-cache/24A437","files":48},{"bytes":16288728,"dir":"com.daisukemajima.kevgate","files":5},{"bytes":16288728,"dir":"com.daisukemajima.kevgate/com.apple.metal","files":4},{"bytes":111920,"dir":"com.apple.dyld","files":1},{"bytes":0,"dir":"com.daisukemajima.kevgate/com.apple.metalfe","files":1},{"bytes":0,"dir":"coreai-cache/sync","files":9}],"dirs_total":7,"exists":true,"files":63,"path":"<app container>/Library/Caches"},"coreai_cache":{"bytes":20024034127,"dirs":[{"bytes":20024034127,"dir":"24A437","files":48},{"bytes":20024034127,"dir":"24A437/com.daisukemajima.kevgate","files":48},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416","files":6},{"bytes":2505681950,"dir":"24A437/com.daisukemajima.kevgate/8f4de1575752ef88d42cb3b3c5a7b9aa354b3c1130fc1bae2416f8d12fc13416/3EED337528B9C2FCA4B6816CDCDED1FEC0A9E9EBA265A286147FA655E86F35B1","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d","files":6},{"bytes":2505661047,"dir":"24A437/com.daisukemajima.kevgate/4131d0284899787bab6cae6ca62a706886478b4e25c4d8cb971c5ba2ad72682d/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2","files":6},{"bytes":2502232663,"dir":"24A437/com.daisukemajima.kevgate/ab60bacd00d9674cb7a7951a1e504d37fd925c0947fa8448edda0132514920f2/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440","files":6},{"bytes":2502232643,"dir":"24A437/com.daisukemajima.kevgate/ef12289c63d12c0be5fd6d23269c545739d25bfc2003e6cb2f76889440085440/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb","files":6},{"bytes":2502056536,"dir":"24A437/com.daisukemajima.kevgate/b21fbbd3c38543a7439e1677a1311661cd765a4989cd171e79581466c5cacdeb/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e","files":6},{"bytes":2502056463,"dir":"24A437/com.daisukemajima.kevgate/19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963","files":6},{"bytes":2502056459,"dir":"24A437/com.daisukemajima.kevgate/8dba782032b4462a97e07ec5e10ec9ac29d375dd88688afeb24efe04e1413963/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e","files":6},{"bytes":2502056366,"dir":"24A437/com.daisukemajima.kevgate/f940810fbbc686b12ab522849547e72db642d4a565225e99b4dbce9e5592842e/2BCC1AD4E15EA0CB8CD8E14DD2D8F3F9B06D666FA1C93914387E9F78D3CF7443","files":6},{"bytes":0,"dir":"sync","files":9},{"bytes":0,"dir":"sync/24A437","files":9}],"dirs_total":20,"exists":true,"files":57,"path":"<app container>/Library/Caches/coreai-cache"},"free_gb":126.723938018,"tmp":{"bytes":0,"dirs":[],"dirs_total":0,"exists":true,"files":0,"path":"/private<app container>/tmp"}},"t_end_s":7.79897475,"t_start_s":4.81689775,"thermal_end":"nominal","thermal_start":"nominal","wall_s":2.736473375},"e2e_fixture":{"set":"fixture","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_ship/kev_0_8b_decode_fp16_metal_dyn512.aimodel","rows":39,"bar":{"questions":39,"questions_non_near_tie":38,"argmax_equal_non_near_tie":38,"near_tie_questions":1,"argmax_equal_near_tie":1,"max_abs_dp":0.0033832192420959473,"worst_row":"tv4_006:q0","mean_of_run_mean_abs_dp":0.0005623065916706509,"pass":true},"ids_equal_oracle":39,"finite_rows":39,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":7,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":39,"missing":0,"max_abs_dp":0.0014469623565673828,"median_abs_dp":0.00020110979676246643,"argmax_equal":39,"p_bit_equal":0,"worst_row":"own_t05:q1"},"vs_mac_u16_r7_swift_reference":{"rows":39,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0015651285648345947,"median_abs_dp":0.0002314448356628418},"near_ties":[{"row":"tv4_003:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007186233997344971,"max_abs_dp":0.0013288259506225586}],"worst_rows":[{"row":"tv4_006:q0","T":237,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005557835102081299,"max_abs_dp":0.0033832192420959473},{"row":"own_t04:q2","T":191,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003357231616973877,"max_abs_dp":0.003125995397567749},{"row":"tv4_005:q0","T":81,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00016054511070251465,"max_abs_dp":0.0028241872787475586},{"row":"own_t03:q2","T":245,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007718503475189209,"max_abs_dp":0.0023921430110931396},{"row":"own_t04:q3","T":175,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":6.753206253051758e-05,"max_abs_dp":0.002187967300415039},{"row":"tv4_000:q0","T":94,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0011610686779022217,"max_abs_dp":0.002124309539794922},{"row":"own_m01:q6","T":154,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00029009580612182617,"max_abs_dp":0.001978456974029541},{"row":"own_t02:q0","T":270,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0002944767475128174,"max_abs_dp":0.001736670732498169}],"calls_total":39,"call_ms_median":64.53,"call_ms_p90":116.586,"call_ms_median_recomputed":64.53,"seconds":40.974244458,"thermal":["nominal","nominal"],"timeline":[[0,"nominal",0.800000011920929,"charging",1359.449848,2180.542728],[21.7,"nominal",0.800000011920929,"charging",1433.030392,2106.962184],[40.9,"nominal",0.800000011920929,"charging",2225.098632,1314.893944]],"memory":{"peak_footprint_mb":2319.355856,"min_available_mb":1220.63672},"errors":0,"shared_bar":{"questions":29,"questions_non_near_tie":29,"argmax_equal_non_near_tie":29,"near_tie_questions":0,"argmax_equal_near_tie":0,"max_abs_dp":0.003066152334213257,"worst_row":"own_t04:q2","mean_of_run_mean_abs_dp":0.0005104245226493806,"pass":true},"prepared_equal_shared":{"records":7,"equal":7},"shared_max_abs_dp_direct":0.0008350014686584473}},"dynamic":true,"pass":true}},"round15":{"gate_published_K128":{"schema":"kev-device-r13-gate/1","form":"K128","S":128,"result_json":"$ZOO_WORK_ROOT/_kev/device_r15/_work/device_runs/20261004-140048/result.json","result_sha256":"a37307af30fcc22cfc8790d13de40e7be53b722d27b8eb15c6c59e79128c3fd6","run_id":"20261004-140048","status":"done","app_pass":true,"app_summary":["load_jit=PASS","warm=PASS","e2e_fixture=PASS","e2e_heldout=PASS","reset=PASS"],"device":{"available_mb":3529.161056,"battery_level":0.800000011920929,"battery_state":"charging","coreai_architecture":"h19p","cpu":"?","footprint_mb":10.83152,"free_gb":150.89268525,"hw_model":"V63AP","low_power_mode":false,"machine":"iPhone19,2","os":"iOS 27.0.0","os_build":"24A437","os_version_string":"Version 27.0 (Build 24A437)","physical_memory_gb":11.272796630859375,"power_source":"USB power","processor_count":6,"thermal":"nominal"},"device_end":{"available_mb":3245.011136,"battery_level":0.800000011920929,"battery_state":"charging","footprint_mb":294.98144,"free_gb":150.89268525,"low_power_mode":false,"thermal":"nominal"},"previous_launch":{"run_id":"20261004-130857","stage_order":["md5"],"status":"done","updated":"2026-10-04T04:08:59Z"},"config_env":{"KEV_DECODER":"decoder_k128","KEV_R13_FORM":"K128","KEV_RUN_ID":"20261004-140048","KEV_STAGES":"load_jit,warm,e2e_fixture,e2e_heldout,reset"},"bar":{"max_abs_dp":0.02,"mean_of_run_mean_abs_dp":0.002,"near_tie_top2_margin":0.02},"mac_same_form_source":["$ZOO_WORK_ROOT/_kev/results/r11_full_K128.json","$ZOO_WORK_ROOT/_kev/results/r11_heldout_K128.json"],"stages":{"load_jit":{"kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k128/kev_0_8b_decode_fp16_metal_pf128.aimodel","asset_bytes":1505385870,"asset_main_hash":"19d5a4809e348c7cdd314c17cf18646170e2af2ef62f5a32beb8948b2c3f684e","options":"preferred gpu, allowed [\"cpu\", \"gpu\", \"neuralEngine\"], expectFrequentReshapes true","wall_s":1.501554041,"aimodel_s":0.0016011250000000001,"main_s":1.147957917,"tokenizer_s":0.34395854200000003,"chunk":128,"shape":{"call_lengths":1,"call_max":128,"dynamic":false,"graph_max":128,"graph_min":128,"multiple":128},"bundle_name":"kev_0_8b_decode_fp16_metal_pf128","decoder_main":"{\"inputs\":{\"input_ids\":{\"shape\":[1,128],\"type\":\"int32\"},\"position_ids\":{\"shape\":[1,-1],\"type\":\"int32\"}},\"outputs\":{\"hidden\":{\"shape\":[1,128,1024],\"type\":\"float16\"}},\"states\":{\"keyCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"valueCache\":{\"shape\":[6,1,2,-1,256],\"type\":\"float16\"},\"convState\":{\"shape\":[18,1,6144,3],\"type\":\"float16\"},\"recState\":{\"shape\":[18,1,16,128,128],\"type\":\"float16\"}}}","cache_bytes_before":5004289126,"cache_bytes_after":5004289126,"cache_bytes_added":0,"cache_state":"warm (entry present)","peak_footprint_mb":193.137776,"min_available_mb":3346.8548,"available_mb_before":3519.1832,"free_gb_before":150.89268525,"free_gb_after":150.89268525,"thermal":["nominal","nominal"],"battery":[{"level":0.800000011920929,"power":"USB power","state":"charging"},{"level":0.800000011920929,"power":"USB power","state":"charging"}],"pass":true,"partial":null,"error":null,"error_detail":null},"warm":{"record":"tv4_000","latency_ms":66.868917,"calls":1,"pass":true,"error":null},"e2e_fixture":{"set":"fixture","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k128/kev_0_8b_decode_fp16_metal_pf128.aimodel","rows":434,"bar":{"questions":434,"questions_non_near_tie":420,"argmax_equal_non_near_tie":420,"near_tie_questions":14,"argmax_equal_near_tie":13,"max_abs_dp":0.01100119948387146,"worst_row":"semif_46b7029b9a704138b77a:q0","mean_of_run_mean_abs_dp":0.0009723608388956548,"pass":true},"ids_equal_oracle":434,"finite_rows":434,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":20,"p_bit_equal_direct":20,"hidden_bit_equal_direct":20,"answers_equal_direct":20},"vs_mac_same_form_r11_python":{"rows":434,"missing":0,"max_abs_dp":0.0026472806930541992,"median_abs_dp":0.0002929568290710449,"argmax_equal":434,"p_bit_equal":0,"worst_row":"semif_2175379f4c69e6207626:q0"},"vs_mac_u16_r7_swift_reference":{"rows":434,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0031995177268981934,"median_abs_dp":0.0003325529396533966},"near_ties":[{"row":"tv4_003:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.001380622386932373,"max_abs_dp":0.0019908249378204346},{"row":"tv4_017:q0","T":76,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003791004419326782,"max_abs_dp":0.0012992620468139648},{"row":"tv4_023:q0","T":92,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010398030281066895,"max_abs_dp":0.0016767680644989014},{"row":"tv4_024:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00010263919830322266,"max_abs_dp":0.0020470023155212402},{"row":"tv4_027:q0","T":77,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0003451108932495117,"max_abs_dp":0.001106351613998413},{"row":"tv4_028:q0","T":290,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006859898567199707,"max_abs_dp":0.0003826320171356201},{"row":"tv4_051:q0","T":136,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008180439472198486,"max_abs_dp":0.001276850700378418},{"row":"tv4_054:q0","T":113,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007375776767730713,"max_abs_dp":0.001546025276184082},{"row":"tv4s_14:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00030072033405303955,"max_abs_dp":0.001337289810180664},{"row":"semif_2175379f4c69e6207626:q0","T":58,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.002010136842727661,"max_abs_dp":0.005270570516586304},{"row":"semif_d167e51bb1f499099645:q0","T":69,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0004182755947113037,"max_abs_dp":0.00209847092628479},{"row":"semif_4089c199b8b796ec3ed8:q0","T":88,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0007336139678955078,"max_abs_dp":0.0029992759227752686},{"row":"own_t10:q2","T":156,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006840825080871582,"max_abs_dp":0.0014229565858840942},{"row":"own_j02:q0","T":332,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005596131086349487,"max_abs_dp":0.0010422766208648682}],"worst_rows":[{"row":"semif_46b7029b9a704138b77a:q0","T":78,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0009321868419647217,"max_abs_dp":0.01100119948387146},{"row":"semif_d7e84e4245a29817da1f:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.000786125659942627,"max_abs_dp":0.007578730583190918},{"row":"semif_942ec65dac0bfb9874f9:q0","T":60,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0009017288684844971,"max_abs_dp":0.006894618272781372},{"row":"semif_8a4c3de28be95c105ca1:q0","T":72,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0010104179382324219,"max_abs_dp":0.006212055683135986},{"row":"tv4_045:q0","T":90,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0011489391326904297,"max_abs_dp":0.00616946816444397},{"row":"tv4_020:q0","T":82,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008234381675720215,"max_abs_dp":0.005565941333770752},{"row":"semif_eafc22c8c40df3932a8e:q0","T":72,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00019440054893493652,"max_abs_dp":0.005371183156967163},{"row":"semif_7ada97b6f99f4788e5c7:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0015981495380401611,"max_abs_dp":0.005364537239074707}],"calls_total":681,"call_ms_median":35.48,"call_ms_p90":37.15,"call_ms_median_recomputed":35.48,"seconds":36.1802675,"thermal":["nominal","nominal"],"timeline":[[0,"nominal",0.800000011920929,"charging",247.762656,3292.22992],[20,"nominal",0.800000011920929,"charging",288.77188,3251.220696],[36.1,"nominal",0.800000011920929,"charging",336.940936,3203.05164]],"memory":{"peak_footprint_mb":389.14036,"min_available_mb":3150.852216},"errors":0,"shared_bar":{"questions":70,"questions_non_near_tie":68,"argmax_equal_non_near_tie":68,"near_tie_questions":2,"argmax_equal_near_tie":2,"max_abs_dp":0.005068600177764893,"worst_row":"own_L02:q0","mean_of_run_mean_abs_dp":0.0006634737377302075,"pass":true},"prepared_equal_shared":{"records":20,"equal":20},"shared_max_abs_dp_direct":0},"e2e_heldout":{"set":"heldout","kind":"jit","asset":"<app container>/Library/Application Support/KevAssets/decoder_k128/kev_0_8b_decode_fp16_metal_pf128.aimodel","rows":130,"bar":{"questions":130,"questions_non_near_tie":125,"argmax_equal_non_near_tie":125,"near_tie_questions":5,"argmax_equal_near_tie":5,"max_abs_dp":0.005920350551605225,"worst_row":"tv4h_11:q0","mean_of_run_mean_abs_dp":0.0008314862770240348,"pass":true},"ids_equal_oracle":130,"finite_rows":130,"all_zero_rows":0,"pass":true,"app_summary_equal":{"questions_non_near_tie":true,"argmax_equal_non_near_tie":true,"near_tie_questions":true,"argmax_equal_near_tie":true,"max_abs_dp":true,"mean_of_run_mean_abs_dp":true},"shared":{"records":0,"p_bit_equal_direct":0,"hidden_bit_equal_direct":0,"answers_equal_direct":0},"vs_mac_same_form_r11_python":{"rows":130,"missing":0,"max_abs_dp":0.001957237720489502,"median_abs_dp":0.0003131479024887085,"argmax_equal":130,"p_bit_equal":0,"worst_row":"tv4xh_sciq_02:q0"},"vs_mac_u16_r7_swift_reference":{"rows":130,"hidden_sha256_equal":0,"p_bit_equal":0,"max_abs_dp":0.0026790499687194824,"median_abs_dp":0.0002968907356262207},"near_ties":[{"row":"tv4h_03:q0","T":67,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005450248718261719,"max_abs_dp":0.0005183219909667969},{"row":"tv4h_07:q0","T":107,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00027507543563842773,"max_abs_dp":0.0007052123546600342},{"row":"tv4h_31:q0","T":75,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0013050734996795654,"max_abs_dp":0.0020380616188049316},{"row":"tv4xh_tweet_offensive_03:q0","T":84,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006586909294128418,"max_abs_dp":0.0006669461727142334},{"row":"tv4xh_paws_06:q0","T":91,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":true,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00024080276489257812,"max_abs_dp":0.0011695027351379395}],"worst_rows":[{"row":"tv4h_11:q0","T":299,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0001811385154724121,"max_abs_dp":0.005920350551605225},{"row":"tv4xh_paws_00:q0","T":94,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0008548498153686523,"max_abs_dp":0.004654735326766968},{"row":"tv4xh_qnli_06:q0","T":48,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00034373998641967773,"max_abs_dp":0.003377974033355713},{"row":"tv4h_00:q0","T":59,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00013728439807891846,"max_abs_dp":0.003296196460723877},{"row":"tv4h_14:q0","T":60,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0009775757789611816,"max_abs_dp":0.0030338168144226074},{"row":"tv4xh_paws_04:q0","T":76,"type":"noul","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0005544722080230713,"max_abs_dp":0.0029573440551757812},{"row":"tv4sh_00:q0","T":98,"type":"score","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.00014978647232055664,"max_abs_dp":0.0029485225677490234},{"row":"tv4xh_composition_holdout_09:q0","T":122,"type":"choice","ids_equal_oracle":true,"app_ids_equal_oracle":true,"near_tie":false,"mac_hidden_sha256_equal":false,"mac_p_bit_equal":false,"mac_max_abs_dp":0.0006534159183502197,"max_abs_dp":0.002842128276824951}],"calls_total":143,"call_ms_median":35.64,"call_ms_p90":35.81,"call_ms_median_recomputed":35.64,"seconds":5.867776958,"thermal":["nominal","nominal"],"timeline":[[0,"nominal",0.800000011920929,"charging",337.809288,3202.183288],[5.9,"nominal",0.800000011920929,"charging",291.934016,3248.05856]],"memory":{"peak_footprint_mb":346.476424,"min_available_mb":3193.516152},"errors":0,"shared_bar":null,"prepared_equal_shared":{"records":0,"equal":0},"shared_max_abs_dp_direct":null},"reset":{"record":"tv4_000","kind":"jit","hidden_bit_equal":true,"p_bit_equal":true,"latency_ms":36.541291,"thermal":"nominal","pass":true,"error":null}},"dynamic":false,"pass":true,"memory":{"source":"$ZOO_WORK_ROOT/_kev/device_r15/_work/device_runs/20261004-140048/memory.tsv","by_stage":{"load_jit":{"samples":17,"footprint_first_mb":21.0,"footprint_peak_mb":193.1,"footprint_last_mb":193.1,"least_available_mb":3346.9,"t_app_s":[2.22,3.8]},"warm":{"samples":3,"footprint_first_mb":168.4,"footprint_peak_mb":247.5,"footprint_last_mb":247.5,"least_available_mb":3292.5,"t_app_s":[4.86,4.97]},"e2e_fixture":{"samples":347,"footprint_first_mb":247.8,"footprint_peak_mb":389.1,"footprint_last_mb":336.9,"least_available_mb":3150.9,"t_app_s":[4.97,41.15]},"e2e_heldout":{"samples":58,"footprint_first_mb":337.8,"footprint_peak_mb":346.5,"footprint_last_mb":291.9,"least_available_mb":3193.5,"t_app_s":[41.22,47.09]}},"footprint_after_each_record":{"e2e_fixture":{"records":384,"first_mb":249.00784,"last_mb":329.060208,"max_mb":329.060208,"min_mb":226.610912,"second_half_change_mb":100.6},"e2e_heldout":{"records":130,"first_mb":337.104776,"last_mb":292.130624,"max_mb":342.44596,"min_mb":292.048704,"second_half_change_mb":-16.0}},"note":"K128 = one call length (128): the footprint does not grow with the records (round 13: the D512 form grew until the app's memory limit)"},"round":"r15 (supervisor 13:5x): the iPhone's final gate of the shipped form K128, round 13's stage-C binary"}}}