{"what":"d1-3B: the shipped bundles are the exports copied to a new name (_s) with the export's debug locations stripped (conversion/d1/strip_bundle.py: coreai-torch's strip_debug_info on one program object, then save_asset): the exported main.mlirb carries the export machine's absolute source paths (14 / 19 / 11 in the fp16 decoder / the int8mlp decoder / the tower), the stripped one none. strip = each bundle's record (before / after main.mlirb bytes and sha256, the h16c AOT compile of the stripped .aimodel); aot_files_shared = the files of each new AOT asset whose bytes equal the exported asset's (cloned on disk to share blocks; contents unchanged); bits = every gate row of the stripped bundles against the exported bundles' transcripts (results/r11s_bits.json); gates = the stripped bundles' gate summaries (Mac GPU, AOT h16c, 2026-10-09 08:01-08:17).","sources":[{"file":"logs/r11_strip_fp16.json","bytes":1500,"sha256":"d0cc40b6f48206b91a8dda6715f4a594d4bdecc5b58dec985b2852c31265e3a4"},{"file":"logs/r11_strip_int8mlp.json","bytes":1515,"sha256":"5ff705c41bd5bd16bd820c405c941ce51c9d9a71ad0f2dcd119f7c4efbb11c56"},{"file":"logs/r11_strip_tower.json","bytes":1424,"sha256":"6fd3c84440fdbe5fc9f6ba12cedf95d277812f0e20fc7f4da3ceb499f24c950b"},{"file":"logs/r11_aot_clone_fp16.json","bytes":619,"sha256":"841f50f01dcb785a918577656f2a916f4dd83be6427ee6fd924e3c63f75dd8c9"},{"file":"logs/r11_aot_clone_int8mlp.json","bytes":624,"sha256":"11deaeb2327047f1be2519e6b8535f7a0b4457582ea8d04352d09f287ad583c6"},{"file":"logs/r11_aot_clone_tower.json","bytes":522,"sha256":"5f8d03be4e9f056775602fac7fcf0a7348955cebeb18a7ef548e4866d9419067"},{"file":"results/r11s_bits.json","bytes":2527,"sha256":"c72196f103b5d2b0cf2e7aca5beadbf00f32897d38f2b239c44246e1ed0b8a94"},{"file":"results/r11s_readout_fp16_pf64_s.json","bytes":555945,"sha256":"4ca2b0a43027e2b2b5d98f0d8ccd77747d575659de55d475f229cb050a7e359f"},{"file":"results/r11s_readout_int8mlp_pf64_s.json","bytes":557909,"sha256":"5f54ba152b22c369da625fcf9b455c1e474bdd6e714c5d8ef925a730a0c48ef1"},{"file":"results/r11s_readout_int8mlp_pf64_s_heldout.json","bytes":166941,"sha256":"c79360ac80784d4e37916188933e060b813d1a6f3b860cf4288442eaf3629c84"},{"file":"results/r11s_images_fp16_pf64.json","bytes":16620,"sha256":"45b08b3efa585a1dcd6522f638a7cfae542da3c1d9ecc7cc23d2b2e92582084a"},{"file":"results/r11s_images_int8mlp_pf64.json","bytes":16661,"sha256":"515fada593378982306ad9342c5f1215e8c1cb8217987cc78c29ec3bad8bee2e"},{"file":"results/r11s_tower_fp16w32_s.json","bytes":62232,"sha256":"9b72e8bf5a70d6bcf779aa8fc17fabc7d86a4cb94e25645bf92c7e47ac11c6d5"}],"trimmed":{"removed":["per-call ms lists (call_ms, first_call_of_process_ms; each transcript keeps its medians)","hidden-dump file names and hashes (npz, npz_key, npz_sha256, hidden_npz) and the hidden rows' lowest positions","the oracle's probabilities inside the transcripts (probs_oracle: they are in fixtures-d1-3b.json)","token ids and rendered prompt text (row_ids, ids, text, instructions, state, criteria)","other sessions' processes seen by the drivers (other_gpu_processes*, other_gpu_jobs*, busiest, top)","the stripped gates' per-row runs (they equal the exported bundles' rows bit for bit: bits)"],"serialization":"compact json (no indentation)","full_copies":"the source files above, in the lane directory $ZOO_WORK_ROOT/_d1_3b/ (not in the repository)","paths":"local paths rewritten: the lane directory as $ZOO_WORK_ROOT/_d1_3b, the repository relative, the home directory as ~, the checkpoint snapshot as <snapshot>, the overlay venv as <overlay venv>, temporary directories as $TMPDIR, Xcode as $DEVELOPER_DIR, the phone's app container as <app container>, the phone's ids as <udid> / <coredevice id>","process_ids":"removed (keys pid / pids; 'pid <n>' in text)"},"strip":{"fp16":{"bundle":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship/d1_3b_decode_fp16_pf64_s","from":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles/d1_3b_decode_fp16_pf64","seconds":4.1,"before":{"bytes":5562548035,"sha256":"d4ed7ae09f048ef7597310b03e1ab88934d9ce5cd4c9df3376e521b5a2b174bb","home_paths":14},"after":{"bytes":5562302268,"sha256":"e54d5d411537782bdcca6ae48610aa0455ad252b360d9dd7ac95ce50f4ecbc5c","home_paths":0},"metadata_sha256":"f9e4ad705923641c0536a851b78f1d4f0b51f81305c9e563b58c20b0e313029a","aot":{"aimodelc":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship_aotc/d1_3b_decode_fp16_pf64_s.h16c.aimodelc","flags":["--platform","macOS","--preferred-compute","gpu","--architecture","h16c","--expect-frequent-reshapes"],"seconds":26.2,"returncode":0,"stderr_tail":[],"main_hash_hex":"a57eae1f97ac12d22690c28595c68f6478ba2a6af31bc3efc705aad3e4aff582","bytes":10600292772}},"int8mlp":{"bundle":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship/d1_3b_decode_int8mlp_pf64_s","from":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles/d1_3b_decode_int8mlp_pf64","seconds":2.8,"before":{"bytes":3704646757,"sha256":"2ab109907108870b8e7e191162d98bff7107b0ff338e3ead4854f490d4a6850b","home_paths":19},"after":{"bytes":3704370745,"sha256":"1836fba840ea88a3cec691be25a7af25585232fdb11b22e0b11cb2748079473f","home_paths":0},"metadata_sha256":"71d8739f0b645741fd116cde002f388827d69633f2881cb63dc74dc66051e32b","aot":{"aimodelc":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship_aotc/d1_3b_decode_int8mlp_pf64_s.h16c.aimodelc","flags":["--platform","macOS","--preferred-compute","gpu","--architecture","h16c","--expect-frequent-reshapes"],"seconds":104.8,"returncode":0,"stderr_tail":[],"main_hash_hex":"4fec2d3f7a445e825a0ac3d49015553449ae197654b9a3f4d5004eca8dbcfefc","bytes":8742371578}},"tower":{"bundle":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship/d1_3b_vision_fp16w32_s","from":"$ZOO_WORK_ROOT/_d1_3b/exports/vision/d1_3b_vision_fp16w32","seconds":0.7,"before":{"bytes":853162237,"sha256":"e24933d812b1b69168eb4b3d3aeccde42847e868e36487cb59c5667fc80c98cf","home_paths":11},"after":{"bytes":852915980,"sha256":"358b7de01a7f29ced8790cd99cfc5c277e2e56b77547f00279e3925859591161","home_paths":0},"metadata_sha256":"1d84a4c0d2ec5fa8e1fa9dfad41e51bc5a125c3c077f3a59e13b6f410b71f669","aot":{"aimodelc":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship_aotc/d1_3b_vision_fp16w32_s.h16c.aimodelc","flags":["--platform","macOS","--preferred-compute","gpu","--architecture","h16c"],"seconds":0.5,"returncode":0,"stderr_tail":[],"main_hash_hex":"6a2a7e742d1ec2e2d5908e874ee478a582dcfe23b814e890f9e3d6f243ab8d64","bytes":853216201}}},"aot_files_shared":{"fp16":{"new":"exports/bundles_ship_aotc/d1_3b_decode_fp16_pf64_s.h16c.aimodelc","old":"exports/bundles_aotc/d1_3b_decode_fp16_pf64.h16c.aimodelc","cloned":["main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/manifest.plist","main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/resources.bin"],"kept":["main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/original_model_0.mpsgraph","main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/specialized_model_1.mpsgraph","main-h16c.mlirb","main.hash","metadata.json","stats.json"],"bytes_shared":10599858391},"int8mlp":{"new":"exports/bundles_ship_aotc/d1_3b_decode_int8mlp_pf64_s.h16c.aimodelc","old":"exports/bundles_aotc/d1_3b_decode_int8mlp_pf64.h16c.aimodelc","cloned":["main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/manifest.plist","main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/resources.bin"],"kept":["main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/original_model_0.mpsgraph","main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/specialized_model_1.mpsgraph","main-h16c.mlirb","main.hash","metadata.json","stats.json"],"bytes_shared":8741924712},"tower":{"new":"exports/bundles_ship_aotc/d1_3b_vision_fp16w32_s.h16c.aimodelc","old":"exports/vision_aotc/d1_3b_vision_fp16w32.h16c.aimodelc","cloned":["main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/manifest.plist","main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/resources.bin"],"kept":["main-h16c-delegates/MPSGraph/mpsExecutable.mpsgraphpackage/specialized_model_0.mpsgraph","main-h16c.mlirb","main.hash","metadata.json","stats.json"],"bytes_shared":852855342}},"bits":{"what":"round 11 (A): the stripped bundles' gate transcripts against the unstripped bundles' (same gate, same rows), bit for bit","generated_at":"2026-10-09T08:17:04+09:00","pairs":[{"kind":"readout","stripped":"results/r11s_readout_fp16_pf64_s.json","unstripped":"results/r6a_readout_fp16_pf64.json","new_result":"PASS","rows_new":406,"rows_old":406,"rows_compared":406,"hidden_sha256_equal":406,"probs_bit_equal":406,"max_abs_dp_where_unequal":0.0,"unequal":[],"only_new":0,"only_old":0,"bit_equal_all":true},{"kind":"readout","stripped":"results/r11s_readout_int8mlp_pf64_s.json","unstripped":"results/r6a_readout_int8mlp_pf64.json","new_result":"PASS","rows_new":406,"rows_old":406,"rows_compared":406,"hidden_sha256_equal":406,"probs_bit_equal":406,"max_abs_dp_where_unequal":0.0,"unequal":[],"only_new":0,"only_old":0,"bit_equal_all":true},{"kind":"readout","stripped":"results/r11s_readout_int8mlp_pf64_s_heldout.json","unstripped":"results/r11_readout_int8mlp_pf64_heldout.json","new_result":"PASS","rows_new":120,"rows_old":120,"rows_compared":120,"hidden_sha256_equal":120,"probs_bit_equal":120,"max_abs_dp_where_unequal":0.0,"unequal":[],"only_new":0,"only_old":0,"bit_equal_all":true},{"kind":"images","stripped":"results/r11s_images_fp16_pf64.json","unstripped":"results/r7_images_fp16_pf64.json","new_result":true,"records_new":12,"records_old":12,"rows_compared":24,"p_bits_equal":24,"hidden_sha256_equal":24,"tower_crops_compared":40,"tower_crops_equal":40,"unequal":[],"bit_equal_all":true},{"kind":"images","stripped":"results/r11s_images_int8mlp_pf64.json","unstripped":"results/r7_images_int8mlp_pf64.json","new_result":true,"records_new":12,"records_old":12,"rows_compared":24,"p_bits_equal":24,"hidden_sha256_equal":24,"tower_crops_compared":40,"tower_crops_equal":40,"unequal":[],"bit_equal_all":true},{"kind":"tower","stripped":"results/r11s_tower_fp16w32_s.json","unstripped":"results/r5b_tower_fp16w32.json","new_result":"PASS","crops_new":64,"crops_old":64,"crops_compared":64,"stats_equal":64,"rerun_bit_equal_new":64,"unequal":[],"bit_equal_all":true}]},"gates":{"fixture_fp16":{"result":"PASS","summary":{"runs":393,"expected_runs":393,"missing_runs":[],"questions":393,"argmax_equal":393,"questions_non_near_tie":392,"argmax_equal_non_near_tie":392,"near_tie_questions":1,"argmax_equal_near_tie":1,"max_abs_dp":0.003938001526033352,"max_abs_dp_non_near_tie":0.003938001526033352,"mean_of_run_mean_abs_dp":0.00018400777830741502,"mean_question_max_abs_dp":0.00026774901064529136,"worst_run":{"id":"tv4s_16","name":"decision","max_abs_dp":0.003938001526033352},"finite_all":true,"all_zero_runs":0,"hidden_rows":14,"min_pos_cos":0.9999677870841723,"hidden_max_abs_diff":0.057308197021484375,"tokens":74504,"padded_tokens":88320,"calls":1380,"pad_waste":0.15643115942028984,"ms_per_call_median":33.91239600023255,"ms_per_call_warm_median":33.91158295562491},"bundle":{"bundle":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship/d1_3b_decode_fp16_pf64_s","name":"d1_3b_decode_fp16_pf64_s","kind":"decision-backbone","compression":null,"prefill_chunk":64,"max_ctx":4096,"toy":null,"metadata_sha256":"f9e4ad705923641c0536a851b78f1d4f0b51f81305c9e563b58c20b0e313029a","main_mlirb":{"bytes":5562302268,"sha256":"e54d5d411537782bdcca6ae48610aa0455ad252b360d9dd7ac95ce50f4ecbc5c"},"tokenizer_sha256":{"chat_template.jinja":"86f4770449a4797c9b4212d110b0cc70fb993c1ce960095bcfb12eea22f61cca","tokenizer.json":"8096ecb9f54599d756c8de728a598a340bc1e43c0deb77ddd62456c38349fcee","tokenizer_config.json":"ef6770d12dd9ac58d334e979bf160c5cdfd41f13d205fd5d5516857645feb0ea"},"head_sha256":{"option_rows.json":"133b9d7150b4dc225da8893d6e052e78198714a11f18e42821738b3e6c1a5acf","option_rows.safetensors":"e43cfaee023b4c1c2bab48b873aa2195bc6e5f86fe9f30049a89a1e0ad948522"},"license_sha256":"4d28ca14dedc0b3d0fcc2b3339f0e79931faa33874f3d24f522183a8fc70068c","aimodelc":{"path":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship_aotc/d1_3b_decode_fp16_pf64_s.h16c.aimodelc","bytes":10600292772,"tree_sha256":"9b1349d4a71cad500b332a83c5c6658bd7ba64aaf4ddd852045bfee544dde1fc"},"aimodelc_main_hash":"a57eae1f97ac12d22690c28595c68f6478ba2a6af31bc3efc705aad3e4aff582"}},"fixture_int8mlp":{"result":"PASS","summary":{"runs":393,"expected_runs":393,"missing_runs":[],"questions":393,"argmax_equal":393,"questions_non_near_tie":392,"argmax_equal_non_near_tie":392,"near_tie_questions":1,"argmax_equal_near_tie":1,"max_abs_dp":0.019660274378349274,"max_abs_dp_non_near_tie":0.019660274378349274,"mean_of_run_mean_abs_dp":0.0012615584218342564,"mean_question_max_abs_dp":0.0018242965018116246,"worst_run":{"id":"semif_33d6e5da58f0fee2490d","name":"answer","max_abs_dp":0.019660274378349274},"finite_all":true,"all_zero_runs":0,"hidden_rows":14,"min_pos_cos":0.9947377666772287,"hidden_max_abs_diff":0.6236745119094849,"tokens":74504,"padded_tokens":88320,"calls":1380,"pad_waste":0.15643115942028984,"ms_per_call_median":33.933104015886784,"ms_per_call_warm_median":33.932479040231556},"bundle":{"bundle":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship/d1_3b_decode_int8mlp_pf64_s","name":"d1_3b_decode_int8mlp_pf64_s","kind":"decision-backbone","compression":{"scheme":"int8mlp","linear":"int8 per-block-32 symmetric_with_clipping (weight only)","quantized":"every MLP linear (feed_forward.gate_proj / up_proj / down_proj)","excluded":"fp32: the four attention projections of every full-attention layer; fp16: the conv-mixer projections (conv.in_proj / out_proj), the embedding table (the tied table of head/option_rows), the conv1d, every RMSNorm, SDPA","excluded_names":[".*\\.conv\\.in_proj$",".*\\.conv\\.out_proj$",".*lm_head$",".*self_attn\\.(q_proj|k_proj|v_proj|out_proj)$"],"excluded_types":["coreai_models.primitives.macos.rms_norm.RMSNorm","coreai_models.primitives.macos.sdpa.SDPA","torch.nn.modules.conv.Conv1d","torch.nn.modules.sparse.Embedding"],"quantized_linear_modules":90,"fp16_layers":[],"fp16_linear_modules":["model.layers.0.conv.in_proj","model.layers.0.conv.out_proj","model.layers.1.conv.in_proj","model.layers.1.conv.out_proj","model.layers.10.conv.in_proj","model.layers.10.conv.out_proj","model.layers.11.conv.in_proj","model.layers.11.conv.out_proj","model.layers.12.conv.in_proj","model.layers.12.conv.out_proj","model.layers.14.conv.in_proj","model.layers.14.conv.out_proj","model.layers.15.conv.in_proj","model.layers.15.conv.out_proj","model.layers.16.conv.in_proj","model.layers.16.conv.out_proj","model.layers.18.conv.in_proj","model.layers.18.conv.out_proj","model.layers.19.conv.in_proj","model.layers.19.conv.out_proj","model.layers.20.conv.in_proj","model.layers.20.conv.out_proj","model.layers.22.conv.in_proj","model.layers.22.conv.out_proj","model.layers.23.conv.in_proj","model.layers.23.conv.out_proj","model.layers.25.conv.in_proj","model.layers.25.conv.out_proj","model.layers.26.conv.in_proj","model.layers.26.conv.out_proj","model.layers.28.conv.in_proj","model.layers.28.conv.out_proj","model.layers.29.conv.in_proj","model.layers.29.conv.out_proj","model.layers.3.conv.in_proj","model.layers.3.conv.out_proj","model.layers.4.conv.in_proj","model.layers.4.conv.out_proj","model.layers.6.conv.in_proj","model.layers.6.conv.out_proj","model.layers.7.conv.in_proj","model.layers.7.conv.out_proj","model.layers.8.conv.in_proj","model.layers.8.conv.out_proj"],"head":"none in the graph (the tied rows of the readout ids are head/option_rows)"},"prefill_chunk":64,"max_ctx":4096,"toy":null,"metadata_sha256":"71d8739f0b645741fd116cde002f388827d69633f2881cb63dc74dc66051e32b","main_mlirb":{"bytes":3704370745,"sha256":"1836fba840ea88a3cec691be25a7af25585232fdb11b22e0b11cb2748079473f"},"tokenizer_sha256":{"chat_template.jinja":"86f4770449a4797c9b4212d110b0cc70fb993c1ce960095bcfb12eea22f61cca","tokenizer.json":"8096ecb9f54599d756c8de728a598a340bc1e43c0deb77ddd62456c38349fcee","tokenizer_config.json":"ef6770d12dd9ac58d334e979bf160c5cdfd41f13d205fd5d5516857645feb0ea"},"head_sha256":{"option_rows.json":"41bb7fc3120b09adf9cc11319b4ec566bc6989ff6ebdb30890e269e257ab8bba","option_rows.safetensors":"e43cfaee023b4c1c2bab48b873aa2195bc6e5f86fe9f30049a89a1e0ad948522"},"license_sha256":"4d28ca14dedc0b3d0fcc2b3339f0e79931faa33874f3d24f522183a8fc70068c","aimodelc":{"path":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship_aotc/d1_3b_decode_int8mlp_pf64_s.h16c.aimodelc","bytes":8742371578,"tree_sha256":"a922057e2b1da99de52251880bd415a910269e18ff885fc5fe7da0fcab0d0cb7"},"aimodelc_main_hash":"4fec2d3f7a445e825a0ac3d49015553449ae197654b9a3f4d5004eca8dbcfefc"}},"heldout_int8mlp":{"result":"PASS","summary":{"runs":120,"expected_runs":120,"missing_runs":[],"questions":120,"argmax_equal":120,"questions_non_near_tie":118,"argmax_equal_non_near_tie":118,"near_tie_questions":2,"argmax_equal_near_tie":2,"max_abs_dp":0.014006239134214393,"max_abs_dp_non_near_tie":0.014006239134214393,"mean_of_run_mean_abs_dp":0.0010123085973413758,"mean_question_max_abs_dp":0.0016684010386006987,"worst_run":{"id":"tv4sh_05","name":"decision","max_abs_dp":0.014006239134214393},"finite_all":true,"all_zero_runs":0,"hidden_rows":0,"min_pos_cos":null,"hidden_max_abs_diff":null,"tokens":13091,"padded_tokens":16704,"calls":261,"pad_waste":0.2162954980842912,"ms_per_call_median":33.95924996584654,"ms_per_call_warm_median":33.95229147281498},"bundle":{"bundle":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship/d1_3b_decode_int8mlp_pf64_s","name":"d1_3b_decode_int8mlp_pf64_s","kind":"decision-backbone","compression":{"scheme":"int8mlp","linear":"int8 per-block-32 symmetric_with_clipping (weight only)","quantized":"every MLP linear (feed_forward.gate_proj / up_proj / down_proj)","excluded":"fp32: the four attention projections of every full-attention layer; fp16: the conv-mixer projections (conv.in_proj / out_proj), the embedding table (the tied table of head/option_rows), the conv1d, every RMSNorm, SDPA","excluded_names":[".*\\.conv\\.in_proj$",".*\\.conv\\.out_proj$",".*lm_head$",".*self_attn\\.(q_proj|k_proj|v_proj|out_proj)$"],"excluded_types":["coreai_models.primitives.macos.rms_norm.RMSNorm","coreai_models.primitives.macos.sdpa.SDPA","torch.nn.modules.conv.Conv1d","torch.nn.modules.sparse.Embedding"],"quantized_linear_modules":90,"fp16_layers":[],"fp16_linear_modules":["model.layers.0.conv.in_proj","model.layers.0.conv.out_proj","model.layers.1.conv.in_proj","model.layers.1.conv.out_proj","model.layers.10.conv.in_proj","model.layers.10.conv.out_proj","model.layers.11.conv.in_proj","model.layers.11.conv.out_proj","model.layers.12.conv.in_proj","model.layers.12.conv.out_proj","model.layers.14.conv.in_proj","model.layers.14.conv.out_proj","model.layers.15.conv.in_proj","model.layers.15.conv.out_proj","model.layers.16.conv.in_proj","model.layers.16.conv.out_proj","model.layers.18.conv.in_proj","model.layers.18.conv.out_proj","model.layers.19.conv.in_proj","model.layers.19.conv.out_proj","model.layers.20.conv.in_proj","model.layers.20.conv.out_proj","model.layers.22.conv.in_proj","model.layers.22.conv.out_proj","model.layers.23.conv.in_proj","model.layers.23.conv.out_proj","model.layers.25.conv.in_proj","model.layers.25.conv.out_proj","model.layers.26.conv.in_proj","model.layers.26.conv.out_proj","model.layers.28.conv.in_proj","model.layers.28.conv.out_proj","model.layers.29.conv.in_proj","model.layers.29.conv.out_proj","model.layers.3.conv.in_proj","model.layers.3.conv.out_proj","model.layers.4.conv.in_proj","model.layers.4.conv.out_proj","model.layers.6.conv.in_proj","model.layers.6.conv.out_proj","model.layers.7.conv.in_proj","model.layers.7.conv.out_proj","model.layers.8.conv.in_proj","model.layers.8.conv.out_proj"],"head":"none in the graph (the tied rows of the readout ids are head/option_rows)"},"prefill_chunk":64,"max_ctx":4096,"toy":null,"metadata_sha256":"71d8739f0b645741fd116cde002f388827d69633f2881cb63dc74dc66051e32b","main_mlirb":{"bytes":3704370745,"sha256":"1836fba840ea88a3cec691be25a7af25585232fdb11b22e0b11cb2748079473f"},"tokenizer_sha256":{"chat_template.jinja":"86f4770449a4797c9b4212d110b0cc70fb993c1ce960095bcfb12eea22f61cca","tokenizer.json":"8096ecb9f54599d756c8de728a598a340bc1e43c0deb77ddd62456c38349fcee","tokenizer_config.json":"ef6770d12dd9ac58d334e979bf160c5cdfd41f13d205fd5d5516857645feb0ea"},"head_sha256":{"option_rows.json":"41bb7fc3120b09adf9cc11319b4ec566bc6989ff6ebdb30890e269e257ab8bba","option_rows.safetensors":"e43cfaee023b4c1c2bab48b873aa2195bc6e5f86fe9f30049a89a1e0ad948522"},"license_sha256":"4d28ca14dedc0b3d0fcc2b3339f0e79931faa33874f3d24f522183a8fc70068c","aimodelc":{"path":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship_aotc/d1_3b_decode_int8mlp_pf64_s.h16c.aimodelc","bytes":8742371578,"tree_sha256":"a922057e2b1da99de52251880bd415a910269e18ff885fc5fe7da0fcab0d0cb7"},"aimodelc_main_hash":"4fec2d3f7a445e825a0ac3d49015553449ae197654b9a3f4d5004eca8dbcfefc"}},"pictures_fp16":{"pass":true,"bar_row_form":{"questions":24,"argmax_equal":24,"questions_non_near_tie":24,"argmax_equal_non_near_tie":24,"near_ties":[],"max_abs_dp":0.00048716797628101105,"worst":"img07_portrait_768x1024:crowded","mean_of_run_mean_abs_dp":5.151017149007074e-05,"pass":true},"bar_api_path":{"questions":24,"argmax_equal":24,"questions_non_near_tie":24,"argmax_equal_non_near_tie":24,"near_ties":[],"max_abs_dp":0.0004861608432051856,"worst":"img07_portrait_768x1024:crowded","mean_of_run_mean_abs_dp":5.165397018409547e-05,"pass":true}},"pictures_int8mlp":{"pass":true,"bar_row_form":{"questions":24,"argmax_equal":24,"questions_non_near_tie":24,"argmax_equal_non_near_tie":24,"near_ties":[],"max_abs_dp":0.002435230632077845,"worst":"img09_wide_1600x1200:crowded","mean_of_run_mean_abs_dp":0.0002337234971274742,"pass":true},"bar_api_path":{"questions":24,"argmax_equal":24,"questions_non_near_tie":24,"argmax_equal_non_near_tie":24,"near_ties":[],"max_abs_dp":0.0024357061272490266,"worst":"img09_wide_1600x1200:crowded","mean_of_run_mean_abs_dp":0.00023375171879558786,"pass":true}},"tower":{"result":"PASS","summary":{"crops":64,"pictures":18,"min_cos":{"value":0.9999999997186582,"key":"img08_square_1024x1024/crop03_tile_r2c2"},"min_row":{"value":0.9999999862463337,"key":"img09_wide_1600x1200/crop06_thumbnail"},"max_abs":{"value":6.946921348571777e-05,"key":"random_2048x1536/crop06_thumbnail"},"n_pass":64,"finite_all":true,"rerun_bit_equal":"64/64","by_kind":{"single":{"crops":10,"min_cos":0.9999999998737493,"min_row":0.9999999956175958,"max_abs":2.47955322265625e-05},"tile":{"crops":46,"min_cos":0.9999999997186582,"min_row":0.9999999934146961,"max_abs":3.9905309677124023e-05},"thumbnail":{"crops":8,"min_cos":0.9999999997855059,"min_row":0.9999999862463337,"max_abs":6.946921348571777e-05}},"controls":{"no_mask":{"crops":17,"immune":47,"immune_keys":["img06_grid_1024x768/crop00_tile_r1c1","img06_grid_1024x768/crop01_tile_r1c2","img06_grid_1024x768/crop02_tile_r1c3","img06_grid_1024x768/crop03_tile_r2c1","img06_grid_1024x768/crop04_tile_r2c2","img06_grid_1024x768/crop05_tile_r2c3","img07_portrait_768x1024/crop00_tile_r1c1","img07_portrait_768x1024/crop01_tile_r1c2","img07_portrait_768x1024/crop02_tile_r2c1","img07_portrait_768x1024/crop03_tile_r2c2","img07_portrait_768x1024/crop04_tile_r3c1","img07_portrait_768x1024/crop05_tile_r3c2","img08_square_1024x1024/crop00_tile_r1c1","img08_square_1024x1024/crop01_tile_r1c2","img08_square_1024x1024/crop02_tile_r2c1","img08_square_1024x1024/crop03_tile_r2c2","img08_square_1024x1024/crop04_thumbnail","img09_wide_1600x1200/crop00_tile_r1c1","img09_wide_1600x1200/crop01_tile_r1c2","img09_wide_1600x1200/crop02_tile_r1c3","img09_wide_1600x1200/crop03_tile_r2c1","img09_wide_1600x1200/crop04_tile_r2c2","img09_wide_1600x1200/crop05_tile_r2c3","img10_big_2048x1536/crop00_tile_r1c1","img10_big_2048x1536/crop01_tile_r1c2","img10_big_2048x1536/crop02_tile_r1c3","img10_big_2048x1536/crop03_tile_r2c1","img10_big_2048x1536/crop04_tile_r2c2","img10_big_2048x1536/crop05_tile_r2c3","random_1024x768/crop00_tile_r1c1","random_1024x768/crop01_tile_r1c2","random_1024x768/crop02_tile_r1c3","random_1024x768/crop03_tile_r2c1","random_1024x768/crop04_tile_r2c2","random_1024x768/crop05_tile_r2c3","random_1600x1200/crop00_tile_r1c1","random_1600x1200/crop01_tile_r1c2","random_1600x1200/crop02_tile_r1c3","random_1600x1200/crop03_tile_r2c1","random_1600x1200/crop04_tile_r2c2","random_1600x1200/crop05_tile_r2c3","random_2048x1536/crop00_tile_r1c1","random_2048x1536/crop01_tile_r1c2","random_2048x1536/crop02_tile_r1c3","random_2048x1536/crop03_tile_r2c1","random_2048x1536/crop04_tile_r2c2","random_2048x1536/crop05_tile_r2c3"],"all_red":true,"max_cos":0.9920300619170227,"min_max_abs":0.14671653509140015},"transposed":{"crops":64,"immune":0,"immune_keys":[],"all_red":true,"max_cos":0.6356883358504121,"min_max_abs":0.4418598636984825}}},"asset":{"bundle":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship/d1_3b_vision_fp16w32_s","name":"d1_3b_vision_fp16w32_s","dtype":"fp16w32","attention":"matmul","metadata_sha256":"1d84a4c0d2ec5fa8e1fa9dfad41e51bc5a125c3c077f3a59e13b6f410b71f669","aimodelc":{"path":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_ship_aotc/d1_3b_vision_fp16w32_s.h16c.aimodelc","bytes":853216201,"tree_sha256":"fa26bb2e3c03fc07f583bc2457eee52dbd78e861b636f0c6d0389503c07565be"},"aimodelc_main_hash":"6a2a7e742d1ec2e2d5908e874ee478a582dcfe23b814e890f9e3d6f243ab8d64","graph":{"function":"main","inputs":{"patches":[[1024,768],"float32"],"pos_table":[[1024,1152],"float32"],"key_bias":[[1024],"float32"],"unshuffle_idx":[[256,4],"int32"]},"outputs":{"image_embeds":[[256,2048],"float32"]},"states":{},"meaning":{"patches":"the crop's patches row-major over its (h, w) patch grid, [y][x][c] inside a 16 x 16 patch (channel fastest), (x - 127.5) / 127.5 in float32; rows h * w .. 1023 zero","pos_table":"host/position_embedding.safetensors [256, d] as [16, 16, d], resized to (h, w) by F.interpolate(bilinear, align_corners=False, antialias=True) in float32, row-major [h * w, d]; rows h * w .. 1023 zero (transformers writes row 0 there; those rows never reach a real one)","key_bias":"0 for rows 0 .. h * w - 1, -inf after: added to every query's attention scores","unshuffle_idx":"row k = i * (w / 2) + j of the (h / 2, w / 2) merged grid: [2i w + 2j, 2i w + 2j + 1, (2i + 1) w + 2j, (2i + 1) w + 2j + 1] (channel m * d + c of the 4 d-vector comes from patch m); rows k >= h w / 4 are [0, 0, 0, 0]","image_embeds":"rows 0 .. h w / 4 - 1 = the crop's image tokens in merged-grid row-major order (the projector's output, no LayerNorm); rows after are padding and are discarded"},"math":"x = patch_embedding(patches) + pos_table; 27 x [x += attn(LN1 x) (scores = q k^T / sqrt(72) + key_bias, softmax over keys); x += fc2(gelu_tanh(fc1(LN2 x)))]; post_layernorm; gather the 4 rows of unshuffle_idx -> [256, 4608]; linear_2(gelu_exact(linear_1(.)))","attention":"matmul","input_names":["patches","pos_table","key_bias","unshuffle_idx"],"output_names":["image_embeds"]}}}}}