{"what":"d1-3B: the iPhone's decoder (int8mlp S = 64, the AOT asset of gate-d1-3b-readout.json's iphone_int8mlp) on the held-out set (120 transfer-v4 records after the fixture's slices, their own oracle run), the same bar; no red arms (their base rows are fixture records) (round 11). The held-out set checks the int8 choice made on the fixture; the fp16 decoder needs no such check. compare_with = the fp16 S = 16 decoder on the same rows (round 5c).","sources":[{"file":"results/r11_readout_int8mlp_pf64_heldout.json","bytes":170437,"sha256":"01a3758476898f057b5f86efa9b4424b507e8ab4e0a2039fad2771881891ccdb"}],"trimmed":{"removed":["per-call ms lists (call_ms, first_call_of_process_ms; each transcript keeps its medians)","hidden-dump file names and hashes (npz, npz_key, npz_sha256, hidden_npz) and the hidden rows' lowest positions","the oracle's probabilities inside the transcripts (probs_oracle: they are in fixtures-d1-3b.json)","token ids and rendered prompt text (row_ids, ids, text, instructions, state, criteria)","other sessions' processes seen by the drivers (other_gpu_processes*, other_gpu_jobs*, busiest, top)","compare_with.rows (per-row numbers against the fp16 S = 16 run)"],"serialization":"compact json (no indentation)","full_copies":"the source files above, in the lane directory $ZOO_WORK_ROOT/_d1_3b/ (not in the repository)","paths":"local paths rewritten: the lane directory as $ZOO_WORK_ROOT/_d1_3b, the repository relative, the home directory as ~, the checkpoint snapshot as <snapshot>, the overlay venv as <overlay venv>, temporary directories as $TMPDIR, Xcode as $DEVELOPER_DIR, the phone's app container as <app container>, the phone's ids as <udid> / <coredevice id>","process_ids":"removed (keys pid / pids; 'pid <n>' in text)"},"readout":{"schema":"d1-decoder-readout-gate/1","gate":"the decoder alone on the Mac GPU (the oracle's row ids), the fp16 slot hidden read out through host.py","bundle":{"bundle":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles/d1_3b_decode_int8mlp_pf64","name":"d1_3b_decode_int8mlp_pf64","kind":"decision-backbone","compression":{"scheme":"int8mlp","linear":"int8 per-block-32 symmetric_with_clipping (weight only)","quantized":"every MLP linear (feed_forward.gate_proj / up_proj / down_proj)","excluded":"fp32: the four attention projections of every full-attention layer; fp16: the conv-mixer projections (conv.in_proj / out_proj), the embedding table (the tied table of head/option_rows), the conv1d, every RMSNorm, SDPA","excluded_names":[".*\\.conv\\.in_proj$",".*\\.conv\\.out_proj$",".*lm_head$",".*self_attn\\.(q_proj|k_proj|v_proj|out_proj)$"],"excluded_types":["coreai_models.primitives.macos.rms_norm.RMSNorm","coreai_models.primitives.macos.sdpa.SDPA","torch.nn.modules.conv.Conv1d","torch.nn.modules.sparse.Embedding"],"quantized_linear_modules":90,"fp16_layers":[],"fp16_linear_modules":["model.layers.0.conv.in_proj","model.layers.0.conv.out_proj","model.layers.1.conv.in_proj","model.layers.1.conv.out_proj","model.layers.10.conv.in_proj","model.layers.10.conv.out_proj","model.layers.11.conv.in_proj","model.layers.11.conv.out_proj","model.layers.12.conv.in_proj","model.layers.12.conv.out_proj","model.layers.14.conv.in_proj","model.layers.14.conv.out_proj","model.layers.15.conv.in_proj","model.layers.15.conv.out_proj","model.layers.16.conv.in_proj","model.layers.16.conv.out_proj","model.layers.18.conv.in_proj","model.layers.18.conv.out_proj","model.layers.19.conv.in_proj","model.layers.19.conv.out_proj","model.layers.20.conv.in_proj","model.layers.20.conv.out_proj","model.layers.22.conv.in_proj","model.layers.22.conv.out_proj","model.layers.23.conv.in_proj","model.layers.23.conv.out_proj","model.layers.25.conv.in_proj","model.layers.25.conv.out_proj","model.layers.26.conv.in_proj","model.layers.26.conv.out_proj","model.layers.28.conv.in_proj","model.layers.28.conv.out_proj","model.layers.29.conv.in_proj","model.layers.29.conv.out_proj","model.layers.3.conv.in_proj","model.layers.3.conv.out_proj","model.layers.4.conv.in_proj","model.layers.4.conv.out_proj","model.layers.6.conv.in_proj","model.layers.6.conv.out_proj","model.layers.7.conv.in_proj","model.layers.7.conv.out_proj","model.layers.8.conv.in_proj","model.layers.8.conv.out_proj"],"head":"none in the graph (the tied rows of the readout ids are head/option_rows)"},"prefill_chunk":64,"max_ctx":4096,"toy":null,"metadata_sha256":"864a2e13289fe5c6f012930fce4a6220db839d4eb23641d8d32023416f318e74","main_mlirb":{"bytes":3704646757,"sha256":"2ab109907108870b8e7e191162d98bff7107b0ff338e3ead4854f490d4a6850b"},"tokenizer_sha256":{"chat_template.jinja":"86f4770449a4797c9b4212d110b0cc70fb993c1ce960095bcfb12eea22f61cca","tokenizer.json":"8096ecb9f54599d756c8de728a598a340bc1e43c0deb77ddd62456c38349fcee","tokenizer_config.json":"ef6770d12dd9ac58d334e979bf160c5cdfd41f13d205fd5d5516857645feb0ea"},"head_sha256":{"option_rows.json":"41bb7fc3120b09adf9cc11319b4ec566bc6989ff6ebdb30890e269e257ab8bba","option_rows.safetensors":"e43cfaee023b4c1c2bab48b873aa2195bc6e5f86fe9f30049a89a1e0ad948522"},"license_sha256":"4d28ca14dedc0b3d0fcc2b3339f0e79931faa33874f3d24f522183a8fc70068c","aimodelc":{"path":"$ZOO_WORK_ROOT/_d1_3b/exports/bundles_aotc/d1_3b_decode_int8mlp_pf64.h16c.aimodelc","bytes":8742889020,"tree_sha256":"607cbb07d9fec258a8ed5cde24670a1062db2a150a8ff93f5630ccc0ef8062e3"},"aimodelc_main_hash":"6b6e4de872f9b4ee33a610b8f5837085a7f968240f0c542f823a267354380933"},"chunk":64,"subset":"all","bar":{"max_abs_dp":0.02,"mean_of_run_mean_abs_dp":0.002,"near_tie_top2_margin":0.02,"argmax":"every question with an oracle top-2 margin above 0.02; near-ties listed apart","max_abs_dp_applies_to":"every option of every question, near-ties included","mean_of_run_mean_abs_dp_definition":"mean over runs (one run = one row = one question) of the mean |dp| over that question's options","reset":"every process re-runs its first row last: hidden rows bit-equal","finite":"every hidden value of every row finite, no row all zero","rows":"every expected row present"},"environment":{"versions":{"python":"3.11.13","numpy":"2.3.5","coreai-core":"1.0.0b2","coreai-torch":"0.4.1","coreai-models":"0.1.0","torch":"2.9.0","safetensors":"0.7.0","tokenizers":"0.23.0rc0"},"platform":"macOS-27.0-arm64-arm-64bit","macos_build":"26A428","chip":"Apple M4 Max","runtime":"coreai python runtime, AOT h16c GPU .aimodelc, SpecializationOptions.default(), no JIT","readout":"host.py: z = h_slot . E[id] in float64 over the group ids (head/option_rows, fp32), group max, softmax over the options","gpu":"shared with other sessions, _GPU_LOCK read only (the ms are contended reference values)"},"summary":{"runs":120,"expected_runs":120,"missing_runs":[],"questions":120,"argmax_equal":120,"questions_non_near_tie":118,"argmax_equal_non_near_tie":118,"near_tie_questions":2,"argmax_equal_near_tie":2,"max_abs_dp":0.014006239134214393,"max_abs_dp_non_near_tie":0.014006239134214393,"mean_of_run_mean_abs_dp":0.0010123085973413758,"mean_question_max_abs_dp":0.0016684010386006987,"worst_run":{"id":"tv4sh_05","name":"decision","max_abs_dp":0.014006239134214393},"finite_all":true,"all_zero_runs":0,"hidden_rows":0,"min_pos_cos":null,"hidden_max_abs_diff":null,"tokens":13091,"padded_tokens":16704,"calls":261,"pad_waste":0.2162954980842912,"ms_per_call_median":34.76254199631512,"ms_per_call_warm_median":34.75954197347164},"by_source":{"tv4h":{"runs":40,"expected_runs":40,"missing_runs":[],"questions":40,"argmax_equal":40,"questions_non_near_tie":39,"argmax_equal_non_near_tie":39,"near_tie_questions":1,"argmax_equal_near_tie":1,"max_abs_dp":0.010671627558392571,"max_abs_dp_non_near_tie":0.010671627558392571,"mean_of_run_mean_abs_dp":0.0010666649783381702,"mean_question_max_abs_dp":0.002190432708224908,"worst_run":{"id":"tv4h_12","name":"answer","max_abs_dp":0.010671627558392571},"finite_all":true,"all_zero_runs":0,"hidden_rows":0,"min_pos_cos":null,"hidden_max_abs_diff":null,"tokens":4589,"padded_tokens":5952,"calls":93,"pad_waste":0.2289986559139785,"ms_per_call_median":34.65950000099838,"ms_per_call_warm_median":34.65950000099838},"tv4sh":{"runs":20,"expected_runs":20,"missing_runs":[],"questions":20,"argmax_equal":20,"questions_non_near_tie":20,"argmax_equal_non_near_tie":20,"near_tie_questions":0,"argmax_equal_near_tie":0,"max_abs_dp":0.014006239134214393,"max_abs_dp_non_near_tie":0.014006239134214393,"mean_of_run_mean_abs_dp":0.0019697659463720264,"mean_question_max_abs_dp":0.0029546489195580493,"worst_run":{"id":"tv4sh_05","name":"decision","max_abs_dp":0.014006239134214393},"finite_all":true,"all_zero_runs":0,"hidden_rows":0,"min_pos_cos":null,"hidden_max_abs_diff":null,"tokens":2430,"padded_tokens":2560,"calls":40,"pad_waste":0.05078125,"ms_per_call_median":34.73239601589739,"ms_per_call_warm_median":34.73239601589739},"tv4xh":{"runs":60,"expected_runs":60,"missing_runs":[],"questions":60,"argmax_equal":60,"questions_non_near_tie":59,"argmax_equal_non_near_tie":59,"near_tie_questions":1,"argmax_equal_near_tie":1,"max_abs_dp":0.005130607614750371,"max_abs_dp_non_near_tie":0.005130607614750371,"mean_of_run_mean_abs_dp":0.0006569185603332963,"mean_question_max_abs_dp":0.0008916306318654418,"worst_run":{"id":"tv4xh_composition_holdout_05","name":"decision","max_abs_dp":0.005130607614750371},"finite_all":true,"all_zero_runs":0,"hidden_rows":0,"min_pos_cos":null,"hidden_max_abs_diff":null,"tokens":6072,"padded_tokens":8192,"calls":128,"pad_waste":0.2587890625,"ms_per_call_median":34.83966656494886,"ms_per_call_warm_median":34.81862507760525}},"near_ties":[{"id":"tv4h_06","name":"answer","oracle_top2_margin":0.014669196070502488,"argmax_equal":true,"max_abs_dp":0.005373351015207417,"probs":[0.4573483614953067,0.037471284445067206,0.041874844721000906,0.46330550933862524]},{"id":"tv4xh_qnli_08","name":"answers","oracle_top2_margin":0.009203650942622987,"argmax_equal":true,"max_abs_dp":0.0025471683595068573,"probs":[0.5071489938308184,0.49285100616918165]}],"checks":{"all_runs":true,"a_argmax_non_near_tie":true,"b_max_abs_dp":true,"c_mean_of_run_mean_abs_dp":true,"d_reset_bit_equal_all_processes":true,"e_finite":true},"result":"PASS","timing":{"contended":true,"S":64,"load_seconds":{"first_process":4.544165791943669,"median":0.6347395830089226,"all":[4.544165791943669,0.6138144170399755,0.6347395830089226]},"ms_per_call_warm_runs":{"n":256,"median":34.75954197347164,"p10":34.15620850864798,"p90":36.27935401163995},"ms_per_call_all_runs":{"n":261,"median":34.76254199631512,"p10":34.15937500540167,"p90":36.41212498769164},"row_wall_seconds_warm_runs":{"n":117,"median":0.07456316705793142,"p10":0.07358703366480768,"p90":0.10900500835850835}},"seconds":{"gpu_processes":25.026295165997,"scoring":0.08652174996677786,"total":25.17587591591291},"generated_at":"2026-10-08T21:58:36+00:00","note":"round 11 step 1: the ship form int8mlp S=64 (dynamic efr AOT h16c) on the held-out set (120 records, verification only); no red arms (their base rows are fixture records)","load":{"start":{"at":"2026-10-09T06:58:11+09:00","loadavg":"{ 7.00 4.85 5.03 }","swapusage":"total = 6144.00M  used = 5082.31M  free = 1061.69M  (encrypted)"},"end":{"at":"2026-10-09T06:58:36+09:00","loadavg":"{ 10.27 5.78 5.36 }","swapusage":"total = 6144.00M  used = 5082.31M  free = 1061.69M  (encrypted)"}},"contract":{"function":"main","inputs":{"input_ids":[[1,64],"int32"],"position_ids":[[1,-1],"int32"],"image_embeds":[[2816,2048],"float16"]},"outputs":{"hidden":[[1,64,2048],"float16"]},"states":{"keyCache":[[8,1,8,-1,64],"float16"],"valueCache":[[8,1,8,-1,64],"float16"],"convState":[[22,1,2048,2],"float16"]},"dynamic":"-1 = dynamic: position_ids [1, seq] with seq in S..max_context_length-1; the KV sequence axis 2048..max_context_length (a host allocates it at max_context_length)"},"oracle":{"path":"$ZOO_WORK_ROOT/_d1_3b/oracle/heldout/records_oracle.json","sha256":"db8b5bf0efd303e4614043c94ec8b5e8134a0673d040fc8d51618ac74e969a45","schema":"d1-oracle/1","toy":null,"hidden_dir":"$ZOO_WORK_ROOT/_d1_3b/oracle/heldout/hidden"},"runtime_cache_entry":{"path":"~/Library/Caches/coreai-cache/26A428/python/6b6e4de872f9b4ee33a610b8f5837085a7f968240f0c542f823a267354380933","exists":true,"kib":8538000},"descriptor_same_in_every_process":true,"red_rule":null,"script":{"path":"conversion/d1/readout_gate.py","sha256":"98703561dc93bc49f4851d359a32c9da54dc85408545306ce09c4943ce6bb104"},"runs":[{"id":"tv4h_00","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":75,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.005196950469489037,"mean_abs_dp":0.0026509756112473213,"oracle_top2_margin":0.2725044301498935,"near_tie":false,"n_options":4,"probs":[0.588941742432498,0.06903605320906933,0.015215940208185081,0.3268062641502476],"hidden_sha256":"a6c36e1262cace2b03d87be978a940f31155d8729d6975ee342b4976aae28cf7","first_in_process":true,"shard":"shard_00","index":0},{"id":"tv4h_01","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":149,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.002819427374843142,"mean_abs_dp":0.0014097136874215727,"oracle_top2_margin":0.28458353306397693,"near_tie":false,"n_options":4,"probs":[0.09164114590203562,0.566658910414059,0.2861863871100755,0.055513556573829774],"hidden_sha256":"8cbd4a9c8329ca7301dc771d1a6f9b4e95bb30502784ff67b928ae8624f4cdaf","first_in_process":false,"shard":"shard_00","index":1},{"id":"tv4h_02","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":92,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0015595792763272165,"mean_abs_dp":0.0007804218686409264,"oracle_top2_margin":0.7199083331282152,"near_tie":false,"n_options":4,"probs":[0.826224630914642,0.0565707915996366,0.008131401084363818,0.10907317640135752],"hidden_sha256":"7341a7a9c646d878fdb31421009d0b65cff7a0774e5912ca15b108443a82f501","first_in_process":false,"shard":"shard_00","index":2},{"id":"tv4h_03","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":84,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0005519284532785607,"mean_abs_dp":0.0002759642266392526,"oracle_top2_margin":0.8980564354403405,"near_tie":false,"n_options":4,"probs":[0.00478788843585567,0.9314443434832007,0.03437122196299028,0.029396546117953275],"hidden_sha256":"f84c4f463cc856bddda99ad94b5273e6e34ec52ddf18278859255aa8a8469680","first_in_process":false,"shard":"shard_00","index":3},{"id":"tv4h_04","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":154,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.00014965467673022648,"mean_abs_dp":7.482733836511454e-05,"oracle_top2_margin":0.9791637434285083,"near_tie":false,"n_options":4,"probs":[0.0022755403302878925,0.006427698658536562,0.9858174560772702,0.005479304933905249],"hidden_sha256":"ff5b2ae6ede00841a10e21a9e6876507d2bb56f2adc556d3103fb6c0e7b0b071","first_in_process":false,"shard":"shard_00","index":4},{"id":"tv4h_05","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":72,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.006562551204759015,"mean_abs_dp":0.003281275602379518,"oracle_top2_margin":0.39825618224991133,"near_tie":false,"n_options":4,"probs":[0.1756712386970967,0.15774862260493794,0.08276066104070721,0.5838194776572582],"hidden_sha256":"396942666be3bc47935cc5e43c0679b042ab0c08b0ed3660aa215edf7047a0e3","first_in_process":false,"shard":"shard_00","index":5},{"id":"tv4h_06","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":105,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.005373351015207417,"mean_abs_dp":0.002686675507603705,"oracle_top2_margin":0.014669196070502488,"near_tie":true,"n_options":4,"probs":[0.4573483614953067,0.037471284445067206,0.041874844721000906,0.46330550933862524],"hidden_sha256":"a74dca1ea9086bad9f846dc96d340d871b03501bf54bf5ed6d068ebca8cbf2d7","first_in_process":false,"shard":"shard_00","index":6},{"id":"tv4h_07","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":118,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0019007792164911774,"mean_abs_dp":0.0009503896082455783,"oracle_top2_margin":0.18835791045557893,"near_tie":false,"n_options":4,"probs":[0.09768403504170477,0.497915470802628,0.3120795877886884,0.09232090636697884],"hidden_sha256":"258ecdf7aab153e1fbd0ca514dfe051e49571105e0fedd26b5f238976bf9b8aa","first_in_process":false,"shard":"shard_00","index":7},{"id":"tv4h_08","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":104,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.0023971881993910815,"mean_abs_dp":0.0015515540935674456,"oracle_top2_margin":0.28137981703738396,"near_tie":false,"n_options":4,"probs":[0.1301439957530943,0.234513125573745,0.5149461362209469,0.12039674245221377],"hidden_sha256":"04df26bc3a226eb86c3f6bc99aa3ffe3ef70cff9a8bfcd33e94d7bc0fe49ec08","first_in_process":false,"shard":"shard_00","index":8},{"id":"tv4h_09","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":140,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.006306326536600293,"mean_abs_dp":0.003259295697735545,"oracle_top2_margin":0.08868271105543885,"near_tie":false,"n_options":4,"probs":[0.364912631121087,0.4427083692474893,0.18059441720153546,0.0117845824298882],"hidden_sha256":"e8ed31e893070492dc11c8bba8757ee1e0060db1888d7159dfc7225334915033","first_in_process":false,"shard":"shard_00","index":9},{"id":"tv4h_10","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":177,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.004009157630185445,"mean_abs_dp":0.0020045788150927107,"oracle_top2_margin":0.33948310130301074,"near_tie":false,"n_options":4,"probs":[0.01101419543135818,0.32292426220641374,0.6544395173532558,0.01162202500897234],"hidden_sha256":"b4c6bfc32d309b86ead2d1ea730135613c77be48b695b64238eee1ed7d2a1c0d","first_in_process":false,"shard":"shard_00","index":10},{"id":"tv4h_11","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":319,"calls":5,"padded_tokens":320,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.0003675217486837079,"mean_abs_dp":0.0001837608743418753,"oracle_top2_margin":0.9417092303278093,"near_tie":false,"n_options":4,"probs":[0.002299719909247472,0.022905894049882945,0.009582822808473565,0.965211563232396],"hidden_sha256":"a70cb8c783fc4f349211fa1a195e492f98e85017899276a358471108d4a90155","first_in_process":false,"shard":"shard_00","index":11},{"id":"tv4h_12","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":151,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.010671627558392571,"mean_abs_dp":0.005335813779196298,"oracle_top2_margin":0.5376130376719038,"near_tie":false,"n_options":4,"probs":[0.19635222671625063,0.07941467731280254,0.7142389867539709,0.009994109216975975],"hidden_sha256":"b8d2fb48f48b258119f7cf5191acd7a4b1df96a39b1274a9986b536ee1edec0c","first_in_process":false,"shard":"shard_00","index":12},{"id":"tv4h_13","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":90,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":6.25703698619029e-05,"mean_abs_dp":3.1285184930967495e-05,"oracle_top2_margin":0.9692691362595759,"near_tie":false,"n_options":4,"probs":[0.003043134440298008,0.0114103298146882,0.9807667455263542,0.004779790218659511],"hidden_sha256":"254d5e85ed148e7ec4807018151c8a3aaffc4e07983ee2ef03d8cb20335b864c","first_in_process":false,"shard":"shard_00","index":13},{"id":"tv4h_14","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":76,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.0005262133334227315,"mean_abs_dp":0.0002631066667113805,"oracle_top2_margin":0.8868815136255577,"near_tie":false,"n_options":4,"probs":[0.03571887050505514,0.024002448683204225,0.9232190234505188,0.017059657361221805],"hidden_sha256":"924b152ae9a7e41a99b8a477316964af0d37fbfa89694bfc0a75b8376243c001","first_in_process":false,"shard":"shard_00","index":14},{"id":"tv4h_15","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":72,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.001109613601056679,"mean_abs_dp":0.0005548068005283718,"oracle_top2_margin":0.861123417320559,"near_tie":false,"n_options":4,"probs":[0.0629027321385085,0.004875581269954386,0.9218682508302396,0.010353435761297514],"hidden_sha256":"3016fe7f6f3b3c7ca1e4db05f47280e702a42d1f89e40796ca4a71ce87d3b1b3","first_in_process":false,"shard":"shard_00","index":15},{"id":"tv4h_16","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":90,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0003829973358640028,"mean_abs_dp":0.00023409582410642386,"oracle_top2_margin":0.8054335389506493,"near_tie":false,"n_options":4,"probs":[0.02478189456589462,0.8771615699171982,0.026193990562148786,0.07186254495475834],"hidden_sha256":"912b1d73ce56353a620e30f0199c4a1bacf878dc126a7324d6810322b452c24f","first_in_process":false,"shard":"shard_00","index":16},{"id":"tv4h_17","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":79,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0014891281797093092,"mean_abs_dp":0.0007445640898546676,"oracle_top2_margin":0.30402620746801273,"near_tie":false,"n_options":4,"probs":[0.010699654297704529,0.6393958306016488,0.33832734658776953,0.011577168512877094],"hidden_sha256":"90d993a6bcb140dd11503db811b1938c8426db289ce72a5f774be8c9584ccb60","first_in_process":false,"shard":"shard_00","index":17},{"id":"tv4h_18","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":76,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.00019070950881580964,"mean_abs_dp":9.53547544079162e-05,"oracle_top2_margin":0.9380871516155121,"near_tie":false,"n_options":4,"probs":[0.003808058715433485,0.02635264284490475,0.9641467374790947,0.005692560960566904],"hidden_sha256":"2a115536ee9eb87fa0c64ed4b8c2efc40798591a2d8b316533ca99c162d5f8f4","first_in_process":false,"shard":"shard_00","index":18},{"id":"tv4h_19","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":116,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.00041242755060071773,"mean_abs_dp":0.00020621377530036927,"oracle_top2_margin":0.6828554464730332,"near_tie":false,"n_options":4,"probs":[0.03668089677126874,0.11826636048892891,0.04410393496540225,0.8009488077744001],"hidden_sha256":"6446f0bbb3b9fb6662c838001c1436cb67c68f822a2957f07edf230b45492a3f","first_in_process":false,"shard":"shard_00","index":19},{"id":"tv4h_20","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":115,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0016036365358399474,"mean_abs_dp":0.000680288047011822,"oracle_top2_margin":0.24264432309769512,"near_tie":false,"n_options":5,"probs":[0.5561649618535801,0.06030553604656586,0.31659730300855804,0.015678922761658512,0.051253276329637415],"hidden_sha256":"a6bebf9b58b3fbceced35c497af5dd07aa1e90ea07a8cfdd62549f4dab535baa","first_in_process":false,"shard":"shard_00","index":20},{"id":"tv4h_21","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":107,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.0010340146462722855,"mean_abs_dp":0.0005442185882974125,"oracle_top2_margin":0.3176710509590949,"near_tie":false,"n_options":4,"probs":[0.29304940301451404,0.02183279123329441,0.6092867755852083,0.07583103016698331],"hidden_sha256":"c357c5cce9ec8615b8430ce6cb00a82ce021ee1e7f79abebe8c7c91a03c7568e","first_in_process":false,"shard":"shard_00","index":21},{"id":"tv4h_22","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":106,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00037891727821659504,"mean_abs_dp":0.0001894586391083448,"oracle_top2_margin":0.9058094854373309,"near_tie":false,"n_options":4,"probs":[0.016709213493661418,0.9398581549009105,0.008889287768296537,0.034543343837131625],"hidden_sha256":"33e8b455ce031fbfdf2dd466921a6a712ab4270ac275ea529a5796c998469c53","first_in_process":false,"shard":"shard_00","index":22},{"id":"tv4h_23","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":86,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0005779440461869401,"mean_abs_dp":0.0002311776184747665,"oracle_top2_margin":0.9192852812389658,"near_tie":false,"n_options":5,"probs":[0.006171258926519459,0.9527190304267883,0.004888651781759761,0.03232776873972545,0.003893290125207084],"hidden_sha256":"3fde84e740ca202b5599e022678020ebbf9cf6d79b630c0b7596a59be5893893","first_in_process":false,"shard":"shard_00","index":23},{"id":"tv4h_24","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":78,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":7.446342725794634e-05,"mean_abs_dp":4.766339600893298e-05,"oracle_top2_margin":0.951758392639439,"near_tie":false,"n_options":4,"probs":[0.008076604501292984,0.9669171794089516,0.009895077273492996,0.015111138816262375],"hidden_sha256":"959b2fe83e3f76a24000e0cc4acb3db258f956e8036f91a638f9719442e80942","first_in_process":false,"shard":"shard_00","index":24},{"id":"tv4h_25","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":77,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":3.113373474050718e-05,"mean_abs_dp":1.556686737027652e-05,"oracle_top2_margin":0.9878370244801267,"near_tie":false,"n_options":4,"probs":[0.9914117799171832,0.0034571876279489906,0.0015962257557997723,0.0035348066990680536],"hidden_sha256":"7bbc27327d224c42f1fc4f179c82d0cb2bdf77bd62502370534a8b46b056d878","first_in_process":false,"shard":"shard_00","index":25},{"id":"tv4h_26","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":119,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.004899294733932136,"mean_abs_dp":0.0019799897271993087,"oracle_top2_margin":0.3406641348638324,"near_tie":false,"n_options":5,"probs":[0.6574275117255801,0.3265139589102911,0.0032354845031444535,0.009923857239939887,0.002899187621044515],"hidden_sha256":"104fe89a12c9f5efe9cd300d66b100884e2e88e551bb965106671e0a530e451e","first_in_process":false,"shard":"shard_00","index":26},{"id":"tv4h_27","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":108,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.001727302691225563,"mean_abs_dp":0.0008636513456127884,"oracle_top2_margin":0.856670855186863,"near_tie":false,"n_options":4,"probs":[0.04392282226044497,0.029088437674688678,0.02322825873555679,0.9037604813293095],"hidden_sha256":"75817f18bf4e19a1bdc7b2bfcedc3b62a1311a6ca889f9ebe5c78dbf063fbc62","first_in_process":false,"shard":"shard_00","index":27},{"id":"tv4h_28","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":110,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.000356064991457683,"mean_abs_dp":0.00018003259052688466,"oracle_top2_margin":0.9589307483192843,"near_tie":false,"n_options":4,"probs":[0.9727798744662309,0.00526216123810256,0.014503901808074881,0.007454062487591588],"hidden_sha256":"9050734a9c82723e9b53a0c259e1d80d8f2a51f10aa4e5a9405fe2422472a3cd","first_in_process":false,"shard":"shard_00","index":28},{"id":"tv4h_29","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":103,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.001534560654816719,"mean_abs_dp":0.0006352094561008308,"oracle_top2_margin":0.39718932226122716,"near_tie":false,"n_options":5,"probs":[0.6727095336449923,0.021616422003809914,0.011557126822594953,0.021339477467224956,0.27277744006137794],"hidden_sha256":"0e4f81b1b236994e3ab2ef08ed2adbd934f4ca7e62593324a56f05fdf68ef457","first_in_process":false,"shard":"shard_00","index":29},{"id":"tv4h_30","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":92,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.0006073893603230074,"mean_abs_dp":0.00035448151669910475,"oracle_top2_margin":0.7948044920156121,"near_tie":false,"n_options":4,"probs":[0.07248099084276514,0.04322782991443433,0.8667796671711294,0.017511512071671106],"hidden_sha256":"9f9265189e9f665bda2e0fdaa14a7a0a83361a3aa1d67d7a009c05980a6ac171","first_in_process":false,"shard":"shard_00","index":30},{"id":"tv4h_31","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":94,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.00017738131937351624,"mean_abs_dp":9.700608105506171e-05,"oracle_top2_margin":0.8762026696262939,"near_tie":false,"n_options":4,"probs":[0.9172141341614424,0.04084492468747771,0.010335681247696087,0.03160525990338375],"hidden_sha256":"d46fb06f3c5e856be2a67deee331c2ce3e2a796640b24d2211635b71b4564988","first_in_process":false,"shard":"shard_00","index":31},{"id":"tv4h_32","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":91,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":3.5447418643475004e-05,"mean_abs_dp":1.4178967457394858e-05,"oracle_top2_margin":0.9444135024624846,"near_tie":false,"n_options":5,"probs":[0.9631890633576478,0.006394185428172868,0.0057947552852126594,0.005884590447792885,0.01873740548117378],"hidden_sha256":"7c914d6f6681b24b8a173503094ee8a2a5ec03756499f3f0f54d6d718ee59cdd","first_in_process":false,"shard":"shard_00","index":32},{"id":"tv4h_33","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":82,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.0009593781808456825,"mean_abs_dp":0.0004807404554490386,"oracle_top2_margin":0.8863349646036672,"near_tie":false,"n_options":4,"probs":[0.03936336047090027,0.02551478853075141,0.010931619422997094,0.9241902315753513],"hidden_sha256":"907644b9b54b17663f4006e50498a48e047daef270812de4392589c20e507979","first_in_process":false,"shard":"shard_00","index":33},{"id":"tv4h_34","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":82,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":1.90108588604492e-05,"mean_abs_dp":1.2926677591010446e-05,"oracle_top2_margin":0.9769747703173897,"near_tie":false,"n_options":4,"probs":[0.9836082326566605,0.0034287744112247182,0.006351202091672233,0.006611790840442483],"hidden_sha256":"2fb38830778449133b6d9c8d503ba8f524ce344bdd66784d1051e3e7805ed0aa","first_in_process":false,"shard":"shard_00","index":34},{"id":"tv4h_35","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":102,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":4,"argmax_oracle":4,"argmax_equal":true,"max_abs_dp":0.0051697178095638785,"mean_abs_dp":0.002069758406096105,"oracle_top2_margin":0.2661670561454353,"near_tie":false,"n_options":5,"probs":[0.006371172981743064,0.0037998559563712318,0.01757690165657155,0.35818088332293235,0.6140711860823819],"hidden_sha256":"79cd3aed95a9b04be3e016ed86b7876e36463c16c6bb0c0ee7c9cb02b59ea8c6","first_in_process":false,"shard":"shard_00","index":35},{"id":"tv4h_36","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":96,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.007333701486161581,"mean_abs_dp":0.003666850743080793,"oracle_top2_margin":0.058097082227760055,"near_tie":false,"n_options":4,"probs":[0.006507447454916382,0.0058165995382727246,0.47207232272275734,0.5156036302840535],"hidden_sha256":"90d7a0e0d3a9bab4b93189e4991972d326c1a5921b8aedf3fa67f1c0b980691b","first_in_process":false,"shard":"shard_00","index":36},{"id":"tv4h_37","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":93,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.0006735835686590974,"mean_abs_dp":0.00035140288793447487,"oracle_top2_margin":0.9062070288331769,"near_tie":false,"n_options":4,"probs":[0.007363474055830468,0.0410735812606552,0.0055971039778169125,0.9459658407056976],"hidden_sha256":"86d78aec4547ddd06fdaa23b9c0e885fc1151123ac405991e8cbfceb7624a3ab","first_in_process":false,"shard":"shard_00","index":37},{"id":"tv4h_38","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":258,"calls":5,"padded_tokens":320,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.005150078573191386,"mean_abs_dp":0.002060031429276573,"oracle_top2_margin":0.05609647363834536,"near_tie":false,"n_options":5,"probs":[0.04321291910839852,0.12885799911037935,0.38089463229799214,0.4428098685612846,0.004224580921945371],"hidden_sha256":"4851c1459c29ce1f1d3cb26ab48a4465ff0c88dc538d448cd0d92e5b45f8533e","first_in_process":false,"shard":"shard_00","index":38},{"id":"tv4h_39","name":"answer","variant":"base","source":"tv4h","type":"choice","tokens":251,"calls":4,"padded_tokens":256,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0032345837737178806,"mean_abs_dp":0.0016172918868589225,"oracle_top2_margin":0.10653105371303895,"near_tie":false,"n_options":4,"probs":[0.41310183857228566,0.525428149618547,0.04781837367877707,0.013651638130390291],"hidden_sha256":"9219cd4d0e84c1c4fb63bbda7a519c86c9d37d6ba77d3d80ad2b1bbd70a89d5b","first_in_process":false,"shard":"shard_00","index":39},{"id":"tv4xh_emotion_00","name":"emotion","variant":"base","source":"tv4xh","type":"choice","tokens":53,"calls":1,"padded_tokens":64,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.0022194591471648983,"mean_abs_dp":0.0007398197157216499,"oracle_top2_margin":0.6908765501379984,"near_tie":false,"n_options":6,"probs":[0.144905130896377,0.005769667843999874,0.005262862030586253,0.8314632720023972,0.009788563724270746,0.0028105035023688863],"hidden_sha256":"5c7baee55b8141654c628f66286bc1fd788d8ecb86cbf8c6338bb91197d717a2","first_in_process":true,"shard":"shard_01","index":0},{"id":"tv4xh_emotion_01","name":"emotion","variant":"base","source":"tv4xh","type":"choice","tokens":84,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0001861459532491727,"mean_abs_dp":0.00011083431313480489,"oracle_top2_margin":0.6446486879050862,"near_tie":false,"n_options":6,"probs":[0.021131085810157234,0.7927221677995808,0.01862423384166543,0.009722291952809771,0.009766529668386014,0.14803369092740065],"hidden_sha256":"e3a7aa484348b815dd22162de33f09142b9f98bfb6221bad5c1b9daf06f59fd8","first_in_process":false,"shard":"shard_01","index":1},{"id":"tv4xh_emotion_02","name":"emotion","variant":"base","source":"tv4xh","type":"choice","tokens":68,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":4,"argmax_oracle":4,"argmax_equal":true,"max_abs_dp":0.001857301656674526,"mean_abs_dp":0.0006191005522248306,"oracle_top2_margin":0.597258403222146,"near_tie":false,"n_options":6,"probs":[0.03758139679801782,0.06097445800048121,0.14504260670173247,0.004816153760190298,0.7453539331175041,0.006231451622074198],"hidden_sha256":"592cc2c6b9979fb26082df732ec4ea44da4b19de508db5d08b2f12c8b6ca06a0","first_in_process":false,"shard":"shard_01","index":2},{"id":"tv4xh_emotion_03","name":"emotion","variant":"base","source":"tv4xh","type":"choice","tokens":64,"calls":1,"padded_tokens":64,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0018161956711318927,"mean_abs_dp":0.0006249545578549987,"oracle_top2_margin":0.20827754387982894,"near_tie":false,"n_options":6,"probs":[0.5146641505169411,0.30901310280632155,0.16012525457495808,0.006190988520562128,0.006610323102382421,0.0033961804788347288],"hidden_sha256":"00e1c894d0cdbf4a44dabe04ef4f52f05fe7757d6a686b082644233a4fe71bdf","first_in_process":false,"shard":"shard_01","index":3},{"id":"tv4xh_emotion_04","name":"emotion","variant":"base","source":"tv4xh","type":"choice","tokens":57,"calls":1,"padded_tokens":64,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0013971154256308127,"mean_abs_dp":0.0005458651088162191,"oracle_top2_margin":0.1730596106031898,"near_tie":false,"n_options":6,"probs":[0.4449440684412329,0.26913778741502004,0.01945373793559698,0.24112575583547016,0.011893211858028415,0.013445438514651423],"hidden_sha256":"9781a7a3ad1f63def65cb4e1ff58b6c2951e475968bc60629e751c31dce18b86","first_in_process":false,"shard":"shard_01","index":4},{"id":"tv4xh_emotion_05","name":"emotion","variant":"base","source":"tv4xh","type":"choice","tokens":52,"calls":1,"padded_tokens":64,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.004996229085662773,"mean_abs_dp":0.0016654096952209224,"oracle_top2_margin":0.13840378106205264,"near_tie":false,"n_options":6,"probs":[0.016491375002562366,0.42120835755126973,0.5499405940350525,0.005026720678032853,0.003811981942534276,0.0035209707905483395],"hidden_sha256":"49fb6432cb9dcb3175a2ce996381d0482903716bc306d26f7334651f6a5a9abb","first_in_process":false,"shard":"shard_01","index":5},{"id":"tv4xh_emotion_06","name":"emotion","variant":"base","source":"tv4xh","type":"choice","tokens":59,"calls":1,"padded_tokens":64,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0004887818692413948,"mean_abs_dp":0.00016292728974711353,"oracle_top2_margin":0.9384830778217252,"near_tie":false,"n_options":6,"probs":[0.9559771357772728,0.006790762801800533,0.00541383921026436,0.009127623278209793,0.005867455649052488,0.016823183283399983],"hidden_sha256":"a1d5e726c8fa40dc7ecd24972b54f2780c219de4582b2727289895ccce82bd84","first_in_process":false,"shard":"shard_01","index":6},{"id":"tv4xh_emotion_07","name":"emotion","variant":"base","source":"tv4xh","type":"choice","tokens":79,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.003416316327021829,"mean_abs_dp":0.0011708209633468363,"oracle_top2_margin":0.14799046710135494,"near_tie":false,"n_options":6,"probs":[0.5367093298006347,0.3823254868712568,0.053834851577907086,0.01157069678707454,0.01083192810016137,0.004727706862965528],"hidden_sha256":"7b9a26602fa47d7ad338e83afab176ef36b35f8a04734e2b15844d03af7c1b5a","first_in_process":false,"shard":"shard_01","index":7},{"id":"tv4xh_emotion_08","name":"emotion","variant":"base","source":"tv4xh","type":"choice","tokens":64,"calls":1,"padded_tokens":64,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00039404285885880075,"mean_abs_dp":0.00013345748835898348,"oracle_top2_margin":0.9174638930859429,"near_tie":false,"n_options":6,"probs":[0.020819195663344007,0.9387797939898025,0.010685107869578095,0.007531435984998552,0.005700282738332249,0.016484183753944615],"hidden_sha256":"b8a5400c6a63a45a3e1579cc60554d401a5427e65e387b150d2744c2416f7317","first_in_process":false,"shard":"shard_01","index":8},{"id":"tv4xh_emotion_09","name":"emotion","variant":"base","source":"tv4xh","type":"choice","tokens":75,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0004546123867793517,"mean_abs_dp":0.00015153746225978347,"oracle_top2_margin":0.9123180150585667,"near_tie":false,"n_options":6,"probs":[0.9348071388200667,0.00771215020160542,0.005318720858023732,0.020379170959688057,0.021948889132616493,0.009833930027999555],"hidden_sha256":"64b8fd2b2bdc1ffb012522f8f28b1cd2c4b3232e9637cac884bbb81da7758a11","first_in_process":false,"shard":"shard_01","index":9},{"id":"tv4xh_qnli_00","name":"answers","variant":"base","source":"tv4xh","type":"noul","tokens":76,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":9.64072058162093e-05,"mean_abs_dp":9.640720581618589e-05,"oracle_top2_margin":0.972091046307037,"near_tie":false,"n_options":2,"probs":[0.014050884052297687,0.9859491159477023],"hidden_sha256":"b915122b1ba030be888f2e602b7ff5e6b24234087851842e22926cf345f44ce7","first_in_process":false,"shard":"shard_01","index":10},{"id":"tv4xh_qnli_01","name":"answers","variant":"base","source":"tv4xh","type":"noul","tokens":70,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0003189307125214258,"mean_abs_dp":0.0003189307125213217,"oracle_top2_margin":0.8558896439324125,"near_tie":false,"n_options":2,"probs":[0.07173624732127248,0.9282637526787276],"hidden_sha256":"8b9bb5779aedf14f41b2ffca30e9a659873efff817f82821b3edcc296e167b3a","first_in_process":false,"shard":"shard_01","index":11},{"id":"tv4xh_qnli_02","name":"answers","variant":"base","source":"tv4xh","type":"noul","tokens":69,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":4.99576824696743e-05,"mean_abs_dp":4.9957682469650017e-05,"oracle_top2_margin":0.8783727158044872,"near_tie":false,"n_options":2,"probs":[0.9392363155847132,0.06076368441528678],"hidden_sha256":"4d62d0979c5a642499e07626616985c869d54b2f3015bbdba12e78a93cb2cfaf","first_in_process":false,"shard":"shard_01","index":12},{"id":"tv4xh_qnli_03","name":"answers","variant":"base","source":"tv4xh","type":"noul","tokens":75,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0038590585170752423,"mean_abs_dp":0.0038590585170751868,"oracle_top2_margin":0.39520254498544866,"near_tie":false,"n_options":2,"probs":[0.6937422139756492,0.3062577860243509],"hidden_sha256":"6e6ac48a9bc70481c177cabbb96eb20ce3492f79c37433475f17802bb4c3643a","first_in_process":false,"shard":"shard_01","index":13},{"id":"tv4xh_qnli_04","name":"answers","variant":"base","source":"tv4xh","type":"noul","tokens":68,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":4.937489878963086e-05,"mean_abs_dp":4.937489878958229e-05,"oracle_top2_margin":0.9460331524610822,"near_tie":false,"n_options":2,"probs":[0.9730659511293307,0.026934048870669275],"hidden_sha256":"5ed72add8950e21e4358ba8f605af9168a63de8642b92e059f65ea92079f8776","first_in_process":false,"shard":"shard_01","index":14},{"id":"tv4xh_qnli_05","name":"answers","variant":"base","source":"tv4xh","type":"noul","tokens":78,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00023763548842814508,"mean_abs_dp":0.00023763548842806181,"oracle_top2_margin":0.9532435348439287,"near_tie":false,"n_options":2,"probs":[0.023615868066463663,0.9763841319335362],"hidden_sha256":"3ab2fa8e0b931e359b4f244c813f7ec035ca27db266ecd89ad5cb77be27a6304","first_in_process":false,"shard":"shard_01","index":15},{"id":"tv4xh_qnli_06","name":"answers","variant":"base","source":"tv4xh","type":"noul","tokens":58,"calls":1,"padded_tokens":64,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0011868331493167794,"mean_abs_dp":0.0011868331493167517,"oracle_top2_margin":0.10947804097428276,"near_tie":false,"n_options":2,"probs":[0.5535521873378246,0.44644781266217537],"hidden_sha256":"c52f52ee7a502ad2d6317d1a0586a15af64b2f9e7d0324cd1b70c11c274a61a4","first_in_process":false,"shard":"shard_01","index":16},{"id":"tv4xh_qnli_07","name":"answers","variant":"base","source":"tv4xh","type":"noul","tokens":105,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":5.7001648813889e-05,"mean_abs_dp":5.700164881380747e-05,"oracle_top2_margin":0.962105098752078,"near_tie":false,"n_options":2,"probs":[0.01900445227277491,0.9809955477272252],"hidden_sha256":"fca85b4b1ae13bad4ad54ddc2225fba31c8d072b6b582a8953d4f44c07e36d34","first_in_process":false,"shard":"shard_01","index":17},{"id":"tv4xh_qnli_08","name":"answers","variant":"base","source":"tv4xh","type":"noul","tokens":55,"calls":1,"padded_tokens":64,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0025471683595068573,"mean_abs_dp":0.0025471683595068573,"oracle_top2_margin":0.009203650942622987,"near_tie":true,"n_options":2,"probs":[0.5071489938308184,0.49285100616918165],"hidden_sha256":"e2995d4f7a5a434579df6278be9f79b3ae2b021493bd5de9b0c23994ea02cdcc","first_in_process":false,"shard":"shard_01","index":18},{"id":"tv4xh_qnli_09","name":"answers","variant":"base","source":"tv4xh","type":"noul","tokens":74,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":1.5849595450756482e-05,"mean_abs_dp":1.5849595450735665e-05,"oracle_top2_margin":0.9240851475761668,"near_tie":false,"n_options":2,"probs":[0.037973275807367333,0.9620267241926327],"hidden_sha256":"451acae73ddf6bcb653685b54cb6d644ec45f50e81b98ebeb84d0defc9bc3a4c","first_in_process":false,"shard":"shard_01","index":19},{"id":"tv4xh_paws_00","name":"paraphrase","variant":"base","source":"tv4xh","type":"noul","tokens":113,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0007074712998473842,"mean_abs_dp":0.0007074712998473426,"oracle_top2_margin":0.8683493089580351,"near_tie":false,"n_options":2,"probs":[0.9348821257788649,0.06511787422113514],"hidden_sha256":"be99e6a4c67b2e7542444f46729e2b73604db2fc825efb1fc66e38f028a8e029","first_in_process":false,"shard":"shard_01","index":20},{"id":"tv4xh_paws_01","name":"paraphrase","variant":"base","source":"tv4xh","type":"noul","tokens":81,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0004741648162470691,"mean_abs_dp":0.00047416481624704826,"oracle_top2_margin":0.8426002149487692,"near_tie":false,"n_options":2,"probs":[0.9208259426581376,0.07917405734186245],"hidden_sha256":"0f9741e049ed1118198a3710fb847ca70730b22dc9ea82a7bcbdcab1b26b0816","first_in_process":false,"shard":"shard_01","index":21},{"id":"tv4xh_paws_02","name":"paraphrase","variant":"base","source":"tv4xh","type":"noul","tokens":136,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0021878481869348487,"mean_abs_dp":0.0021878481869348487,"oracle_top2_margin":0.47962797699948695,"near_tie":false,"n_options":2,"probs":[0.7420018366866783,0.25799816331332165],"hidden_sha256":"fe363ab27781bb69af2435ef38fe2d299b2026dc966d6912cf9a0d871dad96a7","first_in_process":false,"shard":"shard_01","index":22},{"id":"tv4xh_paws_03","name":"paraphrase","variant":"base","source":"tv4xh","type":"noul","tokens":115,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00015007994952664916,"mean_abs_dp":0.0001500799495266266,"oracle_top2_margin":0.942313455699614,"near_tie":false,"n_options":2,"probs":[0.028993352099719597,0.9710066479002804],"hidden_sha256":"b74797ac407eb1a3467815aacbdd148910ce4113d4312151409a262c2b972dfc","first_in_process":false,"shard":"shard_01","index":23},{"id":"tv4xh_paws_04","name":"paraphrase","variant":"base","source":"tv4xh","type":"noul","tokens":89,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0035196058964833687,"mean_abs_dp":0.0035196058964833132,"oracle_top2_margin":0.6676425162890292,"near_tie":false,"n_options":2,"probs":[0.837340864040998,0.16265913595900214],"hidden_sha256":"3a65fb71e8bcbcf29ad954e0a6025817bf91714b0a7ec4a921108ca1de4a0e08","first_in_process":false,"shard":"shard_01","index":24},{"id":"tv4xh_paws_05","name":"paraphrase","variant":"base","source":"tv4xh","type":"noul","tokens":129,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.00019612581291079262,"mean_abs_dp":0.0001961258129107614,"oracle_top2_margin":0.948692899299539,"near_tie":false,"n_options":2,"probs":[0.9745425754626803,0.025457424537319764],"hidden_sha256":"0e673d3f901245633d8f2ee279153d36c807edb7c0ff7b0d4983f5423ad1ab64","first_in_process":false,"shard":"shard_01","index":25},{"id":"tv4xh_paws_06","name":"paraphrase","variant":"base","source":"tv4xh","type":"noul","tokens":108,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":6.782256821369348e-05,"mean_abs_dp":6.782256821365705e-05,"oracle_top2_margin":0.9600186368858499,"near_tie":false,"n_options":2,"probs":[0.02005850412528873,0.9799414958747112],"hidden_sha256":"3046a75f95505093e526af38b35e1bb69de136f43ea1e62f6bd3cd01ca7da30f","first_in_process":false,"shard":"shard_01","index":26},{"id":"tv4xh_paws_07","name":"paraphrase","variant":"base","source":"tv4xh","type":"noul","tokens":98,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00022700579806156362,"mean_abs_dp":0.00022700579806156362,"oracle_top2_margin":0.9029694365626364,"near_tie":false,"n_options":2,"probs":[0.04828827592062026,0.9517117240793798],"hidden_sha256":"2292b5951683880ce2a1d6a2746a93a40f11d65b070d364f79ec05067a79e075","first_in_process":false,"shard":"shard_01","index":27},{"id":"tv4xh_paws_08","name":"paraphrase","variant":"base","source":"tv4xh","type":"noul","tokens":111,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0006018103577273837,"mean_abs_dp":0.0006018103577273004,"oracle_top2_margin":0.8699468280373278,"near_tie":false,"n_options":2,"probs":[0.9355752243763912,0.06442477562360877],"hidden_sha256":"1a75990df65d2c26341c2f51d4f1071082c01af6d6fecc12ab72a82386572997","first_in_process":false,"shard":"shard_01","index":28},{"id":"tv4xh_paws_09","name":"paraphrase","variant":"base","source":"tv4xh","type":"noul","tokens":119,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0005975532106876624,"mean_abs_dp":0.0005975532106876347,"oracle_top2_margin":0.9111100844263906,"near_tie":false,"n_options":2,"probs":[0.04504251099749234,0.9549574890025077],"hidden_sha256":"df5cfb92ee56085e003ed3d8fdde290c97903e82c19fffb1465b486df392fcb4","first_in_process":false,"shard":"shard_01","index":29},{"id":"tv4xh_sciq_00","name":"answer","variant":"base","source":"tv4xh","type":"choice","tokens":132,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.00036932082386897935,"mean_abs_dp":0.0001873658774052133,"oracle_top2_margin":0.9461006304347145,"near_tie":false,"n_options":4,"probs":[0.00098542552442288,0.004355986554943953,0.02464168608080004,0.970016901839833],"hidden_sha256":"6952fdc69d919a5106e7c7374096e0313af24e30c03097f9b7d22c2a630bdb69","first_in_process":false,"shard":"shard_01","index":30},{"id":"tv4xh_sciq_01","name":"answer","variant":"base","source":"tv4xh","type":"choice","tokens":107,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":3.964866810490797e-05,"mean_abs_dp":1.982433405242211e-05,"oracle_top2_margin":0.9882339205480299,"near_tie":false,"n_options":4,"probs":[0.0021445602628500735,0.9916157609348378,0.002925615481750177,0.0033140633205620156],"hidden_sha256":"5347ee68e39026d5d5f5bb88474d3aba4891d6a4c72fd67256429daf58ba8315","first_in_process":false,"shard":"shard_01","index":31},{"id":"tv4xh_sciq_02","name":"answer","variant":"base","source":"tv4xh","type":"choice","tokens":58,"calls":1,"padded_tokens":64,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.001979313476215716,"mean_abs_dp":0.000989656738107846,"oracle_top2_margin":0.5549214845803904,"near_tie":false,"n_options":4,"probs":[0.184122045804774,0.06308427601984429,0.7423918053186437,0.010401872856738123],"hidden_sha256":"1a974d6dc96348a19b169c9ea6ea5e60faf25f0e6cb753bbd859ab69d77af778","first_in_process":false,"shard":"shard_01","index":32},{"id":"tv4xh_sciq_03","name":"answer","variant":"base","source":"tv4xh","type":"choice","tokens":147,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":5.918642509061822e-05,"mean_abs_dp":3.009785276135836e-05,"oracle_top2_margin":0.9751337399623357,"near_tie":false,"n_options":4,"probs":[0.9843168048230581,0.0037117711229323475,0.009296136828585369,0.002675287225424161],"hidden_sha256":"095a95cb6b065e31765e45015c8770cb449940f6202ec516a39afa3c6b71b346","first_in_process":false,"shard":"shard_01","index":33},{"id":"tv4xh_sciq_04","name":"answer","variant":"base","source":"tv4xh","type":"choice","tokens":190,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":7.740208715940368e-06,"mean_abs_dp":3.8701043579897e-06,"oracle_top2_margin":0.9900290371362366,"near_tie":false,"n_options":4,"probs":[0.0013073154960612427,0.0022435179097063168,0.9932397603375457,0.0032094062566866955],"hidden_sha256":"b19f13dae1fa94e44fd5d5f4a0094f47fd4159faf04f6006a62025d434fa75e2","first_in_process":false,"shard":"shard_01","index":34},{"id":"tv4xh_sciq_05","name":"answer","variant":"base","source":"tv4xh","type":"choice","tokens":66,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.002683310334500588,"mean_abs_dp":0.0013416551672502885,"oracle_top2_margin":0.35988130479514857,"near_tie":false,"n_options":4,"probs":[0.6578636922577202,0.3027488279816101,0.02841877151114941,0.010968708249520155],"hidden_sha256":"45bfed5da3acb1ee948a2abf2f69dbf3a1bc236750eef4cd6e1cdb3638dd9c0d","first_in_process":false,"shard":"shard_01","index":35},{"id":"tv4xh_sciq_06","name":"answer","variant":"base","source":"tv4xh","type":"choice","tokens":92,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":3,"argmax_oracle":3,"argmax_equal":true,"max_abs_dp":0.00028813958845430587,"mean_abs_dp":0.0001440697942271369,"oracle_top2_margin":0.9329993033887237,"near_tie":false,"n_options":4,"probs":[0.001393710344474708,0.010243820355620731,0.027467983751953258,0.9608944855479513],"hidden_sha256":"3e19d0bfc628dfbedec168469925001a8c28c1035ea7bc6a9c57e7f99aa7f5f6","first_in_process":false,"shard":"shard_01","index":36},{"id":"tv4xh_sciq_07","name":"answer","variant":"base","source":"tv4xh","type":"choice","tokens":88,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":8.24491486804968e-05,"mean_abs_dp":4.1224574340248074e-05,"oracle_top2_margin":0.9862800921430935,"near_tie":false,"n_options":4,"probs":[0.001878670650751151,0.0037603843592467316,0.9903697849147682,0.003991160075233945],"hidden_sha256":"df97529c392d87f0f95238a0c5b087d1731f93168def3676c1a898fa820e9be5","first_in_process":false,"shard":"shard_01","index":37},{"id":"tv4xh_sciq_08","name":"answer","variant":"base","source":"tv4xh","type":"choice","tokens":127,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":4.119696059956546e-05,"mean_abs_dp":2.059848029977297e-05,"oracle_top2_margin":0.9872376749930396,"near_tie":false,"n_options":4,"probs":[0.001611921337791112,0.9913092721842348,0.0040206743267511905,0.0030581321512229745],"hidden_sha256":"232df85bc121ef561ccdff3ec5a145065388b7b473064862ef126c1191cd0bc8","first_in_process":false,"shard":"shard_01","index":38},{"id":"tv4xh_sciq_09","name":"answer","variant":"base","source":"tv4xh","type":"choice","tokens":198,"calls":4,"padded_tokens":256,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":1.871954208267773e-05,"mean_abs_dp":9.411196313784261e-06,"oracle_top2_margin":0.9809475065676402,"near_tie":false,"n_options":4,"probs":[0.0016137455410885103,0.9878957640349805,0.006915849277153592,0.0035746411467773216],"hidden_sha256":"53f7cf80be391a66c136fdf3534b8f41626f901d130946ed2698bf0919bebfee","first_in_process":false,"shard":"shard_01","index":39},{"id":"tv4xh_legacy_holdout_00","name":"decision","variant":"base","source":"tv4xh","type":"noul","tokens":91,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0005482689592770235,"mean_abs_dp":0.0005482689592769888,"oracle_top2_margin":0.9547597359580128,"near_tie":false,"n_options":2,"probs":[0.9768315990197294,0.02316840098027062],"hidden_sha256":"e25f2b977d92c976dad10901344181947d67f0db9a09ac389288cbff589c55a0","first_in_process":true,"shard":"shard_02","index":0},{"id":"tv4xh_legacy_holdout_01","name":"decision","variant":"base","source":"tv4xh","type":"noul","tokens":92,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":2.7874731283183962e-06,"mean_abs_dp":2.787473128269824e-06,"oracle_top2_margin":0.9798624376530383,"near_tie":false,"n_options":2,"probs":[0.010071568646609104,0.9899284313533908],"hidden_sha256":"9788b8450e33eb02d698974f707f7a0903fdaca57efcc7d9b520e7abdc49fc22","first_in_process":false,"shard":"shard_02","index":1},{"id":"tv4xh_legacy_holdout_02","name":"decision","variant":"base","source":"tv4xh","type":"noul","tokens":91,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0010757937409273423,"mean_abs_dp":0.0010757937409272434,"oracle_top2_margin":0.9525871662627242,"near_tie":false,"n_options":2,"probs":[0.9752177893904349,0.024782210609565227],"hidden_sha256":"c1d35ddb1354ceb165be75246c1b2af8f7853f0a68ff05dffa41e732ff63b885","first_in_process":false,"shard":"shard_02","index":2},{"id":"tv4xh_legacy_holdout_03","name":"decision","variant":"base","source":"tv4xh","type":"noul","tokens":92,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":1.07823458769217e-05,"mean_abs_dp":1.0782345876867924e-05,"oracle_top2_margin":0.9782569520689026,"near_tie":false,"n_options":2,"probs":[0.0108607416196718,0.9891392583803281],"hidden_sha256":"66f04d804ed77345e830e9198c81a80c691d34bc41b51cd00047d8cd87c1eb54","first_in_process":false,"shard":"shard_02","index":3},{"id":"tv4xh_legacy_holdout_04","name":"decision","variant":"base","source":"tv4xh","type":"noul","tokens":93,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0012676777323347155,"mean_abs_dp":0.0012676777323346895,"oracle_top2_margin":0.9518815200574884,"near_tie":false,"n_options":2,"probs":[0.9746730822964095,0.02532691770359043],"hidden_sha256":"c06b560fb1bc4f42d23150ec4a55e53713271a4ae2bb9052f6daa6401559bd75","first_in_process":false,"shard":"shard_02","index":4},{"id":"tv4xh_legacy_holdout_05","name":"decision","variant":"base","source":"tv4xh","type":"noul","tokens":92,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":7.537556178349725e-05,"mean_abs_dp":7.537556178349551e-05,"oracle_top2_margin":0.9715303351693931,"near_tie":false,"n_options":2,"probs":[0.01431020797708692,0.9856897920229131],"hidden_sha256":"c119bfa38de391605f74aab420c458674c62707e8e67b6011c4f37695b88fb88","first_in_process":false,"shard":"shard_02","index":5},{"id":"tv4xh_legacy_holdout_06","name":"decision","variant":"base","source":"tv4xh","type":"noul","tokens":91,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0008879027995990496,"mean_abs_dp":0.0008879027995990097,"oracle_top2_margin":0.9568384177462586,"near_tie":false,"n_options":2,"probs":[0.9775313060735302,0.022468693926469687],"hidden_sha256":"41efcb0ffb68de87f9a8504307dcfde3038573d3b6f3c046f5d947e85c4a00ca","first_in_process":false,"shard":"shard_02","index":6},{"id":"tv4xh_legacy_holdout_07","name":"decision","variant":"base","source":"tv4xh","type":"noul","tokens":92,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":1.5517745842186237e-05,"mean_abs_dp":1.5517745842102103e-05,"oracle_top2_margin":0.9797365370477656,"near_tie":false,"n_options":2,"probs":[0.010116213730275134,0.989883786269725],"hidden_sha256":"5f1c9d6c2d48dc659705e22583aac9c9a8bae43000b750a817844a38debc1caa","first_in_process":false,"shard":"shard_02","index":7},{"id":"tv4xh_legacy_holdout_08","name":"decision","variant":"base","source":"tv4xh","type":"noul","tokens":93,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0002516142391498777,"mean_abs_dp":0.00025161423914986554,"oracle_top2_margin":0.960734291218299,"near_tie":false,"n_options":2,"probs":[0.9806187598482994,0.01938124015170067],"hidden_sha256":"65ebcf499814956bfed845d47262c924536eaceb365335a388c34066b3cba008","first_in_process":false,"shard":"shard_02","index":8},{"id":"tv4xh_legacy_holdout_09","name":"decision","variant":"base","source":"tv4xh","type":"noul","tokens":92,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00010065833256332063,"mean_abs_dp":0.00010065833256327553,"oracle_top2_margin":0.949654861662381,"near_tie":false,"n_options":2,"probs":[0.02507191083624618,0.9749280891637537],"hidden_sha256":"4ca56eff3890b50a6084468df2f0f42e1194823b7bac0f4286cdce62fda87cb9","first_in_process":false,"shard":"shard_02","index":9},{"id":"tv4xh_composition_holdout_00","name":"decision","variant":"base","source":"tv4xh","type":"choice","tokens":159,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0003035169644189928,"mean_abs_dp":0.00030351696441898585,"oracle_top2_margin":0.8411891144662309,"near_tie":false,"n_options":2,"probs":[0.9208980741975344,0.0791019258024656],"hidden_sha256":"8f121f7fdf62f87fb86cea20775b255a9000043afd6e5d540a787f4be6ef9938","first_in_process":false,"shard":"shard_02","index":10},{"id":"tv4xh_composition_holdout_01","name":"decision","variant":"base","source":"tv4xh","type":"choice","tokens":159,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00020165260515314642,"mean_abs_dp":0.00020165260515306316,"oracle_top2_margin":0.33972254311291245,"near_tie":false,"n_options":2,"probs":[0.3303403810486968,0.6696596189513031],"hidden_sha256":"2ffdfc304f79207e91677143612e71cf986ea9e988320f80005d6ed802f4de32","first_in_process":false,"shard":"shard_02","index":11},{"id":"tv4xh_composition_holdout_02","name":"decision","variant":"base","source":"tv4xh","type":"choice","tokens":159,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0003035169644189928,"mean_abs_dp":0.00030351696441898585,"oracle_top2_margin":0.8411891144662309,"near_tie":false,"n_options":2,"probs":[0.9208980741975344,0.0791019258024656],"hidden_sha256":"8f121f7fdf62f87fb86cea20775b255a9000043afd6e5d540a787f4be6ef9938","first_in_process":false,"shard":"shard_02","index":12},{"id":"tv4xh_composition_holdout_03","name":"decision","variant":"base","source":"tv4xh","type":"choice","tokens":159,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0002939643004655351,"mean_abs_dp":0.00029396430046550043,"oracle_top2_margin":0.8435986975616399,"near_tie":false,"n_options":2,"probs":[0.9220933130812854,0.07790668691871454],"hidden_sha256":"7d8bcaa94e9a3fce7def08dd10840362325572b6f5f0d8ffc2218d2b43673b97","first_in_process":false,"shard":"shard_02","index":13},{"id":"tv4xh_composition_holdout_04","name":"decision","variant":"base","source":"tv4xh","type":"choice","tokens":139,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":4.674802537019129e-05,"mean_abs_dp":4.6748025370088944e-05,"oracle_top2_margin":0.9632426283334251,"near_tie":false,"n_options":2,"probs":[0.9816680621920827,0.018331937807917375],"hidden_sha256":"ead90d6c77b63f94454cfc27a86f82e60fdbe865fcf1143de75b0cb1142e5840","first_in_process":false,"shard":"shard_02","index":14},{"id":"tv4xh_composition_holdout_05","name":"decision","variant":"base","source":"tv4xh","type":"choice","tokens":139,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.005130607614750371,"mean_abs_dp":0.0051306076147503155,"oracle_top2_margin":0.3390660496269604,"near_tie":false,"n_options":2,"probs":[0.33559758280127017,0.6644024171987299],"hidden_sha256":"0be70cae1e775526a4f4f5c727cb7c12c093fc46e6b26d41841d13e0d16d3e03","first_in_process":false,"shard":"shard_02","index":15},{"id":"tv4xh_composition_holdout_06","name":"decision","variant":"base","source":"tv4xh","type":"choice","tokens":139,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":4.674802537019129e-05,"mean_abs_dp":4.6748025370088944e-05,"oracle_top2_margin":0.9632426283334251,"near_tie":false,"n_options":2,"probs":[0.9816680621920827,0.018331937807917375],"hidden_sha256":"ead90d6c77b63f94454cfc27a86f82e60fdbe865fcf1143de75b0cb1142e5840","first_in_process":false,"shard":"shard_02","index":16},{"id":"tv4xh_composition_holdout_07","name":"decision","variant":"base","source":"tv4xh","type":"choice","tokens":139,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":8.093338080948989e-05,"mean_abs_dp":8.093338080943958e-05,"oracle_top2_margin":0.9629749970174178,"near_tie":false,"n_options":2,"probs":[0.9815684318895184,0.01843156811048161],"hidden_sha256":"6b1e3baaaf18e99f67b3626ef8c98421e2615c0ffc9102c7c81ef72ff3aa22c9","first_in_process":false,"shard":"shard_02","index":17},{"id":"tv4xh_composition_holdout_08","name":"decision","variant":"base","source":"tv4xh","type":"choice","tokens":137,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00036581457987461263,"mean_abs_dp":0.0003658145798746057,"oracle_top2_margin":0.91505437582624,"near_tie":false,"n_options":2,"probs":[0.04283862666675459,0.9571613733332455],"hidden_sha256":"7fa05528c89f68c7143b830f0e6c9489d2ad8bdebe689ef7b92c472dbf5cce08","first_in_process":false,"shard":"shard_02","index":18},{"id":"tv4xh_composition_holdout_09","name":"decision","variant":"base","source":"tv4xh","type":"choice","tokens":137,"calls":3,"padded_tokens":192,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0025450258082544697,"mean_abs_dp":0.002545025808254456,"oracle_top2_margin":0.7551745454712935,"near_tie":false,"n_options":2,"probs":[0.12495775307260769,0.8750422469273923],"hidden_sha256":"d218020469e9b29ff05dca55ae89827ddba919978e814ed79bdd35cbb0126eca","first_in_process":false,"shard":"shard_02","index":19},{"id":"tv4sh_00","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":121,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":5.941637609185868e-05,"mean_abs_dp":3.961091739459081e-05,"oracle_top2_margin":0.9238524269677251,"near_tie":false,"n_options":3,"probs":[0.960578682962643,0.03683542449074672,0.0025858925466102542],"hidden_sha256":"d53a5c47f059e2427aa348def195577f0dab9913214343ac594068798269686c","first_in_process":false,"shard":"shard_02","index":20},{"id":"tv4sh_01","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":121,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":2,"argmax_oracle":2,"argmax_equal":true,"max_abs_dp":0.009685956615809288,"mean_abs_dp":0.00645730441053955,"oracle_top2_margin":0.09681821192995127,"near_tie":false,"n_options":3,"probs":[0.004700667468325669,0.458867106918084,0.5364322256135903],"hidden_sha256":"4e4a8dffc5bddbec742433e09704cb7fff654a4bdde78214b0d80b6f3f81c458","first_in_process":false,"shard":"shard_02","index":21},{"id":"tv4sh_02","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":122,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.002775572914344826,"mean_abs_dp":0.0018503819428965533,"oracle_top2_margin":0.7211683761096176,"near_tie":false,"n_options":3,"probs":[0.8560885028003222,0.1404581275589325,0.0034533696407452554],"hidden_sha256":"fe0ece8a1f361116de8606d70da80040d926754a76171951a4aeb6ed09ec1e43","first_in_process":false,"shard":"shard_02","index":22},{"id":"tv4sh_03","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":122,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0015512926798071716,"mean_abs_dp":0.0010341951198714397,"oracle_top2_margin":0.8772586976086013,"near_tie":false,"n_options":3,"probs":[0.004060492711258252,0.9381271662576476,0.05781234103109418],"hidden_sha256":"6d4cf3b78551c19ba3da39403eb52b6c17c60004ba248bf12d704c5fe12c7a58","first_in_process":false,"shard":"shard_02","index":23},{"id":"tv4sh_04","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":121,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.004051916641065745,"mean_abs_dp":0.002701277760710522,"oracle_top2_margin":0.5611122394535413,"near_tie":false,"n_options":3,"probs":[0.7749054809257575,0.22185689700273015,0.003237622071512317],"hidden_sha256":"622a8c855d1b668ca6e5d69a7560ae2fd12a2126693d3b24998b83e57709a878","first_in_process":false,"shard":"shard_02","index":24},{"id":"tv4sh_05","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":121,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.014006239134214393,"mean_abs_dp":0.009337492756142903,"oracle_top2_margin":0.4102356688965131,"near_tie":false,"n_options":3,"probs":[0.007204710790398134,0.715444319402025,0.2773509698075769],"hidden_sha256":"2226d8b007fb89941efb7f3764f8b7b0bcfa95b3ee38a264f2d5616e1b9a28eb","first_in_process":false,"shard":"shard_02","index":25},{"id":"tv4sh_06","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":122,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00023735360608112543,"mean_abs_dp":0.00015823573738739036,"oracle_top2_margin":0.947436758291069,"near_tie":false,"n_options":3,"probs":[0.018924138968206265,0.9660525383090411,0.015023322722752546],"hidden_sha256":"f3689fb0c71d81a9a3dc8d007539365c2f4a74f9214baabb28d600ff0585d754","first_in_process":false,"shard":"shard_02","index":26},{"id":"tv4sh_07","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":122,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00030704311985221486,"mean_abs_dp":0.0002046954132348018,"oracle_top2_margin":0.8832636948574127,"near_tie":false,"n_options":3,"probs":[0.01992836369426909,0.9315285857118618,0.04854305059386916],"hidden_sha256":"518344e9166233b3aba1412910c2204fbcf61fb868731a2b0ca8f361d2a627a0","first_in_process":false,"shard":"shard_02","index":27},{"id":"tv4sh_08","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":122,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0023480320353314044,"mean_abs_dp":0.0015653546902209105,"oracle_top2_margin":0.6824864546507107,"near_tie":false,"n_options":3,"probs":[0.15301541587956036,0.8401731663954479,0.00681141772499172],"hidden_sha256":"12b77e5c676da4a42874d155bcd464bf2ab1cdf7dbe16f9d1aa2345cdf3907c3","first_in_process":false,"shard":"shard_02","index":28},{"id":"tv4sh_09","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":122,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00716255551300507,"mean_abs_dp":0.004775037008670023,"oracle_top2_margin":0.7189138929389165,"near_tie":false,"n_options":3,"probs":[0.01795885019956309,0.8574548151258197,0.12458633467461722],"hidden_sha256":"1a60004c8b8f71c1fec52153be3db43aa29ae5a581430a55749896841cb3266c","first_in_process":false,"shard":"shard_02","index":29},{"id":"tv4sh_10","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":121,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0035196744321429607,"mean_abs_dp":0.002346449621428604,"oracle_top2_margin":0.4934250908664084,"near_tie":false,"n_options":3,"probs":[0.7400274317735935,0.25354518008867116,0.006427388137735216],"hidden_sha256":"1681f8edd5c952524aeb9dfe70144c96986d95652457287d1c2f5befbdd6eedb","first_in_process":false,"shard":"shard_02","index":30},{"id":"tv4sh_11","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":121,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":5.142132526936294e-05,"mean_abs_dp":3.4280883512910216e-05,"oracle_top2_margin":0.9752465379547259,"near_tie":false,"n_options":3,"probs":[0.010800220307942102,0.986136289312694,0.0030634903793638948],"hidden_sha256":"890529bc72085fc3514d0e37e2d810133e24cd2c48035aa4573d0a13df617396","first_in_process":false,"shard":"shard_02","index":31},{"id":"tv4sh_12","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":121,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.00025657130505880865,"mean_abs_dp":0.00017104753670591175,"oracle_top2_margin":0.768467920129792,"near_tie":false,"n_options":3,"probs":[0.11341264710896075,0.8814287025779303,0.005158650313108858],"hidden_sha256":"614f34af1a159ac934cafa295a5677c548e143610737e5b8b25455ec1df647ae","first_in_process":false,"shard":"shard_02","index":32},{"id":"tv4sh_13","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":121,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0005104559068029868,"mean_abs_dp":0.00034030393786859255,"oracle_top2_margin":0.9556109583621517,"near_tie":false,"n_options":3,"probs":[0.00784678958850203,0.9735110136980055,0.01864219671349231],"hidden_sha256":"c464374d23427d0e6e0f48e1c635ca1e727590d27b08ae920417ce9c70d51d9b","first_in_process":false,"shard":"shard_02","index":33},{"id":"tv4sh_14","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":121,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":0,"argmax_oracle":0,"argmax_equal":true,"max_abs_dp":0.0014012866036363647,"mean_abs_dp":0.0009341910690908948,"oracle_top2_margin":0.8594658304693302,"near_tie":false,"n_options":3,"probs":[0.9301814348667717,0.06791965415273508,0.0018989109804933076],"hidden_sha256":"b6693ceff9493f750b98b9455efee96460dd2c5a9c49b63c11393227a3dbb006","first_in_process":false,"shard":"shard_02","index":34},{"id":"tv4sh_15","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":121,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":6.278637766987671e-05,"mean_abs_dp":4.1857585113215e-05,"oracle_top2_margin":0.9541482622286976,"near_tie":false,"n_options":3,"probs":[0.005949462322507202,0.9740404737457089,0.020010063931783895],"hidden_sha256":"e0a73ab052869e4a0d3befe4a6667ee92fde9788eb3576bac077b571c6b5ecc9","first_in_process":false,"shard":"shard_02","index":35},{"id":"tv4sh_16","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":122,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0073042095335852375,"mean_abs_dp":0.004869473022390197,"oracle_top2_margin":0.6485930947099603,"near_tie":false,"n_options":3,"probs":[0.18036876440449065,0.8143569989518851,0.005274236643624221],"hidden_sha256":"c2876b3e035314f7073f722fa3eb3b5165a8fea8aa27c41369f36626932058a7","first_in_process":false,"shard":"shard_02","index":36},{"id":"tv4sh_17","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":122,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0021967181572695588,"mean_abs_dp":0.0014644787715130056,"oracle_top2_margin":0.810800195649449,"near_tie":false,"n_options":3,"probs":[0.018324031063154993,0.898198444900371,0.08347752403647392],"hidden_sha256":"c0e3a647c9b738e2abf22d14d34c1721b95f029e91ece2a6e480f63d5ad1f0eb","first_in_process":false,"shard":"shard_02","index":37},{"id":"tv4sh_18","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":122,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0007811892085973771,"mean_abs_dp":0.0005207928057316359,"oracle_top2_margin":0.8624175828077385,"near_tie":false,"n_options":3,"probs":[0.06477726926247838,0.9286855023242508,0.006537228413270678],"hidden_sha256":"312bca9d1391f9e23df0d1d65fa659389258b5ac6ab0b7289e94e75fe6aa24cb","first_in_process":false,"shard":"shard_02","index":38},{"id":"tv4sh_19","name":"decision","variant":"base","source":"tv4sh","type":"score","tokens":122,"calls":2,"padded_tokens":128,"finite":true,"all_zero":false,"argmax":1,"argmax_oracle":1,"argmax_equal":true,"max_abs_dp":0.0008232869055253556,"mean_abs_dp":0.0005488579370168783,"oracle_top2_margin":0.7456003006888868,"near_tie":false,"n_options":3,"probs":[0.039356498680048486,0.853941411853882,0.10670208946606966],"hidden_sha256":"e5611e64be7a198419bc535ef57fe2d9c7c0e2417409ebf7c7d8f74a91960fd9","first_in_process":false,"shard":"shard_02","index":39}],"compare_with":{"other":"$ZOO_WORK_ROOT/_d1_3b/results/r5c_readout_fp16_heldout.json","other_bundle":"d1_3b_decode_fp16_pf16","other_chunk":16,"runs":120,"max_abs_dp":0.0151864816662729,"argmax_equal_runs":120,"slot_hidden_max_abs_diff":0.044677734375,"vs_oracle_max_abs_dp":{"other":0.0020547066562157656,"this":0.014006239134214393}}}}