{"what":"Which decoder layers carry the int8 error: fp32 torch on MPS (S = 64 chunks, the oracle's ids and image rows, the author's head), the exporter's own int8 weights swapped in per config, on the six runs where int8lin breaks the bar worst. The rule was written (bisect/rule.json) before any bisect result; configs with outside_rule_search = true were run after the fixed search and never selected by it.","sources":[{"file":"bisect/rule.json","bytes":1535,"sha256":"2879ed1ef0fa1cfafa6bd2855d9cf4d06d1581b1d1a047b40da2c9e114959e65"},{"file":"results/int8_bisect.json","bytes":363189,"sha256":"b37b2a49a645042191529ba4a8140e0acea875bd90f6c9fa605a72621c1d500f"}],"trimmed":{"removed":["configs.*.runs.*.questions[].probs (each question keeps max |dp| and the argmax flag)"],"serialization":"compact json (no indentation)","full_copies":"the source files above, in the lane directory $ZOO_WORK_ROOT/_clefflash/ (not in the repository)"},"rule":{"rule":{"1":"worst bisect run max|dp| <= 0.010 (every option of every question, near-ties included)","2":"no bisect run's max|dp| above its own int8lin value (this instrument)","3":"at most 6 fp16 layers","4":"the smallest layer set meeting 1-3; between sets of one size, the lexicographically smallest sorted layer list","search":"int8lin, exact, fp16 L00-15, fp16 L16-31, only GDN int8, only attention int8, only MLP int8, one layer fp16 at a time (32); then candidate sets: layers ranked by their single-layer worst-run max|dp| (ties: the lower index); for k = 2..6 the top-k set; at the first k whose top-k set meets 1-3, also every other k-subset of the top k+1; stop there. A single layer meeting 1-3 ends the search at size 1 (every single is evaluated).","limits":{"worst_max_abs_dp":0.01,"max_fp16_layers":6}},"runs":[["semif_1105577da4c8dad4609d","text"],["semif_86a15618ba4cb90a307e","text"],["semif_fb73a85d386cf59b0c51","text"],["own_j12","text"],["semif_8a4c3de28be95c105ca1","text"],["img_06","native"]],"why_runs":"launch rule 'the runs that break the bar + the worst 3, <= 6': int8lin pf64 (results/readout_int8lin_pf64.json) breaks max|dp| 0.02 on 9 runs; these are the 6 worst of them (0.0748, 0.0295, 0.0265, 0.0255, 0.0238, 0.0235)","chunk":64,"script_sha256":"78674d4a70ff8296c56af24ab81a4bcd482b4d97798581d37215cb38ea580c2d","written_at":"2026-10-03T12:32:41+09:00"},"bisect":{"schema":"clef-flash-int8-bisect/1","rule":{"1":"worst bisect run max|dp| <= 0.010 (every option of every question, near-ties included)","2":"no bisect run's max|dp| above its own int8lin value (this instrument)","3":"at most 6 fp16 layers","4":"the smallest layer set meeting 1-3; between sets of one size, the lexicographically smallest sorted layer list","search":"int8lin, exact, fp16 L00-15, fp16 L16-31, only GDN int8, only attention int8, only MLP int8, one layer fp16 at a time (32); then candidate sets: layers ranked by their single-layer worst-run max|dp| (ties: the lower index); for k = 2..6 the top-k set; at the first k whose top-k set meets 1-3, also every other k-subset of the top k+1; stop there. A single layer meeting 1-3 ends the search at size 1 (every single is evaluated).","limits":{"worst_max_abs_dp":0.01,"max_fp16_layers":6}},"rule_file":"<lane>/bisect/rule.json","rule_sha256":"2879ed1ef0fa1cfafa6bd2855d9cf4d06d1581b1d1a047b40da2c9e114959e65","rule_written_at":"2026-10-03T12:32:41+09:00","runs":[["semif_1105577da4c8dad4609d","text"],["semif_86a15618ba4cb90a307e","text"],["semif_fb73a85d386cf59b0c51","text"],["own_j12","text"],["semif_8a4c3de28be95c105ca1","text"],["img_06","native"]],"why_runs":"launch rule 'the runs that break the bar + the worst 3, <= 6': int8lin pf64 (results/readout_int8lin_pf64.json) breaks max|dp| 0.02 on 9 runs; these are the 6 worst of them (0.0748, 0.0295, 0.0265, 0.0255, 0.0238, 0.0235)","instrument":"fp32 torch (parity_decoder_torch.Runner), S = 64 chunks from fresh zero states, oracle ids + oracle fp32 image_embeds, the author's fp32 head; per config the listed modules carry the exporter's int8 weights (quantize_pytorch_model on the fp16 model, dequantized by the finalized module), every other quantizable module its exact checkpoint weight","script":{"path":"conversion/clef_flash/int8_bisect_torch.py","sha256":"f5b684a31e53469d3c1297cadfc3344460e7c81a42ee47fcf824634610a689a0"},"oracle":{"path":"<lane>/oracle/records_oracle.json","sha256":"d8adaa746a5d575e654212ca78f5634af334aaa62eb53ef150d5d5925b1fa7c0"},"dump":{"meta":"<lane>/bisect/dump/int8_clipping.json","sha256":"a54cac973b9e4d8f94f3281b6947597e6419ceb9751bb668df3f7f78fb570fba"},"processes":[{"part":"<lane>/bisect/parts/part_a.json","pid":19022,"device":"mps","threads":8,"load_seconds":8.13579674999346,"rule_sha256":"2879ed1ef0fa1cfafa6bd2855d9cf4d06d1581b1d1a047b40da2c9e114959e65","script_sha256":"78674d4a70ff8296c56af24ab81a4bcd482b4d97798581d37215cb38ea580c2d","configs":["int8lin","exact","fp16_L00-15","fp16_L16-31","only_gdn","only_attn","only_mlp","fp16_L00","fp16_L01","fp16_L02","fp16_L03","fp16_L04","fp16_L05","fp16_L06","fp16_L07","fp16_L08","fp16_L09","fp16_L10","fp16_L11","fp16_L12","fp16_L13","fp16_L14","fp16_L15","fp16_L16","fp16_L17","fp16_L18","fp16_L19","fp16_L20","fp16_L21","fp16_L22","fp16_L23","fp16_L24","fp16_L25","fp16_L26","fp16_L27","fp16_L28","fp16_L29","fp16_L30","fp16_L31","fp16_set_L06_L09","fp16_set_L04_L06_L09","fp16_set_L04_L06_L09_L10","fp16_set_L04_L06_L09_L10_L11","fp16_set_L00_L04_L06_L09_L10_L11"],"ranking":[6,9,4,10,11,0,14,8,12,19,2,18,22,24,30,29,25,26,31,28,27,23,21,17,20,15,16,7,1,5,13,3],"informative":false},{"part":"<lane>/bisect/parts/part_b.json","pid":33830,"device":"mps","threads":8,"load_seconds":10.548559749993728,"rule_sha256":"2879ed1ef0fa1cfafa6bd2855d9cf4d06d1581b1d1a047b40da2c9e114959e65","script_sha256":"f5b684a31e53469d3c1297cadfc3344460e7c81a42ee47fcf824634610a689a0","configs":["fp16_L00-03","fp16_L00-05","fp16_L00-07","fp16_L00-11","fp16_L04-15","fp16_L08-15","fp16_L12-15","first16_gdn_exact","first16_mlp_exact","first16_attn_exact","fp16_set_L00_L01_L02_L03_L04_L05_L06_L07_L08","fp16_set_L00_L01_L02_L03_L04_L05_L06_L07_L08_L09","fp16_set_L00_L01_L02_L03_L04_L05_L06_L07_L08_L09_L10"],"ranking":null,"informative":true}],"chosen":null,"candidates_meeting_rule":[],"table":[{"config":"int8lin","outside_rule_search":false,"fp16_layers":[],"int8_params":6918504448,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":21.57174462499097,"semif_1105577da4c8dad4609d:text":0.08421546220779419,"semif_86a15618ba4cb90a307e:text":0.025906741619110107,"semif_fb73a85d386cf59b0c51:text":0.02338331937789917,"own_j12:text":0.02883768081665039,"semif_8a4c3de28be95c105ca1:text":0.020289063453674316,"img_06:native":0.02439892292022705,"worst_max_abs_dp":0.08421546220779419,"rule_1":false,"rule_2":true,"rule_3":false,"fp16_layer_count":0},{"config":"exact","outside_rule_search":false,"fp16_layers":null,"int8_params":0,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":20.52310854199459,"semif_1105577da4c8dad4609d:text":1.0192394256591797e-05,"semif_86a15618ba4cb90a307e:text":1.3709068298339844e-06,"semif_fb73a85d386cf59b0c51:text":2.473592758178711e-06,"own_j12:text":6.16908073425293e-06,"semif_8a4c3de28be95c105ca1:text":1.0579824447631836e-06,"img_06:native":5.960464477539062e-07,"worst_max_abs_dp":1.0192394256591797e-05,"rule_1":true,"rule_2":true,"rule_3":false,"fp16_layer_count":null},{"config":"fp16_L00-15","outside_rule_search":false,"fp16_layers":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15],"int8_params":3459252224,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.756911749980645,"semif_1105577da4c8dad4609d:text":0.0012458562850952148,"semif_86a15618ba4cb90a307e:text":0.00027066469192504883,"semif_fb73a85d386cf59b0c51:text":0.0002948641777038574,"own_j12:text":0.0023093223571777344,"semif_8a4c3de28be95c105ca1:text":0.0015130043029785156,"img_06:native":0.0016149282455444336,"worst_max_abs_dp":0.0023093223571777344,"rule_1":true,"rule_2":true,"rule_3":false,"fp16_layer_count":16},{"config":"fp16_L16-31","outside_rule_search":false,"fp16_layers":[16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31],"int8_params":3459252224,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":20.11661733299843,"semif_1105577da4c8dad4609d:text":0.08445906639099121,"semif_86a15618ba4cb90a307e:text":0.025534451007843018,"semif_fb73a85d386cf59b0c51:text":0.02331632375717163,"own_j12:text":0.026969492435455322,"semif_8a4c3de28be95c105ca1:text":0.021187245845794678,"img_06:native":0.022742033004760742,"worst_max_abs_dp":0.08445906639099121,"rule_1":false,"rule_2":false,"rule_3":false,"fp16_layer_count":16},{"config":"only_gdn","outside_rule_search":false,"fp16_layers":null,"int8_params":1616904192,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.593113541981438,"semif_1105577da4c8dad4609d:text":0.07522028684616089,"semif_86a15618ba4cb90a307e:text":0.008204832673072815,"semif_fb73a85d386cf59b0c51:text":0.019174516201019287,"own_j12:text":0.02469491958618164,"semif_8a4c3de28be95c105ca1:text":0.024461567401885986,"img_06:native":0.0026354342699050903,"worst_max_abs_dp":0.07522028684616089,"rule_1":false,"rule_2":false,"rule_3":false,"fp16_layer_count":null},{"config":"only_attn","outside_rule_search":false,"fp16_layers":null,"int8_params":469762048,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.441845459019532,"semif_1105577da4c8dad4609d:text":0.023046433925628662,"semif_86a15618ba4cb90a307e:text":0.009882688522338867,"semif_fb73a85d386cf59b0c51:text":0.011654853820800781,"own_j12:text":0.0051841139793396,"semif_8a4c3de28be95c105ca1:text":0.008266150951385498,"img_06:native":0.013766646385192871,"worst_max_abs_dp":0.023046433925628662,"rule_1":false,"rule_2":true,"rule_3":false,"fp16_layer_count":null},{"config":"only_mlp","outside_rule_search":false,"fp16_layers":null,"int8_params":4831838208,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.605930125020677,"semif_1105577da4c8dad4609d:text":0.034227728843688965,"semif_86a15618ba4cb90a307e:text":0.005158185958862305,"semif_fb73a85d386cf59b0c51:text":0.007215380668640137,"own_j12:text":0.0024714916944503784,"semif_8a4c3de28be95c105ca1:text":0.014494776725769043,"img_06:native":0.00875169038772583,"worst_max_abs_dp":0.034227728843688965,"rule_1":false,"rule_2":true,"rule_3":false,"fp16_layer_count":null},{"config":"fp16_L00","outside_rule_search":false,"fp16_layers":[0],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.41470775002381,"semif_1105577da4c8dad4609d:text":0.07579749822616577,"semif_86a15618ba4cb90a307e:text":0.016390621662139893,"semif_fb73a85d386cf59b0c51:text":0.011668801307678223,"own_j12:text":0.015848398208618164,"semif_8a4c3de28be95c105ca1:text":0.01102989912033081,"img_06:native":0.02051520347595215,"worst_max_abs_dp":0.07579749822616577,"rule_1":false,"rule_2":true,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L01","outside_rule_search":false,"fp16_layers":[1],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.179311416985,"semif_1105577da4c8dad4609d:text":0.08871442079544067,"semif_86a15618ba4cb90a307e:text":0.028344273567199707,"semif_fb73a85d386cf59b0c51:text":0.023521602153778076,"own_j12:text":0.030464470386505127,"semif_8a4c3de28be95c105ca1:text":0.021501243114471436,"img_06:native":0.025145113468170166,"worst_max_abs_dp":0.08871442079544067,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L02","outside_rule_search":false,"fp16_layers":[2],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.183002834004583,"semif_1105577da4c8dad4609d:text":0.08329451084136963,"semif_86a15618ba4cb90a307e:text":0.028553903102874756,"semif_fb73a85d386cf59b0c51:text":0.021118521690368652,"own_j12:text":0.028327226638793945,"semif_8a4c3de28be95c105ca1:text":0.0217551589012146,"img_06:native":0.023917675018310547,"worst_max_abs_dp":0.08329451084136963,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L03","outside_rule_search":false,"fp16_layers":[3],"int8_params":6708789248,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":18.97221599999466,"semif_1105577da4c8dad4609d:text":0.11642390489578247,"semif_86a15618ba4cb90a307e:text":0.02824842929840088,"semif_fb73a85d386cf59b0c51:text":0.020697474479675293,"own_j12:text":0.029575586318969727,"semif_8a4c3de28be95c105ca1:text":0.016795456409454346,"img_06:native":0.022546708583831787,"worst_max_abs_dp":0.11642390489578247,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L04","outside_rule_search":false,"fp16_layers":[4],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.179840834025526,"semif_1105577da4c8dad4609d:text":0.057090163230895996,"semif_86a15618ba4cb90a307e:text":0.02517259120941162,"semif_fb73a85d386cf59b0c51:text":0.02168869972229004,"own_j12:text":0.028524041175842285,"semif_8a4c3de28be95c105ca1:text":0.017360329627990723,"img_06:native":0.02365267276763916,"worst_max_abs_dp":0.057090163230895996,"rule_1":false,"rule_2":true,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L05","outside_rule_search":false,"fp16_layers":[5],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.0112500419782,"semif_1105577da4c8dad4609d:text":0.09055161476135254,"semif_86a15618ba4cb90a307e:text":0.022164106369018555,"semif_fb73a85d386cf59b0c51:text":0.023332655429840088,"own_j12:text":0.0252038836479187,"semif_8a4c3de28be95c105ca1:text":0.025760233402252197,"img_06:native":0.02560979127883911,"worst_max_abs_dp":0.09055161476135254,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L06","outside_rule_search":false,"fp16_layers":[6],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.204898790980224,"semif_1105577da4c8dad4609d:text":0.049162089824676514,"semif_86a15618ba4cb90a307e:text":0.02299201488494873,"semif_fb73a85d386cf59b0c51:text":0.02014780044555664,"own_j12:text":0.02971261739730835,"semif_8a4c3de28be95c105ca1:text":0.016025125980377197,"img_06:native":0.0232694149017334,"worst_max_abs_dp":0.049162089824676514,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L07","outside_rule_search":false,"fp16_layers":[7],"int8_params":6708789248,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.189951042004395,"semif_1105577da4c8dad4609d:text":0.08616989850997925,"semif_86a15618ba4cb90a307e:text":0.020802855491638184,"semif_fb73a85d386cf59b0c51:text":0.01508408784866333,"own_j12:text":0.02443748712539673,"semif_8a4c3de28be95c105ca1:text":0.0037218332290649414,"img_06:native":0.018869221210479736,"worst_max_abs_dp":0.08616989850997925,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L08","outside_rule_search":false,"fp16_layers":[8],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.050659958011238,"semif_1105577da4c8dad4609d:text":0.07734131813049316,"semif_86a15618ba4cb90a307e:text":0.02557659149169922,"semif_fb73a85d386cf59b0c51:text":0.03077608346939087,"own_j12:text":0.027656733989715576,"semif_8a4c3de28be95c105ca1:text":0.01613795757293701,"img_06:native":0.023118138313293457,"worst_max_abs_dp":0.07734131813049316,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L09","outside_rule_search":false,"fp16_layers":[9],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.06218145901221,"semif_1105577da4c8dad4609d:text":0.054773569107055664,"semif_86a15618ba4cb90a307e:text":0.031446993350982666,"semif_fb73a85d386cf59b0c51:text":0.02464514970779419,"own_j12:text":0.027036607265472412,"semif_8a4c3de28be95c105ca1:text":0.023695528507232666,"img_06:native":0.0243416428565979,"worst_max_abs_dp":0.054773569107055664,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L10","outside_rule_search":false,"fp16_layers":[10],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.175640291010495,"semif_1105577da4c8dad4609d:text":0.06294989585876465,"semif_86a15618ba4cb90a307e:text":0.020404338836669922,"semif_fb73a85d386cf59b0c51:text":0.024178683757781982,"own_j12:text":0.027408301830291748,"semif_8a4c3de28be95c105ca1:text":0.028086483478546143,"img_06:native":0.02329730987548828,"worst_max_abs_dp":0.06294989585876465,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L11","outside_rule_search":false,"fp16_layers":[11],"int8_params":6708789248,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.008336458995473,"semif_1105577da4c8dad4609d:text":0.07086449861526489,"semif_86a15618ba4cb90a307e:text":0.016692698001861572,"semif_fb73a85d386cf59b0c51:text":0.021638035774230957,"own_j12:text":0.029109537601470947,"semif_8a4c3de28be95c105ca1:text":0.025475263595581055,"img_06:native":0.014336347579956055,"worst_max_abs_dp":0.07086449861526489,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L12","outside_rule_search":false,"fp16_layers":[12],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.067947458010167,"semif_1105577da4c8dad4609d:text":0.07917475700378418,"semif_86a15618ba4cb90a307e:text":0.02413022518157959,"semif_fb73a85d386cf59b0c51:text":0.020841360092163086,"own_j12:text":0.02710282802581787,"semif_8a4c3de28be95c105ca1:text":0.013209104537963867,"img_06:native":0.021236181259155273,"worst_max_abs_dp":0.07917475700378418,"rule_1":false,"rule_2":true,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L13","outside_rule_search":false,"fp16_layers":[13],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.16496508399723,"semif_1105577da4c8dad4609d:text":0.10442620515823364,"semif_86a15618ba4cb90a307e:text":0.023846745491027832,"semif_fb73a85d386cf59b0c51:text":0.024077534675598145,"own_j12:text":0.032267868518829346,"semif_8a4c3de28be95c105ca1:text":0.020855247974395752,"img_06:native":0.02317070960998535,"worst_max_abs_dp":0.10442620515823364,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L14","outside_rule_search":false,"fp16_layers":[14],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.139776166994125,"semif_1105577da4c8dad4609d:text":0.07666230201721191,"semif_86a15618ba4cb90a307e:text":0.02411055564880371,"semif_fb73a85d386cf59b0c51:text":0.02296394109725952,"own_j12:text":0.025750815868377686,"semif_8a4c3de28be95c105ca1:text":0.0173414945602417,"img_06:native":0.0260847806930542,"worst_max_abs_dp":0.07666230201721191,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L15","outside_rule_search":false,"fp16_layers":[15],"int8_params":6708789248,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.038937791978242,"semif_1105577da4c8dad4609d:text":0.08611083030700684,"semif_86a15618ba4cb90a307e:text":0.026803255081176758,"semif_fb73a85d386cf59b0c51:text":0.02436894178390503,"own_j12:text":0.026144802570343018,"semif_8a4c3de28be95c105ca1:text":0.022866785526275635,"img_06:native":0.028285682201385498,"worst_max_abs_dp":0.08611083030700684,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L16","outside_rule_search":false,"fp16_layers":[16],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.10412679100409,"semif_1105577da4c8dad4609d:text":0.08615589141845703,"semif_86a15618ba4cb90a307e:text":0.026147902011871338,"semif_fb73a85d386cf59b0c51:text":0.02174311876296997,"own_j12:text":0.027312159538269043,"semif_8a4c3de28be95c105ca1:text":0.022151947021484375,"img_06:native":0.02468770742416382,"worst_max_abs_dp":0.08615589141845703,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L17","outside_rule_search":false,"fp16_layers":[17],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.220763165998505,"semif_1105577da4c8dad4609d:text":0.08453220129013062,"semif_86a15618ba4cb90a307e:text":0.02580869197845459,"semif_fb73a85d386cf59b0c51:text":0.023625850677490234,"own_j12:text":0.030369460582733154,"semif_8a4c3de28be95c105ca1:text":0.01884007453918457,"img_06:native":0.023379087448120117,"worst_max_abs_dp":0.08453220129013062,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L18","outside_rule_search":false,"fp16_layers":[18],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":18.96304883400444,"semif_1105577da4c8dad4609d:text":0.08335357904434204,"semif_86a15618ba4cb90a307e:text":0.025832176208496094,"semif_fb73a85d386cf59b0c51:text":0.02340000867843628,"own_j12:text":0.027305960655212402,"semif_8a4c3de28be95c105ca1:text":0.021128833293914795,"img_06:native":0.02459263801574707,"worst_max_abs_dp":0.08335357904434204,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L19","outside_rule_search":false,"fp16_layers":[19],"int8_params":6708789248,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.231193249986973,"semif_1105577da4c8dad4609d:text":0.08262395858764648,"semif_86a15618ba4cb90a307e:text":0.024899184703826904,"semif_fb73a85d386cf59b0c51:text":0.0241776704788208,"own_j12:text":0.02941054105758667,"semif_8a4c3de28be95c105ca1:text":0.019611716270446777,"img_06:native":0.023471474647521973,"worst_max_abs_dp":0.08262395858764648,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L20","outside_rule_search":false,"fp16_layers":[20],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.204214750003302,"semif_1105577da4c8dad4609d:text":0.08455055952072144,"semif_86a15618ba4cb90a307e:text":0.026083290576934814,"semif_fb73a85d386cf59b0c51:text":0.023463785648345947,"own_j12:text":0.027928948402404785,"semif_8a4c3de28be95c105ca1:text":0.020318984985351562,"img_06:native":0.024344801902770996,"worst_max_abs_dp":0.08455055952072144,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L21","outside_rule_search":false,"fp16_layers":[21],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":18.996326209016843,"semif_1105577da4c8dad4609d:text":0.08442538976669312,"semif_86a15618ba4cb90a307e:text":0.02600914239883423,"semif_fb73a85d386cf59b0c51:text":0.02328115701675415,"own_j12:text":0.0287015438079834,"semif_8a4c3de28be95c105ca1:text":0.02021610736846924,"img_06:native":0.02405226230621338,"worst_max_abs_dp":0.08442538976669312,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L22","outside_rule_search":false,"fp16_layers":[22],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.27828616698389,"semif_1105577da4c8dad4609d:text":0.08402222394943237,"semif_86a15618ba4cb90a307e:text":0.025966405868530273,"semif_fb73a85d386cf59b0c51:text":0.023215830326080322,"own_j12:text":0.028859615325927734,"semif_8a4c3de28be95c105ca1:text":0.020273566246032715,"img_06:native":0.024794697761535645,"worst_max_abs_dp":0.08402222394943237,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L23","outside_rule_search":false,"fp16_layers":[23],"int8_params":6708789248,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.272079499991378,"semif_1105577da4c8dad4609d:text":0.08434832096099854,"semif_86a15618ba4cb90a307e:text":0.02606523036956787,"semif_fb73a85d386cf59b0c51:text":0.023686647415161133,"own_j12:text":0.028976261615753174,"semif_8a4c3de28be95c105ca1:text":0.02009528875350952,"img_06:native":0.02469426393508911,"worst_max_abs_dp":0.08434832096099854,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L24","outside_rule_search":false,"fp16_layers":[24],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.022530874994118,"semif_1105577da4c8dad4609d:text":0.08405613899230957,"semif_86a15618ba4cb90a307e:text":0.025851190090179443,"semif_fb73a85d386cf59b0c51:text":0.0234982967376709,"own_j12:text":0.029391825199127197,"semif_8a4c3de28be95c105ca1:text":0.02012002468109131,"img_06:native":0.024089276790618896,"worst_max_abs_dp":0.08405613899230957,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L25","outside_rule_search":false,"fp16_layers":[25],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.207857041998068,"semif_1105577da4c8dad4609d:text":0.08420908451080322,"semif_86a15618ba4cb90a307e:text":0.02581334114074707,"semif_fb73a85d386cf59b0c51:text":0.023327171802520752,"own_j12:text":0.028908193111419678,"semif_8a4c3de28be95c105ca1:text":0.02039492130279541,"img_06:native":0.02455770969390869,"worst_max_abs_dp":0.08420908451080322,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L26","outside_rule_search":false,"fp16_layers":[26],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.255197166989092,"semif_1105577da4c8dad4609d:text":0.08422261476516724,"semif_86a15618ba4cb90a307e:text":0.026024580001831055,"semif_fb73a85d386cf59b0c51:text":0.0233229398727417,"own_j12:text":0.028418898582458496,"semif_8a4c3de28be95c105ca1:text":0.020271480083465576,"img_06:native":0.02445763349533081,"worst_max_abs_dp":0.08422261476516724,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L27","outside_rule_search":false,"fp16_layers":[27],"int8_params":6708789248,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.07363975001499,"semif_1105577da4c8dad4609d:text":0.08431774377822876,"semif_86a15618ba4cb90a307e:text":0.026037991046905518,"semif_fb73a85d386cf59b0c51:text":0.023367762565612793,"own_j12:text":0.02902829647064209,"semif_8a4c3de28be95c105ca1:text":0.020277321338653564,"img_06:native":0.024083435535430908,"worst_max_abs_dp":0.08431774377822876,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L28","outside_rule_search":false,"fp16_layers":[28],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.155350458982866,"semif_1105577da4c8dad4609d:text":0.08427363634109497,"semif_86a15618ba4cb90a307e:text":0.025905609130859375,"semif_fb73a85d386cf59b0c51:text":0.023457765579223633,"own_j12:text":0.028718769550323486,"semif_8a4c3de28be95c105ca1:text":0.020406901836395264,"img_06:native":0.024395465850830078,"worst_max_abs_dp":0.08427363634109497,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L29","outside_rule_search":false,"fp16_layers":[29],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.23821529201814,"semif_1105577da4c8dad4609d:text":0.08419311046600342,"semif_86a15618ba4cb90a307e:text":0.02585744857788086,"semif_fb73a85d386cf59b0c51:text":0.02354508638381958,"own_j12:text":0.028786957263946533,"semif_8a4c3de28be95c105ca1:text":0.020302116870880127,"img_06:native":0.024474918842315674,"worst_max_abs_dp":0.08419311046600342,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L30","outside_rule_search":false,"fp16_layers":[30],"int8_params":6700138496,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.045154665975133,"semif_1105577da4c8dad4609d:text":0.08410143852233887,"semif_86a15618ba4cb90a307e:text":0.025811612606048584,"semif_fb73a85d386cf59b0c51:text":0.023518860340118408,"own_j12:text":0.028872787952423096,"semif_8a4c3de28be95c105ca1:text":0.020470738410949707,"img_06:native":0.024316012859344482,"worst_max_abs_dp":0.08410143852233887,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_L31","outside_rule_search":false,"fp16_layers":[31],"int8_params":6708789248,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.18107400002191,"semif_1105577da4c8dad4609d:text":0.08426833152770996,"semif_86a15618ba4cb90a307e:text":0.02603459358215332,"semif_fb73a85d386cf59b0c51:text":0.02344280481338501,"own_j12:text":0.028575658798217773,"semif_8a4c3de28be95c105ca1:text":0.02060103416442871,"img_06:native":0.024319589138031006,"worst_max_abs_dp":0.08426833152770996,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":1},{"config":"fp16_set_L06_L09","outside_rule_search":false,"fp16_layers":[6,9],"int8_params":6481772544,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.27985608400195,"semif_1105577da4c8dad4609d:text":0.02093791961669922,"semif_86a15618ba4cb90a307e:text":0.028418660163879395,"semif_fb73a85d386cf59b0c51:text":0.021698713302612305,"own_j12:text":0.028065502643585205,"semif_8a4c3de28be95c105ca1:text":0.019638895988464355,"img_06:native":0.023213446140289307,"worst_max_abs_dp":0.028418660163879395,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":2},{"config":"fp16_set_L04_L06_L09","outside_rule_search":false,"fp16_layers":[4,6,9],"int8_params":6263406592,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.04903270798968,"semif_1105577da4c8dad4609d:text":0.003751605749130249,"semif_86a15618ba4cb90a307e:text":0.027673542499542236,"semif_fb73a85d386cf59b0c51:text":0.020009219646453857,"own_j12:text":0.02747368812561035,"semif_8a4c3de28be95c105ca1:text":0.016659855842590332,"img_06:native":0.022502422332763672,"worst_max_abs_dp":0.027673542499542236,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":3},{"config":"fp16_set_L04_L06_L09_L10","outside_rule_search":false,"fp16_layers":[4,6,9,10],"int8_params":6045040640,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.090759791986784,"semif_1105577da4c8dad4609d:text":0.01961219310760498,"semif_86a15618ba4cb90a307e:text":0.022242486476898193,"semif_fb73a85d386cf59b0c51:text":0.020944058895111084,"own_j12:text":0.02598893642425537,"semif_8a4c3de28be95c105ca1:text":0.02462106943130493,"img_06:native":0.02140122652053833,"worst_max_abs_dp":0.02598893642425537,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":4},{"config":"fp16_set_L04_L06_L09_L10_L11","outside_rule_search":false,"fp16_layers":[4,6,9,10,11],"int8_params":5835325440,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.143724166002357,"semif_1105577da4c8dad4609d:text":0.02928537130355835,"semif_86a15618ba4cb90a307e:text":0.013353943824768066,"semif_fb73a85d386cf59b0c51:text":0.019093990325927734,"own_j12:text":0.026499629020690918,"semif_8a4c3de28be95c105ca1:text":0.029588282108306885,"img_06:native":0.011475563049316406,"worst_max_abs_dp":0.029588282108306885,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":5},{"config":"fp16_set_L00_L04_L06_L09_L10_L11","outside_rule_search":false,"fp16_layers":[0,4,6,9,10,11],"int8_params":5616959488,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.01764804200502,"semif_1105577da4c8dad4609d:text":0.03503149747848511,"semif_86a15618ba4cb90a307e:text":0.004841625690460205,"semif_fb73a85d386cf59b0c51:text":0.0065392255783081055,"own_j12:text":0.01312488317489624,"semif_8a4c3de28be95c105ca1:text":0.021201372146606445,"img_06:native":0.0076637864112854,"worst_max_abs_dp":0.03503149747848511,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":6},{"config":"fp16_L00-03","outside_rule_search":true,"fp16_layers":[0,1,2,3],"int8_params":6053691392,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":22.00002929198672,"semif_1105577da4c8dad4609d:text":0.11185729503631592,"semif_86a15618ba4cb90a307e:text":0.023159503936767578,"semif_fb73a85d386cf59b0c51:text":0.00737994909286499,"own_j12:text":0.018179357051849365,"semif_8a4c3de28be95c105ca1:text":0.010941803455352783,"img_06:native":0.018950045108795166,"worst_max_abs_dp":0.11185729503631592,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":4},{"config":"fp16_L00-05","outside_rule_search":true,"fp16_layers":[0,1,2,3,4,5],"int8_params":5616959488,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.179309708008077,"semif_1105577da4c8dad4609d:text":0.08937186002731323,"semif_86a15618ba4cb90a307e:text":0.01882922649383545,"semif_fb73a85d386cf59b0c51:text":0.006310880184173584,"own_j12:text":0.013892412185668945,"semif_8a4c3de28be95c105ca1:text":0.013011753559112549,"img_06:native":0.01926898956298828,"worst_max_abs_dp":0.08937186002731323,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":6},{"config":"fp16_L00-07","outside_rule_search":true,"fp16_layers":[0,1,2,3,4,5,6,7],"int8_params":5188878336,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.079658374976134,"semif_1105577da4c8dad4609d:text":0.05677211284637451,"semif_86a15618ba4cb90a307e:text":0.011755108833312988,"semif_fb73a85d386cf59b0c51:text":0.006292134523391724,"own_j12:text":0.010497808456420898,"semif_8a4c3de28be95c105ca1:text":0.010197162628173828,"img_06:native":0.012583911418914795,"worst_max_abs_dp":0.05677211284637451,"rule_1":false,"rule_2":true,"rule_3":false,"fp16_layer_count":8},{"config":"fp16_L00-11","outside_rule_search":true,"fp16_layers":[0,1,2,3,4,5,6,7,8,9,10,11],"int8_params":4324065280,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.233851083001355,"semif_1105577da4c8dad4609d:text":0.006188809871673584,"semif_86a15618ba4cb90a307e:text":0.0038837790489196777,"semif_fb73a85d386cf59b0c51:text":0.001364201307296753,"own_j12:text":0.006854116916656494,"semif_8a4c3de28be95c105ca1:text":0.005394399166107178,"img_06:native":0.00046193599700927734,"worst_max_abs_dp":0.006854116916656494,"rule_1":true,"rule_2":true,"rule_3":false,"fp16_layer_count":12},{"config":"fp16_L04-15","outside_rule_search":true,"fp16_layers":[4,5,6,7,8,9,10,11,12,13,14,15],"int8_params":4324065280,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.354374000016833,"semif_1105577da4c8dad4609d:text":0.02069467306137085,"semif_86a15618ba4cb90a307e:text":0.0018558502197265625,"semif_fb73a85d386cf59b0c51:text":0.017297446727752686,"own_j12:text":0.013640046119689941,"semif_8a4c3de28be95c105ca1:text":0.00905752182006836,"img_06:native":0.007092773914337158,"worst_max_abs_dp":0.02069467306137085,"rule_1":false,"rule_2":true,"rule_3":false,"fp16_layer_count":12},{"config":"fp16_L08-15","outside_rule_search":true,"fp16_layers":[8,9,10,11,12,13,14,15],"int8_params":5188878336,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.148792874999344,"semif_1105577da4c8dad4609d:text":0.02382826805114746,"semif_86a15618ba4cb90a307e:text":0.012128174304962158,"semif_fb73a85d386cf59b0c51:text":0.029603779315948486,"own_j12:text":0.020440220832824707,"semif_8a4c3de28be95c105ca1:text":0.026193976402282715,"img_06:native":0.013058602809906006,"worst_max_abs_dp":0.029603779315948486,"rule_1":false,"rule_2":false,"rule_3":false,"fp16_layer_count":8},{"config":"fp16_L12-15","outside_rule_search":true,"fp16_layers":[12,13,14,15],"int8_params":6053691392,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.119151499995496,"semif_1105577da4c8dad4609d:text":0.09392178058624268,"semif_86a15618ba4cb90a307e:text":0.021242141723632812,"semif_fb73a85d386cf59b0c51:text":0.022118210792541504,"own_j12:text":0.02474457025527954,"semif_8a4c3de28be95c105ca1:text":0.013468682765960693,"img_06:native":0.02555638551712036,"worst_max_abs_dp":0.09392178058624268,"rule_1":false,"rule_2":false,"rule_3":true,"fp16_layer_count":4},{"config":"first16_gdn_exact","outside_rule_search":true,"fp16_layers":null,"int8_params":6110052352,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.097267500008456,"semif_1105577da4c8dad4609d:text":0.007463037967681885,"semif_86a15618ba4cb90a307e:text":0.015871107578277588,"semif_fb73a85d386cf59b0c51:text":0.004230797290802002,"own_j12:text":0.006757795810699463,"semif_8a4c3de28be95c105ca1:text":0.005502656102180481,"img_06:native":0.022944748401641846,"worst_max_abs_dp":0.022944748401641846,"rule_1":false,"rule_2":true,"rule_3":false,"fp16_layer_count":null},{"config":"first16_mlp_exact","outside_rule_search":true,"fp16_layers":null,"int8_params":4502585344,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.51079179099179,"semif_1105577da4c8dad4609d:text":0.04641294479370117,"semif_86a15618ba4cb90a307e:text":0.019115924835205078,"semif_fb73a85d386cf59b0c51:text":0.03189331293106079,"own_j12:text":0.02968043088912964,"semif_8a4c3de28be95c105ca1:text":0.029932081699371338,"img_06:native":0.01613253355026245,"worst_max_abs_dp":0.04641294479370117,"rule_1":false,"rule_2":false,"rule_3":false,"fp16_layer_count":null},{"config":"first16_attn_exact","outside_rule_search":true,"fp16_layers":null,"int8_params":6683623424,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.338425374997314,"semif_1105577da4c8dad4609d:text":0.11514472961425781,"semif_86a15618ba4cb90a307e:text":0.014345943927764893,"semif_fb73a85d386cf59b0c51:text":0.011026918888092041,"own_j12:text":0.023191213607788086,"semif_8a4c3de28be95c105ca1:text":0.013327717781066895,"img_06:native":0.011280655860900879,"worst_max_abs_dp":0.11514472961425781,"rule_1":false,"rule_2":false,"rule_3":false,"fp16_layer_count":null},{"config":"fp16_set_L00_L01_L02_L03_L04_L05_L06_L07_L08","outside_rule_search":true,"fp16_layers":[0,1,2,3,4,5,6,7,8],"int8_params":4970512384,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":21.46946495800512,"semif_1105577da4c8dad4609d:text":0.05089437961578369,"semif_86a15618ba4cb90a307e:text":0.011539876461029053,"semif_fb73a85d386cf59b0c51:text":0.0007879436016082764,"own_j12:text":0.00904470682144165,"semif_8a4c3de28be95c105ca1:text":0.015771150588989258,"img_06:native":0.01131671667098999,"worst_max_abs_dp":0.05089437961578369,"rule_1":false,"rule_2":true,"rule_3":false,"fp16_layer_count":9},{"config":"fp16_set_L00_L01_L02_L03_L04_L05_L06_L07_L08_L09","outside_rule_search":true,"fp16_layers":[0,1,2,3,4,5,6,7,8,9],"int8_params":4752146432,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.217512375005754,"semif_1105577da4c8dad4609d:text":0.023181498050689697,"semif_86a15618ba4cb90a307e:text":0.016122519969940186,"semif_fb73a85d386cf59b0c51:text":0.002443552017211914,"own_j12:text":0.007442653179168701,"semif_8a4c3de28be95c105ca1:text":0.01062709093093872,"img_06:native":0.011272013187408447,"worst_max_abs_dp":0.023181498050689697,"rule_1":false,"rule_2":true,"rule_3":false,"fp16_layer_count":10},{"config":"fp16_set_L00_L01_L02_L03_L04_L05_L06_L07_L08_L09_L10","outside_rule_search":true,"fp16_layers":[0,1,2,3,4,5,6,7,8,9,10],"int8_params":4533780480,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"seconds":19.207267207995756,"semif_1105577da4c8dad4609d:text":0.004324674606323242,"semif_86a15618ba4cb90a307e:text":0.011594235897064209,"semif_fb73a85d386cf59b0c51:text":0.0032349228858947754,"own_j12:text":0.006032586097717285,"semif_8a4c3de28be95c105ca1:text":0.0009352564811706543,"img_06:native":0.010206818580627441,"worst_max_abs_dp":0.011594235897064209,"rule_1":false,"rule_2":true,"rule_3":false,"fp16_layer_count":11}],"configs":{"int8lin":{"why":"the export's int8lin body","fp16_layers":[],"int8_modules":248,"exact_modules":0,"int8_params":6918504448,"modules_swapped":248,"swap_seconds":1.7605964580143336,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08421546220779419,"mean_abs_dp":0.05614366134007772,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.924434924847851,"hidden_max_abs_diff":10.495765686035156,"questions":[{"question_id":"decision","max_abs_dp":0.08421546220779419,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":3.292907875002129},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.025906741619110107,"mean_abs_dp":0.01727113127708435,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9921038297194201,"hidden_max_abs_diff":2.448513984680176,"questions":[{"question_id":"decision","max_abs_dp":0.025906741619110107,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8898832499980927},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02338331937789917,"mean_abs_dp":0.015588919321695963,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971819496399187,"hidden_max_abs_diff":1.5212554931640625,"questions":[{"question_id":"decision","max_abs_dp":0.02338331937789917,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8582220840035006},"own_j12:text":{"max_abs_dp":0.02883768081665039,"mean_abs_dp":0.0046863487133613,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9207845700940519,"hidden_max_abs_diff":4.469055891036987,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.265806198120117e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0009473413228988647,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02883768081665039,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.000530807301402092,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.775840291986242},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.020289063453674316,"mean_abs_dp":0.013526049753030142,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.969244692184882,"hidden_max_abs_diff":5.860572814941406,"questions":[{"question_id":"decision","max_abs_dp":0.020289063453674316,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.905002792016603},"img_06:native":{"max_abs_dp":0.02439892292022705,"mean_abs_dp":0.00897724935784936,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9767115036585006,"hidden_max_abs_diff":5.632632255554199,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011831164360046387,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02439892292022705,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0077710747718811035,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.08915004201117}},"seconds":21.57174462499097,"outside_rule_search":false},"exact":{"why":"no int8: the instrument's floor vs the oracle","fp16_layers":null,"int8_modules":0,"exact_modules":248,"int8_params":0,"modules_swapped":248,"swap_seconds":1.207582791976165,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":1.0192394256591797e-05,"mean_abs_dp":6.784995396931966e-06,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9999999988008605,"hidden_max_abs_diff":0.0022039413452148438,"questions":[{"question_id":"decision","max_abs_dp":1.0192394256591797e-05,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.7535543749982025},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":1.3709068298339844e-06,"mean_abs_dp":9.114543596903483e-07,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9999999993728172,"hidden_max_abs_diff":0.0006246566772460938,"questions":[{"question_id":"decision","max_abs_dp":1.3709068298339844e-06,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8935242499865126},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":2.473592758178711e-06,"mean_abs_dp":1.6217430432637532e-06,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9999999995839783,"hidden_max_abs_diff":0.0010747909545898438,"questions":[{"question_id":"decision","max_abs_dp":2.473592758178711e-06,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9088341250026133},"own_j12:text":{"max_abs_dp":6.16908073425293e-06,"mean_abs_dp":1.1561295160880456e-06,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9999999948026767,"hidden_max_abs_diff":0.0004901885986328125,"questions":[{"question_id":"coupon_valid","max_abs_dp":5.960464477539063e-08,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":1.1473894119262695e-06,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":6.16908073425293e-06,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":1.1920928955078125e-07,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.716881916014245},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":1.0579824447631836e-06,"mean_abs_dp":7.003545761108398e-07,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9999999982479906,"hidden_max_abs_diff":0.0011501312255859375,"questions":[{"question_id":"decision","max_abs_dp":1.0579824447631836e-06,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9346890000160784},"img_06:native":{"max_abs_dp":5.960464477539062e-07,"mean_abs_dp":2.914108335971832e-07,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9999999997073826,"hidden_max_abs_diff":0.0004940032958984375,"questions":[{"question_id":"in_red_zone","max_abs_dp":5.960464477539062e-07,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":5.364418029785156e-07,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":2.980232238769531e-07,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.108022458007326}},"seconds":20.52310854199459,"outside_rule_search":false},"fp16_L00-15":{"why":"first 16 layers exact, last 16 int8","fp16_layers":[0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15],"int8_modules":124,"exact_modules":124,"int8_params":3459252224,"modules_swapped":124,"swap_seconds":0.4900677919795271,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.0012458562850952148,"mean_abs_dp":0.0008305683732032776,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.999717030888398,"hidden_max_abs_diff":0.6358299255371094,"questions":[{"question_id":"decision","max_abs_dp":0.0012458562850952148,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.7562993750034366},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.00027066469192504883,"mean_abs_dp":0.00018045057853062948,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9997802592098666,"hidden_max_abs_diff":0.543853759765625,"questions":[{"question_id":"decision","max_abs_dp":0.00027066469192504883,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9060243750282098},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.0002948641777038574,"mean_abs_dp":0.0001965301732222239,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9995988477506044,"hidden_max_abs_diff":0.8742179870605469,"questions":[{"question_id":"decision","max_abs_dp":0.0002948641777038574,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9608137920149602},"own_j12:text":{"max_abs_dp":0.0023093223571777344,"mean_abs_dp":0.0006056230228680831,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9996873087639853,"hidden_max_abs_diff":0.8011131286621094,"questions":[{"question_id":"coupon_valid","max_abs_dp":1.3131648302078247e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.000644981861114502,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.0023093223571777344,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0009692013263702393,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.737330000003567},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.0015130043029785156,"mean_abs_dp":0.0010086571176846821,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9996696606649891,"hidden_max_abs_diff":0.9453597068786621,"questions":[{"question_id":"decision","max_abs_dp":0.0015130043029785156,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9219712080084719},"img_06:native":{"max_abs_dp":0.0016149282455444336,"mean_abs_dp":0.0005552048794925212,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9997515000875641,"hidden_max_abs_diff":0.6917304992675781,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.0005484223365783691,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.0016149282455444336,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0005494207143783569,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":4.984316875023069}},"seconds":19.756911749980645,"outside_rule_search":false},"fp16_L16-31":{"why":"last 16 layers exact, first 16 int8","fp16_layers":[16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31],"int8_modules":124,"exact_modules":124,"int8_params":3459252224,"modules_swapped":248,"swap_seconds":1.0451202080002986,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08445906639099121,"mean_abs_dp":0.05630606412887573,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.926149028570029,"hidden_max_abs_diff":10.508283615112305,"questions":[{"question_id":"decision","max_abs_dp":0.08445906639099121,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.6835695000190753},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.025534451007843018,"mean_abs_dp":0.017022942503293354,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9920956930115715,"hidden_max_abs_diff":2.5166215896606445,"questions":[{"question_id":"decision","max_abs_dp":0.025534451007843018,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8871060840028804},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02331632375717163,"mean_abs_dp":0.015544240673383078,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9972645914515139,"hidden_max_abs_diff":1.4994351863861084,"questions":[{"question_id":"decision","max_abs_dp":0.02331632375717163,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.873836292012129},"own_j12:text":{"max_abs_dp":0.026969492435455322,"mean_abs_dp":0.004474746206632027,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9178972705561488,"hidden_max_abs_diff":4.417497873306274,"questions":[{"question_id":"coupon_valid","max_abs_dp":8.368492126464844e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0007966309785842896,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.026969492435455322,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0012359619140625,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.633130083006108},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.021187245845794678,"mean_abs_dp":0.014124828080336252,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9695300281961151,"hidden_max_abs_diff":5.496122360229492,"questions":[{"question_id":"decision","max_abs_dp":0.021187245845794678,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.8811588749813382},"img_06:native":{"max_abs_dp":0.022742033004760742,"mean_abs_dp":0.008553053624927998,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.976200639708291,"hidden_max_abs_diff":4.945347785949707,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011444509029388428,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.022742033004760742,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007191494107246399,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.1126127500028815}},"seconds":20.11661733299843,"outside_rule_search":false},"only_gdn":{"why":"GDN in_proj_qkv/z/b/a + out_proj int8, the rest exact","fp16_layers":null,"int8_modules":120,"exact_modules":128,"int8_params":1616904192,"modules_swapped":124,"swap_seconds":0.3931118329928722,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.07522028684616089,"mean_abs_dp":0.05014685789744059,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9455490810587465,"hidden_max_abs_diff":9.135852813720703,"questions":[{"question_id":"decision","max_abs_dp":0.07522028684616089,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.559281458990881},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.008204832673072815,"mean_abs_dp":0.005469925701618195,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.996530360602622,"hidden_max_abs_diff":0.8568325042724609,"questions":[{"question_id":"decision","max_abs_dp":0.008204832673072815,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.910096915991744},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.019174516201019287,"mean_abs_dp":0.012783035635948181,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9981337344448243,"hidden_max_abs_diff":0.9518508911132812,"questions":[{"question_id":"decision","max_abs_dp":0.019174516201019287,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9177768749941606},"own_j12:text":{"max_abs_dp":0.02469491958618164,"mean_abs_dp":0.004285293989456617,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9532507665610467,"hidden_max_abs_diff":2.887667655944824,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00012154318392276764,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0005829930305480957,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02469491958618164,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0022644996643066406,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.759824000007939},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.024461567401885986,"mean_abs_dp":0.01630771408478419,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.970403247975438,"hidden_max_abs_diff":5.293218612670898,"questions":[{"question_id":"decision","max_abs_dp":0.024461567401885986,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9374879589886405},"img_06:native":{"max_abs_dp":0.0026354342699050903,"mean_abs_dp":0.001268972922116518,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9711725293480562,"hidden_max_abs_diff":4.144115447998047,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.0015448927879333496,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.0018474459648132324,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0026354342699050903,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.115440542023862}},"seconds":19.593113541981438,"outside_rule_search":false},"only_attn":{"why":"full-attention q/k/v/o int8, the rest exact","fp16_layers":null,"int8_modules":32,"exact_modules":216,"int8_params":469762048,"modules_swapped":152,"swap_seconds":0.273086000001058,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.023046433925628662,"mean_abs_dp":0.01536428431669871,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9944505561576049,"hidden_max_abs_diff":6.2855424880981445,"questions":[{"question_id":"decision","max_abs_dp":0.023046433925628662,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.555896167003084},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.009882688522338867,"mean_abs_dp":0.006588441630204518,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9990575213896424,"hidden_max_abs_diff":0.9956455230712891,"questions":[{"question_id":"decision","max_abs_dp":0.009882688522338867,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9190754579904024},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.011654853820800781,"mean_abs_dp":0.0077699484924475355,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.999582093038886,"hidden_max_abs_diff":0.7717995643615723,"questions":[{"question_id":"decision","max_abs_dp":0.011654853820800781,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.915868624986615},"own_j12:text":{"max_abs_dp":0.0051841139793396,"mean_abs_dp":0.0009342826043183987,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9837188195475577,"hidden_max_abs_diff":1.9846229553222656,"questions":[{"question_id":"coupon_valid","max_abs_dp":5.65648078918457e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0003487914800643921,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.0051841139793396,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.000247955322265625,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.737980832986068},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.008266150951385498,"mean_abs_dp":0.005510784685611725,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9952852766478937,"hidden_max_abs_diff":1.9304447174072266,"questions":[{"question_id":"decision","max_abs_dp":0.008266150951385498,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9219624169927556},"img_06:native":{"max_abs_dp":0.013766646385192871,"mean_abs_dp":0.00484737977385521,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9974819001815324,"hidden_max_abs_diff":1.6894779205322266,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.006366908550262451,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.013766646385192871,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0026058554649353027,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.117936833004933}},"seconds":19.441845459019532,"outside_rule_search":false},"only_mlp":{"why":"MLP gate/up/down int8, the rest exact","fp16_layers":null,"int8_modules":96,"exact_modules":152,"int8_params":4831838208,"modules_swapped":128,"swap_seconds":0.6429463330132421,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.034227728843688965,"mean_abs_dp":0.022818500796953838,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9874375876770326,"hidden_max_abs_diff":5.325403213500977,"questions":[{"question_id":"decision","max_abs_dp":0.034227728843688965,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.635198500007391},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.005158185958862305,"mean_abs_dp":0.0034387633204460144,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9990876569236778,"hidden_max_abs_diff":0.9269046783447266,"questions":[{"question_id":"decision","max_abs_dp":0.005158185958862305,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9147819159843493},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.007215380668640137,"mean_abs_dp":0.004810300966103871,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9986726207671449,"hidden_max_abs_diff":0.7814960479736328,"questions":[{"question_id":"decision","max_abs_dp":0.007215380668640137,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8666110409831163},"own_j12:text":{"max_abs_dp":0.0024714916944503784,"mean_abs_dp":0.0009403887849587661,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9965577437881326,"hidden_max_abs_diff":2.1678638458251953,"questions":[{"question_id":"coupon_valid","max_abs_dp":1.7881393432617188e-07,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.001998305320739746,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.0016426444053649902,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0024714916944503784,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.625225041992962},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.014494776725769043,"mean_abs_dp":0.009663164615631104,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9966189482269452,"hidden_max_abs_diff":1.6147451400756836,"questions":[{"question_id":"decision","max_abs_dp":0.014494776725769043,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.888039540994214},"img_06:native":{"max_abs_dp":0.00875169038772583,"mean_abs_dp":0.003177474346011877,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9911528612158893,"hidden_max_abs_diff":2.452906608581543,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.004027009010314941,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.00875169038772583,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0024873167276382446,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.033051915990654}},"seconds":19.605930125020677,"outside_rule_search":false},"fp16_L00":{"why":"layer 0 exact, every other layer int8","fp16_layers":[0],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":150,"swap_seconds":0.24985966700478457,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.07579749822616577,"mean_abs_dp":0.05053167541821798,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9458914567435157,"hidden_max_abs_diff":9.005975723266602,"questions":[{"question_id":"decision","max_abs_dp":0.07579749822616577,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.548957541002892},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.016390621662139893,"mean_abs_dp":0.010927038888136545,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9900977911362641,"hidden_max_abs_diff":2.5204925537109375,"questions":[{"question_id":"decision","max_abs_dp":0.016390621662139893,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.923075124999741},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.011668801307678223,"mean_abs_dp":0.007779226948817571,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9944556341726803,"hidden_max_abs_diff":1.4687116146087646,"questions":[{"question_id":"decision","max_abs_dp":0.011668801307678223,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.90906154201366},"own_j12:text":{"max_abs_dp":0.015848398208618164,"mean_abs_dp":0.0028615166934636924,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9538394430588293,"hidden_max_abs_diff":2.6509933471679688,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00012993812561035156,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0022845864295959473,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.015848398208618164,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0003370419144630432,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.752804208983434},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.01102989912033081,"mean_abs_dp":0.007353276014328003,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9592255350542226,"hidden_max_abs_diff":6.503910064697266,"questions":[{"question_id":"decision","max_abs_dp":0.01102989912033081,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9263059999793768},"img_06:native":{"max_abs_dp":0.02051520347595215,"mean_abs_dp":0.007472787238657475,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9870526000804273,"hidden_max_abs_diff":6.247455596923828,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.010132670402526855,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02051520347595215,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.005254760384559631,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.10450287500862}},"seconds":19.41470775002381,"outside_rule_search":false},"fp16_L01":{"why":"layer 1 exact, every other layer int8","fp16_layers":[1],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.05463450000388548,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08871442079544067,"mean_abs_dp":0.05914296706517538,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9185808773060236,"hidden_max_abs_diff":11.037395477294922,"questions":[{"question_id":"decision","max_abs_dp":0.08871442079544067,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.55970562499715},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.028344273567199707,"mean_abs_dp":0.018896182378133137,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.98975112525328,"hidden_max_abs_diff":2.4828433990478516,"questions":[{"question_id":"decision","max_abs_dp":0.028344273567199707,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9106845839996822},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.023521602153778076,"mean_abs_dp":0.015681109080712,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971067231733279,"hidden_max_abs_diff":1.8894214630126953,"questions":[{"question_id":"decision","max_abs_dp":0.023521602153778076,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9184770830033813},"own_j12:text":{"max_abs_dp":0.030464470386505127,"mean_abs_dp":0.005086109758569644,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9106680168651734,"hidden_max_abs_diff":4.261417388916016,"questions":[{"question_id":"coupon_valid","max_abs_dp":8.118152618408203e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0007331520318984985,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.030464470386505127,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.001737833023071289,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.74268412499805},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.021501243114471436,"mean_abs_dp":0.014334169526894888,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.98085821981813,"hidden_max_abs_diff":4.767717361450195,"questions":[{"question_id":"decision","max_abs_dp":0.021501243114471436,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9005411659891251},"img_06:native":{"max_abs_dp":0.025145113468170166,"mean_abs_dp":0.009282249584794044,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9783496090347368,"hidden_max_abs_diff":5.550551891326904,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.012360811233520508,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.025145113468170166,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007765963673591614,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.092443583009299}},"seconds":19.179311416985,"outside_rule_search":false},"fp16_L02":{"why":"layer 2 exact, every other layer int8","fp16_layers":[2],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.056783959007589146,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08329451084136963,"mean_abs_dp":0.055529711147149406,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9237752994420606,"hidden_max_abs_diff":10.673280715942383,"questions":[{"question_id":"decision","max_abs_dp":0.08329451084136963,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.7732176250137854},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.028553903102874756,"mean_abs_dp":0.019035908083120983,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9900590848726712,"hidden_max_abs_diff":2.8428454399108887,"questions":[{"question_id":"decision","max_abs_dp":0.028553903102874756,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.921674625016749},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.021118521690368652,"mean_abs_dp":0.014079031844933828,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9974288683239729,"hidden_max_abs_diff":1.6855583190917969,"questions":[{"question_id":"decision","max_abs_dp":0.021118521690368652,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8973392079933546},"own_j12:text":{"max_abs_dp":0.028327226638793945,"mean_abs_dp":0.004618763637084227,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9287884271960087,"hidden_max_abs_diff":4.793408632278442,"questions":[{"question_id":"coupon_valid","max_abs_dp":5.614757537841797e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.000819861888885498,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028327226638793945,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0006774067878723145,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.622527166997315},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.0217551589012146,"mean_abs_dp":0.014503441751003265,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9671223323322571,"hidden_max_abs_diff":5.974287033081055,"questions":[{"question_id":"decision","max_abs_dp":0.0217551589012146,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.8913573329919018},"img_06:native":{"max_abs_dp":0.023917675018310547,"mean_abs_dp":0.008772470150142908,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9709056692583209,"hidden_max_abs_diff":5.176364898681641,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011566370725631714,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.023917675018310547,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007626965641975403,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.019955124997068}},"seconds":19.183002834004583,"outside_rule_search":false},"fp16_L03":{"why":"layer 3 exact, every other layer int8","fp16_layers":[3],"int8_modules":241,"exact_modules":7,"int8_params":6708789248,"modules_swapped":15,"swap_seconds":0.04907187499338761,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.11642390489578247,"mean_abs_dp":0.07761596391598384,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.8755726031849869,"hidden_max_abs_diff":15.37767219543457,"questions":[{"question_id":"decision","max_abs_dp":0.11642390489578247,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.553388875006931},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02824842929840088,"mean_abs_dp":0.0188322514295578,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9949367987607372,"hidden_max_abs_diff":2.581787109375,"questions":[{"question_id":"decision","max_abs_dp":0.02824842929840088,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.925495208997745},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.020697474479675293,"mean_abs_dp":0.013798346122105917,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9973097436473697,"hidden_max_abs_diff":1.5470936298370361,"questions":[{"question_id":"decision","max_abs_dp":0.020697474479675293,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8651349170249887},"own_j12:text":{"max_abs_dp":0.029575586318969727,"mean_abs_dp":0.0048476474789472725,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9150651660215449,"hidden_max_abs_diff":4.252131462097168,"questions":[{"question_id":"coupon_valid","max_abs_dp":9.80626791715622e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0005678832530975342,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.029575586318969727,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0009264945983886719,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.58327587498934},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.016795456409454346,"mean_abs_dp":0.01119698832432429,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9625839184016415,"hidden_max_abs_diff":6.506072998046875,"questions":[{"question_id":"decision","max_abs_dp":0.016795456409454346,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.8955927499919198},"img_06:native":{"max_abs_dp":0.022546708583831787,"mean_abs_dp":0.008070050366222858,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.983254973459977,"hidden_max_abs_diff":4.126016616821289,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.010188281536102295,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.022546708583831787,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007432475686073303,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.100119666982209}},"seconds":18.97221599999466,"outside_rule_search":false},"fp16_L04":{"why":"layer 4 exact, every other layer int8","fp16_layers":[4],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":15,"swap_seconds":0.04738070900202729,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.057090163230895996,"mean_abs_dp":0.0380601113041242,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9620218883029698,"hidden_max_abs_diff":6.848024368286133,"questions":[{"question_id":"decision","max_abs_dp":0.057090163230895996,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.540387749992078},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02517259120941162,"mean_abs_dp":0.016781732439994812,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9916169393544962,"hidden_max_abs_diff":2.479222297668457,"questions":[{"question_id":"decision","max_abs_dp":0.02517259120941162,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.917394250020152},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02168869972229004,"mean_abs_dp":0.014459174126386642,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9942653166623714,"hidden_max_abs_diff":1.6019554138183594,"questions":[{"question_id":"decision","max_abs_dp":0.02168869972229004,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9140623330022208},"own_j12:text":{"max_abs_dp":0.028524041175842285,"mean_abs_dp":0.004722276559242835,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9342194233397143,"hidden_max_abs_diff":4.8104963302612305,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00012612342834472656,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0008757114410400391,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028524041175842285,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0009364783763885498,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.744318750017555},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.017360329627990723,"mean_abs_dp":0.011573555568854014,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9685394554894549,"hidden_max_abs_diff":5.840679168701172,"questions":[{"question_id":"decision","max_abs_dp":0.017360329627990723,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9149177499930374},"img_06:native":{"max_abs_dp":0.02365267276763916,"mean_abs_dp":0.008614437468349934,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9799333177637236,"hidden_max_abs_diff":5.170355796813965,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011277616024017334,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02365267276763916,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007412716746330261,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.101231875014491}},"seconds":19.179840834025526,"outside_rule_search":false},"fp16_L05":{"why":"layer 5 exact, every other layer int8","fp16_layers":[5],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04748170799575746,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.09055161476135254,"mean_abs_dp":0.060367777943611145,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9139321733652456,"hidden_max_abs_diff":11.947746276855469,"questions":[{"question_id":"decision","max_abs_dp":0.09055161476135254,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.543571874994086},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.022164106369018555,"mean_abs_dp":0.014776075879732767,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9936068002145647,"hidden_max_abs_diff":2.3048152923583984,"questions":[{"question_id":"decision","max_abs_dp":0.022164106369018555,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9117197080049664},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.023332655429840088,"mean_abs_dp":0.015555154532194138,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9975007153489303,"hidden_max_abs_diff":1.5433969497680664,"questions":[{"question_id":"decision","max_abs_dp":0.023332655429840088,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9362208750098944},"own_j12:text":{"max_abs_dp":0.0252038836479187,"mean_abs_dp":0.004186608470403231,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9252729508590689,"hidden_max_abs_diff":5.691960453987122,"questions":[{"question_id":"coupon_valid","max_abs_dp":4.412606358528137e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0008143633604049683,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.0252038836479187,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0011041760444641113,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.673462917009601},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.025760233402252197,"mean_abs_dp":0.017173508803049724,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9905410144847279,"hidden_max_abs_diff":3.167499542236328,"questions":[{"question_id":"decision","max_abs_dp":0.025760233402252197,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.8910045410157181},"img_06:native":{"max_abs_dp":0.02560979127883911,"mean_abs_dp":0.009173552505671978,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9797822254557917,"hidden_max_abs_diff":5.756463050842285,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011606037616729736,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02560979127883911,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0074600279331207275,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.007651124993572}},"seconds":19.0112500419782,"outside_rule_search":false},"fp16_L06":{"why":"layer 6 exact, every other layer int8","fp16_layers":[6],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04713245798484422,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.049162089824676514,"mean_abs_dp":0.03277473400036494,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9730320096621371,"hidden_max_abs_diff":6.038764953613281,"questions":[{"question_id":"decision","max_abs_dp":0.049162089824676514,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5067574999993667},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02299201488494873,"mean_abs_dp":0.015327965219815573,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9950732740247848,"hidden_max_abs_diff":2.1498122215270996,"questions":[{"question_id":"decision","max_abs_dp":0.02299201488494873,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.920435375010129},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02014780044555664,"mean_abs_dp":0.013431861996650696,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9965173054090116,"hidden_max_abs_diff":2.2043676376342773,"questions":[{"question_id":"decision","max_abs_dp":0.02014780044555664,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9216422089957632},"own_j12:text":{"max_abs_dp":0.02971261739730835,"mean_abs_dp":0.004836251959204674,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9384352857993189,"hidden_max_abs_diff":3.3846139907836914,"questions":[{"question_id":"coupon_valid","max_abs_dp":6.628036499023438e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0009752511978149414,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02971261739730835,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0006814450025558472,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.754332249984145},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.016025125980377197,"mean_abs_dp":0.010683404902617136,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9802056192704655,"hidden_max_abs_diff":4.637729644775391,"questions":[{"question_id":"decision","max_abs_dp":0.016025125980377197,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.928976541996235},"img_06:native":{"max_abs_dp":0.0232694149017334,"mean_abs_dp":0.008286530710756778,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9805724505035848,"hidden_max_abs_diff":5.238179683685303,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.010457873344421387,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.0232694149017334,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.006860196590423584,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.12548458299716}},"seconds":19.204898790980224,"outside_rule_search":false},"fp16_L07":{"why":"layer 7 exact, every other layer int8","fp16_layers":[7],"int8_modules":241,"exact_modules":7,"int8_params":6708789248,"modules_swapped":15,"swap_seconds":0.047731291997479275,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08616989850997925,"mean_abs_dp":0.057446626325448356,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9143996613159909,"hidden_max_abs_diff":10.997812271118164,"questions":[{"question_id":"decision","max_abs_dp":0.08616989850997925,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5480718339968007},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.020802855491638184,"mean_abs_dp":0.013868555426597595,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9923622982811692,"hidden_max_abs_diff":2.2237138748168945,"questions":[{"question_id":"decision","max_abs_dp":0.020802855491638184,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.907124291989021},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.01508408784866333,"mean_abs_dp":0.010056075950463613,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9945812228743678,"hidden_max_abs_diff":1.5424079895019531,"questions":[{"question_id":"decision","max_abs_dp":0.01508408784866333,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9148700420046225},"own_j12:text":{"max_abs_dp":0.02443748712539673,"mean_abs_dp":0.00411988150041837,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9547086869610559,"hidden_max_abs_diff":4.962891578674316,"questions":[{"question_id":"coupon_valid","max_abs_dp":6.789900362491608e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.001198887825012207,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02443748712539673,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0008246898651123047,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.743221042008372},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.0037218332290649414,"mean_abs_dp":0.0024812345703442893,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9864372993145388,"hidden_max_abs_diff":3.8894996643066406,"questions":[{"question_id":"decision","max_abs_dp":0.0037218332290649414,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9253852919791825},"img_06:native":{"max_abs_dp":0.018869221210479736,"mean_abs_dp":0.006881534308195114,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9815637096228961,"hidden_max_abs_diff":4.27241325378418,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.009407222270965576,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.018869221210479736,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.005747497081756592,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.103406459005782}},"seconds":19.189951042004395,"outside_rule_search":false},"fp16_L08":{"why":"layer 8 exact, every other layer int8","fp16_layers":[8],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":15,"swap_seconds":0.046657958009745926,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.07734131813049316,"mean_abs_dp":0.05156088868776957,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9359796492937474,"hidden_max_abs_diff":9.270544052124023,"questions":[{"question_id":"decision","max_abs_dp":0.07734131813049316,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.538369458023226},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02557659149169922,"mean_abs_dp":0.01705101877450943,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9924319281524466,"hidden_max_abs_diff":2.3919591903686523,"questions":[{"question_id":"decision","max_abs_dp":0.02557659149169922,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9139716670033522},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.03077608346939087,"mean_abs_dp":0.020517415056626003,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9969435818145541,"hidden_max_abs_diff":1.4844226837158203,"questions":[{"question_id":"decision","max_abs_dp":0.03077608346939087,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9024477500061039},"own_j12:text":{"max_abs_dp":0.027656733989715576,"mean_abs_dp":0.0047603279638748905,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9205140306961693,"hidden_max_abs_diff":4.507735252380371,"questions":[{"question_id":"coupon_valid","max_abs_dp":6.594881415367126e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0018704533576965332,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.027656733989715576,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0010979175567626953,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.750209416990401},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.01613795757293701,"mean_abs_dp":0.010758630931377411,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9784348053631143,"hidden_max_abs_diff":4.789834976196289,"questions":[{"question_id":"decision","max_abs_dp":0.01613795757293701,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.8926756670116447},"img_06:native":{"max_abs_dp":0.023118138313293457,"mean_abs_dp":0.008492177631706,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9797298285157092,"hidden_max_abs_diff":4.398379325866699,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011401593685150146,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.023118138313293457,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0076259225606918335,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.0061865000170656}},"seconds":19.050659958011238,"outside_rule_search":false},"fp16_L09":{"why":"layer 9 exact, every other layer int8","fp16_layers":[9],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04692795901792124,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.054773569107055664,"mean_abs_dp":0.036515720188617706,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9666606210818929,"hidden_max_abs_diff":5.733209609985352,"questions":[{"question_id":"decision","max_abs_dp":0.054773569107055664,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.495250083011342},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.031446993350982666,"mean_abs_dp":0.020964642365773518,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9916990352870062,"hidden_max_abs_diff":2.698647975921631,"questions":[{"question_id":"decision","max_abs_dp":0.031446993350982666,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8732366670155898},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02464514970779419,"mean_abs_dp":0.016430140783389408,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9964855789557465,"hidden_max_abs_diff":1.992908239364624,"questions":[{"question_id":"decision","max_abs_dp":0.02464514970779419,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.904258624999784},"own_j12:text":{"max_abs_dp":0.027036607265472412,"mean_abs_dp":0.004465713667181822,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.919547317022278,"hidden_max_abs_diff":4.1366801261901855,"questions":[{"question_id":"coupon_valid","max_abs_dp":1.1086463928222656e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0015095621347427368,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.027036607265472412,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0004698466509580612,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.7276221250067465},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.023695528507232666,"mean_abs_dp":0.015797023971875507,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9575926073099036,"hidden_max_abs_diff":6.908365249633789,"questions":[{"question_id":"decision","max_abs_dp":0.023695528507232666,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.89451545898919},"img_06:native":{"max_abs_dp":0.0243416428565979,"mean_abs_dp":0.00891074789687991,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9742483202327239,"hidden_max_abs_diff":4.899338722229004,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011092901229858398,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.0243416428565979,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.008344411849975586,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.120231667009648}},"seconds":19.06218145901221,"outside_rule_search":false},"fp16_L10":{"why":"layer 10 exact, every other layer int8","fp16_layers":[10],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04702900000847876,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.06294989585876465,"mean_abs_dp":0.041966614623864494,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9568316866180897,"hidden_max_abs_diff":7.638368606567383,"questions":[{"question_id":"decision","max_abs_dp":0.06294989585876465,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.560270042013144},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.020404338836669922,"mean_abs_dp":0.01360288014014562,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9927467832982931,"hidden_max_abs_diff":2.5763914585113525,"questions":[{"question_id":"decision","max_abs_dp":0.020404338836669922,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9033028330013622},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.024178683757781982,"mean_abs_dp":0.016119124988714855,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9933224034645773,"hidden_max_abs_diff":1.62257981300354,"questions":[{"question_id":"decision","max_abs_dp":0.024178683757781982,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9203092079842463},"own_j12:text":{"max_abs_dp":0.027408301830291748,"mean_abs_dp":0.004542979483421032,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9262617384391546,"hidden_max_abs_diff":4.660594463348389,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00015079975128173828,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.000672951340675354,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.027408301830291748,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0009801983833312988,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.722552416991675},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.028086483478546143,"mean_abs_dp":0.018724319835503895,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9718228143080199,"hidden_max_abs_diff":5.554950714111328,"questions":[{"question_id":"decision","max_abs_dp":0.028086483478546143,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.923163832980208},"img_06:native":{"max_abs_dp":0.02329730987548828,"mean_abs_dp":0.009203028585761785,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9788155037521195,"hidden_max_abs_diff":4.794410228729248,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.013532042503356934,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02329730987548828,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007727861404418945,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.098873915994773}},"seconds":19.175640291010495,"outside_rule_search":false},"fp16_L11":{"why":"layer 11 exact, every other layer int8","fp16_layers":[11],"int8_modules":241,"exact_modules":7,"int8_params":6708789248,"modules_swapped":15,"swap_seconds":0.046531458996469155,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.07086449861526489,"mean_abs_dp":0.04724301149447759,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9450109020325299,"hidden_max_abs_diff":8.265745162963867,"questions":[{"question_id":"decision","max_abs_dp":0.07086449861526489,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5426633750030305},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.016692698001861572,"mean_abs_dp":0.011128462851047516,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9924077962822637,"hidden_max_abs_diff":1.9547454714775085,"questions":[{"question_id":"decision","max_abs_dp":0.016692698001861572,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9038861670123879},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.021638035774230957,"mean_abs_dp":0.01442539319396019,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9960955964066045,"hidden_max_abs_diff":1.9024124145507812,"questions":[{"question_id":"decision","max_abs_dp":0.021638035774230957,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.903497959021479},"own_j12:text":{"max_abs_dp":0.029109537601470947,"mean_abs_dp":0.004980956848997336,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9336545672130365,"hidden_max_abs_diff":4.262387752532959,"questions":[{"question_id":"coupon_valid","max_abs_dp":1.6391277313232422e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.001953721046447754,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.029109537601470947,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0012966543436050415,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.652602207992459},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.025475263595581055,"mean_abs_dp":0.016983526448408764,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9650527920885295,"hidden_max_abs_diff":6.294960021972656,"questions":[{"question_id":"decision","max_abs_dp":0.025475263595581055,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9268480830069166},"img_06:native":{"max_abs_dp":0.014336347579956055,"mean_abs_dp":0.00559445982798934,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9777864884831012,"hidden_max_abs_diff":6.098581314086914,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.007038682699203491,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.014336347579956055,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0060832202434539795,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.032176707987674}},"seconds":19.008336458995473,"outside_rule_search":false},"fp16_L12":{"why":"layer 12 exact, every other layer int8","fp16_layers":[12],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":15,"swap_seconds":0.04489912500139326,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.07917475700378418,"mean_abs_dp":0.0527832085887591,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9314014582159724,"hidden_max_abs_diff":8.921630859375,"questions":[{"question_id":"decision","max_abs_dp":0.07917475700378418,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5102764579933137},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02413022518157959,"mean_abs_dp":0.016086794435977936,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9915915880539299,"hidden_max_abs_diff":2.4948272705078125,"questions":[{"question_id":"decision","max_abs_dp":0.02413022518157959,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.875179124996066},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.020841360092163086,"mean_abs_dp":0.013894253720839819,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9966959402724658,"hidden_max_abs_diff":1.9429378509521484,"questions":[{"question_id":"decision","max_abs_dp":0.020841360092163086,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8753322919947095},"own_j12:text":{"max_abs_dp":0.02710282802581787,"mean_abs_dp":0.004470633342862129,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9157493030861033,"hidden_max_abs_diff":4.6777262687683105,"questions":[{"question_id":"coupon_valid","max_abs_dp":3.4710392355918884e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0008650422096252441,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02710282802581787,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0009946227073669434,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.7170332910027355},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.013209104537963867,"mean_abs_dp":0.008806072175502777,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9720041880244813,"hidden_max_abs_diff":5.53315544128418,"questions":[{"question_id":"decision","max_abs_dp":0.013209104537963867,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.923293208994437},"img_06:native":{"max_abs_dp":0.021236181259155273,"mean_abs_dp":0.007561606168746948,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9755204968132537,"hidden_max_abs_diff":5.667370319366455,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.00935143232345581,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.021236181259155273,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.006843119859695435,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.121803249989171}},"seconds":19.067947458010167,"outside_rule_search":false},"fp16_L13":{"why":"layer 13 exact, every other layer int8","fp16_layers":[13],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04547845901106484,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.10442620515823364,"mean_abs_dp":0.06961747755606969,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.8916452093389661,"hidden_max_abs_diff":13.643321990966797,"questions":[{"question_id":"decision","max_abs_dp":0.10442620515823364,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5424346670042723},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.023846745491027832,"mean_abs_dp":0.01589781294266383,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9921845720585181,"hidden_max_abs_diff":2.4365739822387695,"questions":[{"question_id":"decision","max_abs_dp":0.023846745491027832,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9196963750000577},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.024077534675598145,"mean_abs_dp":0.01605171710252762,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971529665288923,"hidden_max_abs_diff":1.5736262798309326,"questions":[{"question_id":"decision","max_abs_dp":0.024077534675598145,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.908674542006338},"own_j12:text":{"max_abs_dp":0.032267868518829346,"mean_abs_dp":0.00545521152134125,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.924013612420478,"hidden_max_abs_diff":4.43977427482605,"questions":[{"question_id":"coupon_valid","max_abs_dp":2.7239322662353516e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.001194298267364502,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.032267868518829346,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.001862838864326477,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.732205250009429},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.020855247974395752,"mean_abs_dp":0.0139035036166509,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9691393807771511,"hidden_max_abs_diff":5.791065216064453,"questions":[{"question_id":"decision","max_abs_dp":0.020855247974395752,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.935646458005067},"img_06:native":{"max_abs_dp":0.02317070960998535,"mean_abs_dp":0.008783067390322686,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9760400632686606,"hidden_max_abs_diff":5.927716255187988,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.01181948184967041,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02317070960998535,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.008358031511306763,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.080699875019491}},"seconds":19.16496508399723,"outside_rule_search":false},"fp16_L14":{"why":"layer 14 exact, every other layer int8","fp16_layers":[14],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04464308399474248,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.07666230201721191,"mean_abs_dp":0.051108223696549736,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9355080192264119,"hidden_max_abs_diff":9.044811248779297,"questions":[{"question_id":"decision","max_abs_dp":0.07666230201721191,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5227900000172667},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02411055564880371,"mean_abs_dp":0.016073701282342274,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9916882970558769,"hidden_max_abs_diff":2.3718881607055664,"questions":[{"question_id":"decision","max_abs_dp":0.02411055564880371,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9134553750045598},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02296394109725952,"mean_abs_dp":0.01530932014187177,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9972269289923589,"hidden_max_abs_diff":1.7028999328613281,"questions":[{"question_id":"decision","max_abs_dp":0.02296394109725952,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8994097500108182},"own_j12:text":{"max_abs_dp":0.025750815868377686,"mean_abs_dp":0.004245104841314829,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9217991091005729,"hidden_max_abs_diff":4.514113903045654,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.086992263793945e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0013191699981689453,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.025750815868377686,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0004523135721683502,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.732685416995082},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.0173414945602417,"mean_abs_dp":0.011560986439387003,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9665432191646043,"hidden_max_abs_diff":6.174383163452148,"questions":[{"question_id":"decision","max_abs_dp":0.0173414945602417,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9399565419880673},"img_06:native":{"max_abs_dp":0.0260847806930542,"mean_abs_dp":0.009175046812742949,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9773586755192625,"hidden_max_abs_diff":5.37258243560791,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011763572692871094,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.0260847806930542,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007066741585731506,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.086699000006774}},"seconds":19.139776166994125,"outside_rule_search":false},"fp16_L15":{"why":"layer 15 exact, every other layer int8","fp16_layers":[15],"int8_modules":241,"exact_modules":7,"int8_params":6708789248,"modules_swapped":15,"swap_seconds":0.04719729197677225,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08611083030700684,"mean_abs_dp":0.057407259941101074,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9240278964022336,"hidden_max_abs_diff":11.002595901489258,"questions":[{"question_id":"decision","max_abs_dp":0.08611083030700684,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.4998108750151005},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.026803255081176758,"mean_abs_dp":0.017868826786677044,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9914635577894476,"hidden_max_abs_diff":2.537883758544922,"questions":[{"question_id":"decision","max_abs_dp":0.026803255081176758,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8766333330131602},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02436894178390503,"mean_abs_dp":0.01624600092569987,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9975156388453317,"hidden_max_abs_diff":1.5134639739990234,"questions":[{"question_id":"decision","max_abs_dp":0.02436894178390503,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8895075830223504},"own_j12:text":{"max_abs_dp":0.026144802570343018,"mean_abs_dp":0.004443899370156801,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.923575652305513,"hidden_max_abs_diff":4.46933388710022,"questions":[{"question_id":"coupon_valid","max_abs_dp":8.039921522140503e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0011038631200790405,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.026144802570343018,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0011772066354751587,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.670851250004489},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.022866785526275635,"mean_abs_dp":0.015244541068871817,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9685419834702345,"hidden_max_abs_diff":5.892478942871094,"questions":[{"question_id":"decision","max_abs_dp":0.022866785526275635,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9351591669837944},"img_06:native":{"max_abs_dp":0.028285682201385498,"mean_abs_dp":0.010655524674803019,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9766365653656385,"hidden_max_abs_diff":5.624654293060303,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.01464623212814331,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.028285682201385498,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.009454026818275452,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.119648124993546}},"seconds":19.038937791978242,"outside_rule_search":false},"fp16_L16":{"why":"layer 16 exact, every other layer int8","fp16_layers":[16],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":15,"swap_seconds":0.04401424998650327,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08615589141845703,"mean_abs_dp":0.05743727584679922,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9236395899383191,"hidden_max_abs_diff":10.676229476928711,"questions":[{"question_id":"decision","max_abs_dp":0.08615589141845703,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.4973221250111237},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.026147902011871338,"mean_abs_dp":0.017431914806365967,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9922333698602869,"hidden_max_abs_diff":2.3963136672973633,"questions":[{"question_id":"decision","max_abs_dp":0.026147902011871338,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8928420419979375},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02174311876296997,"mean_abs_dp":0.01449540505806605,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971475352619775,"hidden_max_abs_diff":1.519463300704956,"questions":[{"question_id":"decision","max_abs_dp":0.02174311876296997,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.922433291998459},"own_j12:text":{"max_abs_dp":0.027312159538269043,"mean_abs_dp":0.004461594928915684,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9190222462223198,"hidden_max_abs_diff":4.3487818241119385,"questions":[{"question_id":"coupon_valid","max_abs_dp":3.403797745704651e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0011045634746551514,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.027312159538269043,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005495976656675339,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.747539417003281},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.022151947021484375,"mean_abs_dp":0.014767962197462717,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9681117256224153,"hidden_max_abs_diff":5.978099822998047,"questions":[{"question_id":"decision","max_abs_dp":0.022151947021484375,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9132803749816958},"img_06:native":{"max_abs_dp":0.02468770742416382,"mean_abs_dp":0.009185973089188337,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9766033747347618,"hidden_max_abs_diff":5.269002437591553,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.012673765420913696,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02468770742416382,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007378697395324707,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.086562832992058}},"seconds":19.10412679100409,"outside_rule_search":false},"fp16_L17":{"why":"layer 17 exact, every other layer int8","fp16_layers":[17],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04663554101716727,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08453220129013062,"mean_abs_dp":0.056354823211828865,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.927057346875541,"hidden_max_abs_diff":10.1544189453125,"questions":[{"question_id":"decision","max_abs_dp":0.08453220129013062,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5437928329920396},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02580869197845459,"mean_abs_dp":0.01720579465230306,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9918888735850203,"hidden_max_abs_diff":2.5146665573120117,"questions":[{"question_id":"decision","max_abs_dp":0.02580869197845459,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.912662624992663},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.023625850677490234,"mean_abs_dp":0.015750615547100704,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.997230743333733,"hidden_max_abs_diff":1.556511640548706,"questions":[{"question_id":"decision","max_abs_dp":0.023625850677490234,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9136065839848015},"own_j12:text":{"max_abs_dp":0.030369460582733154,"mean_abs_dp":0.004925198709735503,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9206479027052293,"hidden_max_abs_diff":4.421823024749756,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.277727127075195e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0010135024785995483,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.030369460582733154,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.000558074563741684,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.737688708992209},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.01884007453918457,"mean_abs_dp":0.012560054659843445,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9684639956390337,"hidden_max_abs_diff":5.951337814331055,"questions":[{"question_id":"decision","max_abs_dp":0.01884007453918457,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.925262291013496},"img_06:native":{"max_abs_dp":0.023379087448120117,"mean_abs_dp":0.008871262520551681,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9756624856997355,"hidden_max_abs_diff":5.041515827178955,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.01199883222579956,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.023379087448120117,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007852613925933838,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.140982499986421}},"seconds":19.220763165998505,"outside_rule_search":false},"fp16_L18":{"why":"layer 18 exact, every other layer int8","fp16_layers":[18],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04584054200677201,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08335357904434204,"mean_abs_dp":0.05556908746560415,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9242609763315143,"hidden_max_abs_diff":10.44186019897461,"questions":[{"question_id":"decision","max_abs_dp":0.08335357904434204,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5108231249905657},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.025832176208496094,"mean_abs_dp":0.017221443355083466,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9922614587520308,"hidden_max_abs_diff":2.6318235397338867,"questions":[{"question_id":"decision","max_abs_dp":0.025832176208496094,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8749866670113988},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02340000867843628,"mean_abs_dp":0.0156000517308712,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9970119173907794,"hidden_max_abs_diff":1.4679710865020752,"questions":[{"question_id":"decision","max_abs_dp":0.02340000867843628,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8735957920143846},"own_j12:text":{"max_abs_dp":0.027305960655212402,"mean_abs_dp":0.004558899511511509,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9191901285065841,"hidden_max_abs_diff":4.610203504562378,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.408112287521362e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0016242265701293945,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.027305960655212402,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005212035030126572,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.633285457995953},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.021128833293914795,"mean_abs_dp":0.014085883895556131,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9690476981942177,"hidden_max_abs_diff":5.846595764160156,"questions":[{"question_id":"decision","max_abs_dp":0.021128833293914795,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9091012499993667},"img_06:native":{"max_abs_dp":0.02459263801574707,"mean_abs_dp":0.009047536738216877,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9766451394303346,"hidden_max_abs_diff":5.840368747711182,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011944830417633057,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02459263801574707,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007731974124908447,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.11528545798501}},"seconds":18.96304883400444,"outside_rule_search":false},"fp16_L19":{"why":"layer 19 exact, every other layer int8","fp16_layers":[19],"int8_modules":241,"exact_modules":7,"int8_params":6708789248,"modules_swapped":15,"swap_seconds":0.047355957998661324,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08262395858764648,"mean_abs_dp":0.05508264650901159,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.924137864094591,"hidden_max_abs_diff":10.690254211425781,"questions":[{"question_id":"decision","max_abs_dp":0.08262395858764648,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.537508709006943},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.024899184703826904,"mean_abs_dp":0.016599419216314953,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9919336197778501,"hidden_max_abs_diff":2.330979347229004,"questions":[{"question_id":"decision","max_abs_dp":0.024899184703826904,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9162229580106214},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.0241776704788208,"mean_abs_dp":0.01611848051349322,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9972741422432643,"hidden_max_abs_diff":1.415304183959961,"questions":[{"question_id":"decision","max_abs_dp":0.0241776704788208,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9245054579805583},"own_j12:text":{"max_abs_dp":0.02941054105758667,"mean_abs_dp":0.004738514669812643,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9203259607679013,"hidden_max_abs_diff":4.4895875453948975,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00010651350021362305,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0006704479455947876,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02941054105758667,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005371794104576111,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.752456207992509},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.019611716270446777,"mean_abs_dp":0.013074499865372976,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9699992108466359,"hidden_max_abs_diff":5.714160919189453,"questions":[{"question_id":"decision","max_abs_dp":0.019611716270446777,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.925018416979583},"img_06:native":{"max_abs_dp":0.023471474647521973,"mean_abs_dp":0.008328737504780293,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9768689881442915,"hidden_max_abs_diff":5.661644458770752,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.010591566562652588,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.023471474647521973,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.006964445114135742,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.1279957910010125}},"seconds":19.231193249986973,"outside_rule_search":false},"fp16_L20":{"why":"layer 20 exact, every other layer int8","fp16_layers":[20],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":15,"swap_seconds":0.04351037499145605,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08455055952072144,"mean_abs_dp":0.05636705458164215,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9242607847154087,"hidden_max_abs_diff":10.500743865966797,"questions":[{"question_id":"decision","max_abs_dp":0.08455055952072144,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.552836249989923},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.026083290576934814,"mean_abs_dp":0.017388882736365,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9922298586427949,"hidden_max_abs_diff":2.436213731765747,"questions":[{"question_id":"decision","max_abs_dp":0.026083290576934814,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9109109159908257},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.023463785648345947,"mean_abs_dp":0.01564253866672516,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9973012628325986,"hidden_max_abs_diff":1.5612287521362305,"questions":[{"question_id":"decision","max_abs_dp":0.023463785648345947,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9146641669794917},"own_j12:text":{"max_abs_dp":0.027928948402404785,"mean_abs_dp":0.004583446452250848,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9210429432950936,"hidden_max_abs_diff":4.43255615234375,"questions":[{"question_id":"coupon_valid","max_abs_dp":6.967782974243164e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0008745193481445312,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.027928948402404785,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0007908940315246582,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.751589874998899},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.020318984985351562,"mean_abs_dp":0.013545994957288107,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9705605541686037,"hidden_max_abs_diff":5.73124885559082,"questions":[{"question_id":"decision","max_abs_dp":0.020318984985351562,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9287531659938395},"img_06:native":{"max_abs_dp":0.024344801902770996,"mean_abs_dp":0.0089313761331141,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9769120206674413,"hidden_max_abs_diff":5.3346266746521,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011513859033584595,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.024344801902770996,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007921263575553894,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.101789750013268}},"seconds":19.204214750003302,"outside_rule_search":false},"fp16_L21":{"why":"layer 21 exact, every other layer int8","fp16_layers":[21],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.07238324999343604,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08442538976669312,"mean_abs_dp":0.056283640364805855,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9243156873263533,"hidden_max_abs_diff":10.436391830444336,"questions":[{"question_id":"decision","max_abs_dp":0.08442538976669312,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.544532166008139},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02600914239883423,"mean_abs_dp":0.01733940343062083,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9921263653350978,"hidden_max_abs_diff":2.452866554260254,"questions":[{"question_id":"decision","max_abs_dp":0.02600914239883423,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8967664160009008},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02328115701675415,"mean_abs_dp":0.01552078997095426,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9972254319322589,"hidden_max_abs_diff":1.4813425540924072,"questions":[{"question_id":"decision","max_abs_dp":0.02328115701675415,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8675322919734754},"own_j12:text":{"max_abs_dp":0.0287015438079834,"mean_abs_dp":0.004678331172237029,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9209630170585837,"hidden_max_abs_diff":4.51155686378479,"questions":[{"question_id":"coupon_valid","max_abs_dp":6.99162483215332e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0009458363056182861,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.0287015438079834,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005191955715417862,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.632632291992195},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.02021610736846924,"mean_abs_dp":0.01347739746173223,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.969116551976467,"hidden_max_abs_diff":5.810823440551758,"questions":[{"question_id":"decision","max_abs_dp":0.02021610736846924,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.8832239999901503},"img_06:native":{"max_abs_dp":0.02405226230621338,"mean_abs_dp":0.008928032871335746,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9767136403083894,"hidden_max_abs_diff":5.7016921043396,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011815547943115234,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02405226230621338,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007858872413635254,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.0991109590104315}},"seconds":18.996326209016843,"outside_rule_search":false},"fp16_L22":{"why":"layer 22 exact, every other layer int8","fp16_layers":[22],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.045942500000819564,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08402222394943237,"mean_abs_dp":0.05601486066977183,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9245314920934383,"hidden_max_abs_diff":10.50119400024414,"questions":[{"question_id":"decision","max_abs_dp":0.08402222394943237,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.568889707996277},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.025966405868530273,"mean_abs_dp":0.017310904959837597,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9920474192547927,"hidden_max_abs_diff":2.494227409362793,"questions":[{"question_id":"decision","max_abs_dp":0.025966405868530273,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9126850829925388},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.023215830326080322,"mean_abs_dp":0.015477242569128672,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971941123813926,"hidden_max_abs_diff":1.5584449768066406,"questions":[{"question_id":"decision","max_abs_dp":0.023215830326080322,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9154917080013547},"own_j12:text":{"max_abs_dp":0.028859615325927734,"mean_abs_dp":0.004703163527525389,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9215754526888752,"hidden_max_abs_diff":4.446427822113037,"questions":[{"question_id":"coupon_valid","max_abs_dp":5.1569193601608276e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0010308176279067993,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028859615325927734,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005318596959114075,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.772557499993127},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.020273566246032715,"mean_abs_dp":0.013515715797742208,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9688109626061566,"hidden_max_abs_diff":5.839267730712891,"questions":[{"question_id":"decision","max_abs_dp":0.020273566246032715,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.934486833983101},"img_06:native":{"max_abs_dp":0.024794697761535645,"mean_abs_dp":0.00909894872456789,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9767359226680791,"hidden_max_abs_diff":5.584414005279541,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011903136968612671,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.024794697761535645,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007904484868049622,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.128096458007349}},"seconds":19.27828616698389,"outside_rule_search":false},"fp16_L23":{"why":"layer 23 exact, every other layer int8","fp16_layers":[23],"int8_modules":241,"exact_modules":7,"int8_params":6708789248,"modules_swapped":15,"swap_seconds":0.045559458987554535,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08434832096099854,"mean_abs_dp":0.056232236325740814,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.924679417623743,"hidden_max_abs_diff":10.561216354370117,"questions":[{"question_id":"decision","max_abs_dp":0.08434832096099854,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.563657916005468},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02606523036956787,"mean_abs_dp":0.017376792927583058,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9921182643720415,"hidden_max_abs_diff":2.4304046630859375,"questions":[{"question_id":"decision","max_abs_dp":0.02606523036956787,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9173711670155171},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.023686647415161133,"mean_abs_dp":0.015791128079096477,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971506868118325,"hidden_max_abs_diff":1.5487804412841797,"questions":[{"question_id":"decision","max_abs_dp":0.023686647415161133,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9157250830030534},"own_j12:text":{"max_abs_dp":0.028976261615753174,"mean_abs_dp":0.004693672060966492,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9209962916929247,"hidden_max_abs_diff":4.5395567417144775,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.706880569458008e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0009320676326751709,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028976261615753174,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005235262215137482,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.767218957975274},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.02009528875350952,"mean_abs_dp":0.013396854201952616,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9694557748484486,"hidden_max_abs_diff":5.781585693359375,"questions":[{"question_id":"decision","max_abs_dp":0.02009528875350952,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9399211660202127},"img_06:native":{"max_abs_dp":0.02469426393508911,"mean_abs_dp":0.009112602565437555,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9767972791206426,"hidden_max_abs_diff":5.795334815979004,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011931240558624268,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02469426393508911,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.008004173636436462,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.122497916017892}},"seconds":19.272079499991378,"outside_rule_search":false},"fp16_L24":{"why":"layer 24 exact, every other layer int8","fp16_layers":[24],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":15,"swap_seconds":0.045523625012720004,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08405613899230957,"mean_abs_dp":0.056037455797195435,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9244846436939531,"hidden_max_abs_diff":10.470014572143555,"questions":[{"question_id":"decision","max_abs_dp":0.08405613899230957,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5571384170034435},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.025851190090179443,"mean_abs_dp":0.01723410189151764,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9920524403130022,"hidden_max_abs_diff":2.4494924545288086,"questions":[{"question_id":"decision","max_abs_dp":0.025851190090179443,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9353559169976506},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.0234982967376709,"mean_abs_dp":0.015665569653113682,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971928419573961,"hidden_max_abs_diff":1.5780029296875,"questions":[{"question_id":"decision","max_abs_dp":0.0234982967376709,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9159597080142703},"own_j12:text":{"max_abs_dp":0.029391825199127197,"mean_abs_dp":0.00474827134838471,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9206979327183646,"hidden_max_abs_diff":4.421766757965088,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.374025881290436e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0007878988981246948,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.029391825199127197,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005453582853078842,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.624321040988434},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.02012002468109131,"mean_abs_dp":0.013413357237974802,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9696846896563739,"hidden_max_abs_diff":5.824247360229492,"questions":[{"question_id":"decision","max_abs_dp":0.02012002468109131,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.885064499976579},"img_06:native":{"max_abs_dp":0.024089276790618896,"mean_abs_dp":0.008910276927053928,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9767379902405793,"hidden_max_abs_diff":5.556390762329102,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011766374111175537,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.024089276790618896,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0078090280294418335,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.059026417002315}},"seconds":19.022530874994118,"outside_rule_search":false},"fp16_L25":{"why":"layer 25 exact, every other layer int8","fp16_layers":[25],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04689312502159737,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08420908451080322,"mean_abs_dp":0.05613940209150314,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9245158266686123,"hidden_max_abs_diff":10.461503982543945,"questions":[{"question_id":"decision","max_abs_dp":0.08420908451080322,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.555393666989403},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02581334114074707,"mean_abs_dp":0.01720888912677765,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9921290267199903,"hidden_max_abs_diff":2.406062126159668,"questions":[{"question_id":"decision","max_abs_dp":0.02581334114074707,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.916353375010658},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.023327171802520752,"mean_abs_dp":0.015551482637723288,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971595455119132,"hidden_max_abs_diff":1.5182151794433594,"questions":[{"question_id":"decision","max_abs_dp":0.023327171802520752,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9221228749956936},"own_j12:text":{"max_abs_dp":0.028908193111419678,"mean_abs_dp":0.004678346073398223,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9206893839976978,"hidden_max_abs_diff":4.439675569534302,"questions":[{"question_id":"coupon_valid","max_abs_dp":6.717443466186523e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0008886605501174927,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028908193111419678,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005242768675088882,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.70495095802471},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.02039492130279541,"mean_abs_dp":0.013596641520659128,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9694202442185406,"hidden_max_abs_diff":5.859931945800781,"questions":[{"question_id":"decision","max_abs_dp":0.02039492130279541,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9360310420161113},"img_06:native":{"max_abs_dp":0.02455770969390869,"mean_abs_dp":0.009040924347937107,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9767684246765822,"hidden_max_abs_diff":5.691592693328857,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.01189267635345459,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02455770969390869,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007856860756874084,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.125979500007816}},"seconds":19.207857041998068,"outside_rule_search":false},"fp16_L26":{"why":"layer 26 exact, every other layer int8","fp16_layers":[26],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.045979708986124024,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08422261476516724,"mean_abs_dp":0.05614842722813288,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9243821978223078,"hidden_max_abs_diff":10.521455764770508,"questions":[{"question_id":"decision","max_abs_dp":0.08422261476516724,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5526740409841295},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.026024580001831055,"mean_abs_dp":0.017349715034166973,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9921258321135287,"hidden_max_abs_diff":2.4561777114868164,"questions":[{"question_id":"decision","max_abs_dp":0.026024580001831055,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9122921249945648},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.0233229398727417,"mean_abs_dp":0.015548655142386755,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.997164279504693,"hidden_max_abs_diff":1.5698754787445068,"questions":[{"question_id":"decision","max_abs_dp":0.0233229398727417,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9253906660014763},"own_j12:text":{"max_abs_dp":0.028418898582458496,"mean_abs_dp":0.004600867772331605,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9205746430153123,"hidden_max_abs_diff":4.50699520111084,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.844343781471252e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0008940249681472778,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028418898582458496,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005142092704772949,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.74852287498652},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.020271480083465576,"mean_abs_dp":0.013514305154482523,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9693319251533632,"hidden_max_abs_diff":5.848468780517578,"questions":[{"question_id":"decision","max_abs_dp":0.020271480083465576,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9371767499833368},"img_06:native":{"max_abs_dp":0.02445763349533081,"mean_abs_dp":0.008973831683397293,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9767623761805394,"hidden_max_abs_diff":5.653034687042236,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011809468269348145,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02445763349533081,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007736384868621826,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.133019542001421}},"seconds":19.255197166989092,"outside_rule_search":false},"fp16_L27":{"why":"layer 27 exact, every other layer int8","fp16_layers":[27],"int8_modules":241,"exact_modules":7,"int8_params":6708789248,"modules_swapped":15,"swap_seconds":0.045683917007409036,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08431774377822876,"mean_abs_dp":0.05621187388896942,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9245340407408357,"hidden_max_abs_diff":10.456441879272461,"questions":[{"question_id":"decision","max_abs_dp":0.08431774377822876,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5512587499979418},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.026037991046905518,"mean_abs_dp":0.017358603576819103,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9920661530077859,"hidden_max_abs_diff":2.4737157821655273,"questions":[{"question_id":"decision","max_abs_dp":0.026037991046905518,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9209079580032267},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.023367762565612793,"mean_abs_dp":0.015578529487053553,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971712907515391,"hidden_max_abs_diff":1.4935047626495361,"questions":[{"question_id":"decision","max_abs_dp":0.023367762565612793,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.937847207998857},"own_j12:text":{"max_abs_dp":0.02902829647064209,"mean_abs_dp":0.004686469498735208,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9203366633550759,"hidden_max_abs_diff":4.331450939178467,"questions":[{"question_id":"coupon_valid","max_abs_dp":8.02651047706604e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0007729530334472656,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02902829647064209,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005387589335441589,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.689773250021972},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.020277321338653564,"mean_abs_dp":0.013518201808134714,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9690794813285599,"hidden_max_abs_diff":5.873971939086914,"questions":[{"question_id":"decision","max_abs_dp":0.020277321338653564,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9011866670043673},"img_06:native":{"max_abs_dp":0.024083435535430908,"mean_abs_dp":0.008943679090589286,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9767759835050878,"hidden_max_abs_diff":5.683481216430664,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011882960796356201,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.024083435535430908,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007804542779922485,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.02685150000616}},"seconds":19.07363975001499,"outside_rule_search":false},"fp16_L28":{"why":"layer 28 exact, every other layer int8","fp16_layers":[28],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":15,"swap_seconds":0.0443247499933932,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08427363634109497,"mean_abs_dp":0.05618241677681605,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9244479684759329,"hidden_max_abs_diff":10.533056259155273,"questions":[{"question_id":"decision","max_abs_dp":0.08427363634109497,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.538849583012052},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.025905609130859375,"mean_abs_dp":0.017270388702551525,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9920300676047893,"hidden_max_abs_diff":2.4892120361328125,"questions":[{"question_id":"decision","max_abs_dp":0.025905609130859375,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8685199999890756},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.023457765579223633,"mean_abs_dp":0.015638557573159535,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9972120312507698,"hidden_max_abs_diff":1.4955787658691406,"questions":[{"question_id":"decision","max_abs_dp":0.023457765579223633,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8837419159826823},"own_j12:text":{"max_abs_dp":0.028718769550323486,"mean_abs_dp":0.0046749587815541485,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9208816352390248,"hidden_max_abs_diff":4.500844478607178,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.784366607666016e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0009918808937072754,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028718769550323486,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005160197615623474,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.750440500007244},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.020406901836395264,"mean_abs_dp":0.013604583839575449,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9693110525232911,"hidden_max_abs_diff":5.8037872314453125,"questions":[{"question_id":"decision","max_abs_dp":0.020406901836395264,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9337542499997653},"img_06:native":{"max_abs_dp":0.024395465850830078,"mean_abs_dp":0.008957607578486204,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9767160674875871,"hidden_max_abs_diff":5.588406562805176,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011737525463104248,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.024395465850830078,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0077634453773498535,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.135582916002022}},"seconds":19.155350458982866,"outside_rule_search":false},"fp16_L29":{"why":"layer 29 exact, every other layer int8","fp16_layers":[29],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04630854201968759,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08419311046600342,"mean_abs_dp":0.056128782530625664,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9244182721616793,"hidden_max_abs_diff":10.566022872924805,"questions":[{"question_id":"decision","max_abs_dp":0.08419311046600342,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.552561541990144},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02585744857788086,"mean_abs_dp":0.01723828911781311,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9921579285093128,"hidden_max_abs_diff":2.4337282180786133,"questions":[{"question_id":"decision","max_abs_dp":0.02585744857788086,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.910905750002712},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02354508638381958,"mean_abs_dp":0.015696744124094646,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971889113508013,"hidden_max_abs_diff":1.5747604370117188,"questions":[{"question_id":"decision","max_abs_dp":0.02354508638381958,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9198528330016416},"own_j12:text":{"max_abs_dp":0.028786957263946533,"mean_abs_dp":0.004637323319911957,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9207375465750047,"hidden_max_abs_diff":4.47558856010437,"questions":[{"question_id":"coupon_valid","max_abs_dp":8.163414895534515e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0007554441690444946,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028786957263946533,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005185995250940323,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.75821050000377},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.020302116870880127,"mean_abs_dp":0.01353476196527481,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9691758784993962,"hidden_max_abs_diff":5.865238189697266,"questions":[{"question_id":"decision","max_abs_dp":0.020302116870880127,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9220791249827016},"img_06:native":{"max_abs_dp":0.024474918842315674,"mean_abs_dp":0.008970611821860075,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9766900519956596,"hidden_max_abs_diff":5.645697593688965,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011906027793884277,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.024474918842315674,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007606223225593567,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.128159749991028}},"seconds":19.23821529201814,"outside_rule_search":false},"fp16_L30":{"why":"layer 30 exact, every other layer int8","fp16_layers":[30],"int8_modules":240,"exact_modules":8,"int8_params":6700138496,"modules_swapped":16,"swap_seconds":0.04711899999529123,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08410143852233887,"mean_abs_dp":0.056067650516827904,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9244530359290353,"hidden_max_abs_diff":10.512765884399414,"questions":[{"question_id":"decision","max_abs_dp":0.08410143852233887,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5504339579783846},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.025811612606048584,"mean_abs_dp":0.017207741737365723,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9921426839099752,"hidden_max_abs_diff":2.4630041122436523,"questions":[{"question_id":"decision","max_abs_dp":0.025811612606048584,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8937275829957798},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.023518860340118408,"mean_abs_dp":0.01567925636967023,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971734403026288,"hidden_max_abs_diff":1.5124340057373047,"questions":[{"question_id":"decision","max_abs_dp":0.023518860340118408,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9160411249904428},"own_j12:text":{"max_abs_dp":0.028872787952423096,"mean_abs_dp":0.00468371593608306,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9209664527533661,"hidden_max_abs_diff":4.450557231903076,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.18832015991211e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0009119361639022827,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028872787952423096,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005325209349393845,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.72724224999547},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.020470738410949707,"mean_abs_dp":0.013647191226482391,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9691627752785897,"hidden_max_abs_diff":5.846778869628906,"questions":[{"question_id":"decision","max_abs_dp":0.020470738410949707,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.8865914170164615},"img_06:native":{"max_abs_dp":0.024316012859344482,"mean_abs_dp":0.0089350251480937,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9767330609384586,"hidden_max_abs_diff":5.708695888519287,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011752963066101074,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.024316012859344482,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007704839110374451,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.02382529102033}},"seconds":19.045154665975133,"outside_rule_search":false},"fp16_L31":{"why":"layer 31 exact, every other layer int8","fp16_layers":[31],"int8_modules":241,"exact_modules":7,"int8_params":6708789248,"modules_swapped":15,"swap_seconds":0.046790666005108505,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08426833152770996,"mean_abs_dp":0.0561789075533549,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9245727885085733,"hidden_max_abs_diff":10.445690155029297,"questions":[{"question_id":"decision","max_abs_dp":0.08426833152770996,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.504282832989702},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.02603459358215332,"mean_abs_dp":0.017356378336747486,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9920857015803681,"hidden_max_abs_diff":2.448897361755371,"questions":[{"question_id":"decision","max_abs_dp":0.02603459358215332,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9044754579954315},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.02344280481338501,"mean_abs_dp":0.015628570069869358,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971948645877081,"hidden_max_abs_diff":1.590266227722168,"questions":[{"question_id":"decision","max_abs_dp":0.02344280481338501,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9205028750002384},"own_j12:text":{"max_abs_dp":0.028575658798217773,"mean_abs_dp":0.004640823373427758,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9210142714038383,"hidden_max_abs_diff":4.522616386413574,"questions":[{"question_id":"coupon_valid","max_abs_dp":8.692033588886261e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0009838491678237915,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028575658798217773,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0004910249263048172,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.756196666014148},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.02060103416442871,"mean_abs_dp":0.013734025259812674,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9694600568596984,"hidden_max_abs_diff":5.826536178588867,"questions":[{"question_id":"decision","max_abs_dp":0.02060103416442871,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.922562374995323},"img_06:native":{"max_abs_dp":0.024319589138031006,"mean_abs_dp":0.008964516129344702,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.976748684391692,"hidden_max_abs_diff":5.659658432006836,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.011796176433563232,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.024319589138031006,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007822409272193909,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.1261249580129515}},"seconds":19.18107400002191,"outside_rule_search":false},"fp16_set_L06_L09":{"why":"layers [6, 9] exact, every other layer int8","fp16_layers":[6,9],"int8_modules":232,"exact_modules":16,"int8_params":6481772544,"modules_swapped":23,"swap_seconds":0.06918787499307655,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.02093791961669922,"mean_abs_dp":0.013958642880121866,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9939008640901937,"hidden_max_abs_diff":2.3480682373046875,"questions":[{"question_id":"decision","max_abs_dp":0.02093791961669922,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5513739589951},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.028418660163879395,"mean_abs_dp":0.018945736189683277,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9923188378029214,"hidden_max_abs_diff":2.6306557655334473,"questions":[{"question_id":"decision","max_abs_dp":0.028418660163879395,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.923187708016485},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.021698713302612305,"mean_abs_dp":0.01446584239602089,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.993926048679668,"hidden_max_abs_diff":3.519667625427246,"questions":[{"question_id":"decision","max_abs_dp":0.021698713302612305,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.917137750016991},"own_j12:text":{"max_abs_dp":0.028065502643585205,"mean_abs_dp":0.004641026258468628,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.937268688921861,"hidden_max_abs_diff":3.4456653594970703,"questions":[{"question_id":"coupon_valid","max_abs_dp":2.7418136596679688e-06,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0015269964933395386,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.028065502643585205,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005714036524295807,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.755447750008898},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.019638895988464355,"mean_abs_dp":0.013092614710330963,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9701959094404545,"hidden_max_abs_diff":5.698280334472656,"questions":[{"question_id":"decision","max_abs_dp":0.019638895988464355,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9322717909817584},"img_06:native":{"max_abs_dp":0.023213446140289307,"mean_abs_dp":0.008216878585517406,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.978370853916709,"hidden_max_abs_diff":4.520304203033447,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.009719222784042358,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.023213446140289307,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007419899106025696,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.131107624998549}},"seconds":19.27985608400195,"outside_rule_search":false},"fp16_set_L04_L06_L09":{"why":"layers [4, 6, 9] exact, every other layer int8","fp16_layers":[4,6,9],"int8_modules":224,"exact_modules":24,"int8_params":6263406592,"modules_swapped":8,"swap_seconds":0.024926916987169534,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.003751605749130249,"mean_abs_dp":0.002501097818215688,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9981453182668429,"hidden_max_abs_diff":1.3958415985107422,"questions":[{"question_id":"decision","max_abs_dp":0.003751605749130249,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5579970410035457},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.027673542499542236,"mean_abs_dp":0.018449013431866963,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9931828459458766,"hidden_max_abs_diff":2.6761908531188965,"questions":[{"question_id":"decision","max_abs_dp":0.027673542499542236,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9075642920215614},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.020009219646453857,"mean_abs_dp":0.013339494665463766,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9965072850791863,"hidden_max_abs_diff":2.814877510070801,"questions":[{"question_id":"decision","max_abs_dp":0.020009219646453857,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9149309160129633},"own_j12:text":{"max_abs_dp":0.02747368812561035,"mean_abs_dp":0.004639384838250967,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9518713827631257,"hidden_max_abs_diff":3.228329658508301,"questions":[{"question_id":"coupon_valid","max_abs_dp":5.317851901054382e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.001447826623916626,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02747368812561035,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0011812150478363037,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.708018332981737},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.016659855842590332,"mean_abs_dp":0.011106578012307486,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9694115315297178,"hidden_max_abs_diff":5.684577941894531,"questions":[{"question_id":"decision","max_abs_dp":0.016659855842590332,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9320883750042412},"img_06:native":{"max_abs_dp":0.022502422332763672,"mean_abs_dp":0.00786722768098116,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9814128770301775,"hidden_max_abs_diff":4.0807390213012695,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.009177029132843018,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.022502422332763672,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007076844573020935,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.003377125016414}},"seconds":19.04903270798968,"outside_rule_search":false},"fp16_set_L04_L06_L09_L10":{"why":"layers [4, 6, 9, 10] exact, every other layer int8","fp16_layers":[4,6,9,10],"int8_modules":216,"exact_modules":32,"int8_params":6045040640,"modules_swapped":8,"swap_seconds":0.023037999984808266,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.01961219310760498,"mean_abs_dp":0.013074773053328196,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9965499534693045,"hidden_max_abs_diff":4.4825944900512695,"questions":[{"question_id":"decision","max_abs_dp":0.01961219310760498,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5031986249960028},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.022242486476898193,"mean_abs_dp":0.014828292032082876,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9947999349790112,"hidden_max_abs_diff":2.1771035194396973,"questions":[{"question_id":"decision","max_abs_dp":0.022242486476898193,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.87605220801197},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.020944058895111084,"mean_abs_dp":0.013962740699450174,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9950695076900556,"hidden_max_abs_diff":2.543776273727417,"questions":[{"question_id":"decision","max_abs_dp":0.020944058895111084,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8898174999922048},"own_j12:text":{"max_abs_dp":0.02598893642425537,"mean_abs_dp":0.004281211357850295,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9580659805064327,"hidden_max_abs_diff":3.4159772396087646,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.0001327991485595703,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.001170620322227478,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02598893642425537,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005355533212423325,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.7541975830099545},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.02462106943130493,"mean_abs_dp":0.016414043804009754,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9720162312520132,"hidden_max_abs_diff":5.368356704711914,"questions":[{"question_id":"decision","max_abs_dp":0.02462106943130493,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9349232089880388},"img_06:native":{"max_abs_dp":0.02140122652053833,"mean_abs_dp":0.008085789903998376,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9833353107878255,"hidden_max_abs_diff":3.312816619873047,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.010862410068511963,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02140122652053833,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007017210125923157,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.109413708996726}},"seconds":19.090759791986784,"outside_rule_search":false},"fp16_set_L04_L06_L09_L10_L11":{"why":"layers [4, 6, 9, 10, 11] exact, every other layer int8","fp16_layers":[4,6,9,10,11],"int8_modules":209,"exact_modules":39,"int8_params":5835325440,"modules_swapped":7,"swap_seconds":0.02242833300260827,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.02928537130355835,"mean_abs_dp":0.019523543616135914,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9936625127053467,"hidden_max_abs_diff":6.391570091247559,"questions":[{"question_id":"decision","max_abs_dp":0.02928537130355835,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.545267084002262},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.013353943824768066,"mean_abs_dp":0.008902606864770254,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9954177490356182,"hidden_max_abs_diff":1.7826199531555176,"questions":[{"question_id":"decision","max_abs_dp":0.013353943824768066,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.913927749992581},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.019093990325927734,"mean_abs_dp":0.012729339301586151,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9929600320892635,"hidden_max_abs_diff":2.8572299480438232,"questions":[{"question_id":"decision","max_abs_dp":0.019093990325927734,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.917356583988294},"own_j12:text":{"max_abs_dp":0.026499629020690918,"mean_abs_dp":0.004568168606895667,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9637959000193366,"hidden_max_abs_diff":3.241353988647461,"questions":[{"question_id":"coupon_valid","max_abs_dp":8.231401443481445e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0016231536865234375,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.026499629020690918,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0014879554510116577,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.731845041998895},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.029588282108306885,"mean_abs_dp":0.019725521405537922,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9675905390612884,"hidden_max_abs_diff":5.839405059814453,"questions":[{"question_id":"decision","max_abs_dp":0.029588282108306885,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9311593339953106},"img_06:native":{"max_abs_dp":0.011475563049316406,"mean_abs_dp":0.004746013320982456,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9842780900593228,"hidden_max_abs_diff":3.723857879638672,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.006074070930480957,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.011475563049316406,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.005395621061325073,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.081631082983222}},"seconds":19.143724166002357,"outside_rule_search":false},"fp16_set_L00_L04_L06_L09_L10_L11":{"why":"layers [0, 4, 6, 9, 10, 11] exact, every other layer int8","fp16_layers":[0,4,6,9,10,11],"int8_modules":201,"exact_modules":47,"int8_params":5616959488,"modules_swapped":8,"swap_seconds":0.023811666993424296,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.03503149747848511,"mean_abs_dp":0.023354319234689076,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9884470457646755,"hidden_max_abs_diff":7.209944725036621,"questions":[{"question_id":"decision","max_abs_dp":0.03503149747848511,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.48294287500903},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.004841625690460205,"mean_abs_dp":0.0032277355591456094,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9941971097947486,"hidden_max_abs_diff":1.94964599609375,"questions":[{"question_id":"decision","max_abs_dp":0.004841625690460205,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9079912500164937},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.0065392255783081055,"mean_abs_dp":0.004359503587086995,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9873513441414682,"hidden_max_abs_diff":3.1133882999420166,"questions":[{"question_id":"decision","max_abs_dp":0.0065392255783081055,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.8982670420082286},"own_j12:text":{"max_abs_dp":0.01312488317489624,"mean_abs_dp":0.002769647595974115,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9932256654297231,"hidden_max_abs_diff":1.865518569946289,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00014107488095760345,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0031975507736206055,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.01312488317489624,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0015392452478408813,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.711188417015364},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.021201372146606445,"mean_abs_dp":0.014134255548318228,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9580798330246602,"hidden_max_abs_diff":6.459400177001953,"questions":[{"question_id":"decision","max_abs_dp":0.021201372146606445,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9417512080108281},"img_06:native":{"max_abs_dp":0.0076637864112854,"mean_abs_dp":0.003251132182776928,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9932231661571417,"hidden_max_abs_diff":4.269066333770752,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.004351198673248291,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.0076637864112854,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0028659850358963013,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.051575541991042}},"seconds":19.01764804200502,"outside_rule_search":false},"fp16_L00-03":{"why":"layers 0-3 exact, every other layer int8","fp16_layers":[0,1,2,3],"int8_modules":217,"exact_modules":31,"int8_params":6053691392,"modules_swapped":217,"swap_seconds":1.829327084007673,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.11185729503631592,"mean_abs_dp":0.07457156479358673,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.8936419690767149,"hidden_max_abs_diff":14.658912658691406,"questions":[{"question_id":"decision","max_abs_dp":0.11185729503631592,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":3.649809249996906},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.023159503936767578,"mean_abs_dp":0.015439656873544058,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9938023241064724,"hidden_max_abs_diff":3.0906200408935547,"questions":[{"question_id":"decision","max_abs_dp":0.023159503936767578,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9263311250251718},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.00737994909286499,"mean_abs_dp":0.004919993380705516,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9981201150287256,"hidden_max_abs_diff":1.3805546760559082,"questions":[{"question_id":"decision","max_abs_dp":0.00737994909286499,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9112171249871608},"own_j12:text":{"max_abs_dp":0.018179357051849365,"mean_abs_dp":0.003140589795433558,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9436873982348283,"hidden_max_abs_diff":3.072606086730957,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00016201287508010864,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.00027552247047424316,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.018179357051849365,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0016090869903564453,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.776593624992529},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.010941803455352783,"mean_abs_dp":0.0072945281863212585,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9631276026226386,"hidden_max_abs_diff":6.271024703979492,"questions":[{"question_id":"decision","max_abs_dp":0.010941803455352783,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.8922508749819826},"img_06:native":{"max_abs_dp":0.018950045108795166,"mean_abs_dp":0.006697129551321268,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9933596663821166,"hidden_max_abs_diff":4.183067321777344,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.008741617202758789,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.018950045108795166,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.004902556538581848,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.014336583000841}},"seconds":22.00002929198672,"outside_rule_search":true},"fp16_L00-05":{"why":"layers 0-5 exact, every other layer int8","fp16_layers":[0,1,2,3,4,5],"int8_modules":201,"exact_modules":47,"int8_params":5616959488,"modules_swapped":16,"swap_seconds":0.0565497080096975,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.08937186002731323,"mean_abs_dp":0.059581292172273,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9293351999860007,"hidden_max_abs_diff":12.00584602355957,"questions":[{"question_id":"decision","max_abs_dp":0.08937186002731323,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.4907752080180217},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.01882922649383545,"mean_abs_dp":0.012552802761395773,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9959492865478459,"hidden_max_abs_diff":2.68040132522583,"questions":[{"question_id":"decision","max_abs_dp":0.01882922649383545,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9012171250069514},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.006310880184173584,"mean_abs_dp":0.004207278291384379,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9982479504633828,"hidden_max_abs_diff":1.4813032150268555,"questions":[{"question_id":"decision","max_abs_dp":0.006310880184173584,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9434788749786094},"own_j12:text":{"max_abs_dp":0.013892412185668945,"mean_abs_dp":0.002285312144802167,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9644875165941474,"hidden_max_abs_diff":2.1662750244140625,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00018064863979816437,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0005011186003684998,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.013892412185668945,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.00023251771926879883,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.744422499992652},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.013011753559112549,"mean_abs_dp":0.008674487471580505,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.987528868251672,"hidden_max_abs_diff":3.8549346923828125,"questions":[{"question_id":"decision","max_abs_dp":0.013011753559112549,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.933953665982699},"img_06:native":{"max_abs_dp":0.01926898956298828,"mean_abs_dp":0.006494282651692629,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9943079945071314,"hidden_max_abs_diff":3.8835744857788086,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.007976889610290527,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.01926898956298828,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.004190266132354736,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.10878804200911}},"seconds":19.179309708008077,"outside_rule_search":true},"fp16_L00-07":{"why":"layers 0-7 exact, every other layer int8","fp16_layers":[0,1,2,3,4,5,6,7],"int8_modules":186,"exact_modules":62,"int8_params":5188878336,"modules_swapped":15,"swap_seconds":0.06065999998827465,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.05677211284637451,"mean_abs_dp":0.03784808764855067,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9697709822676545,"hidden_max_abs_diff":7.916438102722168,"questions":[{"question_id":"decision","max_abs_dp":0.05677211284637451,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.516672416997608},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.011755108833312988,"mean_abs_dp":0.007836719353993734,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9984251225341894,"hidden_max_abs_diff":1.6771063804626465,"questions":[{"question_id":"decision","max_abs_dp":0.011755108833312988,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9116233330278192},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.006292134523391724,"mean_abs_dp":0.0041947873930136366,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9970878457692777,"hidden_max_abs_diff":2.592789649963379,"questions":[{"question_id":"decision","max_abs_dp":0.006292134523391724,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9093886670016218},"own_j12:text":{"max_abs_dp":0.010497808456420898,"mean_abs_dp":0.001758574006649164,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9954412958958964,"hidden_max_abs_diff":1.3988819122314453,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00018292665481567383,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.00045204535126686096,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.010497808456420898,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0002207774668931961,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.649907834012993},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.010197162628173828,"mean_abs_dp":0.006798113385836284,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9966788130446208,"hidden_max_abs_diff":1.9134190082550049,"questions":[{"question_id":"decision","max_abs_dp":0.010197162628173828,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9252641659986693},"img_06:native":{"max_abs_dp":0.012583911418914795,"mean_abs_dp":0.003736138716340065,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9975299906014329,"hidden_max_abs_diff":2.299912452697754,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.004319310188293457,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.012583911418914795,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0012423843145370483,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.106030082999496}},"seconds":19.079658374976134,"outside_rule_search":true},"fp16_L00-11":{"why":"layers 0-11 exact, every other layer int8","fp16_layers":[0,1,2,3,4,5,6,7,8,9,10,11],"int8_modules":155,"exact_modules":93,"int8_params":4324065280,"modules_swapped":31,"swap_seconds":0.12096358300186694,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.006188809871673584,"mean_abs_dp":0.004125883181889852,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9990167076637418,"hidden_max_abs_diff":0.6911756992340088,"questions":[{"question_id":"decision","max_abs_dp":0.006188809871673584,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5449617500125896},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.0038837790489196777,"mean_abs_dp":0.0025891785820325217,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9993795936895657,"hidden_max_abs_diff":0.9453530311584473,"questions":[{"question_id":"decision","max_abs_dp":0.0038837790489196777,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9090811249916442},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.001364201307296753,"mean_abs_dp":0.0009094861646493276,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9987236271880005,"hidden_max_abs_diff":1.2139673233032227,"questions":[{"question_id":"decision","max_abs_dp":0.001364201307296753,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9101624159957282},"own_j12:text":{"max_abs_dp":0.006854116916656494,"mean_abs_dp":0.0015135416044638706,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9993330962296704,"hidden_max_abs_diff":1.1317901611328125,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00013270042836666107,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0020328164100646973,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.006854116916656494,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0008183717727661133,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.721657250018325},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.005394399166107178,"mean_abs_dp":0.003596268594264984,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9989409486236192,"hidden_max_abs_diff":1.6294529438018799,"questions":[{"question_id":"decision","max_abs_dp":0.005394399166107178,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9205287079967093},"img_06:native":{"max_abs_dp":0.00046193599700927734,"mean_abs_dp":0.00021205274388194084,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9996363421186525,"hidden_max_abs_diff":0.8766574859619141,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.0002468228340148926,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.00046193599700927734,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0002337619662284851,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.106394542002818}},"seconds":19.233851083001355,"outside_rule_search":true},"fp16_L04-15":{"why":"layers 4-15 exact, every other layer int8","fp16_layers":[4,5,6,7,8,9,10,11,12,13,14,15],"int8_modules":155,"exact_modules":93,"int8_params":4324065280,"modules_swapped":62,"swap_seconds":0.23404141701757908,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.02069467306137085,"mean_abs_dp":0.013796426355838776,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.996574591841444,"hidden_max_abs_diff":4.707385063171387,"questions":[{"question_id":"decision","max_abs_dp":0.02069467306137085,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.547075375012355},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.0018558502197265625,"mean_abs_dp":0.0012372061610221863,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9973460356955322,"hidden_max_abs_diff":1.5652961730957031,"questions":[{"question_id":"decision","max_abs_dp":0.0018558502197265625,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9142231669975445},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.017297446727752686,"mean_abs_dp":0.011531605074803034,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9973491169879678,"hidden_max_abs_diff":1.355602502822876,"questions":[{"question_id":"decision","max_abs_dp":0.017297446727752686,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.902566333010327},"own_j12:text":{"max_abs_dp":0.013640046119689941,"mean_abs_dp":0.0026649987468352686,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9628498531880781,"hidden_max_abs_diff":5.20383095741272,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.0001017451286315918,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0010325908660888672,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.013640046119689941,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0024719685316085815,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.732375999999931},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.00905752182006836,"mean_abs_dp":0.006038350363572438,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9971061271429562,"hidden_max_abs_diff":1.086797196418047,"questions":[{"question_id":"decision","max_abs_dp":0.00905752182006836,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9195555000042077},"img_06:native":{"max_abs_dp":0.007092773914337158,"mean_abs_dp":0.002801051363348961,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9919577257914661,"hidden_max_abs_diff":2.1782474517822266,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.00331038236618042,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.007092773914337158,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0035302937030792236,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.10444391699275}},"seconds":19.354374000016833,"outside_rule_search":true},"fp16_L08-15":{"why":"layers 8-15 exact, every other layer int8","fp16_layers":[8,9,10,11,12,13,14,15],"int8_modules":186,"exact_modules":62,"int8_params":5188878336,"modules_swapped":31,"swap_seconds":0.09324025001842529,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.02382826805114746,"mean_abs_dp":0.015885529418786366,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9932535088811272,"hidden_max_abs_diff":1.9008045196533203,"questions":[{"question_id":"decision","max_abs_dp":0.02382826805114746,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.548410041985335},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.012128174304962158,"mean_abs_dp":0.008085439602533976,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9917546717008843,"hidden_max_abs_diff":1.5511913299560547,"questions":[{"question_id":"decision","max_abs_dp":0.012128174304962158,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9084172079747077},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.029603779315948486,"mean_abs_dp":0.019735872745513916,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9927391651434645,"hidden_max_abs_diff":1.6931095123291016,"questions":[{"question_id":"decision","max_abs_dp":0.029603779315948486,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.906718665995868},"own_j12:text":{"max_abs_dp":0.020440220832824707,"mean_abs_dp":0.0035535367922141002,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9398250823473937,"hidden_max_abs_diff":4.425274133682251,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00011551380157470703,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0014243721961975098,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.020440220832824707,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0011179447174072266,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.667476250004256},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.026193976402282715,"mean_abs_dp":0.01746265838543574,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9658603659391561,"hidden_max_abs_diff":5.995702743530273,"questions":[{"question_id":"decision","max_abs_dp":0.026193976402282715,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9291485419962555},"img_06:native":{"max_abs_dp":0.013058602809906006,"mean_abs_dp":0.005618766136467457,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9792184099265079,"hidden_max_abs_diff":3.650432586669922,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.007798433303833008,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.013058602809906006,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.007157161831855774,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.0952679160109255}},"seconds":19.148792874999344,"outside_rule_search":true},"fp16_L12-15":{"why":"layers 12-15 exact, every other layer int8","fp16_layers":[12,13,14,15],"int8_modules":217,"exact_modules":31,"int8_params":6053691392,"modules_swapped":31,"swap_seconds":0.09217008299310692,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.09392178058624268,"mean_abs_dp":0.06261454274257024,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9112559929591892,"hidden_max_abs_diff":11.024337768554688,"questions":[{"question_id":"decision","max_abs_dp":0.09392178058624268,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.53743545798352},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.021242141723632812,"mean_abs_dp":0.014161388079325357,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9905051279487658,"hidden_max_abs_diff":2.4986820220947266,"questions":[{"question_id":"decision","max_abs_dp":0.021242141723632812,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9084849589853548},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.022118210792541504,"mean_abs_dp":0.01474550242225329,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9976260777355918,"hidden_max_abs_diff":1.9813957214355469,"questions":[{"question_id":"decision","max_abs_dp":0.022118210792541504,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9095516249944922},"own_j12:text":{"max_abs_dp":0.02474457025527954,"mean_abs_dp":0.004254370927810669,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9225499856027515,"hidden_max_abs_diff":4.696765422821045,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.30752944946289e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0005486607551574707,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02474457025527954,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.00185471773147583,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.695594708027784},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.013468682765960693,"mean_abs_dp":0.008979114393393198,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9686555601209866,"hidden_max_abs_diff":5.813592910766602,"questions":[{"question_id":"decision","max_abs_dp":0.013468682765960693,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.938842042000033},"img_06:native":{"max_abs_dp":0.02555638551712036,"mean_abs_dp":0.009235948417335748,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9754637671676387,"hidden_max_abs_diff":5.708376407623291,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.01203829050064087,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.02555638551712036,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.00843384861946106,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.036940500023775}},"seconds":19.119151499995496,"outside_rule_search":true},"first16_gdn_exact":{"why":"the gdn linears of layers 0-15 exact, every other linear int8","fp16_layers":null,"int8_modules":188,"exact_modules":60,"int8_params":6110052352,"modules_swapped":61,"swap_seconds":0.14486699999542907,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.007463037967681885,"mean_abs_dp":0.0049753859639167786,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9986740126377974,"hidden_max_abs_diff":1.0632858276367188,"questions":[{"question_id":"decision","max_abs_dp":0.007463037967681885,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.490253790980205},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.015871107578277588,"mean_abs_dp":0.01058075080315272,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9975313198831292,"hidden_max_abs_diff":1.8240070343017578,"questions":[{"question_id":"decision","max_abs_dp":0.015871107578277588,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.8769815409905277},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.004230797290802002,"mean_abs_dp":0.002820561329523722,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9979895459675646,"hidden_max_abs_diff":0.9735536575317383,"questions":[{"question_id":"decision","max_abs_dp":0.004230797290802002,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.867143000010401},"own_j12:text":{"max_abs_dp":0.006757795810699463,"mean_abs_dp":0.0017526538039629275,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9932148197332653,"hidden_max_abs_diff":1.9522247314453125,"questions":[{"question_id":"coupon_valid","max_abs_dp":3.0338764190673828e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0017743706703186035,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.006757795810699463,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0028297454118728638,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.692409708019113},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.005502656102180481,"mean_abs_dp":0.0036684349179267883,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9979384607317937,"hidden_max_abs_diff":1.7243213653564453,"questions":[{"question_id":"decision","max_abs_dp":0.005502656102180481,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9224726670072414},"img_06:native":{"max_abs_dp":0.022944748401641846,"mean_abs_dp":0.007990891207009554,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.980154861088865,"hidden_max_abs_diff":4.6018757820129395,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.010056555271148682,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.022944748401641846,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.005016013979911804,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.1030227079754695}},"seconds":19.097267500008456,"outside_rule_search":true},"first16_mlp_exact":{"why":"the mlp linears of layers 0-15 exact, every other linear int8","fp16_layers":null,"int8_modules":200,"exact_modules":48,"int8_params":4502585344,"modules_swapped":108,"swap_seconds":0.34982158298953436,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.04641294479370117,"mean_abs_dp":0.0309419979651769,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9781511523833917,"hidden_max_abs_diff":5.338253021240234,"questions":[{"question_id":"decision","max_abs_dp":0.04641294479370117,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5467053329921328},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.019115924835205078,"mean_abs_dp":0.012743939956029257,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9942879688897287,"hidden_max_abs_diff":1.7708284854888916,"questions":[{"question_id":"decision","max_abs_dp":0.019115924835205078,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9224436250224244},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.03189331293106079,"mean_abs_dp":0.021262237181266148,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9965316026544084,"hidden_max_abs_diff":1.1910946369171143,"questions":[{"question_id":"decision","max_abs_dp":0.03189331293106079,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.920472708006855},"own_j12:text":{"max_abs_dp":0.02968043088912964,"mean_abs_dp":0.00508551958661813,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9100047741077703,"hidden_max_abs_diff":4.798133611679077,"questions":[{"question_id":"coupon_valid","max_abs_dp":7.450580596923828e-06,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0007583498954772949,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.02968043088912964,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.00226670503616333,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.731881125015207},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.029932081699371338,"mean_abs_dp":0.019954708715279896,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9509889753294085,"hidden_max_abs_diff":7.143087387084961,"questions":[{"question_id":"decision","max_abs_dp":0.029932081699371338,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9360692080226727},"img_06:native":{"max_abs_dp":0.01613253355026245,"mean_abs_dp":0.005880851019173861,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9800977898196434,"hidden_max_abs_diff":4.298215866088867,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.007806301116943359,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.01613253355026245,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.005267798900604248,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.103272250009468}},"seconds":19.51079179099179,"outside_rule_search":true},"first16_attn_exact":{"why":"the attn linears of layers 0-15 exact, every other linear int8","fp16_layers":null,"int8_modules":232,"exact_modules":16,"int8_params":6683623424,"modules_swapped":64,"swap_seconds":0.27508120800484903,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.11514472961425781,"mean_abs_dp":0.07676314314206441,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.8713077788105638,"hidden_max_abs_diff":15.629693984985352,"questions":[{"question_id":"decision","max_abs_dp":0.11514472961425781,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.540875499980757},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.014345943927764893,"mean_abs_dp":0.00956393281618754,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9943797235428116,"hidden_max_abs_diff":1.6521120071411133,"questions":[{"question_id":"decision","max_abs_dp":0.014345943927764893,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.900917416001903},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.011026918888092041,"mean_abs_dp":0.007351294159889221,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9980063947942442,"hidden_max_abs_diff":1.9334602355957031,"questions":[{"question_id":"decision","max_abs_dp":0.011026918888092041,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9057402909966186},"own_j12:text":{"max_abs_dp":0.023191213607788086,"mean_abs_dp":0.0038895713022122015,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.964381869084918,"hidden_max_abs_diff":2.6557960510253906,"questions":[{"question_id":"coupon_valid","max_abs_dp":8.875131607055664e-05,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0013812780380249023,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.023191213607788086,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0005710870027542114,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.7127938749908935},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.013327717781066895,"mean_abs_dp":0.008885137736797333,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9836427547712993,"hidden_max_abs_diff":4.309642791748047,"questions":[{"question_id":"decision","max_abs_dp":0.013327717781066895,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9161023749911692},"img_06:native":{"max_abs_dp":0.011280655860900879,"mean_abs_dp":0.00465744286775589,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9869683928998498,"hidden_max_abs_diff":3.663884162902832,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.006268501281738281,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.011280655860900879,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.005658671259880066,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.0867757920059375}},"seconds":19.338425374997314,"outside_rule_search":true},"fp16_set_L00_L01_L02_L03_L04_L05_L06_L07_L08":{"why":"layers [0, 1, 2, 3, 4, 5, 6, 7, 8] exact, every other layer int8","fp16_layers":[0,1,2,3,4,5,6,7,8],"int8_modules":178,"exact_modules":70,"int8_params":4970512384,"modules_swapped":178,"swap_seconds":0.9899902079778258,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.05089437961578369,"mean_abs_dp":0.033929588894049324,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9758542263633937,"hidden_max_abs_diff":7.195891380310059,"questions":[{"question_id":"decision","max_abs_dp":0.05089437961578369,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":4.04120804197737},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.011539876461029053,"mean_abs_dp":0.007693231105804443,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9987304305237692,"hidden_max_abs_diff":1.624516248703003,"questions":[{"question_id":"decision","max_abs_dp":0.011539876461029053,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.896813250001287},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.0007879436016082764,"mean_abs_dp":0.0005253255367279053,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9968342430925643,"hidden_max_abs_diff":1.750178337097168,"questions":[{"question_id":"decision","max_abs_dp":0.0007879436016082764,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.934613834018819},"own_j12:text":{"max_abs_dp":0.00904470682144165,"mean_abs_dp":0.0017403384240774007,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9975124061735386,"hidden_max_abs_diff":1.5210189819335938,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00017726421356201172,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0012206882238388062,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.00904470682144165,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0008423924446105957,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.702613542001927},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.015771150588989258,"mean_abs_dp":0.010514097909132639,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9972242936965681,"hidden_max_abs_diff":1.9098961353302002,"questions":[{"question_id":"decision","max_abs_dp":0.015771150588989258,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.8864312910009176},"img_06:native":{"max_abs_dp":0.01131671667098999,"mean_abs_dp":0.0032721210271120073,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9990559273125237,"hidden_max_abs_diff":1.2855091094970703,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.003954112529754639,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.01131671667098999,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0010639280080795288,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.017685625003651}},"seconds":21.46946495800512,"outside_rule_search":true},"fp16_set_L00_L01_L02_L03_L04_L05_L06_L07_L08_L09":{"why":"layers [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] exact, every other layer int8","fp16_layers":[0,1,2,3,4,5,6,7,8,9],"int8_modules":170,"exact_modules":78,"int8_params":4752146432,"modules_swapped":8,"swap_seconds":0.02654220801196061,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.023181498050689697,"mean_abs_dp":0.0154543270667394,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.994750020786544,"hidden_max_abs_diff":3.633596420288086,"questions":[{"question_id":"decision","max_abs_dp":0.023181498050689697,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.5279526249796618},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.016122519969940186,"mean_abs_dp":0.010748339196046194,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9979866698396359,"hidden_max_abs_diff":1.7844867706298828,"questions":[{"question_id":"decision","max_abs_dp":0.016122519969940186,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9203237499750685},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.002443552017211914,"mean_abs_dp":0.0016290669639905293,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9951817712729317,"hidden_max_abs_diff":3.1853857040405273,"questions":[{"question_id":"decision","max_abs_dp":0.002443552017211914,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9153902500111144},"own_j12:text":{"max_abs_dp":0.007442653179168701,"mean_abs_dp":0.00162384444131301,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9974079024024658,"hidden_max_abs_diff":1.588592529296875,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.00010973215103149414,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.0017939060926437378,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.007442653179168701,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0010376572608947754,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.783943582995562},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.01062709093093872,"mean_abs_dp":0.007084717353185018,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9979547139231076,"hidden_max_abs_diff":1.7618935108184814,"questions":[{"question_id":"decision","max_abs_dp":0.01062709093093872,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9133958329912275},"img_06:native":{"max_abs_dp":0.011272013187408447,"mean_abs_dp":0.0032368633896112443,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9993383753325384,"hidden_max_abs_diff":1.270212173461914,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.003218412399291992,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.011272013187408447,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0016438663005828857,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.129857833991991}},"seconds":19.217512375005754,"outside_rule_search":true},"fp16_set_L00_L01_L02_L03_L04_L05_L06_L07_L08_L09_L10":{"why":"layers [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10] exact, every other layer int8","fp16_layers":[0,1,2,3,4,5,6,7,8,9,10],"int8_modules":162,"exact_modules":86,"int8_params":4533780480,"modules_swapped":8,"swap_seconds":0.03418962500290945,"runs":{"semif_1105577da4c8dad4609d:text":{"max_abs_dp":0.004324674606323242,"mean_abs_dp":0.0028831462065378823,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9988852340490487,"hidden_max_abs_diff":1.3429927825927734,"questions":[{"question_id":"decision","max_abs_dp":0.004324674606323242,"argmax_equal":true,"near_tie":false}],"tokens":205,"chunks":4,"seconds":2.55064874998061},"semif_86a15618ba4cb90a307e:text":{"max_abs_dp":0.011594235897064209,"mean_abs_dp":0.007729490598042806,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9984924419900292,"hidden_max_abs_diff":1.588613510131836,"questions":[{"question_id":"decision","max_abs_dp":0.011594235897064209,"argmax_equal":true,"near_tie":false}],"tokens":179,"chunks":3,"seconds":1.9164098330074921},"semif_fb73a85d386cf59b0c51:text":{"max_abs_dp":0.0032349228858947754,"mean_abs_dp":0.002156635125478109,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9985183536838526,"hidden_max_abs_diff":1.8488893508911133,"questions":[{"question_id":"decision","max_abs_dp":0.0032349228858947754,"argmax_equal":true,"near_tie":false}],"tokens":185,"chunks":3,"seconds":1.9132030830078293},"own_j12:text":{"max_abs_dp":0.006032586097717285,"mean_abs_dp":0.0014370556634206038,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9981111023861252,"hidden_max_abs_diff":1.5073089599609375,"questions":[{"question_id":"coupon_valid","max_abs_dp":0.0001875162124633789,"argmax_equal":true,"near_tie":false},{"question_id":"total_band","max_abs_dp":0.001346588134765625,"argmax_equal":true,"near_tie":false},{"question_id":"dessert_items","max_abs_dp":0.006032586097717285,"argmax_equal":true,"near_tie":false},{"question_id":"basket_size","max_abs_dp":0.0017741918563842773,"argmax_equal":true,"near_tie":false}],"tokens":562,"chunks":9,"seconds":5.754022707988042},"semif_8a4c3de28be95c105ca1:text":{"max_abs_dp":0.0009352564811706543,"mean_abs_dp":0.0006235241889953613,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9987546626595806,"hidden_max_abs_diff":1.9964513778686523,"questions":[{"question_id":"decision","max_abs_dp":0.0009352564811706543,"argmax_equal":true,"near_tie":false}],"tokens":189,"chunks":3,"seconds":1.9325258749886416},"img_06:native":{"max_abs_dp":0.010206818580627441,"mean_abs_dp":0.003408014960587025,"argmax_all_equal":true,"argmax_equal_non_near_tie":true,"min_pos_cos":0.9993710227649781,"hidden_max_abs_diff":1.270578384399414,"questions":[{"question_id":"in_red_zone","max_abs_dp":0.004782140254974365,"argmax_equal":true,"near_tie":false},{"question_id":"reading","max_abs_dp":0.010206818580627441,"argmax_equal":true,"near_tie":false},{"question_id":"alarm","max_abs_dp":0.0019395947456359863,"argmax_equal":true,"near_tie":false}],"tokens":471,"chunks":8,"seconds":5.106179875001544}},"seconds":19.207267207995756,"outside_rule_search":true}},"generated_at":"2026-10-03T03:54:55+00:00"}}