{"what":"Kev-4B: time per decision on an Apple M4 Max (macOS 27.0 26A428), Swift Release CLI on the AOT assets, in machine-wide GPU lock windows. Round 12 (2026-10-04 14:05:52-14:30:05 JST): the unrolled S = 16 graph, the Metal-kernel graphs S = 64 and 128 and the dynamic-length graph, two clean processes each (no other GPU job during the process, one-minute load average <= 12 at its start and end), 6 decisions per item after one warm-up; pooled = median and p10-p90 over the 12 decisions. Round 7 (00:11-00:33 JST): the unrolled S = 16 graph.","sources":[{"file":"swift/timing/r12_swift_timing_20261004_132821/window.json","bytes":77630,"sha256":"6e573ffc6b03b6a055c35359d0385386c4f2547499680ed52b73313adece1f89"},{"file":"swift/timing/r12_swift_timing_20261004_132821/jit_D512L512q16.json","bytes":19189,"sha256":"3362f90a83a90bb361e14838903347b3bcffba5229e3e82c0dd56744c5300c65"},{"file":"swift/timing/r12_swift_timing_20261004_132821/p0_U16.json","bytes":18681,"sha256":"331430dd71f01b983705d4fe6ce4e669c1d992f5992b5a140bc44d1b68fb0b1f"},{"file":"swift/timing/r12_swift_timing_20261004_132821/p1_K64.json","bytes":18469,"sha256":"b487019fe28fac59af987dcd9bde5a31d49400cb8f99af38e18ae1f3529f4ec0"},{"file":"swift/timing/r12_swift_timing_20261004_132821/p2_K128.json","bytes":18431,"sha256":"c51cf984409f74cf584f99ca1ee35b8ff9c116102081b17f78b2668063f46f71"},{"file":"swift/timing/r12_swift_timing_20261004_132821/p3_D512L512q16.json","bytes":19313,"sha256":"071ec0b867385a8150aab547dc64149ba35ef0e58e45ede9a7344897abddc8bf"},{"file":"swift/timing/r12_swift_timing_20261004_132821/p4_U16.json","bytes":18488,"sha256":"d2af78a28501a546373ec964025dfd24e0d47597381bb2e6f04b54aa5deae911"},{"file":"swift/timing/r12_swift_timing_20261004_132821/p5_K64.json","bytes":18413,"sha256":"d1937111c59bfadcc4564cf887593aa1b20a49eb4ae6405a0f509c41dac716a0"},{"file":"swift/timing/r12_swift_timing_20261004_132821/p6_K128.json","bytes":18446,"sha256":"51007361ff7ce85f5cbeac06fb7adac8901a464c5366fb3ab7af3c2744fbd643"},{"file":"swift/timing/r12_swift_timing_20261004_132821/p7_D512L512q16.json","bytes":19239,"sha256":"61b35e24af2a9a320d911de12d1d2b0b44940d21a99c14005776886187eda52c"},{"file":"results/swift_timing_r7.json","bytes":41108,"sha256":"3789a1d91ea20ef78823fab889389b1ea9dd0762cb72060cc58d931f6e78bbfc"}],"trimmed":{"removed":["window.*: other sessions' process lists (busiest, other_lock_holders_during, other_gpu_jobs_during, before / after samples)","the per-decision values of each process (the lane files keep them)"],"serialization":"compact json (no indentation)","full_copies":"the source files above, in the lane directory $ZOO_WORK_ROOT/_kev/ (not in the repository)","paths":"local paths rewritten: the lane directory as $ZOO_WORK_ROOT/_kev, the repository relative, the home directory as ~, temporary directories as $TMPDIR, Xcode as $DEVELOPER_DIR, the phone's app container as <app container>","process_ids":"removed (keys pid / pids; 'pid <n>' in text)"},"round12_window":{"run_id":"r12_swift_timing_20261004_132821","binary":"$ZOO_WORK_ROOT/_kev/swift_r15/kev_pregate","forms":{"U16":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_4b_decode_fp16_pf16","K64":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_4b_decode_fp16_metal_pf64","K128":"$ZOO_WORK_ROOT/_kev/exports/bundles/kev_4b_decode_fp16_metal_pf128","D512L512q16":"$ZOO_WORK_ROOT/_kev/exports/ship/kev_4b_decode_fp16_metal_dyn512"},"extra_args":{"U16":[],"K64":[],"K128":[],"D512L512q16":["--call-max",512,"--multiple",16,"--warm"]},"meta":{"U16":{"passed":true,"lengths":1},"K64":{"passed":true,"lengths":1},"K128":{"passed":true,"lengths":1},"D512L512q16":{"passed":true,"lengths":32}},"rank_rule":"v2","chunks":{"U16":16,"K64":64,"K128":128,"D512L512q16":512},"candidates":[],"reps":6,"rule":"`kev time --bundle <dir> --records fixtures/records.json --model-label <label> --slot <n> --reps 6`\n(round 7's protocol and _time_mac.sh's command: two loads, then timing.py's 10 items, one warm-up each, then the reps).\n  clean   = no other GPU job seen during the process (ps every 5 s, this process tree, turn waiters and S26 adb excluded)\n            and the 1-minute load average <= 12 at its start and at its end; otherwise \"contended\" (kept, not counted)\n  rounds  = A B C ... twice; then, while a form has fewer than 2 clean processes, rounds of those forms only, up to 4\n  start   = the window's first process waits up to 600 s for the load average to fall to 12 (the time is recorded);\n            later processes wait up to 120 s for it (recorded)\n  rank    = the launch's rule on the clean processes: candidates = U16 + the given forms; out = 5 % or more slower than\n            U16 on any of the 10 items; order = tv4_000:q0 median, within 3 % -> b_m01_first5 shared median, within 3 %\n            -> the smaller S\n  JIT     = one `kev time --asset jit` process of the rank-1 form (the .aimodel specialized by Swift), clean flag recorded","processes":[{"label":"U16","slot":0,"jit":false,"file":"p0_U16.json","cmd":["$ZOO_WORK_ROOT/_kev/swift_r15/kev_pregate","time","--bundle","$ZOO_WORK_ROOT/_kev/exports/bundles/kev_4b_decode_fp16_pf16","--records","$ZOO_WORK_ROOT/_kev/fixtures/records.json","--model-label","U16","--slot","0","--reps","6","--out","$ZOO_WORK_ROOT/_kev/swift/timing/r12_swift_timing_20261004_132821/p0_U16.json"],"exit":0,"wall_s":314.3,"load1_start":6.32,"load1_end":8.86,"footprint_samples":[[0.1,82837504],[5.3,137363456],[10.5,372244480],[15.8,409993216],[21.1,491782144],[26.3,853540864],[31.5,855638016],[36.7,855638016],[41.9,855638016],[47.1,854589440],[52.3,855638016],[57.6,854589440],[62.8,744488960],[68.0,746586112],[73.3,752877568],[78.5,752877568],[83.7,752877568],[88.9,752877568],[94.2,752877568],[99.4,751828992],[104.7,912261120],[109.9,913309696],[115.2,914358272],[120.4,914358272],[125.7,915406848],[130.9,916455424],[136.1,917504000],[141.4,918552576],[146.6,920649728],[151.8,921698304],[157.0,921698304],[162.3,921698304],[167.5,921698304],[172.7,929038336],[177.9,968884224],[183.1,968884224],[188.3,967835648],[193.5,968884224],[198.8,968884224],[204.0,999292928],[209.2,1000341504],[214.4,999292928],[219.6,1000341504],[224.8,1000341504],[230.1,1000341504],[235.3,1000341504],[240.5,1000341504],[245.7,1000341504],[251.0,1000341504],[256.2,1000341504],[261.4,1000341504],[266.6,1000341504],[271.9,1000341504],[277.1,1000341504],[282.3,1000341504],[287.5,1000341504],[292.7,1000341504],[298.0,1000341504],[303.2,1000341504],[308.4,999292928]],"footprint_max_bytes":1000341504,"stopped_at_footprint_cap":null,"clean":true,"why_contended":[],"round":1,"counted":true},{"label":"K64","slot":1,"jit":false,"file":"p1_K64.json","cmd":["$ZOO_WORK_ROOT/_kev/swift_r15/kev_pregate","time","--bundle","$ZOO_WORK_ROOT/_kev/exports/bundles/kev_4b_decode_fp16_metal_pf64","--records","$ZOO_WORK_ROOT/_kev/fixtures/records.json","--model-label","K64","--slot","1","--reps","6","--out","$ZOO_WORK_ROOT/_kev/swift/timing/r12_swift_timing_20261004_132821/p1_K64.json"],"exit":0,"wall_s":126.2,"load1_start":8.86,"load1_end":7.41,"footprint_samples":[[0.1,81788928],[5.3,137363456],[10.5,140509184],[15.8,369098752],[21.1,377487360],[26.4,661651456],[31.6,661651456],[36.8,661651456],[42.0,661651456],[47.2,661651456],[52.4,834666496],[57.6,838860800],[62.9,842006528],[68.1,845152256],[73.3,845152256],[78.5,875560960],[83.7,891289600],[88.9,907018240],[94.1,922746880],[99.3,922746880],[104.5,923795456],[109.7,922746880],[114.9,839909376],[120.1,847249408]],"footprint_max_bytes":923795456,"stopped_at_footprint_cap":null,"clean":true,"why_contended":[],"round":1,"counted":true},{"label":"K128","slot":2,"jit":false,"file":"p2_K128.json","cmd":["$ZOO_WORK_ROOT/_kev/swift_r15/kev_pregate","time","--bundle","$ZOO_WORK_ROOT/_kev/exports/bundles/kev_4b_decode_fp16_metal_pf128","--records","$ZOO_WORK_ROOT/_kev/fixtures/records.json","--model-label","K128","--slot","2","--reps","6","--out","$ZOO_WORK_ROOT/_kev/swift/timing/r12_swift_timing_20261004_132821/p2_K128.json"],"exit":0,"wall_s":120.8,"load1_start":7.41,"load1_end":5.79,"footprint_samples":[[0.1,81788928],[5.3,137363456],[10.5,291504128],[15.8,370147328],[21.2,377487360],[26.4,685768704],[31.6,685768704],[36.8,685768704],[42.1,685768704],[47.3,855638016],[52.5,861929472],[57.7,862978048],[62.9,871366656],[68.1,879755264],[73.3,881852416],[78.5,896532480],[83.7,927989760],[88.9,943718400],[94.1,959447040],[99.3,959447040],[104.6,959447040],[109.8,959447040],[115.0,872415232]],"footprint_max_bytes":959447040,"stopped_at_footprint_cap":null,"clean":true,"why_contended":[],"round":1,"counted":true},{"label":"D512L512q16","slot":3,"jit":false,"file":"p3_D512L512q16.json","cmd":["$ZOO_WORK_ROOT/_kev/swift_r15/kev_pregate","time","--bundle","$ZOO_WORK_ROOT/_kev/exports/ship/kev_4b_decode_fp16_metal_dyn512","--records","$ZOO_WORK_ROOT/_kev/fixtures/records.json","--model-label","D512L512q16","--slot","3","--reps","6","--out","$ZOO_WORK_ROOT/_kev/swift/timing/r12_swift_timing_20261004_132821/p3_D512L512q16.json","--call-max","512","--multiple","16","--warm"],"exit":0,"wall_s":105.0,"load1_start":5.79,"load1_end":5.59,"footprint_samples":[[0.1,81788928],[5.3,137363456],[10.5,347078656],[15.8,355467264],[21.0,724566016],[26.2,2360344576],[31.4,2792357888],[36.6,2792357888],[41.8,2785017856],[47.0,3128950784],[52.2,3643801600],[57.4,3931111424],[62.7,4281335808],[67.9,4537188352],[73.1,4831838208],[78.3,5260705792],[83.5,5385486336],[88.7,5702156288],[93.9,5907677184],[99.1,6197084160]],"footprint_max_bytes":6197084160,"stopped_at_footprint_cap":null,"clean":true,"why_contended":[],"round":1,"counted":true},{"label":"U16","slot":4,"jit":false,"file":"p4_U16.json","cmd":["$ZOO_WORK_ROOT/_kev/swift_r15/kev_pregate","time","--bundle","$ZOO_WORK_ROOT/_kev/exports/bundles/kev_4b_decode_fp16_pf16","--records","$ZOO_WORK_ROOT/_kev/fixtures/records.json","--model-label","U16","--slot","4","--reps","6","--out","$ZOO_WORK_ROOT/_kev/swift/timing/r12_swift_timing_20261004_132821/p4_U16.json"],"exit":0,"wall_s":313.8,"load1_start":5.59,"load1_end":6.04,"footprint_samples":[[0.1,81788928],[5.3,137363456],[10.5,374341632],[15.8,403701760],[21.1,412090368],[26.3,851443712],[31.5,852492288],[36.7,852492288],[41.9,853540864],[47.2,853540864],[52.4,852492288],[57.6,852492288],[62.8,852492288],[68.0,759169024],[73.2,759169024],[78.5,759169024],[83.7,758120448],[88.9,759169024],[94.1,758120448],[99.4,759169024],[104.6,919601152],[109.8,920649728],[115.0,919601152],[120.2,920649728],[125.5,919601152],[130.7,922746880],[135.9,929038336],[141.1,930086912],[146.3,930086912],[151.6,930086912],[156.8,930086912],[162.0,930086912],[167.2,933232640],[172.4,941621248],[177.7,951058432],[182.9,984612864],[188.1,984612864],[193.3,984612864],[198.6,985661440],[203.8,1015021568],[209.0,1016070144],[214.2,1017118720],[219.5,1017118720],[224.7,1017118720],[229.9,1016070144],[235.1,1017118720],[240.4,1016070144],[245.6,1017118720],[250.8,1017118720],[256.0,1016070144],[261.2,1016070144],[266.4,1016070144],[271.6,1016070144],[276.8,1017118720],[282.0,1016070144],[287.2,934281216],[292.4,954204160],[297.6,955252736],[302.8,955252736],[308.1,954204160]],"footprint_max_bytes":1017118720,"stopped_at_footprint_cap":null,"clean":true,"why_contended":[],"round":2,"counted":true},{"label":"K64","slot":5,"jit":false,"file":"p5_K64.json","cmd":["$ZOO_WORK_ROOT/_kev/swift_r15/kev_pregate","time","--bundle","$ZOO_WORK_ROOT/_kev/exports/bundles/kev_4b_decode_fp16_metal_pf64","--records","$ZOO_WORK_ROOT/_kev/fixtures/records.json","--model-label","K64","--slot","5","--reps","6","--out","$ZOO_WORK_ROOT/_kev/swift/timing/r12_swift_timing_20261004_132821/p5_K64.json"],"exit":0,"wall_s":125.9,"load1_start":6.04,"load1_end":5.03,"footprint_samples":[[0.1,81788928],[5.3,137363456],[10.5,142606336],[15.8,370147328],[21.2,377487360],[26.4,659554304],[31.6,659554304],[36.8,659554304],[42.0,659554304],[47.2,660602880],[52.4,837812224],[57.6,843055104],[62.8,852492288],[68.0,856686592],[73.2,856686592],[78.4,887095296],[83.6,902823936],[88.8,918552576],[94.0,934281216],[99.2,934281216],[104.4,934281216],[109.6,934281216],[114.8,858783744],[120.1,858783744]],"footprint_max_bytes":934281216,"stopped_at_footprint_cap":null,"clean":true,"why_contended":[],"round":2,"counted":true},{"label":"K128","slot":6,"jit":false,"file":"p6_K128.json","cmd":["$ZOO_WORK_ROOT/_kev/swift_r15/kev_pregate","time","--bundle","$ZOO_WORK_ROOT/_kev/exports/bundles/kev_4b_decode_fp16_metal_pf128","--records","$ZOO_WORK_ROOT/_kev/fixtures/records.json","--model-label","K128","--slot","6","--reps","6","--out","$ZOO_WORK_ROOT/_kev/swift/timing/r12_swift_timing_20261004_132821/p6_K128.json"],"exit":0,"wall_s":120.7,"load1_start":5.03,"load1_end":4.42,"footprint_samples":[[0.1,82837504],[5.3,137363456],[10.5,347078656],[15.8,372244480],[21.2,379584512],[26.4,685768704],[31.6,686817280],[36.8,686817280],[42.0,686817280],[47.2,854589440],[52.4,859832320],[57.6,864026624],[62.8,872415232],[68.0,873463808],[73.2,874512384],[78.4,884998144],[83.6,916455424],[88.8,936378368],[94.0,952107008],[99.2,952107008],[104.4,952107008],[109.6,952107008],[114.8,952107008]],"footprint_max_bytes":952107008,"stopped_at_footprint_cap":null,"clean":true,"why_contended":[],"round":2,"counted":true},{"label":"D512L512q16","slot":7,"jit":false,"file":"p7_D512L512q16.json","cmd":["$ZOO_WORK_ROOT/_kev/swift_r15/kev_pregate","time","--bundle","$ZOO_WORK_ROOT/_kev/exports/ship/kev_4b_decode_fp16_metal_dyn512","--records","$ZOO_WORK_ROOT/_kev/fixtures/records.json","--model-label","D512L512q16","--slot","7","--reps","6","--out","$ZOO_WORK_ROOT/_kev/swift/timing/r12_swift_timing_20261004_132821/p7_D512L512q16.json","--call-max","512","--multiple","16","--warm"],"exit":0,"wall_s":110.4,"load1_start":4.42,"load1_end":4.56,"footprint_samples":[[0.1,82837504],[5.3,137363456],[10.5,142606336],[15.8,370147328],[21.1,375390208],[26.5,377487360],[31.7,1559232512],[36.9,2682257408],[42.1,2801795072],[47.3,2793406464],[52.5,2794455040],[57.7,3437232128],[62.9,3767533568],[68.1,4118806528],[73.3,4416602112],[78.5,4709154816],[83.7,5146411008],[88.9,5278531584],[94.1,5684330496],[99.3,5800722432],[104.5,6206521344]],"footprint_max_bytes":6206521344,"stopped_at_footprint_cap":null,"clean":true,"why_contended":[],"round":2,"counted":true}],"load_waits":[],"start_wait":{"load_at_start_of_wait":6.32,"waited_s":0,"load_after":6.32,"cap_s":600,"reached":true},"clean_processes":{"U16":2,"K64":2,"K128":2,"D512L512q16":2},"swift_processes":["p0_U16.json","p1_K64.json","p2_K128.json","p3_D512L512q16.json","p4_U16.json","p5_K64.json","p6_K128.json","p7_D512L512q16.json"],"ranking":{"rule":"(a) candidates = forms that passed their full gate or their s80 screen (+ own shared for D), whose host policy can use\n        at most 32 call lengths (L / q for a dynamic-S form; 1 for a static-S form)\n    (b) A dominates B = on every one of the 10 items A is not more than 3 % slower than B, and on at least one A is more than\n        3 % faster -> a dominated form drops out\n    (c) the rest: the 94-token decision (tv4_000:q0) median, within 3 % -> b_m01_first5 shared's median, within 3 % -> the\n        fewer call lengths","items":["tv4_000:q0","own_j03:q0","own_L02:q0","own_L01:q2","b_m01_first5:direct","b_m01_first5:shared","c_m01_all8:direct","c_m01_all8:shared","d_L02_all4:direct","d_L02_all4:shared"],"medians_ms":{"U16":{"tv4_000:q0":269.46283350000004,"own_j03:q0":1075.3829375,"own_L02:q0":4341.901229000001,"own_L01:q2":5200.230375,"b_m01_first5:direct":2367.861083,"b_m01_first5:shared":894.6626455,"c_m01_all8:direct":3776.0337710000003,"c_m01_all8:shared":1262.4293335,"d_L02_all4:direct":17087.673063000002,"d_L02_all4:shared":4713.740250000001},"K64":{"tv4_000:q0":117.963479,"own_j03:q0":351.167271,"own_L02:q0":1409.5179374999998,"own_L01:q2":1701.2189170000001,"b_m01_first5:direct":882.6285625,"b_m01_first5:shared":435.9007710000001,"c_m01_all8:direct":1409.4742500000002,"c_m01_all8:shared":617.9105625000001,"d_L02_all4:direct":5687.387625,"d_L02_all4:shared":1664.0880005},"K128":{"tv4_000:q0":100.1580835,"own_j03:q0":297.95627049999996,"own_L02:q0":1189.0012915,"own_L01:q2":1488.1462915,"b_m01_first5:direct":986.6628955000001,"b_m01_first5:shared":615.5610625,"c_m01_all8:direct":1578.7195205,"c_m01_all8:shared":919.9615210000001,"d_L02_all4:direct":4851.726937,"d_L02_all4:shared":1614.4719370000003},"D512L512q16":{"tv4_000:q0":83.34787450000002,"own_j03:q0":260.71900000000005,"own_L02:q0":1009.584375,"own_L01:q2":1229.089,"b_m01_first5:direct":638.6911040000001,"b_m01_first5:shared":353.51077050000004,"c_m01_all8:direct":1042.1188124999999,"c_m01_all8:shared":515.6600835,"d_L02_all4:direct":4074.8594585,"d_L02_all4:shared":1225.849146}},"meta":{"U16":{"passed":true,"lengths":1},"K64":{"passed":true,"lengths":1},"K128":{"passed":true,"lengths":1},"D512L512q16":{"passed":true,"lengths":32}},"candidates":["U16","K64","K128","D512L512q16"],"out":{"U16":"(b) dominated by ['K64', 'K128', 'D512L512q16']","K64":"(b) dominated by ['D512L512q16']","K128":"(b) dominated by ['D512L512q16']"},"dominated_by":{"U16":["K64","K128","D512L512q16"],"K64":["D512L512q16"],"K128":["D512L512q16"]},"pool":["D512L512q16"],"order":["D512L512q16"],"rank1":"D512L512q16","pairwise":[],"ratio_vs_U16":{"U16":{"tv4_000:q0":1.0,"own_j03:q0":1.0,"own_L02:q0":1.0,"own_L01:q2":1.0,"b_m01_first5:direct":1.0,"b_m01_first5:shared":1.0,"c_m01_all8:direct":1.0,"c_m01_all8:shared":1.0,"d_L02_all4:direct":1.0,"d_L02_all4:shared":1.0},"K64":{"tv4_000:q0":0.43777272534321504,"own_j03:q0":0.326550904570215,"own_L02:q0":0.3246315066049144,"own_L01:q2":0.3271429906602936,"b_m01_first5:direct":0.372753523775871,"b_m01_first5:shared":0.487223617966511,"c_m01_all8:direct":0.3732684439489882,"c_m01_all8:shared":0.4894615057675227,"d_L02_all4:direct":0.33283569998275075,"d_L02_all4:shared":0.35302921082679506},"K128":{"tv4_000:q0":0.37169535478814,"own_j03:q0":0.2770699256142884,"own_L02:q0":0.2738434682849391,"own_L01:q2":0.2861693010090923,"b_m01_first5:direct":0.4166895189011391,"b_m01_first5:shared":0.6880370669281509,"c_m01_all8:direct":0.4180893541325269,"c_m01_all8:shared":0.728723182033064,"d_L02_all4:direct":0.28393140008661927,"d_L02_all4:shared":0.3425033734092582},"D512L512q16":{"tv4_000:q0":0.30931120784789046,"own_j03:q0":0.24244293907629536,"own_L02:q0":0.23252126701014825,"own_L01:q2":0.23635279812002558,"b_m01_first5:direct":0.269733350738127,"b_m01_first5:shared":0.39513303956312323,"c_m01_all8:direct":0.27598238673167835,"c_m01_all8:shared":0.40846649378018435,"d_L02_all4:direct":0.23846777987128673,"d_L02_all4:shared":0.2600586967005659}},"ratio_all":{"U16":{"U16":{"tv4_000:q0":1.0,"own_j03:q0":1.0,"own_L02:q0":1.0,"own_L01:q2":1.0,"b_m01_first5:direct":1.0,"b_m01_first5:shared":1.0,"c_m01_all8:direct":1.0,"c_m01_all8:shared":1.0,"d_L02_all4:direct":1.0,"d_L02_all4:shared":1.0},"K64":{"tv4_000:q0":2.284290322600608,"own_j03:q0":3.0623096920099937,"own_L02:q0":3.080415731850168,"own_L01:q2":3.0567673113877087,"b_m01_first5:direct":2.6827378849979144,"b_m01_first5:shared":2.0524456597026757,"c_m01_all8:direct":2.679037074284968,"c_m01_all8:shared":2.043061585470146,"d_L02_all4:direct":3.0044853964037666,"d_L02_all4:shared":2.8326267893186463},"K128":{"tv4_000:q0":2.6903752955696287,"own_j03:q0":3.6091972009697986,"own_L02:q0":3.651721205047994,"own_L01:q2":3.494434925317959,"b_m01_first5:direct":2.399868378348276,"b_m01_first5:shared":1.4534100676648956,"c_m01_all8:direct":2.391833205308112,"c_m01_all8:shared":1.3722631921906219,"d_L02_all4:direct":3.521977490671792,"d_L02_all4:shared":2.9196792721953644},"D512L512q16":{"tv4_000:q0":3.2329898646665547,"own_j03:q0":4.1246818893137815,"own_L02:q0":4.300681881095873,"own_L01:q2":4.2309632378127215,"b_m01_first5:direct":3.70736505983963,"b_m01_first5:shared":2.5307931756495097,"c_m01_all8:direct":3.623419638631656,"c_m01_all8:shared":2.4481812222721713,"d_L02_all4:direct":4.193438629485926,"d_L02_all4:shared":3.84528574774567}},"K64":{"U16":{"tv4_000:q0":0.43777272534321504,"own_j03:q0":0.326550904570215,"own_L02:q0":0.3246315066049144,"own_L01:q2":0.3271429906602936,"b_m01_first5:direct":0.372753523775871,"b_m01_first5:shared":0.487223617966511,"c_m01_all8:direct":0.3732684439489882,"c_m01_all8:shared":0.4894615057675227,"d_L02_all4:direct":0.33283569998275075,"d_L02_all4:shared":0.35302921082679506},"K64":{"tv4_000:q0":1.0,"own_j03:q0":1.0,"own_L02:q0":1.0,"own_L01:q2":1.0,"b_m01_first5:direct":1.0,"b_m01_first5:shared":1.0,"c_m01_all8:direct":1.0,"c_m01_all8:shared":1.0,"d_L02_all4:direct":1.0,"d_L02_all4:shared":1.0},"K128":{"tv4_000:q0":1.177772925337574,"own_j03:q0":1.178586610748976,"own_L02:q0":1.185463756495844,"own_L01:q2":1.1431798921362968,"b_m01_first5:direct":0.894559394627605,"b_m01_first5:shared":0.7081357115566419,"c_m01_all8:direct":0.8927958587308797,"c_m01_all8:shared":0.6716700083589692,"d_L02_all4:direct":1.172239843431238,"d_L02_all4:shared":1.030732069330481},"D512L512q16":{"tv4_000:q0":1.4153147840620697,"own_j03:q0":1.346918602019799,"own_L02:q0":1.3961368384886106,"own_L01:q2":1.3841299669918128,"b_m01_first5:direct":1.381933389978765,"b_m01_first5:shared":1.2330622073649098,"c_m01_all8:direct":1.3525082102862436,"c_m01_all8:shared":1.1982904674451111,"d_L02_all4:direct":1.395726081579655,"d_L02_all4:shared":1.3574981929301764}},"K128":{"U16":{"tv4_000:q0":0.37169535478814,"own_j03:q0":0.2770699256142884,"own_L02:q0":0.2738434682849391,"own_L01:q2":0.2861693010090923,"b_m01_first5:direct":0.4166895189011391,"b_m01_first5:shared":0.6880370669281509,"c_m01_all8:direct":0.4180893541325269,"c_m01_all8:shared":0.728723182033064,"d_L02_all4:direct":0.28393140008661927,"d_L02_all4:shared":0.3425033734092582},"K64":{"tv4_000:q0":0.8490601018981476,"own_j03:q0":0.8484739185731234,"own_L02:q0":0.843551727769339,"own_L01:q2":0.874752964847263,"b_m01_first5:direct":1.1178687586376403,"b_m01_first5:shared":1.4121586917312425,"c_m01_all8:direct":1.1200768800848968,"c_m01_all8:shared":1.4888263396533215,"d_L02_all4:direct":0.8530677451407227,"d_L02_all4:shared":0.9701842309510724},"K128":{"tv4_000:q0":1.0,"own_j03:q0":1.0,"own_L02:q0":1.0,"own_L01:q2":1.0,"b_m01_first5:direct":1.0,"b_m01_first5:shared":1.0,"c_m01_all8:direct":1.0,"c_m01_all8:shared":1.0,"d_L02_all4:direct":1.0,"d_L02_all4:shared":1.0},"D512L512q16":{"tv4_000:q0":1.2016873147736957,"own_j03:q0":1.142825304254772,"own_L02:q0":1.1777136423094898,"own_L01:q2":1.2107717923600325,"b_m01_first5:direct":1.544820163175468,"b_m01_first5:shared":1.7412795135756691,"c_m01_all8:direct":1.514913176466623,"c_m01_all8:shared":1.7840464104877725,"d_L02_all4:direct":1.1906489012472528,"d_L02_all4:shared":1.3170233403254337}},"D512L512q16":{"U16":{"tv4_000:q0":0.30931120784789046,"own_j03:q0":0.24244293907629536,"own_L02:q0":0.23252126701014825,"own_L01:q2":0.23635279812002558,"b_m01_first5:direct":0.269733350738127,"b_m01_first5:shared":0.39513303956312323,"c_m01_all8:direct":0.27598238673167835,"c_m01_all8:shared":0.40846649378018435,"d_L02_all4:direct":0.23846777987128673,"d_L02_all4:shared":0.2600586967005659},"K64":{"tv4_000:q0":0.7065565987588414,"own_j03:q0":0.7424353620927276,"own_L02:q0":0.716262168887794,"own_L01:q2":0.7224755072483124,"b_m01_first5:direct":0.7236238788726034,"b_m01_first5:shared":0.8109890920564579,"c_m01_all8:direct":0.7393670459038182,"c_m01_all8:shared":0.834522202393975,"d_L02_all4:direct":0.716472962136109,"d_L02_all4:shared":0.7366492310693157},"K128":{"tv4_000:q0":0.8321632322367671,"own_j03:q0":0.8750243771090567,"own_L02:q0":0.8491028413655849,"own_L01:q2":0.8259194724472423,"b_m01_first5:direct":0.6473245390223555,"b_m01_first5:shared":0.5742903377680748,"c_m01_all8:direct":0.6601038366650132,"c_m01_all8:shared":0.5605235346577067,"d_L02_all4:direct":0.8398781529571477,"d_L02_all4:shared":0.7592879863107833},"D512L512q16":{"tv4_000:q0":1.0,"own_j03:q0":1.0,"own_L02:q0":1.0,"own_L01:q2":1.0,"b_m01_first5:direct":1.0,"b_m01_first5:shared":1.0,"c_m01_all8:direct":1.0,"c_m01_all8:shared":1.0,"d_L02_all4:direct":1.0,"d_L02_all4:shared":1.0}}}},"rank1":{"label":"D512L512q16"},"jit_processes":["jit_D512L512q16.json"],"jit_record":{"label":"D512L512q16","exit":0,"wall_s":104.7,"clean":true,"why_contended":[],"load1_start":4.51,"load1_end":5.36},"wall_s":1449},"round12_pooled":{"U16":{"tv4_000:q0":{"median":269.46283350000004,"p10":267.9252497,"p90":274.788292,"n":12},"own_j03:q0":{"median":1075.3829375,"p10":1068.7453214,"p90":1098.9054084,"n":12},"own_L02:q0":{"median":4341.901229000001,"p10":4232.5112456,"p90":4398.1302497,"n":12},"own_L01:q2":{"median":5200.230375,"p10":5076.202075300001,"p90":5242.259841,"n":12},"b_m01_first5 direct":{"median":2367.861083,"p10":2311.0934039000003,"p90":2414.4221253,"n":12},"b_m01_first5 shared":{"median":894.6626455,"p10":888.693741,"p90":938.7817083,"n":12},"c_m01_all8 direct":{"median":3776.0337710000003,"p10":3761.5407289000004,"p90":3826.3939628000003,"n":12},"c_m01_all8 shared":{"median":1262.4293335,"p10":1257.9804036,"p90":1297.4847539,"n":12},"d_L02_all4 direct":{"median":17087.673063000002,"p10":16926.4606744,"p90":17646.5970586,"n":12},"d_L02_all4 shared":{"median":4713.740250000001,"p10":4645.1782923,"p90":4772.427575000001,"n":12}},"K64":{"tv4_000:q0":{"median":117.963479,"p10":117.19635830000001,"p90":120.38159610000001,"n":12},"own_j03:q0":{"median":351.167271,"p10":348.8459715,"p90":356.14994140000005,"n":12},"own_L02:q0":{"median":1409.5179374999998,"p10":1399.2928089,"p90":1430.1217912999998,"n":12},"own_L01:q2":{"median":1701.2189170000001,"p10":1692.5211462000002,"p90":1732.2197836999999,"n":12},"b_m01_first5 direct":{"median":882.6285625,"p10":873.3679798000001,"p90":897.6083420000001,"n":12},"b_m01_first5 shared":{"median":435.9007710000001,"p10":432.01152060000004,"p90":447.64738330000006,"n":12},"c_m01_all8 direct":{"median":1409.4742500000002,"p10":1399.3882378,"p90":1431.3526086000002,"n":12},"c_m01_all8 shared":{"median":617.9105625000001,"p10":613.4529163000001,"p90":631.3096959000001,"n":12},"d_L02_all4 direct":{"median":5687.387625,"p10":5656.423417,"p90":5744.049912500001,"n":12},"d_L02_all4 shared":{"median":1664.0880005,"p10":1658.9139414,"p90":1675.8196417000001,"n":12}},"K128":{"tv4_000:q0":{"median":100.1580835,"p10":99.28452500000002,"p90":101.20986280000001,"n":12},"own_j03:q0":{"median":297.95627049999996,"p10":296.13717500000007,"p90":304.5115381,"n":12},"own_L02:q0":{"median":1189.0012915,"p10":1182.8778167,"p90":1194.8772666999998,"n":12},"own_L01:q2":{"median":1488.1462915,"p10":1484.3255339000002,"p90":1498.5010417,"n":12},"b_m01_first5 direct":{"median":986.6628955000001,"p10":982.9805203000001,"p90":990.1675253000001,"n":12},"b_m01_first5 shared":{"median":615.5610625,"p10":613.2803709,"p90":624.4605417,"n":12},"c_m01_all8 direct":{"median":1578.7195205,"p10":1574.1711006,"p90":1591.6399292,"n":12},"c_m01_all8 shared":{"median":919.9615210000001,"p10":916.9006789000001,"p90":930.5917035000001,"n":12},"d_L02_all4 direct":{"median":4851.726937,"p10":4839.177425,"p90":4870.6157077,"n":12},"d_L02_all4 shared":{"median":1614.4719370000003,"p10":1607.4508664000002,"p90":1647.8478795,"n":12}},"D512L512q16":{"tv4_000:q0":{"median":83.34787450000002,"p10":82.7792295,"p90":83.78875800000002,"n":12},"own_j03:q0":{"median":260.71900000000005,"p10":260.0353828,"p90":261.00073750000007,"n":12},"own_L02:q0":{"median":1009.584375,"p10":1008.7963414,"p90":1010.4611499999999,"n":12},"own_L01:q2":{"median":1229.089,"p10":1228.6496579999998,"p90":1229.9942163,"n":12},"b_m01_first5 direct":{"median":638.6911040000001,"p10":636.5858077,"p90":639.5686416000001,"n":12},"b_m01_first5 shared":{"median":353.51077050000004,"p10":348.60758360000005,"p90":355.89412500000003,"n":12},"c_m01_all8 direct":{"median":1042.1188124999999,"p10":1039.8223497000001,"p90":1043.2569375000003,"n":12},"c_m01_all8 shared":{"median":515.6600835,"p10":512.4312291,"p90":518.6313545,"n":12},"d_L02_all4 direct":{"median":4074.8594585,"p10":4070.2368292,"p90":4077.00515,"n":12},"d_L02_all4 shared":{"median":1225.849146,"p10":1224.0230542000002,"p90":1227.8737541,"n":12}}},"round12_processes":[{"form":"U16","file":"swift/timing/r12_swift_timing_20261004_132821/p0_U16.json","q94_latency_ms_median":272.3176665,"footprint_end_bytes":1000095080,"load_cold":{"seconds":9.742635542,"model_seconds":0.0029756250000000004,"main_seconds":9.739659917000001,"wall_with_tokenizer_and_head":10.246041042},"load_warm":{"seconds":1.469982417,"model_seconds":0.001007375,"main_seconds":1.468975042,"wall_with_tokenizer_and_head":2.042850916}},{"form":"K64","file":"swift/timing/r12_swift_timing_20261004_132821/p1_K64.json","q94_latency_ms_median":118.7382915,"footprint_end_bytes":847412656,"load_cold":{"seconds":11.523799375,"model_seconds":0.003574167,"main_seconds":11.520225208,"wall_with_tokenizer_and_head":12.080911917},"load_warm":{"seconds":1.2501225,"model_seconds":0.001089125,"main_seconds":1.249033375,"wall_with_tokenizer_and_head":1.8080630000000002}},{"form":"K128","file":"swift/timing/r12_swift_timing_20261004_132821/p2_K128.json","q94_latency_ms_median":100.576271,"footprint_end_bytes":887766184,"load_cold":{"seconds":9.901118583,"model_seconds":0.003061125,"main_seconds":9.898057458,"wall_with_tokenizer_and_head":10.43158975},"load_warm":{"seconds":1.295783167,"model_seconds":0.00117325,"main_seconds":1.294609917,"wall_with_tokenizer_and_head":1.851287458}},{"form":"D512L512q16","file":"swift/timing/r12_swift_timing_20261004_132821/p3_D512L512q16.json","q94_latency_ms_median":83.427187,"footprint_end_bytes":6313197312,"load_cold":{"seconds":9.824203,"model_seconds":0.0033567500000000004,"main_seconds":9.82084625,"wall_with_tokenizer_and_head":10.359709375},"load_warm":{"seconds":1.221793708,"model_seconds":0.0010605410000000001,"main_seconds":1.2207331670000001,"wall_with_tokenizer_and_head":1.783825958}},{"form":"U16","file":"swift/timing/r12_swift_timing_20261004_132821/p4_U16.json","q94_latency_ms_median":268.49852050000004,"footprint_end_bytes":954924416,"load_cold":{"seconds":9.715654749,"model_seconds":0.0032739160000000004,"main_seconds":9.712380833000001,"wall_with_tokenizer_and_head":10.24745625},"load_warm":{"seconds":1.370415501,"model_seconds":0.000990667,"main_seconds":1.3694248340000001,"wall_with_tokenizer_and_head":1.935061208}},{"form":"K64","file":"swift/timing/r12_swift_timing_20261004_132821/p5_K64.json","q94_latency_ms_median":117.38677050000001,"footprint_end_bytes":858488168,"load_cold":{"seconds":9.988893000000001,"model_seconds":0.0028852920000000002,"main_seconds":9.986007708,"wall_with_tokenizer_and_head":10.504939833},"load_warm":{"seconds":1.223610417,"model_seconds":0.0011161250000000001,"main_seconds":1.222494292,"wall_with_tokenizer_and_head":1.772409208}},{"form":"K128","file":"swift/timing/r12_swift_timing_20261004_132821/p6_K128.json","q94_latency_ms_median":99.70281250000001,"footprint_end_bytes":952237248,"load_cold":{"seconds":9.905317541,"model_seconds":0.0029663330000000003,"main_seconds":9.902351208,"wall_with_tokenizer_and_head":10.423825083},"load_warm":{"seconds":1.219770666,"model_seconds":0.001005375,"main_seconds":1.218765291,"wall_with_tokenizer_and_head":1.778043958}},{"form":"D512L512q16","file":"swift/timing/r12_swift_timing_20261004_132821/p7_D512L512q16.json","q94_latency_ms_median":83.1665625,"footprint_end_bytes":6322519616,"load_cold":{"seconds":10.172141292,"model_seconds":0.003486292,"main_seconds":10.168655,"wall_with_tokenizer_and_head":10.726353667},"load_warm":{"seconds":1.299260626,"model_seconds":0.0010335840000000002,"main_seconds":1.298227042,"wall_with_tokenizer_and_head":1.84837425}},{"form":"D512L512q16","file":"swift/timing/r12_swift_timing_20261004_132821/jit_D512L512q16.json","q94_latency_ms_median":83.06735400000001,"footprint_end_bytes":6279706088,"load_cold":{"seconds":19.768772333999998,"model_seconds":18.561249584,"main_seconds":1.20752275,"wall_with_tokenizer_and_head":20.276062584},"load_warm":{"seconds":1.428949042,"model_seconds":0.000985792,"main_seconds":1.42796325,"wall_with_tokenizer_and_head":2.108875292}}],"round7":{"load_seconds":{"cold":[9.485385958,1.225578958],"warm":[1.203179791,1.312993917]},"per_call_check":{"ms_per_call_median_per_process":[44.228886163157895,44.27134212631577],"gate_warm_median":47.738416484207846,"gate_transcript":"readout_fp16_pf16_4b.json","ratio_per_process":[0.92648414883617,0.9273734946981536]},"single":[{"item":"tv4_000:q0","row_tokens":94,"calls":6,"padded_tokens":96,"latency_ms":{"n":20,"median":264.005896,"p10":263.3690875,"p90":264.5591289,"min":263.03875000000005,"max":264.859167},"latency_ms_median_per_process":[263.7282915,264.34868700000004],"e2e_ms":{"n":20,"median":264.697375,"p10":264.0516622,"p90":265.2601375,"min":263.7515,"max":265.58312500000005},"graph_ms":{"n":20,"median":262.448479,"p10":261.80376640000003,"p90":262.9914160000001,"min":261.45745900000003,"max":263.291832},"tokens_per_s_at_median":356.05265421799515,"padded_tokens_per_s_at_median":363.62824260561206},{"item":"own_j03:q0","row_tokens":380,"calls":24,"padded_tokens":384,"latency_ms":{"n":20,"median":1062.9574375000002,"p10":1061.7891548,"p90":1068.0142709000002,"min":1060.3651670000002,"max":1077.680667},"latency_ms_median_per_process":[1062.975,1062.8903335],"e2e_ms":{"n":20,"median":1064.4307079999999,"p10":1063.2303456,"p90":1069.4186753000001,"min":1061.8176669999998,"max":1079.0775409999999},"graph_ms":{"n":20,"median":1061.2876430000001,"p10":1060.1370923,"p90":1066.3579564,"min":1058.791874,"max":1076.071795},"tokens_per_s_at_median":357.4931475090224,"padded_tokens_per_s_at_median":361.25623327227527},{"item":"own_L02:q0","row_tokens":1518,"calls":95,"padded_tokens":1520,"latency_ms":{"n":20,"median":4209.543250000001,"p10":4200.8036494,"p90":4233.6167711,"min":4199.440541999999,"max":4269.082875},"latency_ms_median_per_process":[4204.3995415,4213.9749170000005],"e2e_ms":{"n":20,"median":4215.4884795,"p10":4206.5905920000005,"p90":4239.4487413,"min":4205.168750000001,"max":4274.791042000001},"graph_ms":{"n":20,"median":4207.756877000001,"p10":4199.0615210999995,"p90":4231.7841029,"min":4197.6459559999985,"max":4267.320087},"tokens_per_s_at_median":360.6091943585566,"padded_tokens_per_s_at_median":361.0843052865652},{"item":"own_L01:q2","row_tokens":1802,"calls":113,"padded_tokens":1808,"latency_ms":{"n":20,"median":5014.2514165,"p10":5006.6143372,"p90":5071.2567708999995,"min":5004.048958,"max":5153.533167},"latency_ms_median_per_process":[5014.2514165,5014.354187500001],"e2e_ms":{"n":20,"median":5019.821542,"p10":5012.2132295,"p90":5077.103278799999,"min":5009.744000000001,"max":5159.5615},"graph_ms":{"n":20,"median":5012.441207000002,"p10":5004.781497699999,"p90":5069.4146501,"min":5002.215755999999,"max":5151.510374},"tokens_per_s_at_median":359.3756775079728,"padded_tokens_per_s_at_median":360.5722668892424}],"multi":[{"item":"b_m01_first5","record":"own_m01","questions":5,"state_len":137,"input_tokens":240,"row_tokens":[156,150,159,169,154],"shared_plan":{"state_len":137,"k":8,"shared_tokens":128},"p_bit_equal_every_rep":true,"direct":{"calls":51,"padded_tokens":816,"latency_ms":{"n":20,"median":2249.5432085,"p10":2246.3906041,"p90":2285.0134836,"min":2244.013792,"max":2291.502875},"latency_ms_median_per_process":[2247.9072085,2267.8172080000004],"e2e_ms":{"n":20,"median":2251.2581875,"p10":2248.2284756000004,"p90":2286.8765043999997,"min":2245.776042,"max":2293.426875},"input_tokens_per_s_at_median":106.68832636472561},"shared":{"calls":19,"padded_tokens":304,"latency_ms":{"n":20,"median":862.807042,"p10":860.8800545000001,"p90":877.1398663,"min":860.66575,"max":882.00525},"latency_ms_median_per_process":[862.3778125000001,866.537666],"e2e_ms":{"n":20,"median":864.4894790000001,"p10":862.5877337000001,"p90":878.846342,"min":862.347917,"max":883.6904590000001},"input_tokens_per_s_at_median":278.16184652790537},"shared_over_direct_median":0.383547663694498},{"item":"c_m01_all8","record":"own_m01","questions":8,"state_len":137,"input_tokens":320,"row_tokens":[156,150,159,169,154,168,154,169],"shared_plan":{"state_len":137,"k":8,"shared_tokens":128},"p_bit_equal_every_rep":true,"direct":{"calls":83,"padded_tokens":1328,"latency_ms":{"n":20,"median":3663.187854,"p10":3658.0302336,"p90":3694.2540827,"min":3655.200125,"max":3769.8750419999997},"latency_ms_median_per_process":[3661.071104,3664.2694585],"e2e_ms":{"n":20,"median":3665.861229,"p10":3660.6083667,"p90":3696.9975128,"min":3657.8006250000003,"max":3772.74375},"input_tokens_per_s_at_median":87.35560739823309},"shared":{"calls":27,"padded_tokens":432,"latency_ms":{"n":20,"median":1225.9832084999998,"p10":1222.2775462,"p90":1265.1143914,"min":1220.944708,"max":1300.850708},"latency_ms_median_per_process":[1225.391042,1226.0218755],"e2e_ms":{"n":20,"median":1228.547979,"p10":1224.8640628,"p90":1267.9575499999999,"min":1223.4909579999999,"max":1303.734083},"input_tokens_per_s_at_median":261.0149941543837},"shared_over_direct_median":0.3346765869954754},{"item":"d_L02_all4","record":"own_L02","questions":4,"state_len":1477,"input_tokens":1622,"row_tokens":[1518,1497,1539,1499],"shared_plan":{"state_len":1477,"k":92,"shared_tokens":1472},"p_bit_equal_every_rep":true,"direct":{"calls":380,"padded_tokens":6080,"latency_ms":{"n":20,"median":16897.4072085,"p10":16836.5008205,"p90":17063.388916300002,"min":16827.095624999998,"max":17177.611959},"latency_ms_median_per_process":[16848.352145999997,16991.7359795],"e2e_ms":{"n":20,"median":16903.960853999997,"p10":16843.101829799998,"p90":17070.3907,"min":16833.659291,"max":17184.555125},"input_tokens_per_s_at_median":95.99105827218722},"shared":{"calls":104,"padded_tokens":1664,"latency_ms":{"n":20,"median":4641.0337500000005,"p10":4630.3092206,"p90":4689.4580587,"min":4629.00175,"max":4718.09975},"latency_ms_median_per_process":[4631.333479500001,4656.398938],"e2e_ms":{"n":20,"median":4648.0368745,"p10":4636.7546831,"p90":4696.6749131,"min":4635.399292,"max":4725.208583},"input_tokens_per_s_at_median":349.49110206319875},"shared_over_direct_median":0.27465951981469644}]}}