Skip to content

chore(ci): refresh the Test Core shard-timings dataset - #24467

Open
github-actions[bot] wants to merge 1 commit into
mainfrom
claude/shard-timings-refresh-39202368342
Open

github-actions[bot] wants to merge 1 commit into
mainfrom
claude/shard-timings-refresh-39202368342

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

Refreshes scripts/test-shard-timings.json, the balancing input for the Test Core
shard split. Opened automatically by .github/workflows/shard-timings-refresh.yml.
Every byte came out of scripts/measure-test-shard-timings.mjs; nothing here was
hand-edited, and no bound, timeout or matrix entry was touched.

Regression readings: NOT MEASURED -- the diff refused (exit 1)

file:///home/runner/work/objectstack/objectstack/scripts/measure-test-shard-timings.mjs:1271
    throw new Error(
          ^

Error: packages/cli/test/serve-mcp-stdio-early-initialize.integration.test.ts:2: the budget 15 s is not on the 10 s grid. A test file's budget is ONE header line, `// test-budget: SECONDS — CLASS: REASON` (ruling records 6181973363 and 6212133431): SECONDS is the measured CI reading x 1.25 rounded up to the next 10 s, above the 10 s line; CLASS is one of "spawns the real producer once per single-cause fixture", "whole-package import", "compiles the package type graph once"; REASON is not empty. Refusing to guess which budget the file is held to.
    at refuse (file:///home/runner/work/objectstack/objectstack/scripts/measure-test-shard-timings.mjs:1271:11)
    at readTestBudget (file:///home/runner/work/objectstack/objectstack/scripts/measure-test-shard-timings.mjs:1298:29)
    at declaredBudgetInTree (file:///home/runner/work/objectstack/objectstack/scripts/measure-test-shard-timings.mjs:1323:10)
    at declaredBudget (file:///home/runner/work/objectstack/objectstack/scripts/measure-test-shard-timings.mjs:3404:40)
    at windowFiles (file:///home/runner/work/objectstack/objectstack/scripts/measure-test-shard-timings.mjs:1386:17)
    at diffMain (file:///home/runner/work/objectstack/objectstack/scripts/measure-test-shard-timings.mjs:3400:21)
    at main (file:///home/runner/work/objectstack/objectstack/scripts/measure-test-shard-timings.mjs:3460:24)
    at file:///home/runner/work/objectstack/objectstack/scripts/measure-test-shard-timings.mjs:3644:3
    at ModuleJob.run (node:internal/modules/esm/module_job:343:25)
    at async onImport.tracePromise.__proto__ (node:internal/modules/esm/loader:681:26)

Node.js v22.23.3

What the seat landing this PR does

File nothing from this refresh's readings: no rise and no file was judged. The refusal above
is a defect in this lane, and that is the one card to file.

Source

Measured across 7 accumulated run(s) of the HOURLY schedule run of CI on
main — the full-battery run (#16467). A push run on main is affected-only and
is not a measurement of the workspace, so no push run feeds this file.

No single green run measures the whole workspace either — turbo's cache is namespaced
per shard and only main pushes write it, so a
package whose inputs have not changed is a HIT and the generator refuses hits rather
than recording a replay as a duration. Runs are therefore accumulated, each fenced by
its own --run group, until every package has been EXECUTED by at least the
generator's minimum number of them, and each weight is the median of those executions.

All 75 package weights were measured in these runs; nothing was carried.

⚠️ This PR references #16173 and #16222 but does NOT carry a closing keyword for them,
because a weekly lane cannot know which cards a given run ought to retire. If this is
the first refresh to land, retire those two by hand as part of merging it.

Sample depth, run-to-run spread and suite-duration ceilings

Every one of the 75 weights rests on at least 3 executed runs; none is provisional.

Suite-duration ceilings: 72 held unchanged (a refresh never moves one; a raise is a ruling), 3 new (@objectstack/connector-imap, @objectstack/service-mailbox, @objectstack/service-print), each new one its slowest executed run in this window x 1.25.

Every package carries a ceiling.

⚠️ 17 package(s) ran OVER their held ceiling in this window (marked in the table): a reading, not a red -- under #22949 ruling E the ceiling reports on every event, and a regression is judged by the diff at the top of this body. This refresh does not raise them; that takes a ruling.

Each package's executed runs in this refresh (minimum 3), the spread of its readings in seconds, and the suite-duration ceiling Test Core grades it against: its slowest executed run x 1.25 when first set, then held by every refresh -- a ceiling is raised only by a ruling.

package runs min s median s max s max/min ceiling s
@objectstack/service-package 7 11.80 56.10 77.53 6.57× 32.90 held; this window: 96.92; ⚠ a window run is OVER its held ceiling
@objectstack/example-embed-objectql 5 15.95 36.60 41.75 2.62× 51.51 held; this window: 52.19
@objectstack/service-automation 7 257.94 421.20 648.55 2.51× 557.10 held; this window: 810.69; ⚠ a window run is OVER its held ceiling
@objectstack/knowledge-memory 7 2.43 4.94 5.79 2.38× 6.39 held; this window: 7.25
@objectstack/plugin-email 7 50.81 89.58 113.67 2.24× 119.94 held; this window: 142.09
@objectstack/connector-slack 7 19.54 34.08 41.49 2.12× 55.45 held; this window: 51.86
@objectstack/embedder-openai 7 3.98 6.53 8.29 2.08× 9.10 held; this window: 10.37
@objectstack/downstream-contract 7 9.73 15.04 19.92 2.05× 22.71 held; this window: 24.91
@objectstack/rest 6 399.75 589.43 810.02 2.03× 878.41 held; this window: 1012.53
@objectstack/example-showcase 7 70.14 134.65 141.40 2.02× 192.05 held; this window: 176.75
@objectstack/observability 7 1.92 3.28 3.81 1.98× 4.24 held; this window: 4.77
@objectstack/knowledge-ragflow 7 2.26 3.53 4.43 1.96× 3.40 held; this window: 5.55; ⚠ a window run is OVER its held ceiling
@objectstack/service-knowledge 4 25.18 38.19 48.56 1.93× 48.58 held; this window: 60.71
@objectstack/plugin-webhooks 5 51.92 89.12 99.81 1.92× 108.05 held; this window: 124.76
@objectstack/driver-mongodb 5 62.94 116.48 119.88 1.90× 158.96 held; this window: 149.85
@objectstack/plugin-auth 7 210.17 364.34 399.32 1.90× 600.45 held; this window: 499.15
@objectstack/sdui-parser 6 2.94 3.89 5.58 1.90× 5.18 held; this window: 6.98; ⚠ a window run is OVER its held ceiling
@objectstack/service-i18n 5 12.61 22.28 23.87 1.89× 49.45 held; this window: 29.84
@objectstack/service-storage 6 116.35 170.85 219.42 1.89× 208.28 held; this window: 274.28; ⚠ a window run is OVER its held ceiling
@objectstack/http-conformance 7 92.08 132.73 170.40 1.85× 149.61 held; this window: 213.00; ⚠ a window run is OVER its held ceiling
@objectstack/runtime 6 580.75 785.07 1072.49 1.85× 913.09 held; this window: 1340.61; ⚠ a window run is OVER its held ceiling
@objectstack/service-datasource 5 59.95 103.29 109.88 1.83× 128.93 held; this window: 137.36
@objectstack/connector-openapi 7 26.23 37.61 47.69 1.82× 61.57 held; this window: 59.62
@objectstack/plugin-pinyin-search 6 23.89 40.04 43.33 1.81× 62.37 held; this window: 54.17
@objectstack/example-todo 7 41.20 61.04 74.71 1.81× 88.84 held; this window: 93.39
@objectstack/example-crm 7 33.07 47.57 59.80 1.81× 68.83 held; this window: 74.76
@objectstack/plugin-approvals 6 181.11 236.69 325.18 1.80× 290.60 held; this window: 406.48; ⚠ a window run is OVER its held ceiling
@objectstack/service-sms 7 22.54 26.53 40.35 1.79× 47.04 held; this window: 50.44
@objectstack/service-realtime 6 8.12 12.93 14.54 1.79× 27.68 held; this window: 18.18
@objectstack/metadata-fs 3 31.41 42.15 56.16 1.79× 61.33 held; this window: 70.20
@objectstack/client 7 92.73 138.48 165.14 1.78× 179.74 held; this window: 206.43
@objectstack/driver-sqlite-wasm 5 66.03 77.97 115.36 1.75× 123.14 held; this window: 144.20
@objectstack/cloud-connection 6 164.09 215.78 283.85 1.73× 163.89 held; this window: 354.82; ⚠ a window run is OVER its held ceiling
@objectstack/plugin-security 7 223.50 285.53 385.68 1.73× 474.43 held; this window: 482.10
@objectstack/service-cluster-redis 6 17.09 27.45 29.46 1.72× 28.00 held; this window: 36.83; ⚠ a window run is OVER its held ceiling
@objectstack/lint 6 105.36 169.58 181.20 1.72× 332.18 held; this window: 226.50
@objectstack/metadata-protocol 5 455.64 598.00 783.05 1.72× 769.71 held; this window: 978.82; ⚠ a window run is OVER its held ceiling
@objectstack/driver-memory 5 90.11 150.01 154.64 1.72× 171.63 held; this window: 193.31
@objectstack/plugin-sharing 6 111.06 180.01 186.86 1.68× 235.53 held; this window: 233.58
@objectstack/service-cache 5 1.36 1.82 2.29 1.68× 3.69 held; this window: 2.87
@objectstack/formula 3 30.95 41.17 51.37 1.66× 56.95 held; this window: 64.22
@objectstack/service-analytics 5 234.97 310.41 388.40 1.65× 440.54 held; this window: 485.50
@objectstack/service-print 7 27.87 30.02 45.86 1.65× 57.33
@objectstack/service-settings 7 87.11 129.49 142.52 1.64× 157.56 held; this window: 178.15
@objectstack/platform-objects 5 65.74 86.24 107.51 1.64× 135.03 held; this window: 134.39
@objectstack/verify 6 124.29 159.02 203.04 1.63× 418.97 held; this window: 253.80
@objectstack/driver-sql 5 243.39 377.63 396.21 1.63× 450.76 held; this window: 495.27
@objectstack/plugin-audit 6 140.41 182.09 228.51 1.63× 185.93 held; this window: 285.64; ⚠ a window run is OVER its held ceiling
@objectstack/service-cluster 7 17.54 26.66 28.43 1.62× 28.46 held; this window: 35.54
@objectstack/organizations 6 65.43 95.63 106.00 1.62× 137.91 held; this window: 132.50
@objectstack/trigger-api 5 15.39 19.89 24.81 1.61× 42.12 held; this window: 31.01
@objectstack/service-messaging 5 111.27 132.72 179.08 1.61× 166.91 held; this window: 223.86; ⚠ a window run is OVER its held ceiling
@objectstack/plugin-dev 6 41.54 60.42 66.03 1.59× 87.97 held; this window: 82.54
@objectstack/spec 4 983.84 1336.15 1555.84 1.58× 1903.55 held; this window: 1944.80
@objectstack/driver-turso 4 182.15 250.01 287.93 1.58× 272.37 held; this window: 359.92; ⚠ a window run is OVER its held ceiling
@objectstack/client-react 6 8.75 11.58 13.74 1.57× 16.23 held; this window: 17.18
@objectstack/connector-rest 7 34.03 38.27 52.99 1.56× 60.82 held; this window: 66.24
@objectstack/types 3 20.25 29.96 31.30 1.55× 32.05 held; this window: 39.13
@objectstack/hono 6 32.96 39.53 50.64 1.54× 45.99 held; this window: 63.30; ⚠ a window run is OVER its held ceiling
@objectstack/vitest-filter-preflight 6 19.07 28.65 29.24 1.53× 28.93 held; this window: 36.55; ⚠ a window run is OVER its held ceiling
@objectstack/connector-mcp 6 34.11 43.53 51.37 1.51× 54.85 held; this window: 64.22
@objectstack/trigger-schedule 7 42.90 49.48 64.45 1.50× 72.40 held; this window: 80.57
@objectstack/service-mailbox 6 50.28 60.57 74.96 1.49× 93.70
@objectstack/metadata 4 122.14 159.82 181.98 1.49× 194.04 held; this window: 227.48
@objectstack/service-queue 6 35.61 46.52 52.66 1.48× 83.25 held; this window: 65.82
@objectstack/metadata-core 5 21.52 29.80 31.34 1.46× 38.66 held; this window: 39.18
@objectstack/core 5 102.91 141.12 146.81 1.43× 151.42 held; this window: 183.51
@objectstack/service-job 5 26.01 34.91 36.94 1.42× 45.32 held; this window: 46.18
create-objectstack 4 17.95 22.31 25.39 1.41× 38.40 held; this window: 31.74
@objectstack/plugin-hono-server 5 58.60 74.61 82.11 1.40× 78.61 held; this window: 102.64; ⚠ a window run is OVER its held ceiling
@objectstack/mcp 5 77.94 103.71 106.52 1.37× 108.17 held; this window: 133.15
@objectstack/connector-imap 6 2.88 3.65 3.83 1.33× 4.79
@objectstack/objectql 3 683.19 892.57 896.33 1.31× 952.27 held; this window: 1120.41
@objectstack/trigger-record-change 5 68.10 77.91 85.49 1.26× 109.12 held; this window: 106.86
@objectstack/cli 7 2440.94 2519.78 2628.50 1.08× 2868.12 held; this window: 3285.63

Measured per-shard suite time on the newest run in the set

1: 1010s  |  2: 1320s  |  3: 1159s  |  4: 1464s  |  5: 5s  |  6: 668s

Predicted bins, before and after

BEFORE  partition-test-shards: self-test OK (73 measured packages -> 75 shard items, 6 shards, max/mean 1.00x <= 1.3x, floor 1331s, bins 1937.14/1938.17/1937.85/1935.62/1934.09/1935.99s within the 2205.79s density cap, file-level slices: @objectstack/cli x3)
AFTER   partition-test-shards: self-test OK (75 measured packages -> 77 shard items, 6 shards, max/mean 1.00x <= 1.3x, floor 1336s, bins 2201.57/2202.88/2200.73/2203.97/2204.58/2202.50s within the 2519.78s density cap, file-level slices: @objectstack/cli x3)

No checks will start on this PR by themselves

It was opened with the Actions GITHUB_TOKEN, and GitHub's recursion guard means a
PR opened that way triggers no workflow runs. Push any commit to the branch, or close
and reopen the PR, to start CI.

Refs #16464, #16173, #16222.

Regenerated by .github/workflows/shard-timings-refresh.yml from the test-core-run-summary artifacts of 7 accumulated run(s) (39202368342 39197429467 39192681060 39188268133 39184708096 39178996284 39174682274), newest 39202368342 at 725a5b1. Generated, never hand-edited.
@github-actions github-actions Bot added the skip-changeset PR has no user-facing published change; bypasses the changeset gate label Oct 19, 2026
This was referenced Oct 19, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

skip-changeset PR has no user-facing published change; bypasses the changeset gate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants