All pull requests

Pull requests

• OLMoE3: log the OLMo-core hero's metrics, fix z-loss under GA, and add OLMo-core's perplexity evals

  #5880·AkshitaB opened Oct 21, 2026·

  ·
  5

• feat(benchmarks): expose elastic training, goodput, checkpointing and data-input overrides in recipes and CTK runner

  #5879·hsuan-lun-chiang opened Oct 21, 2026Collaborator·3 of 4 tasks·

  ·
  5

• Draft the rest of m3: MoE runtime, infra transforms, kernels, Qwen3-MoE and DeepSeek-V3

  #5878·bvandermoon opened Oct 21, 2026Collaborator·4 tasks done·

  ·
  4

• Scheduling extension

  #5877·jberchtold-nvidia opened Oct 21, 2026Contributor·4 tasks·

  ·
  2

• Support moe_dropless_fallback=layer on the ragged all-to-all MoE path

  #5876·d0t2 opened Oct 21, 2026Collaborator·4 tasks done·

  ·
  4

• Add general scan support for M3

  gemini-review
  #5875·hengtaoguo opened Oct 20, 2026Collaborator·4 tasks·

  ·
  18

• Use public Orbax V1 Checkpointer logger API.

  #5874·copybara-service[bot] opened Oct 20, 2026Bot·

  ·
  1

• Add TE MoE cuDNN GMM fusion override

  #5873·jberchtold-nvidia opened Oct 20, 2026Contributor·4 tasks done·

  ·
  4

• fix(ci): replace job-level always() with !cancelled() and avoid cancelling in-progress scheduled runs

  #5872·SurbhiJainUSC opened Oct 20, 2026Collaborator·4 tasks done·

  ·
  10

• Speed up moe_test.py by overriding full Mixtral-8x7B dimensions and caching reference runs

  #5871·SurbhiJainUSC opened Oct 20, 2026Collaborator·4 tasks done·

  ·
  6

• Require orbax-checkpoint>=0.12.8 and regenerate MaxText requirements.

  #5869·copybara-service[bot] opened Oct 20, 2026Bot·

  ·
  1

• Restore backward-compatible Profiling mixin on RLConfig and map legacy step flags

  pull ready
  #5868·SurbhiJainUSC opened Oct 20, 2026Collaborator·4 tasks done·

  ·
  3

• OLMoE3: global load balancing, seq-major vocab tiling, and GA memory fixes for the OLMo 3.5 hero replay

  #5867·AkshitaB opened Oct 20, 2026·

  ·
  4

• Prefetch FSDP weights per sub-layer for inhomogeneous blocks (Qwen3.5)

  #5865·darisoy opened Oct 20, 2026Collaborator·7 tasks done·

  ·
  10

• build(deps): add diffusers as a pre-training extra dependency

  #5864·lydhr opened Oct 20, 2026Collaborator·4 tasks done·

  ·
  2

• Add evaluation and MoE routing metrics to RL TensorBoard logging

  #5863·barnes-vidit opened Oct 20, 2026Contributor·2 of 4 tasks·

  ·
  4

• Eliminate layout-mismatch copies in MaxText RMSNorm scale multiplication.

  #5862·copybara-service[bot] opened Oct 20, 2026Bot·

  ·
  1

• Eliminate standalone bf16 unfused_reshape instructions in RoutedMoE.permute and RoutedMoE.unpermute via direct token gather and repeat-major unsorting.

  #5861·copybara-service[bot] opened Oct 20, 2026Bot·

  ·

• Enable direct position frequency computation with sharding in YarnRotaryEmbedding.

  #5860·copybara-service[bot] opened Oct 20, 2026Bot·

  ·

• Fix pass@K RL evaluation returning the last sample's result

  #5859·harshaa765 opened Oct 20, 2026·4 tasks done·

  ·
  3

• Fix prefill batch sharding for cached_ar_lengths

  #5857·shawnwang18 opened Oct 20, 2026·4 tasks done·

  ·

• Add DeepSeek-V4-Pro (1600B) announcement to README Latest news

  gemini-review
  #5854·AusarYao28 opened Oct 20, 2026Collaborator·4 tasks done·

  ·
  4

• Fix DeepSeek-V4 SFT EOS loss masking and chat encoding

  gemini-review
  #5853·AusarYao28 opened Oct 20, 2026Collaborator·4 tasks done·

  ·
  5

• Pre-build and distribute GPU test venv artifact to install dependencies once across CI workers

  #5852·copybara-service[bot] opened Oct 19, 2026Bot·

  ·
  2

  

• Use the sequence-wise balance loss for DeepSeek-V4 routers

  gemini-review
  #5850·AusarYao28 opened Oct 19, 2026Collaborator·4 tasks done·

  ·
  7