Skip to content

fix(desktop-gpui): transcribe only the audio the timeline keeps - #2747

Open
yashranaway wants to merge 3 commits into
CapSoftware:mainfrom
yashranaway:fix/trim-transcription
Open

yashranaway wants to merge 3 commits into
CapSoftware:mainfrom
yashranaway:fix/trim-transcription

Conversation

@yashranaway

@yashranaway yashranaway commented Oct 20, 2026 •

Copy link
Copy Markdown
Contributor

generating captions decoded and transcribed every recording segment in full, ignoring the timeline. so a 30 minute recording trimmed down to 1 minute still sent all 30 minutes through the model, which is slow and was half of what #2719 hit. the long input crash itself was already fixed by #2539.

now it works out the source ranges the timeline actually keeps, merges overlaps, joins just those into one audio buffer and runs the model once, then maps word times back to source time through an offset table so caption placement doesn't change. if an undo brings back audio while it's running, it asks you to generate again instead of applying partial captions. the captions oracles pass.

fixes #2719

RetriggerView in GreptileConfidence Score: 5/5

The PR appears safe to merge; no new actionable issues were found.

Summary

Caption generation now reads only audio kept by the timeline. Overlapping source ranges are merged, joined for one transcription call, and mapped back to source times.

  • Caption generation transcribes only audio kept by the timeline.
  • The editor checks that the timeline still fits the transcribed audio.

Reviews (3) · Last reviewed commit: "fix(desktop-gpui): transcribe kept range..." · Reviewed by Greptile

@vercel

vercel Bot commented Oct 20, 2026

Copy link
Copy Markdown
Contributor

@yashranaway is attempting to deploy a commit to the Cap Software Inc Team on Vercel.

A member of the Team first needs to authorize it.

@yashranaway

Copy link
Copy Markdown
Contributor Author

@greptileai review

Comment thread apps/desktop-gpui/src/editor_tabs.rs
@yashranaway

Copy link
Copy Markdown
Contributor Author

@greptileai review

@superagent-security superagent-security Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Superagent found 1 security concern(s).

Comment thread apps/desktop-gpui/src/transcription.rs
@yashranaway

Copy link
Copy Markdown
Contributor Author

@greptileai review

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Captions fail on trimmed recordings: Parakeet transcribes full untrimmed audio and crashes on >~6.5 min (ONNX broadcast error 3042 by 8042)

1 participant