Skip to content

Integrate bbc/peaks.js for waveform display #212

Open

Description

@NickRuiz

Is your feature request related to a problem? Please describe.
Sometimes when transcribing long audio files there are long pauses. From an ASR (STT) standpoint, no speech regions may be detected, but there may be a muffled word that was missed. A quick view of the waveform can help pick out audio regions to listen to.

Describe the solution you'd like
Toggle display of the waveform below the time bar

Describe alternatives you've considered
Separate waveforms per audio channel would be great.

Additional context

Activity

  1. pietrop commented on Nov 8, 2019

    @pietrop
    Contributor

    👋 @NickRuiz

    Throwing another option into the mix,

    Replace the progress bar / or have an alternative progress bar in storybook using wavesurfer-js

    The issue I see with using peak.js (and might be wrong coz I am not super familiar with the library) is that it says in the README:

    Peaks.js was developed by BBC R&D to allow users to make accurate clippings of audio content in the browser, using a backend API that serves the waveform data.

    And if it does need a backend to generate the waveform data it would make it harder to keep it self contained as part of the component.

  2. NickRuiz commented on Nov 8, 2019

    @NickRuiz
    Author

    Good point. Thanks for sharing a few more-compatible alternatives.

  3. pietrop commented on Nov 18, 2019

    @pietrop
    Contributor

    @NickRuiz I thought you might find this interesting / useful bbc/stt-align-node if you are looking for a way to review results of STT?

    Click load demo- pietrop/stt-align-node in the example page.

    Out of curiosity what is your main use case for the TranscriptEditor component ?

  4. NickRuiz commented on Nov 18, 2019

    @NickRuiz
    Author

    Our transcribers/annotators use waveform display to quickly find the beginning of new "paragraphs", etc. Depending on how the ASR transcript is generated/segmented it might not be apparent when two adjacent words are separated by a long period of silence.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Enhancementa request for improvement

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions