Skip to main content

Proposal: Switching from Whisper to the new GPT-4o-transcribe model

As an active user of your Chrome extension, I'd like to suggest an improvement that would significantly enhance transcription accuracy.

1. Current issue

I've been using the extension for audio transcription for over a month. When working with Russian language, numerous errors occur. This requires extensive manual corrections, reducing work efficiency.

2. Solution: Transition to GPT-4o-transcribe

OpenAI has released a new transcription model that substantially outperforms the current Whisper: https://openai.com/index/introducing-our-next-generation-audio-models/

Key advantages:

  • Significantly improved accuracy (reduced Word Error Rate), tested on more than 100 languages

  • Better recognition of accents and regional speech patterns

  • Increased resilience to background noise during recording

  • Adaptation to varying speech speeds

  • Reduction of incorrect interpretations for complex words

  • Better context understanding and recognition of specific terminology

3. Alternative solution:

If the full GPT-4o-transcribe version proves too expensive, you could implement gpt-4o-mini-transcribe. Even this mini version significantly outperforms the current Whisper model in terms of accuracy and reliability.

4. Simple integration

This enhancement requires minimal effort — simply changing the model name used in the API request.

Status: Completed6 comments

Log in to comment and vote

Comments6

  • BlabbyAI Dev

    Team•

    Mar 21, 2025

    Thanks for the proposal! It doesn’t fully work yet, but I’ll add it as soon as it does
    https://community.openai.com/t/gpt-4o-transcribe-returns-audio-file-might-be-corrupted-or-unsupported/1148381

    • Web

      •

      Mar 24, 2025

      From what I gather in the latest forum posts, it seems they've found a solution to the problem.

      • BlabbyAI Dev

        Team•

        Mar 25, 2025

        I've tested it, and it seems a bit slower, but I'll add an option in the extension to choose between the Whisper and GPT models.

        • Web

          •

          Mar 26, 2025

          Great. That’s an excellent idea to add an option for selecting different models.

          When do you plan to update the app in the Google Chrome store? And will there be any notification about the update afterward?

          • BlabbyAI Dev

            Team•

            Mar 26, 2025

            Yes, you'll be notified when we have the update. I'm planning to add this option in the next day or two, but it might take longer since we have to wait for the Chrome Web Store to review the changes, so it could take up to a week.

            • Web

              •

              Mar 26, 2025

              Thank you, that's really great news.