Transcribe.cpp
101 points by sebjones 3 hours ago | 15 comments

ukuina 6 minutes ago
What's the easiest way to add speaker separation to this?
reply
aomix 9 minutes ago
What good timing to spot this. I've been reading more and more people talk about bringing TTS into their prompting toolkit and wanted to give that a try. The idea of rambling brain dump into a doc -> edit pass -> send to the robot loop sounds appealing.
reply
ghm2199 28 minutes ago
Congrats on shipping this. I love handy on my Mac, my phone for STT in situations where it’s not possible/poor performance of the native Model for STT(e.g apple’s thing is not upto scruff, like mistranslating words corresponding to a domain).

Noob question: How do you think about funding from a foundation(i have no clue if you need it or not, I do hope you have a way to get paid one way or another because handy is amazing) for maintenance of this? if you did or were going to get paid by asking for maintaining such a project what might be the kind of organizations you would look for to get supported and how would you do it?

reply
bengotow 21 minutes ago
This is an incredible contribution to the community and it's just... one guy? I kept reading expecting a Series A funding announcement at the bottom.

It's a nice reminder: You can use AI to slop cannon at maximum speed, or you can use it to scale your ambitions and build something more rigorous and lasting than ever before.

I'd build Transcribe.cpp into the apps I maintain, but I feel like this functionality should (generally) be integrated into the OS or "everywhere" via an app like Handy.

reply
yjftsjthsd-h 2 hours ago
So it's mostly intended to be a better replacement for whisper? Mostly? With better support for more models and maybe acceleration backends?
reply
sbinnee 50 minutes ago
I saw that metal is almost x10 faster than vulkan? Why so much gap?
reply
aarvin_roshin 2 hours ago
Spot on:

> I think as we look forward to the future, more inference will start happening locally for one reason or the other. This brings the distribution story front and center. In order to have more applications running inference locally, we need to make running inference easier.

This makes these projects so much more trustworthy and easier to approach:

> Were any of the words here written using AI? Nope. They came from my mouth or my fingers.

reply
boplicity 53 minutes ago
>This makes these projects so much more trustworthy and easier to approach:

>> Were any of the words here written using AI? Nope. They came from my mouth or my fingers.

I have to push back on this a bit, as I believe (quite strongly) that we're shaped by the tools we use; text-to-speech LLMs are still LLMs, and generally their mistakes are shaped by the expectations inherent in their training. This, in turn, shapes the words that appear on the screen. For those who regularly use them, you then learn which word sequences are likely to be accurately transcribed, and this definitively becomes part of your thinking process. Over time, the LLM becomes tangled into your thinking; the use of AI, even in this way, very much can and often does shape the resulting words.

reply
eventualcomp 7 minutes ago
Isn't this like saying "my words are not really my own when I speak to my family, because I know my father is a non-native English speaker and hard of hearing so I try to use words which are well enunciated and are few in syllable count"?
reply
nullsanity 9 minutes ago
[dead]
reply
shade 21 minutes ago
Nice - I'm definitely going to take a look at this. I've built my own cross-platform (Mac/Win/Linux) live captioning app on top of Nemotron, and it works well but dealing with ONNX is kind of annoying. With this having Rust support (I built it on Rust/Tauri) it should be a pretty solid candidate; I'll have to see if I can find a Silero VAD implementation that doesn't depend on ONNX, or maybe I'll see if the clankers can migrate it for me.
reply
arikrahman 2 hours ago
Excellent work, paired with the 500kb TTS model headlining today I can see the full stack coming together.
reply
zuzululu 44 minutes ago
saw the demo its impressive but the audio was robotic
reply
zuzululu 44 minutes ago
would love to see a demo handy is fantastic although its still behind the frontier models
reply
therealpygon 40 minutes ago
Pretty sure I saw Handy using it; if you have the latest version, you’re probably already demoing it.
reply
loufe 39 minutes ago
author of the blogpost is the maintainer of Handy, so almost guaranteed!
reply