RE: https://wetdry.world/@micr0/117626061627812378
This is pretty cool. Thanks for liberating the gooey center!
When I launched Cava Reader I said it was my first closed-source project. The app still is, but the part that does the actual cool stuff isn't anymore
Meet CavaAlign v1. You give it a recording and its text, and it tells you when every single word is said. It's tiny, it's fast, and it's the model I made for read along in Cava Reader, and it's now open source! (under AGPL-3.0)
One 16 MB file, 35 languages, it can run on a phone's CPU. Numbers are in the image attached, and yes, that's a 16 MB model next to a 378 MB and a 967 MB one, doing better than them, I double-checked lol
It's made for books, so footnotes and the "this is a LibriVox recording..." intros don't throw it off, it’s able to just skip them.
The old engine in Cava Reader needed a 40 MB download for every extra language except English (which was bundled). This one is 16 MB for all 35, and it ships inside the app binary, the size of the whole app is a smaller size too
The model weights, a Python example aligner, a Kotlin port for Android, and a guide for mobile apps are all on Hugging Face so it’s easy to get started using it in your own projects:
https://huggingface.co/cava-reader/cavaalign-v1
It’s a standard ONNX model, so it runs anywhere the ONNX Runtime does: phones, desktops, servers, Raspberry Pis, and it should even run in a browser. No GPU needed, it's fully offline, and it handles recordings of any length with flat memory use. If you have audio and its text, it'll time every word.
if you build something with it, please show me!! <3
#OpenSource #MachineLearning #Accessibility #Audiobooks #AGPL #CavaAlign