this post was submitted on 09 Jan 2025
379 points (98.7% liked)
Opensource
1593 readers
715 users here now
A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!
⠀
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I don't mind the idea, but I would be curious where the training data comes from. You can't just train them off of the user's (unsubtitled) videos, because you need subtitles to know if the output is right or wrong. I checked their twitter post, but it didn't seem to help.
subtitles aren't a unique dataset it's just audio to text
They may have to give it some special training to be able to understand audio mixed by the Chris Nolan school of wtf are they saying.
No, if you have a center track you can just use that. Volume isn't a problem for a computer listening to it since they don't use the physical speakers.
I hope they're using Open Subtitles, or one of the many academic Speech To Text datasets that exist.