Shortrocity EP4: Syncing Captions to Audio with Whisper

In this video I use OpenAI Whisper to synchronize automatic captions to CZcams Shorts for my Shortrocity AI CZcams short generator project.
GitHub: github.com/unconv/captacity
Support: buymeacoffee.com/unconv
Consultations: www.buymeacoffee.com/unconv/e...
Memberships: www.buymeacoffee.com/unconv/m...
00:00 Intro & Recap
03:46 Making up a name
04:32 Generate short without captions
05:49 Initialize Whisper
08:17 Fixing short without captions
09:27 Transcribe words with Whisper
11:09 Parse Whisper results
14:53 Drawing caption on video
25:58 Styling the text
27:40 Extracting audio automatically with FFMPEG
34:27 It almost works
36:27 It works!
37:41 Commit working version
38:25 Drawing multiple words at the same time
42:28 Implement word wrap
57:00 Fixing missing words
1:04:52 Git commit
1:05:39 Final version with multiple lines

[@HealthyHive-oo6vc]

I'm eagerly anticipating your next video, Sir. Could you create one focusing on OpenDevin, and its integration with some open-source LLms.

[@HealthyHive-oo6vc]

Always fascinating as usual. Much love Sir!

[@unconv]

Thank you!

[@loryo80]

very good video as usual, there was just a little mistake Groq is with Q not Groc with c so there was a loss of orginal word after transcription. hank you for te video keep sharing, i love what you are doing

[@unconv]

Thanks. I will address the issue in the next video

[@ThaiNeuralNerd]

Great video! I really appreciated the insights on the coding style for Creating YT Short Transcriptions. It was informative and well-presented. Keep up the fantastic work! Consider the same for multi-lingual.

[@unconv]

Thanks! It should already work in any language, though

[@gold-junge91]

Really great Video, Aswell with the Coding showing, for People as that are in Learning Python.

[@unconv]

Thank you very much!

[@anfiiaidev]

Hey There Love your videos

[@unconv]

Thank you!

[@anfiiaidev]

@@unconv I am beginner to AI(Like not on your level) what would you recommend me to learn to become such master? Love to get a response back on it from you...

[@BradBounds]

Please update as Elevenlabs and OpenAI have changed the way to use there API'S.

[@unconv]

What do you mean?

[@BradBounds]

Your scripts will no longer work with elevenlabs API calling or OpenAi Api as of 6 days ago. I have tried everything to get them to work with the changes to elevenlabs and openai and have failed misuerably.Any chance of updating the Shortrocity scripts to amend the resent depriciations from OpenAi and Elevenlabs?@@unconv

[@BradBounds]

For instance Davinci 003 has been depreciated and God only knows what elevenlabs has done.@@unconv

[@petswolrd280]

could u use moviepy for better styles and colors for sub titiles

[@unconv]

Perhaps. We'll see in a future video :)