CHROME / EDGE BROWSER EXTENSION TO AUTO GENERATE TRANSLATED LIVE SUBTITLE / LIVE CAPTION
Vložit
- čas přidán 12. 09. 2024
- Source:
github.com/bot...
Chrome/Edge extension that can RECOGNIZE any live audio/video streaming using Chrome Speech Recognition builtin API then TRANSLATE it for FREE!
You need to install CORS Unblock Chrome extension before install this extension to avoid default CORS Blocking Policy of Chrome and Edge
You will also need Stereo Mix recording device for best recognizing
Installation:
Turn on Chrome Developer Mode then Load Unpacked folder
In Control Panel, open Sound, choose Speaker as Output Device and Stereo Mix as Recording Device
If you get some glitches when clicking the start/stop button (the start stop stage not change) then you need to open DevTools window by open Extensions (or just type chrome://extensions in URL box) then click that "service worker" link of this extension.
Check my other Speech Recognition projects :
Android Live Subtitle : • ANDROID LIVE SUBTITLE ...
Android VOSK Powered Live Subtitle : • ANDROID VOSK POWERED L...
Web HTML Template : • WEB HTML TEMPLATE TO A...
Python Based Simple Command Line AUTOSRT : • How To Automatically G...
ANDROID-AUTOSRT : • ANDROID AUTOSRT : AUTO...
ANDROID-AUTOSRT-V2 : • ANDROID AUTOSRT V2 : A...
PyAutoSRT : • PyAutoSRT : a DESKTOP ...
Python Desktop App Live Subtitle : • PYTHON VOSK LIVE SUBTI...
Java Desktop App Live Subtitle : • JAVA VOSK LIVE SUBTITL...
GITHUB :
Check my other SPEECH RECOGNITIION + TRANSLATE PROJECTS in github.com/bot...
BUY ME COFFEE : sociabuzz.com/...
#javascript #chrome #edge #extension #addon #closedcaption #subtitles #googletranslate #transcription #translation #speechrecognition #voicerecognition #livecaption #livesubtitle
I love you, you are the greatest person in the field of translation
Amazing work it works perfectly. If i could give some feedback, maybe trying to get the windows bigger so it could probably keep more lines of sentences on the screen instead of just enlarging the same 3 lines of sentences, otherwise I'm in love
Thanks for your feedback
Please try this update : github.com/botbahlul/crx-live-translate/releases/
Woow thank you so much, I've been looking for years live captions but didn't work very well
feel free to test my other projects : github.com/botbahlul?tab=repositories
Really well done creating this application OP!!
Works well, just a shame it can't translate German as well XD
Deutsch is German language
hello It seems that I'm the only one experiencing issues with this. It appears to have been 14 hourse since the last update of this extension. Could that be the problem?
Can you please click that "VMnnn:nnn" of the console.log error (where nnn is VM and line numbers). It will point you to the source code that gave error. Please copy & paste that line here.
Hi please answer that question : How can i use it using headset ? seems like it doesn't work with headset .
If you have VIRTUAL AUDIO CABLE already installed just change that WAVE OUT to your headset device like this : drive.google.com/file/d/1HJqICu3VYa7cI6rbqcbVVkSZJLDa-N4z/view?usp=sharing
If you don't have VAC and only using STEREO MIX just change that playback of sound control panel to your headset device like this : drive.google.com/file/d/1XFuSbEtRF20seThQZ-iFz8mIXcmIvBZT/view?usp=sharing
HAVE YOU READ THE README PAGE OF MY REPO?
github.com/botbahlul/crx-live-translate
@@botbahlul5735 Thank you so much , can you help me with a link where I can download VAC without trial version .
Except for CZcams, there are subtitles suspended on the entire screen, and other like Twitch and Netflix have no subtitles when they are on the whole screen
This extension can only show subtitles if you entered full screen mode by using F11 key. Other than that, it can't reach the topmost of screen's components (javascript limitation, or maybe it was me that didn't know how to handle it yet?).
If you're still want to see the video in fully full screen mode, maybe you can try my other app : github.com/botbahlul/pyvosklivesubtitle
But please note that this app support only 23 video languages, even though it can translate to any languages supported by google translate.
Check latest update!
I've added a CUSTOM FULLSCREEN BUTTON on the RIGHT BOTTOM CORNER OF THE VIDEO when you run this extension, so we can watch the video in fullscreen mode and subtitles will be shown!
Please let me know if you find any bugs.
Sorry, I'm very stupid, how can I make the microphone record the screen?
if you're using STEREO MIX :
czcams.com/video/Bd3moKLV5sE/video.html
if you're using VIRTUAL AUDIO CABLE :
czcams.com/video/bl0NQAjHbws/video.html
Okay.. I Have Another Question
How Can I Get Rid of the Word `trial` Because It Says When I Run the App @@botbahlul5735 😅
Do you know how to save captions as a text file that chrome live caption generates?
I'm still working on it..
this FILE API will be a good start
web.dev/read-files/
for now, if you want to record a video and get its transcription (in SRT format) for FREE you can use my other project
czcams.com/video/Ga5aBnjcLtw/video.html
If you need a BETTER RESULTS you can use PROPRIETARY SOFTWARES like Corel Video Studio or Adobe Premiere Pro
@@botbahlul5735 thank you for your answer. I also try to find a solution, chrome caption is very accurate and interesting.
@@danamustafa1936 webkitspeechrecognition has an UNEDITABLE DEFAULT 10 SECONDS PAUSE THRESHOLD
it's hard to create a TIME STAMP when trying to generate SRT FILE
@@danamustafa1936 Please try this update and let me know what you think : github.com/botbahlul/crx-live-translate/releases/
Can you copy ans paste the text? Cuz if it is, then my job as a transcriber will be easy af
Try latest version : github.com/botbahlul/crx-live-translate/releases
or just do : git clone github.com/botbahlul/crx-live-translate
Every time you stop (by clicking that start/stop button) there will be "transcript.txt" and "translated_transcript.txt" files on your browser download folder (download folder set in your browser settings).
Please note that you need to open DevTools window to make sure this button work properly.
To open DevTools window :
- open Extensions (or type chrome://extensions/ in url box)
- click on the "service worker" link of this extension.
The main purpose of this extension is to understand what they are talking in a LIVE STREAMING.
If you can download the video first you better use whisper_autosrt : github.com/botbahlul/whisper_autosrt to get its transcriptions.
Feel free to try my other projects : github.com/botbahlul?tab=repositories
I did all process but I can’t able get live captions from system inbuilt audio?
Could any one please for this😢
I assume you don't have VIRTUAL AUDIO CABLE so your only option in Windows is using STEREO MIX.
Make sure you've already installed CORS Unblock Chrome extension and TURN IT ON (You will see a "C" letter on its icon when it turned on).
Open Control Panel, search for "Sound" in Control Panel's Search Box you will see some search results, click on "Manage Audio Devices" of Sound group.
Go to PLAYBACK tab, click on Speaker, and click on "Set default" button below.
Go to RECORDING tab, click on Stereo Mix then click on "Set default" button below. If you don't see that Stereo Mix, right click anything on that Recording tabs list, click on "Show disabled device", then click Enable.
Double click that Stereo Mix to open its Properties window, click on Listen tab, click on "Listen to this device" check box to mark it as checked.
On "Playback through this device" list box select Speaker
Goto LEVELS tab, slide that Stereo Mix volume level about 50% (can be less or more) just to make sure it doesn't give you that very loud speaker beep.
After complete those steps you should be able to turn this extension on and enjoy your captions and translated captions.
I hope this help you.
i installed it on ubuntu but its doesnt work, its show error "Uncaught (in promise) Error: Could not load file: 'js/moment.min.js'."
my bad, it seems that I forgot to include that file, sorry
I've added that missing file, you can check it now
Do you use google's or deepl's or something else?
For this extension I use WEBKITSPEECHRECOGNITION API from Google Chrome
developer.chrome.com/blog/voice-driven-web-apps-introduction-to-the-web-speech-api/
For other apps ( check my git repo : github.com/botbahlul?tab=repositories ),
I use various FREE API like :
VOSK
github.com/alphacep/vosk-api
FASTER_WHIPER (a modifed version of OpenAI WHISPER)
github.com/guillaumekln/faster-whisper
and ofcourse Google Speech Recognition API
( modified version of this : github.com/agermanidis/autosub )
Can i use it on any site? and can it work without virt cabel, like on your guide?
Please try on youtube first to check if all of configuration has been setup correctly.
After that you can try on other sites.
Some sites may restrict the use of javascripts other than their own.
Virtual Audio Cable will give best results, but
Stereo Mix will still work.
How to install it on Edge
check this picture ibb.co/gSHYMsJ
Is there a way to save Google chrome live caption as a text?
For this extension I'm still can't find any way to create time stamps of transcriptions because the limitation of webkitspeechrecognition API.
If you know how to DOWNLOAD THE VIDEO FIRST, please use my other apps like
autosrt : github.com/botbahlul/autosrt (130+ languages support)
pyautosrt : github.com/botbahlul/PyAutoSRT (GUI version of autosrt)
vosk_autosrt : github.com/botbahlul/vosk_autosrt (23 languages support)
whisper_autosrt : github.com/botbahlul/whisper_autosrt (100+ languages support)
If you're still want to get a file transcription of a LIVE STREAMING then you can try :
pyvosklivesubtitle : github.com/botbahlul/pyvosklivesubtitle (23 languages support)
Feel free to try my various projects : github.com/botbahlul?tab=repositories
PLEASE READ CAREFULY THE README PAGE OF EACH APP!
@@botbahlul5735 Thanks for your response. Can you recommend an Android app similar to Google Chrome's live caption? I'm looking for something that can display captions even when using a headset, as many apps, such as Live Transcribe, require speakers (Any audible voices).
Please try this update and let me know what you think : github.com/botbahlul/crx-live-translate/releases/download/crx-live-translate-0.1.5/crx-live-translate-0.1.5.zip
Thx man!
check the others
github.com/botbahlul?tab=repositories
@@botbahlul5735 💟
di 0:50 saya pencet yg live translate gk bisa si ka, malah keluanya file
lha memang harus didownload filenya
habis gitu tinggal ngikut di video langkah-langkah selanjutnya (ekstrak, install, dst)
hi, great works! can you make one that works on android broswer without vlc? Thanks.
You can run this extension on android if you install android browsers that support extension.
www.androidpolice.com/browsers-that-support-extensions-on-android/
Fell free to try my other apps :
github.com/botbahlul?tab=repositories
Thanks for your quick reply. How about the requirements for stereo mix or virtual audio cable?
@@chewgimhan4351 Just use it in a quiet room, as long as your android device has a good quality mic, it will work.
AFAIK there's no such a virtual driver like Windows Virtual Audio Cable in Android system.
If you're not satisfy with this extension, I recommend you to try Android Vosk Live Subtitle - V3 : github.com/botbahlul/VOSK-Powered-Live-Subtitle-V3
Thanks, i tried to install it in kiwi broswer, not sure why is there an error msg when I click translate
@@chewgimhan4351 Have you installed CORS UNBLOCK EXTENSION and TURN IT ON?
I have to warn you that using this extension on android is a bit tricky. When the mic is listening to audio/video, the audio/video sometimes will stop. You have to tap the video play button again every time the audio/video stop.
If the audio languages you want to use are supported by VOSK (23 languages) I recommend you to use Vosk Live Subtitle V3 instead : github.com/botbahlul/VOSK-Powered-Live-Subtitle-V3
do this tool one work on other sites to
It will work on almost all kind of streaming website as long as you're correctly setup everything as I instructed in the readme page : github.com/botbahlul/crx-live-translate
But some websites may restrict the use of javascripts other than their own.
it's seems it doesnt work for me, it gives me a error js/background.js:0
2 errors also
Uncaught (in promise) Error: Could not establish connection. Receiving end does not exist.Uncaught (in promise) Error: Could not establish connection. Receiving end does not exist.
Uncaught (in promise) Error: Cannot access a chrome:// URL
did some testings on CORS and my last failed by this reason, i have no idea what to do Server does not support PATCH Method (status code: 405)
ok i figured out, it works fine but it doesnt show translation instead. but recognizes voice perfectly (the reasons of errors above is still there, i think it's an AI translation problem that did you use API from them (?) because it's still a connection problem im not really sure)
@@lolo-bb6yc First of all, you need to install CORS UNBLOCK EXTENSION and click it to ACTIVATE it (it will show that "c" letter on its icon when activated) to make this extension translate function to work.
chrome.google.com/webstore/detail/cors-unblock/lfhmikememgdcahcdlaciloancbhjino
This extension is using webkitspeechrecognition API from Google Chrome
developer.chrome.com/blog/voice-driven-web-apps-introduction-to-the-web-speech-api/
Make sure that google servers is not banned by your ISP/Country.
My I know on which streaming site did you test this extension?
Some of youtube sites (not all) have their own javascript that sometimes will interrupt this extension, so on that kind of site you need to manually re-click this extension start/stop button.
Another thing, when you right click this extension icon, thare's "Option" menu that when you click on it, it will show options of language selection and show/hide checkbox to show/hide recognized text and translation text. Have you checked them correctly?
@@botbahlul5735 yes i checked them eventually and turned on, i was using it for twitch and CORS UNBLOCK EXTENTION was turned on as well, i'm not sure if google servers banned, would it work if i turned VPN too?
there is no arabic?
You're right, I've missed it.
Here's the update : github.com/botbahlul/crx-live-translate/releases/download/crx-live-translate/crx-live-translate.zip
it doesn't work :(
please READ CAREFULY all of the INSTRUCTIONS on github.com/botbahlul/crx-live-translate README PAGE
Show me the screenshot of what you have tried (using STEREO MIX or VIRTUAL AUDIO CABLE, CORS Unblock has INSTALLED and TURNED ON, etc)
You can create an account on Github and create a New Issue on my repo to post all the screenshot
YOU CAN ALSO TRY MY OTHER LIVE SUBTITLE APP like PyVoskLiveSubtitle github.com/botbahlul/pyvosklivesubtitle
@@botbahlul5735 thank you, but it doesnt smoothy work
:(
@@nguyentrantienanh3342 it's working fine here
ibb.co/YXsBXy9
how can I help if you didn't give me any information?
1. What browser that you use?
2. What OS?
3. Have you installed and activate CORS UNBLOCK?
4. What Audio Input/Output do you use? Virtual Audio Cable or Stereo Mix?
5. Have you followed instruction as I wrote on Github Readme page?
6. What Voice Language did you try to recognize, English? French?
7. Any other extra information that you can give?
@@nguyentrantienanh3342 If you watch on a streaming site that has many javascript running on their server, this extension will be blocked sometimes. You can see it if you press F12 key. It will show something like BLOCKED BY CLIENT. So if you want to use this extension, avoid watch on site that has many javascripts running on their site (like ads or else). If you insist want to watch that site, please use my other apps (see my repo : github.com/botbahlul?tab=repositories)
Can you help me with stereo mix or VAC. I dont have both@@botbahlul5735
1:14 Dude has 'CP' 3 folders above his cursor💀
It literally means another thing not what you are thinking of. A lot of abbreviations have different meanings.
@@dimi_ptr friend look at the creation date of the folder (CP), and there are others with that date called VPN ☠☠☠
friend look at the creation date of the folder (CP), and there are others with that date called VPN ☠☠☠