INSANELY FAST Talking AI: Powered by Groq & Deepgram

Sdílet
Vložit
  • čas přidán 6. 09. 2024

Komentáře • 53

  • @engineerprompt
    @engineerprompt  Před 3 měsíci +6

    Releasing the updated code with "project Verbi": Same functionality shown in the video but better! github.com/PromtEngineer/Verbi

    • @drawing1611
      @drawing1611 Před 3 měsíci +1

      Could you please create a tutorial video on building a website with a frontend UI that allows users to interact with this incredibly fast AI aka Jarvis-like project? I would love that please make a video it will be very helpful. Love all your videos Sir, you are a genius and a legend! Thank you very much Sir

  • @user-bw5np7zz5m
    @user-bw5np7zz5m Před 3 měsíci +8

    Completely local or runpod-even if slow, would be wonderful. No external services beyond your own.

  • @coocku5390
    @coocku5390 Před 3 měsíci +1

    So glad to have stumbled across this video, I've been looking for something similar to this all week. Thanks for putting this together, I can tell it will be very useful for me! I'm excited to see the streaming functionality on the top of the roadmap as well.

    • @engineerprompt
      @engineerprompt  Před 3 měsíci

      Glad it was helpful! The repo already has some updates. More to come soon.

  • @fatjay9402
    @fatjay9402 Před 3 měsíci +3

    The vocie spund pissed 😂😂😂

  • @drawing1611
    @drawing1611 Před 2 měsíci

    Could you create a tutorial video on constructing a website with a frontend UI that enables user interaction with this incredibly fast AI, akin to a Jarvis-like project? I would greatly appreciate it. Your videos are fantastic, and you are truly a genius and a legend! Thank you so much.

  • @TomanswerAi
    @TomanswerAi Před 3 měsíci +2

    Looking forward to local version

  • @AirzGamingTTV
    @AirzGamingTTV Před 3 měsíci +1

    Incredible content! Could you post a version of this implementation that is locally hosted without subscriptions or fees? Thanks!!!!

    • @engineerprompt
      @engineerprompt  Před 3 měsíci +2

      Thank you, yes, will be updating it in future

  • @satheeshthangaraj5614
    @satheeshthangaraj5614 Před 3 měsíci +2

    Please upload the same using local model. Thanks.

  • @harristengku7153
    @harristengku7153 Před 3 měsíci +8

    Bro 4s response times are god fearingly slow😂

    • @harristengku7153
      @harristengku7153 Před 3 měsíci

      Just checked your code. Set stream to true for your TTS,SST and LLM. Then switch your TTS to PlayHT.

    • @drawing1611
      @drawing1611 Před 3 měsíci

      See yourself pal, this is insanely fast actually !

    • @RedCloudServices
      @RedCloudServices Před 19 dny

      🤔 how fast is the one you built?

    • @siddhubhai2508
      @siddhubhai2508 Před 14 dny +1

      It's only internet problem, use lightning AI you will see the fastness ❤️

  • @Neiltxu
    @Neiltxu Před 3 měsíci +1

    You're a legend

  • @Leonardo_A1
    @Leonardo_A1 Před 27 dny

    Great🎉 i like to build a local ai where i can ask my doc. What sould i have to do

  • @zippythinginvention
    @zippythinginvention Před 3 měsíci

    Exciting!

  • @Shankdude
    @Shankdude Před 3 měsíci

    I guess i should expect performance issues if I extend this to RAG use cases? Any recommendations for a performance optimized vector database?

    • @engineerprompt
      @engineerprompt  Před 3 měsíci

      I don't see performance issues but you will need to manage when the audio generation starts

  • @KenshiDigital
    @KenshiDigital Před 2 měsíci

    Can you do this when you speak to the ai, it automatically add a task or text in google sheets or notion?

  • @newssir5790
    @newssir5790 Před 2 měsíci

    is not there a way to use faster-whisper with groq?

  • @TomanswerAi
    @TomanswerAi Před 3 měsíci

    Very cool

  • @Arsat74
    @Arsat74 Před 3 měsíci

    Unfortunately, with Groq it doesn't sound as if it would be suitable for rebuilding free of charge :(

  • @wingchong68
    @wingchong68 Před 3 měsíci

    I'm in Fresno CA and it's 4am😮

  • @johnaleksanderjazbec993
    @johnaleksanderjazbec993 Před 3 měsíci

    How to use it with Flowise?

  • @StefanReich
    @StefanReich Před 3 měsíci

    Why do you have sleep(1) in the code?

    • @engineerprompt
      @engineerprompt  Před 3 měsíci

      I was running into issues of the llm generating the response but the audio would be just last few words without giving the system time to finishing playing the audio. Need a better solution :)

  • @RedCloudServices
    @RedCloudServices Před 20 dny

    can Groq host a custom model that I provide from huggingface?

    • @engineerprompt
      @engineerprompt  Před 16 dny

      At the moment, Groq doesn't provide that functionality.

  • @carlyoukilleditbeats
    @carlyoukilleditbeats Před 3 měsíci

    I keep getting "Server disconnected without sending a response."

  • @PiyushAggarwal-n9b
    @PiyushAggarwal-n9b Před měsícem

    can we fine tune it

    • @engineerprompt
      @engineerprompt  Před měsícem

      Not the Deepgram but I think you can use the Elevanlabs api for cloning.

  • @niketgoriya8764
    @niketgoriya8764 Před 3 měsíci

    please do video for local opensource setup of this

    • @engineerprompt
      @engineerprompt  Před 3 měsíci +1

      Just pushed open source models for to TTS and STT. Will create a video on the updated package after some optimization

    • @niketgoriya8764
      @niketgoriya8764 Před 3 měsíci

      ​@@engineerprompt Great Thanks looking forward to that.

  • @Player-oz2nk
    @Player-oz2nk Před 3 měsíci +2

    Would implement instantly the day groq releases api payments bc rn rates limits are too strict since it's free

  • @RickySupriyadi
    @RickySupriyadi Před 3 měsíci

    I hope groq API have option to let dev continue their API for free, but in sense of incubator fee...

  • @matten_zero
    @matten_zero Před 3 měsíci

    You could do this almost with only Deepgram as well.

  • @faisal-u7f
    @faisal-u7f Před 3 měsíci

    I am doing Bachelor in AI.I want more to learn Gen AI

  • @WhyAreYouFindingMe
    @WhyAreYouFindingMe Před 3 měsíci

    We cannot sacrifice quality of voice anyways.

    • @engineerprompt
      @engineerprompt  Před 3 měsíci

      Probably should have picked a better voice from available voices 😀

    • @WhyAreYouFindingMe
      @WhyAreYouFindingMe Před 3 měsíci

      @@engineerprompt May be. but this will get outdated soon, what do you say? AI have taken a rapid pace. one after another advancements.