Was the delayed wake word response time bothering you?? We have solved the issue and updated the documentation. Read more here if interested: github.com/FutureProofHomes/wyoming-enhancements/discussions/4#discussioncomment-8225110
Happy to see my scripts living their best life lol Good job explaining how to setup though - HA is really getting there. I like your videos, keep up the good work
@JasonWeyermars, were you the inventor of the awake and done script? I’m so sorry I forgot to call you out! Sincere apologies! Do the modifications get your stamp of approval? Many thanks.
@@FutureProofHomes no credits required - other than there is a great community, doing great things, and we're all learning and helping each other out where we can! Voice satellite, although a WIP, is really making my Star Trek fantasies come true :) Keep up these videos, they're great to see.
This is what I was hoping all those components would "someday" be able to provide. I didn't realise that "someday" was today. Great job explaining everything and showing us what Home Assistant, Music Assistant and everything else can do NOW.
Fantastic well organized tutorial! One thing though. After that you have done this tutorial, Snapcast has started dividing up the snapclient releases into 2 versions. One with pulse and the other without pulse. I wasted a day trying to figure out why my snapclient refused to work with pulse. Installed the version "with pulse" and it worked perfectly.
Awesome deep dive on getting all the components and tweaks together in working state and sharing with us all. Huge thanks. Now I just need to find some time to replicate it on my HA. I did implemented your GPT integration with my existing Piper/Whisper and it's working flowless. Kudos to you and all the other people who dedicating time and work towards the HA integrations and community.
Your work is NEXT LEVEL. I sincerely appreciate the time you are putting into this. I would "LOVE" a scaled back tutorial with maybe some scripts to get this going for just "audio" playback (i.e. SONOS replacement)...... I know, I can do that myself :)
Wow!! I want to thank you and the community for the hard work you've put into these projects! I'm not even running HA yet, but am incredibly amazed by what people have accomplished with it. I'm looking forward to a time when so much of this is just plug 'N play and EVERYBODY can ditch Alexa, Google, Home Kit, and any other spy devices.
You would use the media player entities created by the Music Assistant integration, the same way you would for other devices that act as media players, like a Google Home Mini or Amazon Echo. If Brad doesn't get to it first, I could do this.
Thanks for your dedication to helping us keep our smart homes on the cutting edge of technology, and thanks for your detailed tutorials. Your videos are appreciated.
Yes - Yes - this is AS COOL TO ME! I am focusing on the same stuff you have been providing and you are doing the heavy lifting. Please know hoe much this is ENORMOUSLY appreciated. I have been trying to come up with a solid SONOS replacement (I wont buy those $$$ items) but my work around have never been quite what I want. This is very much what I am after. TREMENDOUS WORK!
Thank you so much for this! In my journey to remove Alexa, this was one of my concerns with my Sonos integration. You have built in all of the nuances that I was concerned about losing - dimming the music while talking, etc. I have already followed your ChatGPT integration and I'm loving it! Thank you for continuing this path in your videos!
Well, if you are truly excited that I have watched your excellent, well-produced, and well-executed video, I'll just tell you I am so excited I just wet my pants! Seriously, keep it coming, when I can get caught up to your level I will be implementing this complete system in my small condo here in Mexico! Much love, happiness, and success to you!
Really cool. I would love to see it working with all the sounds off and just working. Side note, to call the Sonos speaker expensive is not fair. The current small speaker, the "Era 100" is really a very cost effective speaker. The amplification, the speaker, the technology of putting it all together in a great sounding speaker for its size, can't be beat. There is no way you can make something DIY to compete with it.
@8:28 you said set autospawn to "no" but you set it to yes, im assuming this was a mistake and you should have change the value to "no". good work on the video, perfect pace as always. keep it up
Thanks for the video. I found keeping the old arecord line instead of using parecord gave me a lot better performance with speed and voice accuracy. Also disabling the activation sound seems to speed things up. It feels like the voice stream isn't sent to the whisper server until a few seconds after the sound finished playing
I would just like to say, Thank you for making this fantastic video. You made it so easy to follow. The explanation really helps. Thank you again for your time and help.
It would be cool to build this service to look at the room in Home Assistant and link the voice assistant and speakers in the same room with each other - so that going forward all you do is add the two 'devices' in the room and get this functionality.
I came to this comment section to ask/suggest exactly this. I’m wondering if HA can tell which Area the wyoming-satellite that provided the commands is in. If so, you can target the media player that is in that same area…
Looking forward to trying this out! Haven’t seen your tutorial on doing the initial setup just yet. Hoping maybe these additional steps can be combined somehow to make things slightly more automatic to get up and running.
@@FutureProofHomes I love watching the bleeding edge get developed, but I get even more excited when the community decides on the “good defaults” like these features and they get baked into simplified installations just waiting to be turned on.
Watch my other video about stealth voice assistants in the ceiling it discusses all of that. For the video though, I just temporarily plugged the voice assistant into an m-audio audio controller so I could record its response.
Looking forward to that present detection tutorial! Maybe can we get a tutorial on running scripts/ ssh commands on the pi through the voice assistant? Would greatly appreciate it!
I love all your videos, and I can't wait to try this myself when all my parts arrive! I have a quick question though. Have you found a way to reduce the delay for the response to the wake word? It's a pretty minor thing, but I can see that driving me crazy since I'm used to the near instant response from my google homes haha
Track the open discussion here. I think/hope we'll solve this in the next few days. Not gonna try tonight cause I gotta get some sleep. :) Human after all. github.com/FutureProofHomes/wyoming-enhancements/discussions/4
On 8:29 you left autospawn as YES instead of NO. I assume the right value is NO as you said and not yes... but just FYI :) And thanks for the video! It's awesome how you made it work. I've been trying to do this myself at my own pace and time but damn I was getting nowhere :D
You’re right. I goofed there, but the documentation is accurate. I wish I could easily fix that, but YT won’t let me edit the video to correct that footage. Hopefully people will see my mistake and use common sense. Apologies!
@@FutureProofHomes No need to apologize! It's all good :) Just wanted to raise to your awareness as I don't know if you can drop a small "annotation" over the video or something to refer that... You're doing an excellent job there! Keep it up!
Loving this project and have been following along at home with building some of this out. Always an exciting day when you have a new video up. I'm still waiting for a viable local LLM that can do what OpenAI does. I can get the speed there running on a GPU however, the results still suck for the models I've tried. I think we need a custom tuned model.
@@FutureProofHomes I've tied mistral-7b-openorca, airoboros-l2-13b, and llama-2-7b-chat so far. Is there a special Mistral 7b with functions? Interested what you have tried and how you would rate it compared to OpenAI. I see Trelis has some tuned for function calling.
@@subfighter13 I'm having similar experience. I'm doing lots of digging and trying all sorts of models and settings as I learn more. So far its super flakey at best. About 5% of the time it will turn on / off a single light and one time it opened my shade but wouldn't close it. I don't want to use cloud based OpenAI for all the usual reasons but maybe I'll try it just to see it working.
I’m very excited to give this a try- even more so the ChatGPT pipeline stuff from your earlier video. I’m trying to get a handle on realistic costs to use the ChatGPT API. Any thoughts?
Have played with it for a few hours and it works out at fractions of a cent per exchange. I don’t think it’s a major concern. You will have to add on $10 every few months probably. That’s at current prices anyway. They could well start screwing people to boost their share prices, as per any of these services.
I’m a heavy user. I’ve managed to get my costs to approx $8/month. Still watching the data though and I hear cost optimizations are coming. Consider running the LLM locally so you don’t pay OpenAI at all. I’ll have a detailed video on this shortly.
Cool project! Gonna try it. But at the beginning you mention that Sonos voice control is powered by google or Amazon. Sonos Voice is actually local to the device. No cloud
You’re right. Sonos music streaming is local (although they love keeping all your logs in their cloud, go read about it). But, the built-in Google and Amazon voice assistant in their speakers very much rely on the internet to control your Sonos.
You must break down your dashboard for us dummies! The yaml and miles of documentation beat me every time I think it's time to attempt home assistant again! 😂
I am so excited about this but have a couple of questions...1. what is your audio setup. Looks like you are using in ceiling spaekers and some kind of amp connected to the headphone jack. Is this right? What are the downstream components? Amp? Speakers? etc... 2. Most Sonos are portable speakers. Can you recommend an audio solution that would be portable?
Thank you for the tremendous work that went into this! I'm now a subscriber. That said, Jarvis seemed slow to respond. Anyway to improve that or use Siri and Google assistant until better hardware/software happens? Another commenter said Jarvis trips randomly every 20 minutes, which is a deal breaker. Lastly, how might we tie in existing ceiling speakers? I have an old Nuvo whole house audio system with control panels that has died that I need to replace with a new amp and control system and tie into HA.
1. Yes, the extra PulseAudio layer seems to add a 1 second delay. I bet there is a solution and I haven’t found it yet. I do think more powerful hardware could help. 2. Try different wakewords and different mic gain/noise cancelling to avoid false positives. I’ve found Okay Nabu wakes more often than Jarvis. We need to train these wakewords even more to really solve this issue. 3. Watch my “stealth voice assistant” video. It will answer all your questions.
Great video, thanks! However saying you don't want Google or Amazon listening in but then sending all your interactions to ChatGPT seems to nullify your goal? It didn't look like you were running a local hosted LLM.
@@FutureProofHomesI did also watch that video (and subbed at that time) but you didn't show the actual response time. You did however indicate it was way too slow to be useful with the cut video and the "an Eternity Later" still.
ah, yes. Well I have now have in the lab an LLM hooked into HA that is producing 2-3 second response times and controlling my home. The next vid should go deep into showing how to REALLY build the holy grail. Getting closer and closer!
Unfortunately, after second try to do this i have to admit, that pulseaudio makes delay between wake word detection and voice capturing totally huge, which renders satellite unusable. I'm on Pi-Zero_2W, and it's awful. I really wanted it to work... Also for some reason pamixer isn't available for my OS (Lite, legacy)... Will ditch this, since i already have good working setups on ESP32-S3. I really wanted it to work...
(Update) It's currently in progress on Music Assistant Quote ( OzGav commented 2 days ago It is being worked on. There is a desire to have this done by the end of the month but it depends on workload.) (Old Comment) How would I go about having announcements via tts, play through the wyoming satellite? Music assistant doesn't support it at the moment I hope there's a way would be a total game changer
Excellent video. Could install as shown in the video. Everything works fine except for the last part to control volume. Is pamixer still around to be installed? Can I use pulsemixer instead?
Running into some issues installing the snapcast client. The following packages have unmet dependencies: snapclient:armhf : Depends: libflac8:armhf (>= 1.3.0) but it is not installable. This is a fresh install ( just installed this all following the wyoming satellite tutorial from your last video on sunday)
❓16:43 I also created player-groups. Is it somehow possible to change how the groupe-volume influences the individual volumes? Example: How it behaves right now. Group = vol.60 -> vol.30 (60-30) Player1 = vol.80 -> vol.50 (80-30) Player2 = vol.40 -> vol.10 (40-30) (So it's by addition/subtraction of the volume.) ❗Example: How I want it to behave: Group = vol.60 -> vol.30 (60/2) Player1 = vol.80 -> vol.40 (80/2) Player2 = vol.40 -> vol.20 (40/2) (So it's by multiplication/division of the volume.) BECAUSE than the relative volume relative to eachother is kept equal! So if I have 2 speakers in opposite corners, I sit closer to Player2 and I have adjusted their volume so they sound for this position equally loud they still sound equally loud with multiplication/division but NOT with addition/subtraction. I hope it's understandable what I mean. Can someone give me some ideas or help how to achieve this? Thank you all very much!
I followed this, currently having problems with the audio jumping and skipping when playing music and just general voice commands. Increased the SNAP Buffer and still get it.
Fantasic video. Thank you for all your efforts. Having go it working I am left with three issues. 1. Jarvis talks on my HDMI port speaker and music plays on my Mic2 card audio jack. I've tried to see why but can't work it out. 2. I get a fair few dropouts on the audio. 3. I tried adding some other pre-made wakewords (that work on the HA Server), but they don't work (error is can't find wakeword, but they are there in the same place as the ones that work. I'd appreciate any tips or advice. Cheers, Bill
Fantastic series of videos. As a newby to HA your instructions and explanations are just brilliant. I had been planning to use Ligitech Media Server, until Media Assistant is out of Beta, and a bunch of picoreplayers (each with an amplifier Hat to drive some speakers) for the whole house audio. Is there any way to integrate the Wyoming voice assistant functionality you have created with the picoreplayers such that they would go quiet when a voice command was spoken etc? Basically to achieve the same end result as you have achieved but using LMS and picoreplayers for the audio distribution?
This is neat. I think I will be doing this once I have Internet at home again because I'm really interested in getting a useful voice assistant set up at home. I'm ever so close to having F.R.I.D.A.Y. from Avengers: Age of Ultron running my house with this kind of thing being possible.
@@FutureProofHomes Got it working on a Pi Zero 2 W today. Need to see if I can figure out why it's not playing nice on the Pi 4, and get it all working on the other Pi Zero 2 W I bought. A nice, but not absolutely necessary, addition to the collection of enhancements would be telling us how to install custom wake words on the Pi so we can do that if we want to.
I followed your tutorial, but I can't get the snapclient to output sound. I tried setting the output device, but it can't seem to find the mic hat. Also, during the tutorial I was able to execute the paplay command, but after completing the steps it errors with: Failed to drain stream: Timeout. Could you help me with that?
Still didn't try the ReSpeaker with the Raspberry Pi 4 as I commented in your other video. The ReSpeaker is out of stock everywhere. Anyway, just to be clear, can you clarify your setup? Because I see two issues with this that I still want to solve and I think you agree. You are still using non-local solutions, both NabuCasa and ChatGPT. I know you want to replace ChatGPT but I think at this moment, it's almost impossible to use Home Assistant with Local Voice, instead of NabuCasa. From my personal experience, it's way too slow. I just want to be sure that for you this is still like this and that is not a problem only on my side. Thanks for another great video and waiting for the one about replacing completely cloud ChatGPT :P
@@FutureProofHomesI found one that says "ReSpeaker 2-Mic Pi HAT V1.0 4b Zero/Zero W/B+ Raspberry Pi Keyestudio", I'm not sure if this is the same because of the version but I will buy it and see :D
Question. What can I modify in this setup to point the TTS output to play through my Sonos / AMP speakers in my ceiling rather than using the audio output of the Wyoming Satellite?
Does snapcast allow you to remove a client from a group while keeping the audio playing on the others, or to resume a previous session if it's stopped? Ooh and is there a way to use multiple mics in the same room with the same functionality, either with more rpis or with esp32 satellites that just handle audio input? Also, it would be very nice to have a prebuilt Wyoming satellite image with pulseaudio for peeps! Maybe I'll make one... Though I'd love to use pipewire instead if that's usable.
you could use home assistant to send tts from the PI to home assistant and call the Sonos! or I am wrong, I saw something like that on GitHub but couldn't do it? i am building my house and I am looking to build something like you did on my house, could you tell me what is the best hardware to use to make this? do you think PI and the HAT mic is better then esp32 with a mic?
There are quite a few ways I can think of to hack the satellite to output it's TTS response to an external speaker/media_player. I/we should really think about the best solution here. Also, I bet Nabu Casa will build this at some point. It would be uber powerful for many folks.
Have played with most of this (HA+Wyoming+ChatGPT) and the major deal breaker for me, at the moment, is the reliability of the local wakeword detection. In a room with the TV playing or just general background noise “hey Jarvis” will trip randomly every 20 mins or so. I never had this with the echo dots. I’ll give it another look in six months to see if it’s improved.
Try loading in other wakewords, there are a lot of them out there. Even custom ones. You may have better luck. I hear you with this false positive issue. Happens to me too.
It works for my use case. But I do want to go further with those scripts and have ability to play songs, albums, artists too. Keep an eye on the repo and I’ll share those scripts if someone else doesn’t commit them before I do.
Thank you for these great videos, I'm getting the music out from 3.5 rpi jacket and not respeaker 2-mics pi hat as voice does, what have I missed here?
Intro: 1. We don't want big companies to listen to us. 2. We hooked our custom microphones to ChatGPT (which states not to put private stuff on it). (Hypocrisy aside, I do know that it's for a local LLM in the end)
Hello, can you make it talk/play songs wirelessly from Sonos so you dont have to plug in physical cable into this Wyoming Satellite ? I want to use the satellite for speaking and for playing Sonos. TIA.
Absolutely amazing content, I'm definitely going to try this out. I do have one question though and I'm not sure if it will work, but maybe you can shed some light on it. I have existing Sonos speakers. Would it be possible to use the Sonos speakers (mapped as mediaplayers in Home Assistant) as output via Home Assistant or do I need to hard wire the pi + hat into a speaker?
@@FutureProofHomes If possible both, I'm using the cheap Ikea Sonos speakers throughout my house and if I could combine this, I don't have to get separate speakers just for this project.
I added another command. when there was a false detection of the wake word and no command was sent, the audio would not return to normal. Adding this command fixed it... --error-command '/home/loftsatellite/wyoming-enhancements/snapcast/scripts/done.sh' \
Hi. Noob question. I have Sonos Amps in a rack in my utility room and ceiling speakers throughout my house and have ethernet w/POE in every room I would need voice assist. Is this a good solution for me? Also, I've built my own inference server with 4090 running Oobabooga and am using the LlaMA Conversation Integration with very limited success in affecting my Lutron lights and shades. I'm thinking of rebuilding using the LocalAI with Extended OpenAI Conversation but would like some reassurance that it is actually working before I go through the effort. It seems like its more miss than hit / miss for the local LLM for me so far.
Awesome work! I managed to get it all through til the end on my Raspberry Pi 3 with Respeaker 4mic-HAT. But I did not manage yet to get the Voice Assistant to control the Music. Maybe its because I am trying to use it in another language than english?
This is great stuff, have it working fine except I can get the script to work, ChatGPT says "template list object has no element 0" any advice on that? Ah just realised it needs to be a playlist, cant just say play Elton John must be the name of a playlist
I'm at the point of installing Music Assistant and in my version of Home Assistant, they have removed the HACS explorer and you are not able to select any Beta options. All I see is the download button and it's installing the current version. Does anyone have any advice on how to request the Beta versions in HACS now with the new UI?
Very cools stuff! I got it to work somewhat, but adding the pulsaudio ducking isn't working for me. Using pulseaudio vs alsa seems to add a significant lag to the wakeword detection and often stops listening to me before I even finish speaking. I also have not been able to wake the assistant while music is playing, even at very low volumes. any ideas?
Add - - debug onto the end of your enhanced-wyoming-satellite.service and restart. Utter the wakeword and share those logs. That will help me determine your issue. Open ticket or QA discussions in the GH repo. Easier to debug there. PulseAudio causes a delay. I'm discussing that here: github.com/FutureProofHomes/wyoming-enhancements/discussions/4 The whole "stops listening before finishing or when audio is playing" sound like you need to tune your noise cancellation and sensitivity levels. You can play with those levels in settings -> integrations -> wyoming -> device settings in home assistant UI.
What OS version do you have? I am running the 64bit latest raspberry pi os for the pi zero 2 w on mine and having a number of issues related to it not finding dependencies and the like.
Just followed this method to a 'T', and still have no sound output from the device when playing music, or using the voice wakeword command. Its listening, because when using the wakeword, the LED's light up, and the command is executed. However snapclient/snapcast music playback does not work, and the sound output does not work. The error i get is Jul 07 09:59:04 wyoming pulseaudio[510]: Failed to open cookie file '/var/run/pulse/.pulse-cookie': No such file or directory Jul 07 09:59:04 wyoming pulseaudio[510]: Failed to load authentication key '/var/run/pulse/.pulse-cookie': No such file or directory Jul 07 09:59:04 wyoming systemd[1]: Started pulseaudio.service - PulseAudio system server. Jul 07 09:59:07 wyoming pulseaudio[510]: Failed to find a working profile. Jul 07 09:59:08 wyoming pulseaudio[510]: Failed to load module "module-alsa-card" (argument: "device_id="0" name="platform-3f902000.hdmi" card_name="alsa_card.platform-3f902000.hdmi" namereg_fail=false tsched=yes fixed_latency_range=no > Jul 07 09:59:14 wyoming pulseaudio[510]: Failed to find a working profile. Jul 07 09:59:14 wyoming pulseaudio[510]: Failed to load module "module-alsa-card" (argument: "device_id="0" name="platform-3f902000.hdmi" card_name="alsa_card.platform-3f902000.hdmi" namereg_fail=false tsched=yes fixed_latency_range=no > Jul 07 09:59:14 wyoming pulseaudio[510]: ALSA woke us up to write new data to the device, but there was actually nothing to write. Jul 07 09:59:14 wyoming pulseaudio[510]: Most likely this is a bug in the ALSA driver 'snd_bcm2835'. Please report this issue to the ALSA developers. Jul 07 09:59:14 wyoming pulseaudio[510]: We were woken up with POLLOUT set -- however a subsequent snd_pcm_avail() returned 0 or another value < min_avail. But when using the command paplay /usr/share/sounds/alsa/Front_Center.wav the sound outputs fine. I ran the command pactl set-default-sink alsa_output.platform-soc_sound.stereo-fallback to set the output to the 2mic pi hat. Any ideas
This is awesome! I've followed your other tutorials and now this one but seems to have not quite got it right. When I say "Hey Jarvis, play jazz on the living room satellite" it spits back this error in the voice assistant debug - "Something went wrong: Service script.play_music not found." Not entirely sure why as there definitely is a script.play_music entity and it has been exposed to Assist. Any ideas what I could be doing wrong?
I've been following this as is life to do something similar. I notice that there's a pretty substantial delay between your wake word and then command. Is there no record buffer capability with the pi and hat setup you use?
When I'm using wyoming satellite with wake word service enabled in it, it looks like chatgpt is invoked without any previous context. When I use the same "assistant" pipeline through HA web page ("Assist" chat) it keeps context. Any fixes?
Built it with a raspberry pi 3, USB microphone off a USB webcam and headphones! It sounds so much better than the esp32 ones! Wow! Pretty easy to get the basics going! Adding all your enchantments now!👍
another question.. when you activate the wake word, you don't speak until it lights up. is that a requirement? Really looking for a more natural engagement where you start with the wake word and just speak normally.
Kinda, yes. Gotta take a breath so it begins recording. It’s still kinda like riding a bike. Takes a moment to get used to. It will get better and I plan on experimenting with better hardware soonish.
@@FutureProofHomes have you replaced your Alexia with this new setup yet? Watching all your other videos you have a lot of stuff built around Alexia. I've been on a journey of removing Alexia and using HomePod as a media player. I can't seem to find the middle ground or best of all the worlds.. It does seem the Wyoming and HomeAssistant stuff is getting real close.
wait i have in my living room sonos speakers but i have google hubs and nest speakers in all other rooms. How are you setting it to play onto the speakers
Watch this video. It shows you how I'm doing it. czcams.com/video/eN0_8GCsZm0/video.html There is a more convenient/wireless way to do this, but I/we haven't built a tutorial for this though.
Silly question but first....... your videos are SOOOOOOOOOOOOOOOOOOO helpful, Thank you!!! Okay so I have my 'jarvis' working in HA is there a way to funnel the output into a Sonos Speaker instead of a plugin in that pi hat LOL.... if you can help that would be appreciated but if not STILL much appreciated for your work!!
Yes. There is a way to do this. But nothing I’ve found that isn’t a major hack and that is stable. I’ll keep hunting for the right solution and share as soon I can.
Can you turn a esp32 s3 box 3 into a media player like this? Or does it have to be a raspberry pi. Edit bassd on watching more of the video seems like has to be a pi👍 so pumped to build this! Thank you again!
Pulse Audio, OpenWakeWord, Snapcast… I think these services are beyond what ESP32 can handle and thus requiring a Pi. Please anyone, correct me if I’m wrong here.
@@FutureProofHomesI am the snapcast developer for MA and just running snapcast on an esp32 is problematic, there are several implementations but none is as good for something like this.
Personally, for me to sell my Sonos equipment I/we need to achieve the following: 1. Sub-second wake word response times w/ 1% error rate in false-positive wake word detections. 2. A bunch of well tested scripts powered by a local LLM that can intuitively search for artists, genres, songs AND play, skip, join groups, split groups, control volume perfectly. 3. Zero buffering/out-of-sync/glichy audio streams across 6 zones. I'm on a mission to get here. Then yes... I will truly ditch my current expensive Sonos system.
Great content, thank you for the detailed instructions. New subscriber here. Ive ordered a raspberry pi to try and get this done. Question. Do you know if it is possible to have the response of assist run on another device? I know how to do this on a esphome satellite, but would like to on a wyoming satelite..
Was the delayed wake word response time bothering you?? We have solved the issue and updated the documentation. Read more here if interested: github.com/FutureProofHomes/wyoming-enhancements/discussions/4#discussioncomment-8225110
Nice I was just going to ask about that
Is there new updated link? Thank you!
I really appreciate running and explaining this cutting-edge setup for the rest of us. This is what HA will be in a about 2 years for us normies.
My pleasure. Really glad you enjoying the topics!
Happy to see my scripts living their best life lol
Good job explaining how to setup though - HA is really getting there. I like your videos, keep up the good work
@JasonWeyermars, were you the inventor of the awake and done script? I’m so sorry I forgot to call you out! Sincere apologies! Do the modifications get your stamp of approval? Many thanks.
@@FutureProofHomes no credits required - other than there is a great community, doing great things, and we're all learning and helping each other out where we can!
Voice satellite, although a WIP, is really making my Star Trek fantasies come true :)
Keep up these videos, they're great to see.
Yea, I've been dreaming of this stuff for years. We're so close to it being real. Exciting times. Nice to meet btw.
This is what I was hoping all those components would "someday" be able to provide. I didn't realise that "someday" was today. Great job explaining everything and showing us what Home Assistant, Music Assistant and everything else can do NOW.
You’re very welcome. The future is happening fast. Fun times!
Fantastic well organized tutorial! One thing though. After that you have done this tutorial, Snapcast has started dividing up the snapclient releases into 2 versions. One with pulse and the other without pulse. I wasted a day trying to figure out why my snapclient refused to work with pulse. Installed the version "with pulse" and it worked perfectly.
this video was structured very well! having a demo in the first half to show exactly what you’re going to build should always be the norm. Great work!
Feels natural to do this. Really appreciate the feedback. Thank you!
Awesome deep dive on getting all the components and tweaks together in working state and sharing with us all. Huge thanks. Now I just need to find some time to replicate it on my HA. I did implemented your GPT integration with my existing Piper/Whisper and it's working flowless. Kudos to you and all the other people who dedicating time and work towards the HA integrations and community.
Your work is NEXT LEVEL. I sincerely appreciate the time you are putting into this. I would "LOVE" a scaled back tutorial with maybe some scripts to get this going for just "audio" playback (i.e. SONOS replacement)...... I know, I can do that myself :)
Yep. I’ve been thinking of ways to script these steps so install is easy. That may be something I work on in the future.
Wow!! I want to thank you and the community for the hard work you've put into these projects! I'm not even running HA yet, but am incredibly amazed by what people have accomplished with it.
I'm looking forward to a time when so much of this is just plug 'N play and EVERYBODY can ditch Alexa, Google, Home Kit, and any other spy devices.
Thanks @BenReese… This guy gets it! :)
Very excited for this. Ushering us into the future!
Endless potential with this voice assistant and LLMs. I fully agree. The future is here!
A tutorial on how to use these satellites as voice output for TTS generated using Piper in Home Assistant would be great.
You would use the media player entities created by the Music Assistant integration, the same way you would for other devices that act as media players, like a Google Home Mini or Amazon Echo. If Brad doesn't get to it first, I could do this.
Not currently supported I've tried thats the main automation I'm waiting on @@MatthewN8OHU
Look into Chime TTS.
Thanks for your dedication to helping us keep our smart homes on the cutting edge of technology, and thanks for your detailed tutorials. Your videos are appreciated.
Thank you for the kind words. I’ll definitely keep pushing the boundaries and sharing as I go.
Yes - Yes - this is AS COOL TO ME! I am focusing on the same stuff you have been providing and you are doing the heavy lifting. Please know hoe much this is ENORMOUSLY appreciated. I have been trying to come up with a solid SONOS replacement (I wont buy those $$$ items) but my work around have never been quite what I want. This is very much what I am after. TREMENDOUS WORK!
Love it man! Thanks so much. Glad these vids are of value to you!
Yet another very interesting video! Hope you keep up the pace and I can't wait to see how you did presence detection.
Promise it's coming. Not in the can yet. But it's in my head. I'll get it out after I get some necessary local LLM videos off my chest.
Thank you so much for this! In my journey to remove Alexa, this was one of my concerns with my Sonos integration. You have built in all of the nuances that I was concerned about losing - dimming the music while talking, etc. I have already followed your ChatGPT integration and I'm loving it! Thank you for continuing this path in your videos!
You are so welcome! Really happy it’s inspiring. Nice to meet Tom!
Right on brother! - lookin' forward to doing this in my home!
Heck yea man! Let me know how it goes!
Well, if you are truly excited that I have watched your excellent, well-produced, and well-executed video, I'll just tell you I am so excited I just wet my pants! Seriously, keep it coming, when I can get caught up to your level I will be implementing this complete system in my small condo here in Mexico!
Much love, happiness, and success to you!
Much love to you too, Rodney. My fam lives in the Playa Del Carmen area btw. Good life over there. Cheers!
10 vids and 11.5k subs. Nice job so far.
Really cool. I would love to see it working with all the sounds off and just working.
Side note, to call the Sonos speaker expensive is not fair. The current small speaker, the "Era 100" is really a very cost effective speaker. The amplification, the speaker, the technology of putting it all together in a great sounding speaker for its size, can't be beat. There is no way you can make something DIY to compete with it.
I wish you the best and keep going. Maybe next video will be about how to connect all doors to assistant . GG
@8:28 you said set autospawn to "no" but you set it to yes, im assuming this was a mistake and you should have change the value to "no".
good work on the video, perfect pace as always. keep it up
You are correct. My apologies guys! This error will love forever on the internet. I’ll try and add a title in CZcams editor.
I am blast away by this fantastic project.
Wow, thank you! Really glad it’s inspiring. More to come. ;)
Thanks for the video. I found keeping the old arecord line instead of using parecord gave me a lot better performance with speed and voice accuracy. Also disabling the activation sound seems to speed things up. It feels like the voice stream isn't sent to the whisper server until a few seconds after the sound finished playing
We’ve solved the delay issue with parecord. Checkout the pinned comment.
@@FutureProofHomes awesome, works perfectly
Absolutely love the "The IT Crowd" clips!!
Ha. Thnx man! Loved that show.
I would just like to say, Thank you for making this fantastic video. You made it so easy to follow. The explanation really helps. Thank you again for your time and help.
You're very welcome!
It would be cool to build this service to look at the room in Home Assistant and link the voice assistant and speakers in the same room with each other - so that going forward all you do is add the two 'devices' in the room and get this functionality.
Agree! I’m working on it. I have some ideas on how to pull this off without it being a really ugly hack. It needs to be an elegant implementation.
I came to this comment section to ask/suggest exactly this. I’m wondering if HA can tell which Area the wyoming-satellite that provided the commands is in. If so, you can target the media player that is in that same area…
This is what I was looking for! before it was like sonos... boo, now its like: hell yes!
Great minds.... :)
Looking forward to trying this out! Haven’t seen your tutorial on doing the initial setup just yet. Hoping maybe these additional steps can be combined somehow to make things slightly more automatic to get up and running.
Yes, you can combine both tutorials in realtime to save time! Good thought.
@@FutureProofHomes I love watching the bleeding edge get developed, but I get even more excited when the community decides on the “good defaults” like these features and they get baked into simplified installations just waiting to be turned on.
yea, me too. I like pushing in the right direction. I'm betting HA will bake this stuff into Wyoming in the near future.
Geez - what a painful setup. There should be just a image for this. Thanks for running us through that.
What is the reason you use Snapcast, instead of something like SqueezeBox?
Wow this is AMAZING! One quick question: What kind of cable are you plugging into the pi to connect the speakers?
Watch my other video about stealth voice assistants in the ceiling it discusses all of that. For the video though, I just temporarily plugged the voice assistant into an m-audio audio controller so I could record its response.
Looking forward to that present detection tutorial! Maybe can we get a tutorial on running scripts/ ssh commands on the pi through the voice assistant? Would greatly appreciate it!
Checkout the latest branch of the repo. It has the script calling features you may be looking for. I’ll merge them into main soon. Sorry for delay!
I love all your videos, and I can't wait to try this myself when all my parts arrive! I have a quick question though. Have you found a way to reduce the delay for the response to the wake word? It's a pretty minor thing, but I can see that driving me crazy since I'm used to the near instant response from my google homes haha
Track the open discussion here. I think/hope we'll solve this in the next few days. Not gonna try tonight cause I gotta get some sleep. :) Human after all.
github.com/FutureProofHomes/wyoming-enhancements/discussions/4
thanks for doing these video's ...great tutorial and a good addition to the raspberry pi 2w..
Glad you like them!
Is there a reason you added the snapcast server using the add-on instead of just relying on the one that MusicAssistant will set up?
On 8:29 you left autospawn as YES instead of NO. I assume the right value is NO as you said and not yes... but just FYI :)
And thanks for the video! It's awesome how you made it work. I've been trying to do this myself at my own pace and time but damn I was getting nowhere :D
You’re right. I goofed there, but the documentation is accurate. I wish I could easily fix that, but YT won’t let me edit the video to correct that footage. Hopefully people will see my mistake and use common sense. Apologies!
@@FutureProofHomes No need to apologize! It's all good :) Just wanted to raise to your awareness as I don't know if you can drop a small "annotation" over the video or something to refer that... You're doing an excellent job there! Keep it up!
Loving this project and have been following along at home with building some of this out. Always an exciting day when you have a new video up. I'm still waiting for a viable local LLM that can do what OpenAI does. I can get the speed there running on a GPU however, the results still suck for the models I've tried. I think we need a custom tuned model.
Out of curiosity, which models did you try? Mistral 7b by chance w/ openai functions overlay?
@@FutureProofHomes I've tied mistral-7b-openorca, airoboros-l2-13b, and llama-2-7b-chat so far. Is there a special Mistral 7b with functions? Interested what you have tried and how you would rate it compared to OpenAI. I see Trelis has some tuned for function calling.
@@subfighter13 I'm having similar experience. I'm doing lots of digging and trying all sorts of models and settings as I learn more. So far its super flakey at best. About 5% of the time it will turn on / off a single light and one time it opened my shade but wouldn't close it. I don't want to use cloud based OpenAI for all the usual reasons but maybe I'll try it just to see it working.
Great video! Thanks and keep up the good work!! Thumbs up!!
I’m very excited to give this a try- even more so the ChatGPT pipeline stuff from your earlier video. I’m trying to get a handle on realistic costs to use the ChatGPT API. Any thoughts?
Have played with it for a few hours and it works out at fractions of a cent per exchange. I don’t think it’s a major concern. You will have to add on $10 every few months probably. That’s at current prices anyway. They could well start screwing people to boost their share prices, as per any of these services.
I’m a heavy user. I’ve managed to get my costs to approx $8/month. Still watching the data though and I hear cost optimizations are coming. Consider running the LLM locally so you don’t pay OpenAI at all. I’ll have a detailed video on this shortly.
I saw this. I think you made a comment that it was very slow? I’d prefer all local not so much because if costs if it that cheap but just privacy.
20+ years ago when I first touched Linux and simply play some mp3 files was a nightmare to get sound to work. Now look how the little penguin evolved!
Linux runs the world. Makes me proud how far we’ve come too. :)
@@FutureProofHomes Indeed! Congrats for your channel btw! Quite rare to see some quality content here nowadays!
Cool project! Gonna try it. But at the beginning you mention that Sonos voice control is powered by google or Amazon. Sonos Voice is actually local to the device. No cloud
You’re right. Sonos music streaming is local (although they love keeping all your logs in their cloud, go read about it). But, the built-in Google and Amazon voice assistant in their speakers very much rely on the internet to control your Sonos.
You must break down your dashboard for us dummies! The yaml and miles of documentation beat me every time I think it's time to attempt home assistant again! 😂
I am so excited about this but have a couple of questions...1. what is your audio setup. Looks like you are using in ceiling spaekers and some kind of amp connected to the headphone jack. Is this right? What are the downstream components? Amp? Speakers? etc... 2. Most Sonos are portable speakers. Can you recommend an audio solution that would be portable?
Checkout my other video about Stealth Voice Assistant install. It explains everything.
Thank you for the tremendous work that went into this! I'm now a subscriber. That said, Jarvis seemed slow to respond. Anyway to improve that or use Siri and Google assistant until better hardware/software happens? Another commenter said Jarvis trips randomly every 20 minutes, which is a deal breaker. Lastly, how might we tie in existing ceiling speakers? I have an old Nuvo whole house audio system with control panels that has died that I need to replace with a new amp and control system and tie into HA.
1. Yes, the extra PulseAudio layer seems to add a 1 second delay. I bet there is a solution and I haven’t found it yet. I do think more powerful hardware could help.
2. Try different wakewords and different mic gain/noise cancelling to avoid false positives. I’ve found Okay Nabu wakes more often than Jarvis. We need to train these wakewords even more to really solve this issue.
3. Watch my “stealth voice assistant” video. It will answer all your questions.
Very deep and informative, great video. Does anyone has experience streaming audio from tv to the multiroom, does it get crazy latency?
Great video, thanks! However saying you don't want Google or Amazon listening in but then sending all your interactions to ChatGPT seems to nullify your goal? It didn't look like you were running a local hosted LLM.
Recommend digging into all my videos. I show the whole world how to run completely local LLM powered voice assistants.
Excellent work. What text to speech voice are you using. I really like it.
US British - Ryan Neural
Love the content, but not sure I want ChatGPT collecting and storing my information and conversations any more than Google or Sonos
Check out my private ChatGPT video. I show how that you can run your own LLM in your home and that you don’t need OpenAI at all.
@@FutureProofHomesI did also watch that video (and subbed at that time) but you didn't show the actual response time. You did however indicate it was way too slow to be useful with the cut video and the "an Eternity Later" still.
ah, yes. Well I have now have in the lab an LLM hooked into HA that is producing 2-3 second response times and controlling my home. The next vid should go deep into showing how to REALLY build the holy grail. Getting closer and closer!
@@FutureProofHomes have you tried running whisper locally? I wonder how much latency you get using NC for tts\stt.
Great video!
Thanks Mr. Escobar!
Is there a way to do this with squeezebox/squeezelite instead of snapcast?
Unfortunately, after second try to do this i have to admit, that pulseaudio makes delay between wake word detection and voice capturing totally huge, which renders satellite unusable. I'm on Pi-Zero_2W, and it's awful. I really wanted it to work...
Also for some reason pamixer isn't available for my OS (Lite, legacy)...
Will ditch this, since i already have good working setups on ESP32-S3.
I really wanted it to work...
I thought the Music Assistant documentation said that it acted as a Snapcast server. Is Step 1 (installing a separate Snapcast server) necessary?
(Update) It's currently in progress on Music Assistant Quote ( OzGav commented 2 days ago
It is being worked on. There is a desire to have this done by the end of the month but it depends on workload.)
(Old Comment) How would I go about having announcements via tts, play through the wyoming satellite? Music assistant doesn't support it at the moment I hope there's a way would be a total game changer
Excellent video. Could install as shown in the video. Everything works fine except for the last part to control volume. Is pamixer still around to be installed? Can I use pulsemixer instead?
Running into some issues installing the snapcast client. The following packages have unmet dependencies:
snapclient:armhf : Depends: libflac8:armhf (>= 1.3.0) but it is not installable. This is a fresh install ( just installed this all following the wyoming satellite tutorial from your last video on sunday)
I'm having the same issue.
I have found that it will install on a Pi Zero 2 W but errors when installing on a Pi 4B
I finally got to work on my Pi4B. I ended up having to install Pi OS Bullseye 64-bit to get the snapcast client to install.
❓16:43
I also created player-groups.
Is it somehow possible to change how the groupe-volume influences the individual volumes?
Example: How it behaves right now.
Group = vol.60 -> vol.30 (60-30)
Player1 = vol.80 -> vol.50 (80-30)
Player2 = vol.40 -> vol.10 (40-30)
(So it's by addition/subtraction of the volume.)
❗Example: How I want it to behave:
Group = vol.60 -> vol.30 (60/2)
Player1 = vol.80 -> vol.40 (80/2)
Player2 = vol.40 -> vol.20 (40/2)
(So it's by multiplication/division of the volume.)
BECAUSE than the relative volume relative to eachother is kept equal!
So if I have 2 speakers in opposite corners, I sit closer to Player2 and I have adjusted their volume so they sound for this position equally loud they still sound equally loud with multiplication/division but NOT with addition/subtraction.
I hope it's understandable what I mean.
Can someone give me some ideas or help how to achieve this?
Thank you all very much!
I followed this, currently having problems with the audio jumping and skipping when playing music and just general voice commands. Increased the SNAP Buffer and still get it.
Fantasic video. Thank you for all your efforts. Having go it working I am left with three issues. 1. Jarvis talks on my HDMI port speaker and music plays on my Mic2 card audio jack. I've tried to see why but can't work it out. 2. I get a fair few dropouts on the audio. 3. I tried adding some other pre-made wakewords (that work on the HA Server), but they don't work (error is can't find wakeword, but they are there in the same place as the ones that work. I'd appreciate any tips or advice. Cheers, Bill
what actual speakers are you using? I've gone too far down the rabbit hole trying to figure speakers and amps out
Fantastic series of videos. As a newby to HA your instructions and explanations are just brilliant. I had been planning to use Ligitech Media Server, until Media Assistant is out of Beta, and a bunch of picoreplayers (each with an amplifier Hat to drive some speakers) for the whole house audio. Is there any way to integrate the Wyoming voice assistant functionality you have created with the picoreplayers such that they would go quiet when a voice command was spoken etc? Basically to achieve the same end result as you have achieved but using LMS and picoreplayers for the audio distribution?
That’s a good question. I don’t know the answer unfortunately cause I haven’t played with picoreplayers yet. Let us know if you give it a shot.
This is neat. I think I will be doing this once I have Internet at home again because I'm really interested in getting a useful voice assistant set up at home. I'm ever so close to having F.R.I.D.A.Y. from Avengers: Age of Ultron running my house with this kind of thing being possible.
Awesome. Really glad this was inspiring. Thanks for the feedback.
@@FutureProofHomes Ordered two Pi Zero 2Ws today for this. Need to find some speakers for it yet, but that will happen soon enough.
@@FutureProofHomes Got it working on a Pi Zero 2 W today. Need to see if I can figure out why it's not playing nice on the Pi 4, and get it all working on the other Pi Zero 2 W I bought. A nice, but not absolutely necessary, addition to the collection of enhancements would be telling us how to install custom wake words on the Pi so we can do that if we want to.
What are you listening to on the AirPods?
I followed your tutorial, but I can't get the snapclient to output sound. I tried setting the output device, but it can't seem to find the mic hat. Also, during the tutorial I was able to execute the paplay command, but after completing the steps it errors with: Failed to drain stream: Timeout. Could you help me with that?
Still didn't try the ReSpeaker with the Raspberry Pi 4 as I commented in your other video. The ReSpeaker is out of stock everywhere. Anyway, just to be clear, can you clarify your setup? Because I see two issues with this that I still want to solve and I think you agree. You are still using non-local solutions, both NabuCasa and ChatGPT. I know you want to replace ChatGPT but I think at this moment, it's almost impossible to use Home Assistant with Local Voice, instead of NabuCasa. From my personal experience, it's way too slow. I just want to be sure that for you this is still like this and that is not a problem only on my side. Thanks for another great video and waiting for the one about replacing completely cloud ChatGPT :P
Check my links. There is still reSpeaker stock! And they work, I’ve used them. Gotta move fast.
@@FutureProofHomes Not where I am :) But I will get it for sure.
Ugh. I'm sorry man.
@@FutureProofHomesI found one that says "ReSpeaker 2-Mic Pi HAT V1.0 4b Zero/Zero W/B+ Raspberry Pi Keyestudio", I'm not sure if this is the same because of the version but I will buy it and see :D
Any chance to have pianobar or pandora work with this set up?
wonderful video...
Thank you! Cheers!
Question. What can I modify in this setup to point the TTS output to play through my Sonos / AMP speakers in my ceiling rather than using the audio output of the Wyoming Satellite?
Does snapcast allow you to remove a client from a group while keeping the audio playing on the others, or to resume a previous session if it's stopped?
Ooh and is there a way to use multiple mics in the same room with the same functionality, either with more rpis or with esp32 satellites that just handle audio input?
Also, it would be very nice to have a prebuilt Wyoming satellite image with pulseaudio for peeps! Maybe I'll make one... Though I'd love to use pipewire instead if that's usable.
you could use home assistant to send tts from the PI to home assistant and call the Sonos! or I am wrong, I saw something like that on GitHub but couldn't do it?
i am building my house and I am looking to build something like you did on my house, could you tell me what is the best hardware to use to make this?
do you think PI and the HAT mic is better then esp32 with a mic?
There are quite a few ways I can think of to hack the satellite to output it's TTS response to an external speaker/media_player. I/we should really think about the best solution here.
Also, I bet Nabu Casa will build this at some point. It would be uber powerful for many folks.
Have played with most of this (HA+Wyoming+ChatGPT) and the major deal breaker for me, at the moment, is the reliability of the local wakeword detection. In a room with the TV playing or just general background noise “hey Jarvis” will trip randomly every 20 mins or so. I never had this with the echo dots. I’ll give it another look in six months to see if it’s improved.
Try loading in other wakewords, there are a lot of them out there. Even custom ones. You may have better luck. I hear you with this false positive issue. Happens to me too.
Mine rarely triggers, but I am using a custom wake word.. "Hey superkalifragilistikexpialigetisch, turn on the livingroom light"
Lol... I don't know if that wake word is a brilliant idea to avoid false-positives or a terrible idea to cause more of them. :D
Great video, thank you! Is playing playlists working for you? This is strangely omitted from all the guides.
It works for my use case. But I do want to go further with those scripts and have ability to play songs, albums, artists too. Keep an eye on the repo and I’ll share those scripts if someone else doesn’t commit them before I do.
Thank you for these great videos, I'm getting the music out from 3.5 rpi jacket and not respeaker 2-mics pi hat as voice does, what have I missed here?
Intro:
1. We don't want big companies to listen to us.
2. We hooked our custom microphones to ChatGPT (which states not to put private stuff on it).
(Hypocrisy aside, I do know that it's for a local LLM in the end)
;) ;) Local LLMs are coming in hot. I've got one in the lab that is going to solve our needs. Stay tuned!
Can we coin "LLLM" yet?
Hello, can you make it talk/play songs wirelessly from Sonos so you dont have to plug in physical cable into this Wyoming Satellite ? I want to use the satellite for speaking and for playing Sonos. TIA.
Absolutely amazing content, I'm definitely going to try this out. I do have one question though and I'm not sure if it will work, but maybe you can shed some light on it. I have existing Sonos speakers. Would it be possible to use the Sonos speakers (mapped as mediaplayers in Home Assistant) as output via Home Assistant or do I need to hard wire the pi + hat into a speaker?
Are you looking to output the music to Sonos or the voice assistants voice? Or both?
@@FutureProofHomes If possible both, I'm using the cheap Ikea Sonos speakers throughout my house and if I could combine this, I don't have to get separate speakers just for this project.
So dope. Thanks!
Glad you like it!
I added another command. when there was a false detection of the wake word and no command was sent, the audio would not return to normal. Adding this command fixed it...
--error-command '/home/loftsatellite/wyoming-enhancements/snapcast/scripts/done.sh' \
With the connection to open AI, its still cloud push isn't it?
Hi. Noob question. I have Sonos Amps in a rack in my utility room and ceiling speakers throughout my house and have ethernet w/POE in every room I would need voice assist. Is this a good solution for me? Also, I've built my own inference server with 4090 running Oobabooga and am using the LlaMA Conversation Integration with very limited success in affecting my Lutron lights and shades. I'm thinking of rebuilding using the LocalAI with Extended OpenAI Conversation but would like some reassurance that it is actually working before I go through the effort. It seems like its more miss than hit / miss for the local LLM for me so far.
Awesome work!
I managed to get it all through til the end on my Raspberry Pi 3 with Respeaker 4mic-HAT. But I did not manage yet to get the Voice Assistant to control the Music. Maybe its because I am trying to use it in another language than english?
The response from the Voice Assistant is: "something went wrong. Template rendered invalid entities."
Thank you for sharing.
My pleasure!
This is great stuff, have it working fine except I can get the script to work, ChatGPT says "template list object has no element 0" any advice on that?
Ah just realised it needs to be a playlist, cant just say play Elton John must be the name of a playlist
can you send announcements over these speakers?
Sure can! Just use the correct TTS service and you’re golden!
If I want to listen to the same song in 2 different rooms, is satellite synchronization possible? Just like google nest mini.
Sonos's May 2024 app update is so horrible that this video is going to become viral.
I'm at the point of installing Music Assistant and in my version of Home Assistant, they have removed the HACS explorer and you are not able to select any Beta options. All I see is the download button and it's installing the current version. Does anyone have any advice on how to request the Beta versions in HACS now with the new UI?
Very cools stuff! I got it to work somewhat, but adding the pulsaudio ducking isn't working for me. Using pulseaudio vs alsa seems to add a significant lag to the wakeword detection and often stops listening to me before I even finish speaking. I also have not been able to wake the assistant while music is playing, even at very low volumes. any ideas?
Add - - debug onto the end of your enhanced-wyoming-satellite.service and restart. Utter the wakeword and share those logs. That will help me determine your issue. Open ticket or QA discussions in the GH repo. Easier to debug there.
PulseAudio causes a delay. I'm discussing that here: github.com/FutureProofHomes/wyoming-enhancements/discussions/4
The whole "stops listening before finishing or when audio is playing" sound like you need to tune your noise cancellation and sensitivity levels. You can play with those levels in settings -> integrations -> wyoming -> device settings in home assistant UI.
Hello thanks for this video. I have question...Can I use CZcams Music instead Spotify?
You certainly can. Just configure Music Assistant to use YT as the provider and then you may need to modify my play_music scripts slightly.
What OS version do you have? I am running the 64bit latest raspberry pi os for the pi zero 2 w on mine and having a number of issues related to it not finding dependencies and the like.
Just followed this method to a 'T', and still have no sound output from the device when playing music, or using the voice wakeword command. Its listening, because when using the wakeword, the LED's light up, and the command is executed. However snapclient/snapcast music playback does not work, and the sound output does not work. The error i get is
Jul 07 09:59:04 wyoming pulseaudio[510]: Failed to open cookie file '/var/run/pulse/.pulse-cookie': No such file or directory
Jul 07 09:59:04 wyoming pulseaudio[510]: Failed to load authentication key '/var/run/pulse/.pulse-cookie': No such file or directory
Jul 07 09:59:04 wyoming systemd[1]: Started pulseaudio.service - PulseAudio system server.
Jul 07 09:59:07 wyoming pulseaudio[510]: Failed to find a working profile.
Jul 07 09:59:08 wyoming pulseaudio[510]: Failed to load module "module-alsa-card" (argument: "device_id="0" name="platform-3f902000.hdmi" card_name="alsa_card.platform-3f902000.hdmi" namereg_fail=false tsched=yes fixed_latency_range=no >
Jul 07 09:59:14 wyoming pulseaudio[510]: Failed to find a working profile.
Jul 07 09:59:14 wyoming pulseaudio[510]: Failed to load module "module-alsa-card" (argument: "device_id="0" name="platform-3f902000.hdmi" card_name="alsa_card.platform-3f902000.hdmi" namereg_fail=false tsched=yes fixed_latency_range=no >
Jul 07 09:59:14 wyoming pulseaudio[510]: ALSA woke us up to write new data to the device, but there was actually nothing to write.
Jul 07 09:59:14 wyoming pulseaudio[510]: Most likely this is a bug in the ALSA driver 'snd_bcm2835'. Please report this issue to the ALSA developers.
Jul 07 09:59:14 wyoming pulseaudio[510]: We were woken up with POLLOUT set -- however a subsequent snd_pcm_avail() returned 0 or another value < min_avail.
But when using the command paplay /usr/share/sounds/alsa/Front_Center.wav the sound outputs fine. I ran the command pactl set-default-sink alsa_output.platform-soc_sound.stereo-fallback to set the output to the 2mic pi hat. Any ideas
This is awesome! I've followed your other tutorials and now this one but seems to have not quite got it right. When I say "Hey Jarvis, play jazz on the living room satellite" it spits back this error in the voice assistant debug - "Something went wrong: Service script.play_music not found."
Not entirely sure why as there definitely is a script.play_music entity and it has been exposed to Assist.
Any ideas what I could be doing wrong?
Did you manage to fix that?
I've been following this as is life to do something similar. I notice that there's a pretty substantial delay between your wake word and then command. Is there no record buffer capability with the pi and hat setup you use?
Yep. approx 1 sec delay approx. maybe a little more. kinda sucks. If anyone knows how to remove this delay tell me!
When I'm using wyoming satellite with wake word service enabled in it, it looks like chatgpt is invoked without any previous context. When I use the same "assistant" pipeline through HA web page ("Assist" chat) it keeps context. Any fixes?
how do you get those start and stop sounds. I want those specific ones!
The sound files are included in Home Assistants Wyoming Satellite project.
Built it with a raspberry pi 3, USB microphone off a USB webcam and headphones! It sounds so much better than the esp32 ones! Wow! Pretty easy to get the basics going! Adding all your enchantments now!👍
Dang man. You're fast!
another question.. when you activate the wake word, you don't speak until it lights up. is that a requirement? Really looking for a more natural engagement where you start with the wake word and just speak normally.
Kinda, yes. Gotta take a breath so it begins recording. It’s still kinda like riding a bike. Takes a moment to get used to. It will get better and I plan on experimenting with better hardware soonish.
@@FutureProofHomes have you replaced your Alexia with this new setup yet? Watching all your other videos you have a lot of stuff built around Alexia. I've been on a journey of removing Alexia and using HomePod as a media player. I can't seem to find the middle ground or best of all the worlds.. It does seem the Wyoming and HomeAssistant stuff is getting real close.
Haven't replaced Alexa yet. But I will. Right now I run the voice assistants side-by-side.
wait i have in my living room sonos speakers but i have google hubs and nest speakers in all other rooms. How are you setting it to play onto the speakers
Watch this video. It shows you how I'm doing it. czcams.com/video/eN0_8GCsZm0/video.html
There is a more convenient/wireless way to do this, but I/we haven't built a tutorial for this though.
Silly question but first....... your videos are SOOOOOOOOOOOOOOOOOOO helpful, Thank you!!! Okay so I have my 'jarvis' working in HA is there a way to funnel the output into a Sonos Speaker instead of a plugin in that pi hat LOL.... if you can help that would be appreciated but if not STILL much appreciated for your work!!
Yes. There is a way to do this. But nothing I’ve found that isn’t a major hack and that is stable. I’ll keep hunting for the right solution and share as soon I can.
I've been thinking about the same thing. It should just be in the pipeline@@FutureProofHomes
Can you turn a esp32 s3 box 3 into a media player like this? Or does it have to be a raspberry pi. Edit bassd on watching more of the video seems like has to be a pi👍 so pumped to build this! Thank you again!
Pulse Audio, OpenWakeWord, Snapcast… I think these services are beyond what ESP32 can handle and thus requiring a Pi. Please anyone, correct me if I’m wrong here.
@@FutureProofHomesI am the snapcast developer for MA and just running snapcast on an esp32 is problematic, there are several implementations but none is as good for something like this.
Are you still using the Sonos speakers? Or what cheaper speakers do you recommend?
Personally, for me to sell my Sonos equipment I/we need to achieve the following:
1. Sub-second wake word response times w/ 1% error rate in false-positive wake word detections.
2. A bunch of well tested scripts powered by a local LLM that can intuitively search for artists, genres, songs AND play, skip, join groups, split groups, control volume perfectly.
3. Zero buffering/out-of-sync/glichy audio streams across 6 zones.
I'm on a mission to get here. Then yes... I will truly ditch my current expensive Sonos system.
I have no speakers, so when you find those and post a video… they’ll be mine!
Great content, thank you for the detailed instructions. New subscriber here. Ive ordered a raspberry pi to try and get this done.
Question. Do you know if it is possible to have the response of assist run on another device? I know how to do this on a esphome satellite, but would like to on a wyoming satelite..
It’s not impossible. Take a little hacking and I plan to share how I’m doing this soon.
@@FutureProofHomes awesome, looki g forward to that.