Vložit
- čas přidán 28. 06. 2024
- A well-kept secret of the ESP32 is its extended audio capabilities because it is hard to use. Luckily, I found a library and a toolset enabling us to easily use these capabilities. We can now connect microphones, loudspeakers, Bluetooth loudspeakers, SD cards, and even browsers to an ESP32 to record and play sound. Very handy for all sorts of projects. And we will build an internet radio with a single line of code in the loop().
I am a proud Patreon of @GreatScott! , @Electronoobs , @EEVblog , and others.
Links:
Phil's Library: github.com/pschatzmann/arduin...
Phil's A2DP library (Needed for Bluetooth): github.com/pschatzmann/ESP32-...
ESP32 board: s.click.aliexpress.com/e/_9fcxid
Microphone: s.click.aliexpress.com/e/_ABXMq1
MAX98357A I2S Amplifier: s.click.aliexpress.com/e/_A8FZaH
PCM5102 DAC: s.click.aliexpress.com/e/_AdOLAl
I2S ADC: s.click.aliexpress.com/e/_9zMQg5
ESP32 Audio Kit: s.click.aliexpress.com/e/_DEN...
PMOD "Soundcard": digilent.com/shop/pmod-i2s2-s...
Filter Video: • ESP32 Arduino with ard...
I2S Pins: bit.ly/3KAkkmv
My second channel: / @hb9bla
The links above usually are affiliate links that support the channel (no additional cost for you).
Supporting Material and Blog Page: www.sensorsiot.org
GitHub: www.github.com/sensorsiot
My Patreon Page: / andreasspiess
Discord: / discord
If you want to support the channel, please use the links below to start your shopping. No additional charges for you, but I get a commission of your purchases to buy new stuff for the channel
My Amazon.com shop: www.amazon.com/shop/andreassp...
For Banggood bit.ly/2jAQEf4
For AliExpress: bit.ly/2B0yTLL
For Amazon.de: amzn.to/2r0ZCYI
For Amazon UK: amzn.to/2mxBaJf
For ebay.com: ebay.to/2DuYXBp
profile.php?...
/ spiessa
www.instructables.com/member/...
Please do not try to email me. This communication channel is reserved for my primary job
As an Amazon Associate, I earn from qualifying purchases
#no#midroll#ads - Věda a technologie
I love that you don't just cover one topic in each video and make a "series". Instead you give us a comprehensive guide end to end. Thank you!
Thank you for your feedback. Sometimes not easy in 15 or less minutes ;-)
I second to that 👍🏻
@@AndreasSpiess 30 to 60 minutes videos are ok too!
Ah, a library that is properly documented. How Swiss!
I agree. Its documentation is good. And I think also the examples. It helps a lot for the beginning...
I've used Phil's library for a few projects - it's really good work and removes a lot of the complexity of I2S.
Thank you for your feedback! I am also a subscriber of your channel ;-)
@@AndreasSpiess You've no idea how happy that makes me. I feel like I have won the internet :)
Amazing as usual, I gave up on connecting the tiny microphone, but with this library you make it work!! Thanks again for your amazing way of presenting just what we need:)
I hope you will be successful!
This is really getting a Swiss channel... an accent, a library...
What a great video and really usefull !
You are right! This was truly by chance. There is not a lot of ESP32 audio content around...
I always enjoy receiving a new episode from your channel. I just have to remind myself: sit down and pay attention! Thank you for such an information-rich source!!
That is the right attitude! Then you do not need to ask questions about things which were presented in the video ;-)
Simply Beautiful! Love your work ! Audio was a very big problem for me in my projects but you showed me such a great way to tackle that. Thank you !
Glad I could help!
Wow, sound using I2S has now been demystified. Great work. Creating comprehensive single source of documented and working solutions for audio through internet is great time saver. I use to have to scour the internet and look for information that a lot of times did not work properly or was difficult to adapt to my projects due to code complexity, bugs and undocumented functions.
Thanks for spending the time and money so others don't have to.
You are welcome! All the work was done by Phil!
I have been wanting to build a "Arduino based" MP3 player for awhile, but didn't see the tools necessary. This video is exactly what I needed. Thank You, Andreas.
You are welcome!
Impressive find 👍
Great walkthrough of the process as always 👍😀
Thanks for sharing your experience with all of us 👍😀
You are welcome! I am glad this video solves many problems!
You are covering exactly what I am working on this weekend. Thanks!
Excellent! Hopefully you get along a little faster.
Yeah! Another ESP32 video! Thanks for creating it. Recording and playing sound is a very useful topic.
Many viewers agree that this is a useful library!
A video jam-packed with information and ideas! Thanks.
Glad you enjoyed it!
Literally all the information I was looking for for 2 different projects in 1 great video. Thanks :)
You are welcome!
I just saw your Super Thanks on my PC (it is not displayed on the IPad). Thank you for your support!
Really a great project. Thanks for honestly sharing your experiences with all the wrong details a beginner makes. So we all can learn from it.
Glad it was helpful!
Classic Andreas , Informative and comprehensive , easy to follow . Thank you !
You are welcome!
Great stuff as always Andreas! Thanks a lot for this!
You are welcome!
Thank you for bringing Phil's library to my attention at least. You''ve opened up some possibilities for a lot of projects.
(One thing, at 9:40 I couldn't get Frankie Laine singing Ghost Riders in the Sky out of my head.)
Unfortunately, I do not understand your reference to Ghost Riders :-(
Lovely! great efforts! thank you everyone from swissterland!
:-)
Many thanks for nice, useful and calming content in this difficult times. Best regards Niksa.
You are welcome!
Thank you for this video! I have currently a problem on an esp32 audio project and this can maybe fix this. Will try it out. Great timing! 🥳🎉
I hope you will succeed!
Thank you! That has really helped as I bought one of the I2S capture cards some time ago and struggled to get it to do anything except generate noise. It works perfectly with the library you recommend :)
Glad it helped!
Kudos for explaining master clock on the ESP32, and doing it well.
You are welcome!
What a wonderful guy! Its a pleasure for my mind, all your contents. Many thanks Andreas, 73
You are welcome! 73
Thank you Andreas, send Phil my gratitude
You are welcome! I hope he reads these comments, too
Wow! It sounds great! 🎶 Thanks for sharing it!
Glad you like it!
wow, thanks for this video - this library was just what I was looking for. I wanted to make an mp3 receiver with an ESP and was afraid I would have to do all the i2s stuff by hand.. but this makes it really easy.
Glad I could help!
THANK YOU SO MUCH ANDREAS! This gives me a lot of idea to play with radio and internet hehehe
Cool. That is very good.
I noticed that lately I keep hitting videos with this specific guy with a Swiss accent. After the 5th video I decided, "Well... I guess this guy with a Swiss accent has earned a subscription..." :D Thank you for all of the work you do!
Welcome aboard the channel!
I'm using this library for streaming i2s audio from a FM Radio chip to Bluetooth Speakers 🔊 but sometimes it will freeze up as Andrea experienced, at least when I was testing 6 months ago.
I also use this library to stream Internet radio to Bluetooth speakers 🔊 or to a I2S amplifier which works well.
Love to see more people get involved and keep improving the library.
Cool projects! Let's hope the A2DP issue can be resolved. Maybe you can provide more debugging info to Phil?
Nice topic, so thanks for all the insights, Andreas.
Glad you enjoyed it! I also see some interesting projects...
Thanks, Andreas very well explained as always, we want more 😁
:-) We will see...
Amazing content density. Thanks! I am going to try this out this week. I wish I had viewed the video the day it came out... So very busy 😑
We are all busy. No problem ;-)
This looks great. Thanks so much!
You are welcome!
Excellent video Mr. Swiss guy, just excellent 👍. Thank you.
You are welcome!
Great video Andreas and thank you for the link ;)
You deserve it ;-)
Awesome video Andreas.
Thank you very much!
Thank you for sharing this!
My pleasure!
Outstanding, thank you!
You are welcome!
Nice one :)
Plenty of ideas for future tinkering !
True. I have some projects in mind, too...
Nice work!
Thanks!
Keep going Andreas, i really like your videos
Thanks! 😃
I would really like to use a capability like this with Home Assistant to build small devices that I could use to play audio announcements, alerting tones, etc. and maybe also use them for music playback as a flexible media_player type device. More projects to investigate! Thanks for the introduction to this capability that I wasn't previously aware of!
Either using a webserver or an SD card as a source should enable all these projects.
Great job Andreas
Thank you!
If combined with the esp32-cam and a sip library the next step would be a ESP32 Video Doorbell😁
I thought of the esp32cam too due to integrated SD card reader!
Just do it (and document it ;-)
Share it pls
Helpful video. I liked it
:-)
Many "dankkes" to our Swiss friends, Herren Speiss und Schatzmann for introducing us to the audio-tools library - quite amazing and a most excellent use of "streams". Typical Swiss product - very high precision... If you dig into Phil's project there are many discoveries to be made. The project I was working on is a musical tannenbaum.. It took me no time to implement Phil's "player" with a LCD2004 display showing the metadata... Being an ESP32, of course, adding a time display is a cinch. Now to dig for another output stream to make the lights on the tree dance... could it be that I get to write a custom stream? sounds like a fun challenge.
Keep up the good work, Andreas - I always sit in the front row...😀
Good luck with your project! Still some time till Christmas.
Thanks for your efforts.
You are welcome!
Looking forward to that video on applying audio filters with this library on esp32! I have a need to hpf audio at about 150hz...
That should be possible... Not decided how I will cover the topic.
Liked, thank you, sir!👍
You are welcome!
A very informative video. It 'sounds' as though the ESP32 could form the basis for a microphone audio processor for amateur radio use. Regards.
Yes. That was the reason for these experiments.
I LOVE IT, thank you so much
You're welcome 😊
Excellent video, very interesting, pity I don't have time to "play" with this, but it surely will be on my preferred list or pension hobby list.
Cool. A bucket list is very important ;-)
Radio Swiss Jazz ❤️. Best Station ever… tnx for using this as webradio sample.
This was Phil's idea! Also Swiss-Pop is quite cool. Maybe only for elder people like me ;-)
Thanks for these vids.
You are welcome!
Hello Sir. I'm from Cuba. I like very much all your videos specially those related to Espressif ecosystem. I use Eclipse ide form my projects. I really aprecciate examples in your videos using that ide. Form ESP-IDF 4.4 Espressif has an IDE based on eclipse. Very useful.
I only use the Arduino IDE on this channel because this is used by most Makers.
this is so cool - i want to make small tuner/amplifier/effect for ukulele - this can simplify my work quite well
:)
Glad it is helpful!
3:05 "Each device can act as a master or... whatever name you prefer" got me in stitches.
:-)
@Andreas Thanks for pointing to this library... now i can remove Basic i2s Audio from my projectlist... and give my attention to voice recognithion,
Hopefully you will be successful!
This is really useful. I have been putting off making a smart mp3 player play sleep music at night (along with controlling some ambient lights and switching the bedroom fan on/off). I have purchased a UDA1334A I2S Stereo DAC breakout a while back and tested it tonight as you suggested and it works perfectly! Thank you. I do wish however I was able to figure out how to start the mp3 stream via an MQTT command! If you have any suggestions about this, I would gladly hear them!
Maybe you open an Issue on Phil's GitHub. I am sure you are not the only with this question...
For those who were confused like I was, streams-generator-csv has been renamed streams-generator-serial.
Thank you for the info!
I've struggled on and off trying to understand audio recording and play back on the esp32. Cobbling together examples and trying to decipher the I2S docs. Tha k yiu doe highlighting this. I still want to understand it at a low level, at least now there's a library that works which I can look at.
I agree. Having a working example helps a lot in many cases...
Awesome!!!
Thank you!
Cool! New horizons. Thanks
Indeed, it opens new possibilities!
imo the ESP32s integrated dac is pretty ok especially for simple audio notifications on your projects
Agreed. We also want to use it for a radio project where bandwidth is limited to 2.5kHz. But for "real" audio it is not good enough
Perfect, many many thanks...
Yesterday i played around with this Ai Thinker board but didnt had any luck because i was unable to get the esp-adf to work.
I will try it with this library.
Use the respective examples of the library!
@@AndreasSpiess Yep, they are working perfectly fine 👍
This part with the BT-Speaker sounds nice... Hope you will make an github example. My idea is that to make next Radio project.... and i will use my ESP32 and only one of my many BT-Speaker....
yw
It seems it works with other examples of the library and I was unlucky.
Hello Professor Spiess! Congratulations for your great classes!! It would be interesting to use the ESP32 to access some API from Spotify or Amazon Prime Music and stream online music or even entire playlists on the JBL or some other bluetooth speaker. If there's someway to accomplish this, we don't need computers (or MPUs like the Raspberry) to do this task anymore. Best Regards from Brazil !!
Maybe you open a feature request on Phil's GitHub...
Very cool! Wonder minimal sized phased array needed to integrate with multicast udp over ku and ka microwave downlink. Could be useful...
I do not understand your comment :-(
Amazing video! And I loved the Master/whatever reference :) Do you think it would be possible do use an ADC module with i2s, si5351 oscilator, mixer chip like ne602 and an ESP32 to build a SDR receiver only with modules?
I will cover SDR stuff on my second channel. And this video is the preparation for digital filters which are needed there...
Merci beaucoup!
De Rien!
Thank you for this. I've been trying to finish a project using other available ESP32/ESP8266 audio libraries but run into problems with reliability or getting the functionality I want. Hopefully this library will help me to finally get it working.
I hope, too!
Muito bom, obrigado! 👍🏼🇧🇷 Thanks,
You are welcome!
Thank you. I got an ESP32 KORVO v 1.1 sound development from ESPRESSIF, that seems to have been shipped missing some components. It does have the required I2S DAC and ADC chips though... With this I can finally use the components on there for something useful.. :)
I hope the chips there are usable with the library.
@@AndreasSpiess I hope so too... Got a real bad experience with that particular device.. lots of missing components, technical drawings not up to date etc... but, that is good, as it will be a challenge to see what can be salvaged and repurposed... The library that you referred to will definitely work with the ESP32... it is now up to hunting down datasheets for the supporting components :)
Danke!😎
Gern geschehen!
Would be interesting to see the impact of this continuous streaming on power draw. I always thought it would be cool to build an Internet Radio for Pandora, and I suspect the ESP32 would be easier on batteries than, say, a Pi Zero W.
I did not check. WiFi anyway is not ideal with batteries.
Internet radio on the Esp32 is amazing. check out the Adafruit i2s stereo decoder board, connected to a hifi amp, you get great sound quality. makes you relaize how bad DAB is
These I2S decoders seem to have a decent quality, especially for the price...
Awesome. At 8:24, though, it's completely fine to have signals up to 5V on ESP32 (just not on power pin). CEO of Espressif has confirmed this
I only heard that for the ESP8266...
@@AndreasSpiess Teo Swee Ann confirmed that the ESP32 GPIO pins are 5V tolerant. Apparently, they took that out of the datasheet because users were trying to power the chip with 5V
Hello! These videos are superb, I'm learning a ton from each one. I'd like to try creating a LoRa system for automating the scoring and refereeing of an outdoor game/sport. Think of "capture the flag" type of game, where players can take control of points in an outdoor area by "checkin in" on the points, and are scored for example based on how long they control each point during a match. I have a small demo of this on an Arduino through Wifi, but the final application will need much longer range than what Wifi can provide, with about 12 points in an area of one or a couple square kilometres. The system should be able to run for two days straight on battery power. I've been looking at ESP32s with a LoRa capability and an RIFD reader (with an RFID tag on every player) to make this happen, but the amount of components on the market is just overwhelming, and new ones just keep coming up. Could you please suggest some parts to start looking at and developing on? I would really appreciate any advice on the most suitable parts as the main board, the reader, LoRa part and the battery.. And if there are any go-to tutorials that you would suggest, I'd be happy to hear about them. Thank you!
This is a very complex project and I do not do consulting, unfortunately. You are on the right track to start with a prototype for every aspect of your project and finally integrate it into an entire system. You find a lot of info on this channel for each aspect.
@@AndreasSpiess Thank you very much for the reply. I have managed to make a shopping list for components and am making good progress by following more of your videos.
Perfect
:-)
Hey! Seriously thank you so much! This is such an amazing resource! I've managed to get things running here but the audio coming out of the earphones jack on the AI Thinker audiokit is real quiet! Did you have a similar experience? Can't tell if I need an amp or just got a bad one haha! Thanks again!
So far I have no experience with the AI Thinker kit :-(
Please make also a video about the minimal setup like A2DP sink for ESP32-A1S module as they have two different models because of the two codecs, one with AC101 and the new ES8388. Thank you!
You find a lot of examples for both versions of the A1S in Phil's repo.
I saw that the expressf dev has a way to create a Bluetooth speaker or headset example made with the esp32 but not Arduino, could be a nice little project
I agree. You can save the audio amplifier...
Great stuff Andreas, ill have to check this lib out..looks simple as!
..idea for you now you have audio.. 433mhz decoder..and/or APRS packet monitor, with audio out and decoder to LCD/TFT... and (for your other channel) maybe a two way 433mhz or APRS ?
We already have an LoRa APRS on 433. So no need for something better. And for 144 we want to use this project for an APRS tracker using a Walkie-Talkie module. But first I have to find a Chinese manufacturer for my boards. I do not want to distribute them...
@@AndreasSpiess i had a feeling i had seen APRS on 433... ya project idea sounds perfect! ..no pun intended! :P
I would REALLY like to see someone get that Bluetooth speaker functionality working. That would be huge.
Others reported that it works.
Good Show, Andreas. No gold this weekend .
Thank you! Rome also was not built in one day as we say here...
I built the blue toothe speaker in your video with the esp32 dev board and max98357a! I made the connections on a breadboard and uploaded the A2DP code to it! It worked for about a minute and started dropping out. Now I cant get it to show in the device manager on my phone or laptop. Looks like i got some work ahead for me. Pretty impressive how easy you made it though, since I'm new to micro controllers and programing! Awesome projects you have! 👍
Welcome to the channel. I wish you luck finding the problems. Otherwise, Phil is helpful if you create an issue on github.
@@AndreasSpiess wow cool! I wasn't expecting a comment back from the creator! 👋😀 I think the project simply wasn't getting enough current as I was using a 7805 voltage regulator to power both the boards up! Probably a brown out issue but if I still have problems I'll definitely contact phil. pleasant surprise to hear from you! Thanks for your input!
@@ryanmowry1170 All comments are answered on this channel ;-)
@@AndreasSpiess I got my project working! 😀👍 I powered the circuit directly without 7805 voltage regulator and tested it all day and didn't drop once! Very cool project and easy all thanks too your wonderful and helpful channel! Keep up the great work! Your channel makes a difference and is much appreciated! Now I'm going to make a more permanent version of the circuit with my first attempt at making homemade pcbs and soldering the stand alone esp32 and amplifier modules to it!
The BluetoothA2DPSink library by Phil Schatzmann with an ESP32 connected to a PCM5102 decoder module plays audio via Bluetooth
Cool. Thanks for the feedback!
Hey das isch genau es richtige video wo ich bruchä dankä 🎉🎉😂
Gern geschehen!
To bad about that BT audio, hope to see it fixed soon. I see great potential for using this with KaRadio and BT speakers.
Others had more luck. It seems to work somehow...
On the note of Master/Slave naming scheme….the company I work with calls it Master/Member which I believe is a better encapsulation of what the phrase conveys….just a thought…
So they added a new variant. Interesting!
Great video its helping a lot. Question: what is the browser url when you send audio to a webpage?
I do not know it by heart. But it is for sure documented in the Github project.
Very nice library, I have to try it with my AtomEcho. I have to be careful, though. I fried the neopixel on the Echo when I installed the wrong audio example for the i2s library and the default config tried to play sound on it.
Better be careful than sorry ;-)
ESP32 is taking over the world. My first computer cost well over £2000, and did not even have sound. I will be running my house on ESP32s :)
That is what we do, too. It is a marvellous chip!
Thank you for such a great video. I wanted to ask you one question that how have you hooked up the esp32 with inmp441? Thank you once again.
You find the info on Phil's page
Was really looking forward to trying Phil's library, unfortunately it doesn't work on my ESP32-C3 dev boards. I entered a question on his github site. Hopefully this will be resolved soon.
I am not sure if it makes sense to use it on a single core processor with Wi-Fi as a "competitor"
Great find, it's a skill finding the solution, sometimes you create it - often you reinvent a wheel already out there and you find that wheel, so thank you.
Now need to get some ESP32's (already planned), been playing with pico's and the ESP32's predecessor and been fun. But the built-in wifi and Bluetooth on the ESP32, sure does offset the PICO's lovely PIO interface perks and performance.
One question - what is a good external ADC at a good price balance for resolution? Also looking at ADC's with multiple channels - they seem to poll one channel at a time. What I want to do is poll 4 ADC ports in sync so that the value I get from all 4 is the exact (close as beyond clock jitter that I want as low as possible) time. What I want to do is read 4 piezo elements (cheap mic's if you like) located around a hard surface like a blackboard and from that, hopefully, work out where contact is made to the surface. Turning any hard surface into a touch interface. Now the ideal plan is to be able to read accurate enough in sync so that I can get a good accuracy of the surface noise location and be able to write upon the board and get a digital representation of that via the sound location of the 4 piezo elements. With that, a cheap and simple device that could digitise any blackboard work.
So any suggestions, or pointers and insights etc, would be extremely well received.
Thank you in advance.
I made a video about external and internal ADCs. Parallel is always hard. But maybe you do not need parallel, just only s small difference.
Been working on that myself a few years back, wanted to run it on an arduino for a drum synth input that takes drum surface polar coordinates into account. Life got in the way, but if I were to revisit that idea (some day!) I'd use separate controllers on a common clock to handle all the peak sensing and compare timestamps a few millis later. Might just cut it without lagging too much.
I just realized how much faster the signal would move through a solid, so instead of timestamps you'd be comparing levels, of course. The system would need calibration anyway. To cut costs, 3 sensors inputs could be used instead of 4, if accuracy and sensitivity are high enough.
@@ronnetgrazer362 Yip, clock sync is golden for this - cool idea for drums and be funky to see an overhead display of the drummers' actions from another perspective. Hopefully, motivating you into rekindling that project, I know what it is like, many things on the go and flip between them depending upon time, mode and resources.
@@PaulGrayUK Exactly, there's always another interesting project fighting for attention!
I made a million edits to the previous comment btw, sorry for that.
And i just now realized that sufficient precision would allow you to fit all 3(?) sensors in the middle of the sensing surface, spaced apart just enough to fit the main PCB in between. Don't know if you figured 4 corners means one sensor on each of them like I did mere seconds ago, but I don't see why you couldn't sense outside of the array as long as specs allow for it.
@@ronnetgrazer362 I was looking at 4 sensors around the outside, so any sound which will be in contact with the surface would have a delay difference for each sensor and with that, want them far apart around the outside and for my objective - 4 should be 1 more than enough and 1 more for a level of accuracy. But need to play and see if 4 is the sweet spot or 5 or 3. What the offset in costs and more so accuracy and see how those plots out.
Drums bit more complicated. Don't want to add anything that will change the sound of the drum. So maybe a laser mic would be the way for those and can have under the drum tracking from the underside - how many I'd start with 3, should cover the main area drummers like to play upon the skin (can look at used drum skins to get good idea or area you are targeting to cover). It May work, may not, but be fun to play with as everybody loves lasers. :) However - like any well-formed plan, there will be exceptions - and drummers doing a rimshot would be one that would prove to fall into that path of exceptions. But may also be detectable by the pattern it plays out upon the laser mic array. One of those, try and see.
Hi Andreas, thanks for the nice video and content.
Here are some questions:
1 - How many ohms has the speaker that you used at valse.mp3 example?
2 - Is there a limitation in ESP32 about speakers impedance?
3 - It is possible an audio comunication between LoRa Rf? A conversation between two people for example.
Here is the guy with Brazilian accent :)
Hi Helmuth I am no expert but checkout the i2c audio module he used the MAX98357A. "Output Power: 3.2W at 4Ω, 10% THD, 1.8W at 8Ω, 10% THD, with 5V supply". I highly doubt LORA is good for that application since it is very low transfer rate. LORA would be better for sending text messages.
@@JonnyWaldes many thanks :)
I agree with Jonny
Wunderbar
:-)
thank you and it is really helpful. and also do you have plan to use a2dp and BLE serieal communication at the same time? since esp32 support dual bluetoth but there are not imformation about it (especially with arduino IDE)
thank you again ser
Maybe you ask Phil, the creator of the library?