Writing a Really Tiny RISC-V Emulator
Vložit
- čas přidán 8. 09. 2024
- Github Project: github.com/cnl...
The Assembly talk: • Hackaday Supercon 2022...
TCC Installer: github.com/cnl... / github.com/cnt...
.exe file was compressed with UPX (Alternate EXE Packer) for thumbnail.
Discord link: / discord
Terminal Font: AudioLink Console Heavy audiolink.dev/ - Věda a technologie
It makes sense that you would be a RISC giver rather than a risk taker. 🙂Thanks for sharing.
Oh I like that joke.
*\(^___^)/* 🐁
So cool, the whole thing fits the L1 cache of a modern processor with lines and lines to spare 😎
Absolutely!
*\(^___^)/* 🦊
Nice work! A fun step with emulators is adding in a gdb server/hooks so you can debug your emulated processor with breakpoints and watched variables just like on real hardware.
I haven't gotten to it, but, that can totally be done using this emulator. The .h file can have overrides to facilitate this.
*\(^___^)/* 🐒
*\(^___^)/* 🦒
I understand the whole being excited about a project… reach a monumental milestone and then hit the unsure if you will continue or quit while ahead haha. This is great work and you are very inspiring!!! I hope your curiosity continues to fuel your excitement for this project. Where this goes will be a great adventure. Keep up the awesome content! I have a feeling your channel is on the cusp of massive growth! Again great job!
I did push it a litttle bit further, so I'm going to make at least one more video!
*\(^___^)/* 🐻
Great video, as always. And I know that the ESP32 isn't the only place this could be useful, but you can absolutely boot noMMU Linux natively on an ESP32 with external PSRAM! I've got a kernel+buildroot setup that boots successfully in QEMU!
Esp32 cannot use the psram as rwx it can only rw or rx from the ram it's a limitation of the hardware.
@@jesset2550 While that's technically true, a) that does not mean it can't run Linux b) ESP32-S3, the newest ESP32, actually can just map 32MB of external RAM on *both* data and instruction bus. It works in QEMU already, I'm almost confident that I can get this to work on real hardware when I finally get a real ESP32 with PSRAM in my hands.
@@Maxjoker98 ESP32-S3 is not RiscV and has closed ISA protected by Xtensa. Esp is slowly replaced by chips like K210 or latest M1s that are superior and cheaper and much better. Espressif should make 64bit dual core riscv to make it easier for people but they care about money more
@@browaruspierogus2182 I never claimed the ESP32 S3 is RISC-V. Also the Xtensa ISA is well documented(You probably mean they should freely license it and their designs based on it).
But I think what they should do is make the tiniest noMMU Linux capable SoC they can make, with Wifi and Bluetooth.
I think there would be a market for that.
And they already make the S3, which is capable of running Linux - I would love an ESP with RISC-V and PSRAM support, but that doesn't exist yet(It wouldn't have to be such a large and complex SoC as the K210, which is way more expensive).
@@Maxjoker98 you probably didn't read posts on esp32 forum how many problems S3 has with managing f.ex LCD and Wifi/BT at same time. And how clunky and bas is psram. The design is really bad and they need to come up with better design
This has helped me in planning my discrete TTL risc-v cpu. Thanks for posting
Excellent! If I find any bugs I'll do my best to keep updating the template. Someone else already used my emulator as a template to write a RISC-V emulator in squirrel.
*\(^___^)/* 🐑
Now try to implement prediction branching (it would probably slow down everything). Impressive stuff. Making a Risc-V emulator is something, maiking it actually run an OS is a different thing. I have the Neza Sipeed Risc-V SBC with Debian, Risc-V is the only possible future for everything. It is so well designed and their ABI makes everything faster because we know what registers to use.
It almost certainly would slow things down, because there's already going to be branch prediction on the emulating hardware. Making that more sophisticated will just add abstraction overhead.
@@CNLohr It would probably still run faster than WASM
@@MarquisDeSang lol
*\(^___^)/* 🐕
*\(^___^)/* 🦒
So happy you are back and working on stuff that I'm also interested in!
It may only be for a bit but I'm gonna try to make it longer!
*\(^___^)/* 🐒
Nice one! Thanks for sharing, there's a lot of cool stuff to learn from this... cheers!
This RISC-V emulator is like the gift that keeps giving. I just made two more videos on it, you should check my channel.
*\(^___^)/* :😺
It's funny how many times I have rediscovered your channel learning about unrelated interesting things.
I like finding out lots of unrelated interesting things!
Thumbs up for putting it together .. 👍🏼👍🏼
This is cool.
I'm working on a very similar project for a RISC-V emulator, intended to be run as a sandbox inside of other applications.
It'll be my second go at writing an emulated CPU. My first one used a made up machine instruction set, and I programmed in machine code by hand.
When I paid attention to the RISC-V, I saw that my project was similar in may ways.
In this second attempt, I am focused minimizing resources and and maximizing speed.
After looking into other emulator projects, including yours, I see that the footprint is likely to be smaller than I anticipated.
You might want to join my Discord, there's other RISC-Vers there. You can ping me at `cnlohr` on Discord.
Yay new upload!
I learnt a lot with this video, thanks for sharing. Hope you'll continue this project and make other cool stuff with it !
I'm gonna be making at least one more, so be sure you're subbed!
@@CNLohr I am, for quite a long time already ;)
That is so awesome! This really encourages me to try to implement Linux on my RV32 system as well! (I'm not sure Its doable, but we'll see :))
yess
Great project! love your videos, I hope you have more time to do them next year!
We will see. I may or may not.
*\(^___^)/* 🐒
Great video
maybe you don't want to put a red line at the bottom of the thumbnail as some people may think that they already watched the video
100%
also, great work!
Osnap.
Haha this is brilliant!
actually insane
Amazing! Thank you.
solid work
that was impressive!
Thanks.
Nice to see come back with such beautiful way.
Thanks. I "want" to keep making videos. It's just really hard to keep up the momentum.
In case anyone is interested, there's a good video where George Hotz opens the spec, and starts writing a little RISC-V core in Python and in Verilog!
BTW, with so many different flavors of Risc-V chip, each selecting the ISA options it wants.. won't the performance between chips be different, depending on the silicon technology, and how it implements those instructions?
It absolutely will depend vastly. You could have 20MHz cores or 2GHz cores.
@@CNLohr Just as you can with ARM.
Great work! Thanks for sharing
Thanks for watching
that's cool
Hi! Good to see you!
Dude, nice work on this!
Thanks!
i'm sorry if you mentioned it in the video but i didn't notice if you said that your Emulator follows the Unprivileged or Privileged Spec for RISC-V.
having Linux run without an MMU is already pretty dope, but it would be even more amazing if it could also run on a CPU without seperate privilege levels (like Unprivileged RISC-V) and just enough CSR's to implement a few interrupts.
Thanks for this video. I’m trying to learn to do something like this
I think you'll like my channel then! This kinda stuff is my jam.
MMUless Linux isn't anything new; 15 years ago a lot of embedded systems ran µClinux (aka uClinux), which was a fork of Linux specifically to not require an MMU. Really cool to see the idea alive and well, even if under a different project.
And of course, really neat to see just how little code is actually necessary for RISC-V emulation (which isn't terribly surprising given the whole point to RISC-V).
This is mainline. Not a fork. That's what makes it so cool.
@@CNLohr Yeah, apparently uClinux got merged in quite some time ago! So it's neat that it's still working.
wow, super interesting!
Nicely done!
Thanks!
we missed you!
I know it's just so hard to make time to make these videos.
Hey! Great video! I'm just wondering what font you use for your terminal and text editor? It looks great!
audiolink.dev/
This is most impressive.
I tried to do a similar project, what helped me to get the decoding right was to print out the assembly and then it was pretty apparent if some number was wrong in comparison.
5:25 can you replace the ninja requirement with samurai? That one is pure C and Make.
14:04 xxd -e can show in little endian
14:04 - I didn't know that.
And - I can't update the way buildroot builds. At this point, I've just removed qemu from the build tree.
That's really cool!
Thanks
Wow!
Have you considered using ATDD (acceptance test driven design), especially with Cucumber, to test the specs of your CPU, before you implement it or run Linux on it? Or was the goal to make the source as small as possible, including "no unit test"? I think I would start getting nightmares designing a CPU emulation software without the ATDD for each operation.
impressive
Thank you!
This is awesome! I've been working on some similar hobby projects but nothing nearly as ambitious as trying to run Linux. I would not have imagined it could be run without an MMU (aside from in the "universal Turing machine" sense).
I'm working on a simulator, assembler, and RTL implementation for FPGA. I want to get a basic RISC-V computer working on FPGA and then write a simple kernel for it. Now that I've seen this video, I'm more optimistic that I could at some point get Linux running on there, which would be amazing!
Very interesting..
Do ett. You could also try to make things _even more stripped down_ and use an emulator as a test bed for the features you intend to implement.
Wow! I wonder is it possible to run beowoolf cluster on blades based on risc-v (allwiner d1 for example)? And teach it to work with 10BASE-T for example? That is the case I would invest..
probably!
Charles! Nice Good to see you. Nice video. Still at the place we worked together at a few years ago?
Still hanging on. Though I feel a little like "hang In there" from S08E11 of the Simpsons.
@@CNLohr Mob war or free pretzels?
So... a question... can a No-MMU version of linux work on a 386 in something like an unreal mode? I've been thinking about this for the past couple days as I also became aware of the no-mmu kernel stuff.
As it stands, there's a little extra code that needs to be written per-architecture and there are still some unusual restrictions. But, the underlying answer is now "yes."
I feel like we have the same weird special interests just again. Running linux on $1 mcu is what I dream of for a long time. Someone seen my nc10 netbook from 2009 that I upgraded with usb 3.0? xD
I think there's a chance!
The magic is that the $1 MCUs are so CAPABLE. I remember not too long ago, when people doing stunts like booting Linux on an 8-bit machine ... in about an hour.
Is the slowdown after initial stages of boot because I/O changes from polled to interrupt driven?
I believe so. Or more specifically, that the Kernel appears to force a context switch because it assumes there "should" be no more room left in the output buffer even though there is.
We need to compile it to WebAssembly 😱
It is painful that I'm not adding goto's to this code for this very reason.
@@CNLohr :(
RVVM actually works with this, but perf is abyssmal ;D, and there is a way to do RISC-V->WASM JIT
Sadly YT removes links to test page
"It's like an embeddable scripting language, except you can compile to it with gcc"
That is indeed one way describe an entire RISC-V emulator xD
I'm glad it was technically accurate.
Scripting languages are all virtual machines. However, the point of most scripting languages is to avoid some of the difficulties encountered with compiled languages. So what has been achieved? You can now write in C what you could have written in Python? Umm...
could you port this to webassembly then run Linux in the browser
Someone already made a better RV32 emulator that runs in-browser. bellard.org/tinyemu/
Time for me to rewrite it in Rust!
But what problem with adding MMU features to the emulator?
Nope. It adds code. I need the smallest emulator that can boot Linux
funfact: opencomputers2 a minecraftmod has risc V emulation
Yeah, but can it run Doom? 😅 Amazing work! 👍
He just posted a screenshot of it running Doom in the Discord last night.
@@sellicott I was just jocking but that's so cool!
Check out my video I just posted! "But can it run doom?"
Kendryte K210 is great but newer 3-core riscV mcu is out too - M1s
Sadly RV64, so less interesting for my purposes.
@@CNLohr guess you don't read specs at all...
At first I thought, why would you want to emulate a microcontroller, on a microcontroller? But then I slowly started to realize, that it's all a matter of priorities. If you need more memory than your microcontroller has, then one option is to do swapping to an external device, to allow you to use more memory than you have, at the cost of a big reduction in performance. And sometimes it's worth the cost to be able to do things you otherwise couldn't. I say "external device", because I can just see people thinking to accelerate things by swapping to the on-chip Flash memory, and thereby wearing out their microcontrollers. I think Tesla had a problem like this. But if you have socketed Flash memory, in the form of SD cards or whatever the latest socketed format is, then what gets worn out is something that's replaceable. I worry about this a little on my laptop, since it runs a devil-may-care OS that swaps to a solid state drive that is a bit of a pain to replace. But then, by the time it wears that out, I'll be able (probably) to replace it with a bigger, faster SSD.
Absolutely! There's a lot of weird reasons why it makes sense to virtualize your functionality. It's really nice to do with RISC-V because there's such good tooling and compilers to minimize the perf hit and frustration.
I did not understand any point of this but watched. I know just Python and want to be familiar with C or Assembly. I would like to get tips where can I start RISC-V and do some simple projects.
I am not sure if I have the best answer. You usually learn C before doing embedded.
I love that font on your terminal emulator, what's it called please?
It's in the description. audiolink.dev
Would this be adaptable for a pi pico or does it require a lot of ram? I mean the linux kernel, less the emulator.
There already is someone who's adapted it for the pico. It's called pico-rv32ima
Linux can run on something without an MMU!?
Abso-lutely!
thans for sharing!
terminal font name please
Mentioned in my other video description "AudioLink Mono" -- It's available on the VRChat AudioLink Discord
this could be useful to make DSLinux 2.0
There are a ton of applications, and it's small and easy to use so give it a go!
Dude, you need a microphone pop-filter. Otherwise awesome stuff!
I have one - it's just a few parts I re-recorded I didn't have it.
@@CNLohr Ok, no worries. I noticed the audio got much better. I'm quite impressed with this project and I'm soaking up as much of it as possible. Build failed in subsystem for windows so I'll spin up a Linux VM to have a play. Thanks!
@@vincei4252 let me know how it goes. I miiight try building it in WSL myself.
@@vincei4252 Also see my note about needing to fix your paths for WSL.
@@CNLohr ugh. CZcams. Sorry, I just saw your response. I wasn't notified. I was able to get everything working in a VM all the way to the command prompt. Superb stuff. Got sidelined on other things but EEVBlogs video about 10 cent RISC-V microcontrollers reminded me to come back here.
First!
Probably another annoying question by me, but could you emulate a MiSTer FPGA on top of your RISC-V Emulator (instead of the ARM it currently uses)?
I don't understand what you are asking. I am not familiar with a MiSTer. But there are people who have RV32 emulators for FPGAs now.
@@CNLohr I'll try to clarify with a couple questions: Because RISC-V chips are so inexpensive, could they be _woven_ into a singular, unified "hardware" surface which serves all the modern needs of a full-featured computer (i.e. CPU, GPU, Buses and other SoC functions, aside from obvious separate need for storage), where the CPU, GPU, and Bus 'bundles' are modular enough to be _expandable_ in such a way that you can just throw more RISC-V processors at any 'expandable' category and it all still works?
If so, could this same "RISC-V SoC" be emulated, where the MISTer FPGA _layer_ (not sure if this is only hardware or hardware + OS) would then be emulated on top of it? Finally, could the sum total of all that be used as a normal MISTer (instead of the ARM-based De10 Nano presently in use)?
The reason for the last question is for the purpose of *knowing* whether or not it's going to work on whatever system you're emulating the RISC-V SoC, _before_ having the actual SoC built to silicon.
@@lafemmedevastation The biggest limitation is many tasks are serial and not parallel. Modern apps want very fast single thread execution. And it's impractical to use mountains of slow single processors to deliver something that would make a good system.
@@CNLohr Fair, thanks for thinking about it with me😺
Whats your terminal font?
AudioLink Mono. It's by Llelloo in the VRChat AudioLink Discord Server
@@CNLohr Is that available for download anywhere?
+1 really interested
@@justgook audiolink.dev/
@@CNLohr thanks
Got 10 IQ by just watching this video
It'll fade, but I'll try to keep making videos to help keep the IQ up!
Where can one find "AudioLink Mono"?
audiolink.dev/
Ninja doesn't need Cmake, Cmake wants wither ninja or regular make
It's how Python is configured to compile.
@@CNLohr yeah but idk if you got it in the right order,
Does this mean i can run yolov5 on maixduino??
y not
Maybe the og PSP can run Linux now
Looks like it should have no issues.
so did you made it run in VRchat ?
Not... yet.
Will port it to Arduino Uno
😬
Of course it will. It has SPI, so just rack up a whole bunch of PSRAM. Everything else is just software.
python
because there weren't enough scripting languages already
emulate the mmu inside the operating system
its just a memory access interface adapter
any law rule based will drain your iq if you rely on it
your life is death
what you praise shows what you believe in
It would be toooo sloowwwww
Now remake the entire video in english please 😂😂
line 227, system("") huh? that one of the common windows bullshitty undocumented stuff?
Absolutely. I explained it in my doom deep dive video I just uploaded.
Please invest in a pop filter. This video is VERY hard to listen to because of all of the plosives.
Otherwise, amazing work! This is really cool and I look forward to seeing what you do next. :)
Boo
Thanks! And I do have one, I just didn't use it for a few of the parts I had to re-record.
Linux in a shader go 🧮
Already been done. Just the question is can I do it better
Nice.