How to Structure a Modular Monolith Project in .NET
Vložit
- čas přidán 19. 06. 2024
- ☄️ Master the Modular Monolith Architecture: bit.ly/3SXlzSt
📌 Accelerate your Clean Architecture skills: bit.ly/3PupkOJ
🚀 Support me on Patreon to access the source code: / milanjovanovic
What is a Modular Monolith? It's a monolith system designed in a modular way. I know this sounds even more confusing. But in this video, I'll explain the modular monolith architecture. Then, I'll show you a system implemented using the modular monolith architecture. We'll review the entire module and discuss what you should place inside it. I worked on a system like that on a project for the past 2 years, and I'm sharing what I learned along the way and some of the mistakes I made. This will be a good introduction to modular monoliths as I prepare an upcoming course about this architecture.
Join my weekly .NET newsletter:
www.milanjovanovic.tech
Read my Blog here:
www.milanjovanovic.tech/blog
What Is a Modular Monolith?
www.milanjovanovic.tech/blog/...
Monolith to Microservices: How a Modular Monolith Helps
www.milanjovanovic.tech/blog/...
Monolith to Microservices: How a Modular Monolith Helps:
www.milanjovanovic.tech/blog/...
Chapters
0:00 Modular Monolith introduction
2:52 Reviewing Module implementation in .NET
7:00 Integration events and Domain events
9:21 Database organization for Modules
11:03 Structuring Module dependency injection
12:04 Endpoints for Module using ApiEndpoints
14:03 Web API project overview
14:44 Bounded context - quick comment - Věda a technologie
💡You can learn more about Modular Monolith Architecture here: bit.ly/3SXlzSt
Great video Milan this is exactly what i was looking for as i was doing my own Modular Monolith project and i needed some answers on how to handle some stuff in it, and you did indeed answered me with this video great content and i hope that we can see more about this topic in next weeks
I'm definitely planning more about this topic
Hi Milan! This is what I was waiting for. I greatly appreciate this video, which has helped me significantly clarify some doubts. I hope you continue uploading more videos about how you implement the concepts of CA and DDD in different architectures. Greetings!
Planning to do more work into Modular monolith
Nicely done, I love seeing a different view to seemingly the same topic :)
Glad you enjoyed it! I'll be covering MM a lot more in the coming weeks/months
Awesome about modular monoliths structure. Thank so much.
Glad it was helpful!
Cool video :) Nice to see this architecture coming back, 10+ years ago when I was doing PHP, there was a phase where frameworks were moving from MVC to so called HMVC, which was a similar concept and idea. Sadly microservices took over, nice to see somebody pushing this again :)
I've been using it for a few years. I wish it was more popular, but I'm also seeing a lot of chatter on this topic, so things could change.
This is probably the last step before passing into Microservice Architechture. Best to use it if you're right on the edge of creating separate teams to develop the project. A bit too much separation of concerns if you have a small application. For example, projects Domain/Application/Infrastructure could be all in the same project and only separated by folders, messaging between countext is also very strict in this case and adds a lot of overhead, resulting in difficult/painful to change. So I would say, don't start with this if you're not sure of your bounded context and event generated.
This sample project is a bit dogmatic, I have to say. I'm working on a video series with an improved architecture that should be coming out in a few weeks
Having layers in one project would mean zero isolation between them, which could lead to some programmers referencing between layers in a wrong way. Watching over them would be a pain
@@Eugene.Golubev it's sad if you don't trust your programmers at this point.
@@maxpuissant2 people make mistakes. If you can prevent them technically, then you should do it. It's like programming in dynamic instead of static languages
@@Eugene.Golubev I don't believe you make that mistake by error but if you want a safety net you should write a test, it will be more flexible and explicit.
Great content Milan! I've been implementing this architecture myself and got to a very similar solution structure.
The main difference is that your "IntegrationEvents" project is my "Contract" project. That includes not only integration events, but also the definitions of commands and queries. This allows me to query specific data from a different module in a clean and decoupled way, without the need of making the local copy using integration events. I use it when the query is not frequent, otherwise I stick to your approach of duplicating the data using events. I don't currently use it for commands (prefer event+subscriber for that) but I don't see why I couldn't. It's the module public API after all.
I also tried the railway architecture you are using here but eventually got back to using exceptions and filters. I couldn't see the gain and all the bind,tap,map makes the code less readable, not more.
FP and ROP isn't for everyone. Curious what you're using to implement queries/commands? MassTransit request/response or something else?
@@MilanJovanovicTech Right now I'm good with Mediatr, but I hide it behind an ICommandBus and IQueryBus just in case I need something else in the future.
Thank you for your amazing content. If you have the time, I would be grateful if you built a complex library containing a lot of abstractions, so we can see a good example of modeling. Thank you for your time.
Going to release some sample applications to GitHub next year
Good intro to structuring modular monoliths.
Love the video thumbnail 😂
Had to get creative with the thumbnail. Unless Rubik's cube sues me... You never know.
I love the modular monolith solution! Could you make a video about injecting dependencies into modular monoliths without using autofac, please?
This isn't Autofac though
Thanks for your great content!
I would be really interested in an example of the modular monolith approach with the vertical slice architecture.
Also, would you recommend to start with the vertical slice architecture in a new project and with a team, that has not much experience with modular monoliths yet?
The two aren't mutually exclusive, nor do they require each other. You can definitely start with VSA.
Modular monolith is more about solving the interaction and coupling between modules.
Hello. Great video as always! Have u tired fast endpoints? If yes, Whats ur take on it?
Releasing a video about it soon
hey milan! please a video on how to fetch nested data while executing raw sql or stored procedures.
Will see
Hi Milan, as always, great content. I was wondering how I could get the code and inspect on my own. Could you please share information about that?
www.patreon.com/posts/how-to-structure-92696857
@milan, you've mentioned communication between modules is done via an inmemory bus provided by masstransit, which is fine for a fire and forget, but can you explain how we'd go about the retrieval of data from a module. example, module A needs data from module B during the execution time within a method in module A. without direct calls, I cannot see how a pub/sub implementation would work in this scenario
Have I got a video for you 😁 Check this out: czcams.com/video/NjsoykEOkrk/video.html
Hi
Just recently started your videos. Great content. A couple of questions
1. Do you always use DDD in all the projects ? Or that depends on specific use case. If yes then what will be those
2. I saw you used UserPermission. ReadUser or UserPermission. ModifyUser, these are string constants as i saw. Are you saving these permission in some kind of token like cookie or jwt. Just a thought wont it make a token very large with all the permissions or if it is saved in Db then it will suffer from performance as it puts more load on database.
1. Context-dependent - but I do tend to use it in my examples
2. I showcased this in a separate series: czcams.com/video/4cFhYUK8wnc/video.html
You can simply query the permissions based on the User ID when the API is called, and store the values in a cache for quick retrieval in the future.
Great!
Thank you :)
Hi @Milan, very nicely put all things together. I have one question, instead of one executable to expose endpoints of all modules, can't we separate the executables as well per modules? There will be multiple API applications in that case, it might distribute the loads as well. Will it be still monolith if not what it calls?
Would not be a monolith anymore
@@MilanJovanovicTech But we still have one data source/database, right? Shouldn't it still be a monolith? Am I missing something?
How your persistent your data doesn't make something a Monolith. Having one one executable does.
You say that it is used MassTransit with memory transport. But later you show database tables for inbox/outbox and event handling. Is they part of MassTransit ? Does MassTransit always use db tables despite the way of transport messages ?
No, those are custom inbox/outbox tables
Hi millan thanks for nice video, will you be upgrading your clean architecture course in .net8
Yes, some updates coming in January. Subscribe to my newsletter to get notified!
It won't be just .NET 8 - there will be new chapters and some re-recordings
Hi Milan! In the Pragmatic Clean Architecture course, is the solution structured as a Modular Monolith?
PCA is just a single module. I'll release a separate course dedicated to Modular Monoliths, with various architectural approaches inside
@@MilanJovanovicTech waiting for the course, planned dates?
Modular is a great way to separate domains within the same monolith, and we can constrain direct access to domain models through assembly properties. Also, another positive thing is even though you are running monolith locally you exclude certain modules that are not dependant from your module and thus cut the build time.
You gave me an idea there. Might explore the exclusion part for a future video
@@MilanJovanovicTech great to hear that. Keep on producing great content. Really love watching and following your new videos.
Hello :) create user trigger one event and return the user. Then you make bind tap ... for validation. But if this user is not valid you return errors but the event is allready save ?,
Check out some of my videos about Railway-Oriented Programming to understand how this works
Hi! What would be the alternative for communication between the modules? If I do not want to use message bus, what else could I use? Thank you.
Good ol' method calls
@@MilanJovanovicTech In different application :P
Hi @Milan, Thank you for this kind of video,
For modular monolith how do you deal with UI / Pages of a web app that has datas that getting on multiple modules?
A sample page is displaying a listing of added cart items but on the same page Im also displaying the user information like name, address, mobile number etc.
You can send multiple API requests when loading the page
@@MilanJovanovicTech thank you for your insight. In typical MVC that will use modular approach, is it correct to do composite ui? for ex. component ui that present in modules(cart and profile) then consume it to host application (Pages/Cart.cshtml)
How did you use Bind and Tap Extension method after Create method ?
Check this out: czcams.com/video/dDasAmowFts/video.html
Great video, if I understand correctly, is a module essentially a microservice, except that all modules share a common process?
Wrong way to look at it - but yeah, if it suits you 😅
I understand the concept, but I’m curious about four things:
1. In the database design at 10:11 how would a customer register for a training be stored? Can I store the userId in the trainings module?
2. How to handle a database transaction, where at least two modules must do something before persisting
3. How to split off a module into a micro service
4. How many endpoints on average would be the maximum size of a module?
Thank you for the video
1. Yes, you can store the UserId (or Client - as it's referred to in that module)
2. No cross-module transactions. You treat them as separate transactions.
3. Pull the code out, add a reverse proxy, done.
4. No such metric, you decide
How are integration event handlers registered? Is there a section of code that registers a particular integration event with one or more handlers that are interested in this event from other modules?
Yeah, just call AddConsumer from MassTransit
Thank you Milan, great content, i would love to study in dept your source code, can you guid please where to find/buy it?
I share the source code on Patreon: www.patreon.com/milanjovanovic
this link is somehow inaccessible @@MilanJovanovicTech
Is it hard to understand that inter-module communication through integrated events?
www.milanjovanovic.tech/blog/modular-monolith-communication-patterns
Hi Milan, i think i am too late to ask something, but i have one question about how to organize the modules using ddd.
So, i have bounded context, let's say catalog, within this bounded context has 3 sub-domains inventoryManagement, catalogManagement and princing.
My question is, each of these sub-domains should be a module? If we use clean architecture, each of these sub-domains should have it's own domain, application and infra layers?
It's never too late on my channel :)
If they're the same bounded context, I would keep them inside a single module.
@@MilanJovanovicTech Hi, If my bounded context is large and has 10 aggregates, is it a sign i'm doing something wrong or it's normal and i should put all those entities on the domain folder of that bounded context?
@@MilanJovanovicTech thanks
Спасибо, бро
Нема на чему!
Nice video! But absolutely complicated structure for me 😅, looks a bit similar to Redux concept
Well this is pretty advanced, and most project won't need this
Which lib is that who uses Tap and Bind stuff?
Custom stuff, built around the Result monad
Thank you for a such halpfull video. Could you please share the code used in this video and attach the link to it under the video? It would be very useful to examine it.
www.patreon.com/posts/how-to-structure-92696857
If you don't mind me asking Milan, how would you handle exposing such a monolith if one needs an auth server (like aws cognito or identity server from duende), email service like SendGrid, payment service like Stripe ... would you put upfront, before the frontend, a gateway of sorts (just like for microservices) and reroute calls to those services and make them external APIs talking to your database ... or would you create modules for those and also put them inside this monolith ?
I never see anyone discussing Gateways and Modular Monoliths, but just because you have a modular monolith does not automatically imply all your apis and services should be inside of it I assume ... ? I'm a bit lost here on what I should do. I expect up to 100 EF queries (GraphQL queries) per second so I cannot say this is such a huge project that I would need microservices, but not too small either. And I like having a gateway that can do rate / ip limiting and also add correlation IDs ... but to me it feels like that App project is a gateway on its own :D
Please help answer this pleb xD
But these are all third-party APIs, right? You typically call them using HttpClient or using an SDK if it's provided.
Which is why this part sounds confusing: "would you put upfront, before the frontend, a gateway of sorts (just like for microservices) and reroute calls to those services and make them external APIs talking to your database"
I'm recording a bunch of Modular monolith videos this month, and I'll make sure to cover gateways
P.S. Help me clear up my confusion, and I'm sure I could help
Not sure if I should call them 3rd party, since they are APIs I will build from scratch for my pet project that indeed wrap the 3rd party sdks from the respective cloud offerings like stripe or sendgrid. I just wish I knew how to approach hiding frontend communication to the backend services from users (clients), by only exposing a gateway … when it comes to “modular monoliths”.
Or perhaps it would imply a mix of microservices (gateway, auth, email svc) and modular monolith…
Loved your Pragmatic Clean Architecture Course btw 🎉
Looking forward to your vids! Cheers!
do you have this code in .net 8 version?
No this one, but there's nothing different in .NET 8 (no breaking changes)
At what level of my career should I be familiar with all of that? Is this mid, or senior level?
I guess mid/senior level
Stay Awesome?! That's serpentza's tag line!
Ok
Love the logo 😂
Yeah, pretty original if I may say so. Quite a thing of beauty.
just Keep the great job man
@@MilanJovanovicTech
It would be great to download/access the solution or at least the skeleton of it. Is it available somewhere? Thank you!
Right now, only on Patreon
That's great! Is the silver level enough for that?
@ Yes, of course
Thanks for this. Clearly, there was a lot of work involved. It is a nice reference that brings in messaging, functional programming, layers in slices, etc.
Unfortunately, the entire purpose of Modularization and Bounded Contexts has been completely obviated by the massive duplication of data maintained in the 2 database schemas.
Using integration events to couple Modules and Bounded contexts is odd. Common, but odd.
What is the reason for creating this coupling?
Duplication allows the modules to exist independently
@@MilanJovanovicTech With all due respect Milan, that makes zero sense.
It is precisely the fact that they duplicate and sync data that makes them completely dependent.
That's what coupling is. That's what dependence is.
Perhaps, I am misunderstanding something you are doing.
Why do you need FirstName, LastName, email in both services?
@@vincentcifello4435 I look at it from a perspective of a single module. It has all the data it requires to function. It can continue functioning even if the other module is down/unavailable. Disregard for a moment that the modules are publishing integration events to pass around this data.
Having said that, this is an example project where I purposefully pushed some things to the extreme. So look at it from that perspective also.
@@vincentcifello4435 I think you have a fundamental misunderstanding of the concept of coupling.
@@MiningForPies huh?
If you change the FirstName field in User from 50 characters to 80 characters, then you have to change the FirstName field in Trainers.
That is coupling.
hi! do you receive a crypto for share source code examples?
No, sorry
What do you think about abp framework ?
why my previous comment has been removed about Fullstackhero ?
YT deletes comments sometimes
I think it's a nice place to start - if you can get past the learning curve
@@MilanJovanovicTech thanks Milan, maybe because I added a link to Github
Where is the link to download the code of the project?
www.patreon.com/posts/how-to-structure-92696857
Can you add another API project in the same solution ?
Why not?
Hi Milan
Some of your subscribers are from India.
And i am also from India.
In India we are not able to get access on Source Code. As in our country patreon is not working. Any other way to share the source code with us. So we can clearly understand the flow and other things.
Humble request pls do something for us.
I'll release something on GitHub soon
@@MilanJovanovicTech Thank you ❤️❤️☺️
please publish this sample code milan
For now, Patreon only
It would much easier if we only have 2 projects per module. Module itself and contracts. Much easier to manage when you have large number of modules
Sure, you can do that
Still your modules use Infrastructures from others... Anyway, thank you for sharing
No they don't? 🤔
All of this code, albeit well engineered, is really to replace the same kind of functionality which in a database-centric system would be one or two stored procedures. It is a lot of overhead. Each project might have to have physical project files and folders residing at top level within an overall solution folder in the file system and the more projects and modules there are the more subfolders there will be in that solution folder. How scalable is this, do you think?
Stored procedures are unmaintainable.
Database centric systems are unmaintainable.
Avoid them at all cost.
There is a reason it is *far* from the norm nowadays.
@@RaMz00z Subjective
I get where you're coming from, but this is more about logical separation and organization within a monolith. While keeping track of inter-module dependencies and database dependencies. It's actually a very "pretty" way to develop systems. And scales well, since you can easily move into microservices.
@@MilanJovanovicTech How do you distinguish logical and physical? I would suggest there be a way to provide logical modules with less overhead and better scalability. At the moment it requires either under-documented, rather obscure Assembly files with multiple Assemblies defined in same file, or, more normally, separate projects compiled into separate DLLs.
Is this a microservice? What are microservices？
No, it's a monolith