Why use a monorepo?
Vložit
- čas přidán 26. 07. 2024
- Matt Pocock (@mattpocockuk) explains how debugging is faster, code editing is easier, and build processes are easier to understand after refactoring a polyrepo setup to a monorepo, and deploying it on Vercel. Try Turborepo: vercel.fyi/tryturbo
0:00 The bug
1:02 Polyrepo or monorepo?
1:29 Creating a new monorepo
2:01 Migrating the repos
3:11 Setting up a turbo.json
3:53 Fixing the bug
4:11 Deploying to npm
4:44 Deploying to Vercel
6:03 Summary
For more on Turborepo:
◆ Migrating to a monorepo: turborepo.org/docs/handbook/m...
◆ Publishing packages: turborepo.org/docs/handbook/p...
◆ Building apps: turborepo.org/docs/handbook/b...
#monorepo - Věda a technologie
Well, that's more a "How" than a "Why"...
The why is kind of implied
@@frontendtony Yeah, but there's more to say about the pros and cons to adopt a monorepo and the video title is a bit misleading in that regard ;-)
It improves the efficiency of your workflow so you spent more time programming and solving problems rather than administrating your repo
Mono repo actually adds more administrative work not less in my opinion.
Matt just wanted to show off his math package hahaha, I agree the “why” is implicit which means video’s title is clickbait (kinda).
His way of explaining is on another level!
I love Matt's explainers. Very clear
I've been very happy with Turborepo and have been using it for almost every solo project that I do. I like it's simplicity and ease of use.
You can also use *patch-package* which is very simple to use and you can regress the changes you have made once the repo has been updated and you see the problem you fixed is gone.
I love your teaching style. You rock!
this video was great
It really demostrates the use of Turborepo very well
Thanks for the tutorial! If only this video was made before my suffering of having to publish and installing over and over again for my package, my life would have been easier 🤣.
Hell yeah man good work
Thanks for that my friend
amazing video
great video!
quick question;
If I were to have my Azure pipeline covering my monorepo, and each successful build would become a release, would turborepo consider a cached build (so out of my 2 apps I have, App1 is cached and App2 has changes to be rebuilt, alongside a ui package for shared react components lets say) a succesful build and thus cause a re-deployment for both apps? this is what my team is currently struggling with. Or is there a way we could emit the cache hit/missed to our pipeline so we can then have that determine wether or not to re-deploy
Hey, interesting question.
This is pretty easy to solve with a mono-repo (there's a technology called Nx Monorepos). Our team picked Nx Monorepos because they ship with a "nx affected:*" command set that lets you to define what steps to follow when deploying on an individual app/library level through a pipeline by using the "nx affected:*" magic and only hitting the "deploy" process for apps/libraries that are TRULY affected by the change in your merge.
However, you're right, it adds a load of trouble. It was a live and learn process for us, we still continue doing it.
Would I recommend this? Depends. If you're just trying to bring in 2-3 repos into one mono-repo, then I'd say, not worth the trouble. If you have 5-10 repositories that you want to put together into 1 and each of them have decent changes frequently, then I'd say, yes, the pain of a mono-repo is worth it as you won't have to waste time publishing on one end, and then running your pipelines individually for each app for just bumping a package version.
great explanation
Finally I get to know whole monorepo. I used to see packages folder under source I was wondering how do they manage it, now no more
Despite not really explaining anything, I love how monorepo is bouncing back from the microservice era.
Monolith for the win
They're completely unrelated
You can still have both a monorepo and microservices
@@hojdog The era represents conventions and the hype within said period, like, living in COVID times doesn't make you COVID itself.
I know, it's hard to believe.
Amazing video Matt!
What if your maths package is being used on 3 separate projects? That would mean bundling the maths package with all 3? This looks like it would be useful but only when theres a 1 to 1 relationship between package and app. Or am I really missing something here?
Yes I am thinking that also
yeah it doesnt make sense really. why even make a package if its only in 1 repo? you can just use two repos in one workspace while you are working on the npm package.
TurboRepo half-heartedly supports Docker. It seems like an afterthought. Vercel doesn't support Docker at all. I'm not trying to be rude, but a monorepo having _something_ Docker is super common, and Render offers this. Does the TurboRepo/Vercel team have any plans for improving Docker support in the upcoming year?
Specifically, I want to be able to put a docker-compose.yml in every app and/or package in my TurboRepo project, then deploy with something as simple as `$ vercel deploy`. I'd be sold for life.
+1 on this
Matt is hilarious 😊
hanks lot Sir.. You helping us..
Does a _hybrid_ workflow exist where you have a "maths" package inside a private monorepo but also "maths" inside a public monorepo that can be shared?
I use Turborepo and love it- but I'm in a situation where we're creating packages inside a private monorepo that I also need in my personal monorepo. I need a way to share that same package in both, make updates in both and pull in changes in both.
Is this possible?
Haven't seen anything with nextjs with custom server (check NextJs docs/advanced-features/custom-server)
That would be cool an example! Just saying. (Having huge troubles myself with it, its impossible to resolve workspace modules)
My company has a monorepo with like 20 apps and I can't even block a PR if the CI doesn't pass (like for test or linter). I'm advocating for smaller multiple repos but they won't do it because "it would take too much time to migrate from one state to another".
I don't see the point of a monorepo for more than 3-4 apps. I've worked in more than 15 stacks and still can't see any advantage of using a monorepo...
Been using nx workspace for mono repo,
Love it so far
horrible experience with nx for me, some guy set it up before i joined the project and now all i get are angular related threads anything related to nx
@@sarunmrzn it took me a while to figure out how everything is wired up. Once i got a mental model of what's going on, I love it even more
I don't really see the benefit on the why. Maybe I'm misunderstanding it but this at least to me seems like it would introduce more problems in the future since now your project would be responsible for maintaining the code that you're using. Sure the example your giving is simple, but depending on the work this can easily be some specific call function that is dependent on a slew of other dependencies in that packages repository that they use on the side. Unless the projects abandoned and you can't find a good alternative, I feel like its better to leave off package maintanence to the maintainers of that project, and just PR fixes to that branch even if it takes hours to push.
I think it works well for that specific usecase. But if you have 10 apps using that library, having them all in 1 monorepo would be a mess.. Thanks but no
Does a _hybrid_ workflow exist where you have a "maths" package inside a private monorepo but also "maths" in its own public repo on Github so others could contribute?
I use Turborepo and love it- but I'm in a situation where we're creating packages inside a private monorepo that I also need in my personal monorepo. I need a way to share that same package in both, make updates in both and pull in changes in both.
Is this possible?
what happen if i have many project and many package, can it make slow on build or start app on development?
Got a bit of a more complicated migration (if I even bother at this point), I have a bigger project in a monolithic repo with multiple scripts (check, prebuild, svgo prepare scripts and such) and utilities shared between backend and those scripts so I'd need some packages to have binaries and couldn't get that to work with yarn 1.x so far and having types accesible outside of packages has already been confusing enough with my current workaround requiring d.ts files in the packages root directory (even tho types get generated into dist... alongside the build). I also already have the next app deployed to vercel, so I'd need to change those settings.
How is the maths repo configured? Is the example published?
yo bro, really thankya. Big respect
what is the actual advantages of turborepo over pnpms built-in workspaces?
Inefficient for huge applications that have complex CI pipelines for fixing this type of problem. There are also other aspects to what type of architecture fits best, depends on use case.
Is there a real need to publish the package here ?
On deployment, won't it be pulled from the monorepo directly ?
whats that vcscode letter theme-?
In my experience, monorepo if you're working alone and polyrepo if you're working as a team/group. But do be careful because monorepos, after they grow past a certain size, can cause tools like Git and other build tools to slow down/malfunction just because of the sheer amount of data they have to handle.
I think you have it backwards. I single dev is more easily going to be able to manage polyrepos because they know when dependencies change.
It’s big teams that get the most benefit from monorepos since dependencies change all the time and need to be kept in sync
doesn't this problem already have a "native" solution with npm link or patch-package??
should add a video in versioning strategies and publish workflows of libs and apps in monorepos
What about a repo with submodules?
why not use a "link"?
So basically: you use a monorepo if you want to quickly develop multiple related projects together, of which one or multiple projects (in /packages) might also be published for others to use.
My employer: "We will now dump everything into one massive monorepo and keep everything closed-source. All projects, related or not, go into one repository."
Me: "... oh fuck, they're dumb."
This seems much more work and looks way more complicated than just having two dedicated repos 😅
Use a monorepo and then come back and say this
exactly. you dont need a monorepo to use workspaces. you can just add two repos to one workspace.
But then how do you share all the common build tools and configuration with team members?
If you need to share the workspace config you can make that a repo as well. Not 100% sure how turbo will handle that but with yarn workspaces git will not commit every file from the individual repos. It just stores what commit each child repo is on and then you can commit your workspace config. IMO this makes way more sense when a package is being used in a lot of different projects. You can easily add and remove repos to and from your workspace.
@@cookie_doki I don’t see how that’s useful, if your code and packages aren’t all shared amongst each other and you can work in isolation happily, then you don’t need a monorepo
Cool
I hate the fact that I have to maintain a separate build step for packages inside my monorepo which I'm not going to publish anyway
We can do "yarn link" for instance , Monorepo isn't always the answer, but I'm a big fun of Monorepo though😉, but good marketing 👍
yarn/npm link is not powerful as this and it's more clunky to work with. Just linking cannot really detect dependencies and rebuild stuff in such a way that a monorepo setup with Turborepo or NX can.
@@rand0mtv660 I know, but not in all use cases we'll have to use a monorepo, it just doesn't make any sense, it all ends on what you really need and if things need to setup a monorepo, I'm not against it as I'm using it as well in some projects, not all of them 🙃
@@webcodeuniversity Yeah for sure. I'm just saying that yarn link isn't really an equivalent to a monorepo. But what you are saying is definitely correct. Each tool has its purpose and monorepo isn't always the solution.
@@rand0mtv660 sure thing, I agree. I mentioned "yarn link" just to say that monorepo isn't the right thing for everything, because I know some less experienced devs would take it for granted which is misleading. Thanks for your intervention though, it's been nice conversation 🤝
Installed, everything works, thanks!
nice acting, my man😎
…git submodules exist tho
Ok, this is cool and all but what happens when another project needs to also use your maths repo?
You pull it in my-monorepo as well?
If it's a popular library in your company, I imagine that would get chaotic real quick.
Also, what happens when there's ANOTHER library you want to use in the way you used maths repo? Let's say... foo repo.
Foo repo already exists in another location, so by pulling into my-monorepo, you're just basically creating your own fork...
It sounds like what you did in this video works great if you're making ONE application which requires ONE custom library, then you can tightly couple them together.
Anything more complicated than that looks... messy.
Write tests to not have that kind of problems.
This video is a "how" not a "why"
I get no reason why I should do this
It's gone over pretty quick, but the reason he essentially gave was this (adding some things he missed to better highlight the overall point):
Separate packages means that to make even a small change you need to open a new window, make the change, publish the change, then go back to your first project and install the new version once it's ready. If you're working on a team, then there's an entire extra pull request and all the delays that happen there. Your tiny 1 character change could take hours depending on how quick others are to approve the pull request. All the while, you are blocked from other work or need to install the package locally anyway to keep going...
If you used a monorepo from the start... You'd just make your 1 character change and carry on. You might even find more meaningful changes to make for the next package version than just the 1 character change while developing if you're doing what is shown in the video.
In other words, breaking everything into separate packages across codebases can take hours to do small changes whereas in a monorepo this happens in mere moments.
🤴
Superb acting on the + and - part. I truly believed you were capable of cocking up so badly. Have you considered Hollywood? On my way to update it to 0.0.4 to fix my apps.
... or just pin versions and test your software.
Or use submodules
That was a great explanation. That said, it would have been better to deploy a static .html file.
Before anyone comments on this being a very small, non-practical example, let me just prelude that static .html files without ads also work on real projects.
Awesome, first create a problem, then rollback to what worked for decades xD. JS devs are not changing)))
I think many go for a monorepo only because they don’t know the npm link command.
but npm link only works in development
@@zuma206 You don’t need npm link in production. In production you just import the packages.
Why use monorepo?
To confuse yourself in future
this is actually a solid alternative to using git submodule
The real nightmare here is that you're bundling esm to cjs to use in an ESM project.
Why not just use git submodules? There is a thing already made for it. Everything is already there.
Jason Statham?!
I don't like examples that doesn't make sense :|
It is june 2024, is this concept dead?
JavaScript nightmare
Explanation felt too quick, need to slow down maybe
hi, the app now has workspace * . won't it pull the latest all the time ? what about production? no version pinning ?
I'm not always watch those video because explanation felt too quick, zoom out zoom in without any word explanation where you at and why use this... But at least I have more knowledge, but not understand. This just like intro video not a "make your monkey brain understand this" type of video.
Edit video title to how… not why. And you should consider using yarn workspaces and yarn PnP
instructions unclear, in AMERICA we use MATH not MATHS, there is only one MATH and ours is it
I AM WHO I AM
AAUUUGGHHH
Maths makes just as much sense as mathematics (which is also plural).
In America, we kind of have a "mathematic" idea to go with our "math". As a fellow American, we might just be the weird ones here :).
But, same same but different...
My guy here must be using python_communism on a daily basis
This looks like a really bad and inefficient way to do thing if I am being honest
Sorry, I really hate these 1+1 !== 2 examples. I immediately start checking out. Then, I hear about npm publish is too painful, my immediate response is, no, it's not too painful. The basis of 1 + 1 not being 2 is just not sound. Yes, give us a fictionalish example, but, I definitely don't like the 1+1 !== 2. Just one opinion tho, maybe I'm the outlier!!
Hmm.. how about 2+2 !== 3?
Well, fixing the obvious "1 + 1" bug isn't the point. The point is about different ways to manage dependency versions across a repository. I.E: Multiple repositories VS. one mono-repo.
The "1 + 1" bug is only there to serve the purpose of needing to release a new version of a project. Migrating to that new version is the actual example.
Granted, I do feel like this video missed the point it was trying to make also. Like other comments say, it's just showing you "how" to utilize a mono-repo, not "why" you should.