Supermicro E300-9D-4CN8TP with Intel Xeon D-2123IT Review
Vložit
- čas přidán 15. 06. 2024
- STH Main Site Article: www.servethehome.com/supermic...
STH Merch on Teespring: the-sth-merch-shop.myteesprin...
STH Top 5 Weekly Newsletter: eepurl.com/dryM09
In our Supermicro E300-9D-4C8TP review, we see what this Intel Xeon D-2123IT with 4x 1GbE and 4x 10GbE (2x SFP+ and 2x 10Gbase-T) offers. We discuss why this is an embedded network appliance platform that we use for firewalls in our networks.
--------------------------------------------------------------------
Timestamps
--------------------------------------------------------------------
0:00 Introduction
0:48 External Supermicro Hardware Overview
6:23 Internal Supermicro Hardware Overview
16:11 Performance
18:08 A Word on Noise
18:24 Intel Lewisburg PCH IP
19:56 Power Consumption and Comparison
20:13 Management
20:36 Pricing and Value Breakdown
22:33 The Intel Xeon D-2100 in Today's World
25:56 Wrap-up
--------------------------------------------------------------------
Other STH Articles Mentioned in this Video
--------------------------------------------------------------------
- Intel Xeon D-2123IT Review: www.servethehome.com/intel-xe...
- Intel Xeon D-2100 Architecture and Platform Overview: www.servethehome.com/intel-xe...
- Supermicro X11SDV-16C-TP8F Review www.servethehome.com/supermic... (this is the 16-core version of the motherboard used in this system) - Věda a technologie
What a name, it just rolls off the tounge
We use 2 of these in their rack-mount form (SYS-5019D-4C-FN8TP) as edge firewall appliances at work. Awesome machines.
Love your enthusiasm, Patrick! You can tell you have a passion for this tech!
EXACTLY what I was looking for :) Thank you!
This will be my new firewall
Yes it's a good system, I have the E300-9A-4C version, that's perfect for my home network :)
@@GodAtum I use opnsense so I would assume pfsense would run it without any issue. But always check if the nic and cpu is being supported, because there are small differences in the sku’s
a xeon for a firewall seems overkill, but multiple 1g and 10g ports with pfsense and a bunch of addon modules looks like fun.
@@brianw.4985 Most of these "appliances" do far more than just provide a firewall such as VPN encryption... but that's the most common function. You really don't want the CPU utilization to go beyond 5% to maintain low latency performance so the IPCs can come into play with high speed connections and a high count of users.
@@OVERKILL_PINBALL Thanx for feedback. What makes this look appealing is 10G for a NAS, and then multiple 1g ports for various VLANs and things. There is as you implied enough CPU to make VPN encryption a no problem scenario. I would probably run some other PFsense packages (Suricata) that would tax a lesser system.
Thanks for posting this walk-through. I think you covered everything there is! E300-9D-4CN8TP is a great product as is the Atom C3000 equivalent and the higher core count versions. It's a natural choice for a home lab or whitebox type uCPE for datacenter and/or branch office, edge compute platform. As you know, Network Function Virtualization is a major growth area and this hardware is a great choice.
This is like the X9SCL I use for my firewall/web server. That unit is a half-depth 1U with 2 internal drive bays and a 350w 80+ gold supply. It's a Sandy Bridge Xeon system, so the E3-1220 is almost exactly half the speed of this Xeon. It's nice because it does have a full sized PCIe slot and riser, so I can toss a quad GbE NIC in there for the Firewall and pass through one of the onboard NICs for the web server, leaving the IPMI and other onboard NIC for the hypervisor host.
Thanks for sharing. Curious about sound at idle. Have you measured? I would like to know if this would work in a home office environment from a noise perspective. Thanks!
I asked for it - I got it :) - looking forward to this
even the price of a used one can afford my entire network including 5 APs and 9gen intel server.
Question for Patrick at STH: have you noticed that this platform can burn through NVMe drives? I’ve had a couple Samsung 980’s simply fail within a couple/few months of use, even with heat shields. I’ve also had riser NVMe drives fail. Going down to less heat generating 970’s, or even 950’s seem to help.
Hey Patrick and STH team, Great video love your content as always from Trinidad. I recently built a overkill PF sense firewall router with the AMD version of the server, I wish it had more super micro custom ports to power Sata drives, I have one Nvme and one sata in zfs mirror. Thanks for covering this content, I also wish it had Tangi networking at some point I will get the external card just hope the power consumption is not too bad please advise a suitable model regards Shane
i just bought a supermicro X10SLH-N6-ST031 on ebay. six 10gb x540 ports, I have a dual intel spf+ card and a quad 1gb card. Xeon 1230. it's my pfsense rig for my electronics lab. Real handy to have the connectivity options
I can't afford the item, but I do like your information-dense videos.
Great presentation Patrick! May I ask which firewall application do you run on such a hardware platform?
I tend to use pfSense heavily both bare metal and in VMs
@@ServeTheHomeVideo Great choice (from my perspective).
Just one more, which would be the maximum throughput you would expect on such a combination Software/Hardware running an "average" firewall set-up?
@Patrick: If you were going to use this purely as a pfsense appliance on bare metal, and were purchasing today, would you go with the 4C/8T Xeon-D or a higher core count Denverton platform?
Good question. We have a bunch of different firewalls. At 1GbE speeds a C3558 is likely fine so there is an assumption you are running more with these. I would probably recommend the C3000, however, saying that we use these over the C3000 in our networks in many places. The Atom C2000 bug taught a lesson in diversification
I was pleasantly surprised to see the underside mounts for hanging this chassis from a networking board. Not really the most quite system, super flexible though.
looks like an excellent PFSENSE box :D
Yay new video :) hoping for power usage at the wall 😊
Good point. Let me work on some time stamps.
Could be mistaken but I didn't hear you talk about the software. OPNsense, pfSense? I take it these works out of the box? And someone else mentioned power. Maybe that was in the noise section that got cut. Thank you.
I would think that theoretically you could also make a pigtail for redundant power.
So much condensed into a small form factor, wow. The cut on the finger, true hardware guy lol.
Does anyone have a good example a firewall with the newer xeon he is talking about? I was looking at the Supermicro SYS-5019D-4C-FN8TP but I don't think that is the type he is talking about.
The "hump" mentioned 15:30 is actually another case called CSE-E301 instead of CSE-E300. :)
Was just looking at this product like last week... How'd you read my mind?!!
Noticed the same thing re: pricing. So painful to get one these today when you compare it to the current list prices Xeon-SP refresh. It's almost like they know their embedded customers will keep paying the higher markup if they need full-fat Skylake cores. 😡😩
That said, you do get sr-iov on all the network ports, and plenty of memory bandwidth, so it's tempting to actually use a hypervisor and run pfsense virtualized.
This is exactly what I use it for, primarily because it’s really hard to find the NIC I/O, performance and features for the same size and money. It may not be the best package for every use case, but for small form factor networking projects, it’s a great little server.
I would like to know what the power consumption for idle and load is.
It is in the power consumption section of this video (index in description) under the D-2123IT
Hi, how much does it cost ? Can it be racked yo a bay properly ? 19" format ?
what firewall were you running on this unit
Neat, maybe running selks or security onion inside it
I finally found out why someone would want a half terabyte of memory on the board.
If someone uses an app like Primocache to defer drive writes for high performance throughputs it could be usible for a defferance of 60 secs or whenever the drive is at 0 percent to do a "Fast write" as i know it by rather than having the write slowed down by whatever is using high IOPS at the time.
In addition if i use the 10G ports and aggrtegate them together that can be very stressful on the drives in a large transfer or multi-smal;l file transfers leaving the disk to torture itself.
I used this with ramcache and it was a blessing in my experience
Great example
Would it be possible to add a full sized pci-e sata expansion card to connect to some jbot f.ex. qnap storage expansion?
It would be a really nice to run proxmox with some additional external storage on it.
Yes in the PCIe slot.
Considering using such a unit as a SOHO router (pfSence) for Bell Canada FTTH. Any suggestions/concerns?
I keep thinking about making it my next Untangle box...
This is a use case similar to what we use these for. The big concern is just noise under load if you want this to be next to your desk. If you have it in the garage, basement, or something like that then this is not a big deal. You can also tweak fan curves in IPMI to help with the noise a lot, especially if you are not planning on 100% CPU utilization with AVX512 24x7.
That will work when I outgrow my current firewall which only has Gbe and a 7th gen i5.
Great for pf sense!
Where can I get a good deal on these servers? Is there a builder who will customize instead of figuring out every part item.
Is there a version or something similar with all the connectivity features that has more cores?
Looks like a good pfsensebox
What’s the routing speed between two 10GE ports with Linux or FBSD firewalls?
Thanks, that's what I want to know, too.
Depends on exactly what you're doing, simple routing is full line speed across all ports.
If you're doing any inspection, or anything slightly complicated, the CPU will become a bottleneck rather quickly.
@@christophertstone is that an actual measurement on this hardware? what packet sizes?
Small question: Can you rack-mount this in a 10" rack?
Yes supermicro does have a rack mount kit for this
The super micro kit is for 19” racks.
seems to be good homelab
How does it compare to the HP G10 Microserver plus for use as an esxi host with 7 or 8 vms and running a virtualised firewall like pfsense ?
They are somewhat different machines. The HPE MSG10+ has 3.5" bays and is much larger. The Supermicro has for onboard 10GbE ports so better networking and more memory capacity. CPU wise it is closer to the higher-end CPU option in the MSG10+ assuming one does not upgrade the CPU. The HPE is quieter with bigger fans.
This is more comparable to the HP EC200A. The EC200A is a step down from this system in terms of CPU performance (Broadwell Xeon-D instead of the Skylake), memory capacity (2x32GB instead of 4x128GB), memory channels (2 instead of 4), and networking (2x1GbE Intel NICs + proprietary 4x1GbE expansion card instead of 4x1GbE + 4x10GbE). However, it's been available fairly cheaply on the used market.
STH has a video on that system here:
czcams.com/video/pjGhjZaVK88/video.html
@@ServeTheHomeVideo I just want a compact server that has quad core Xeon or better with ability to pack in memory and good networking with modest storage to run vms, pfsense and still be quiet enough to sit in a cupboard by the house entrance whilst not sounding like a data center. Currently I use a Dell T20 with an intel i350 quad nic but want something that allows more memory and remote console that fits on a shelf. The g10plus is small enough and a nice form factor but not willing to pay the silly price for ilo.
Low core count/high mem if you are going to oversubscribe the cores with virtualization with workloads that are low utilization.
I totally agree, but it is a bit hard to see 512GB for 4 cores. 128GB/ core is a lot these days.
Can someone please clarify for me how we can put 4x NVMEs in this? (11:40) Where exactly would each one be? I plan on building many machines like this that each have as many NVMEs as possible as long as their bottle-neck is the 10Gb ethernet, so I'm fine as long as the speed of these NVMEs doesn't drop below ~1.2GB/s. How many can I put then, and where? I also don't mind if a PCIe extension comes out of the chassis to a card that has many NVMEs (maybe more than 4 total then?) as long as the general speed doesn't drop below 1.2GB/s. Thanks!
Want it 👍👍
What type video cards fit inside this machine?
Have been using D1528 since it was released as a edge VE. Awesome feature set, great price. Have three in a pve ha cluster. D2100 series upper the power consumption drastically, so avoided the part.
Would LOVE to see a review of Supermicro Ryzen 8C 16T mitx board and associated platforms. It ticks the power per performance checkbox waaaay more than d2100.
Please do review on liqid fabric switch please please
And here i am with my ancient supermicro X8DTT, sadly my DTT-IBQ version died, so i'm stuck with dual 1G instead of 40g
Edit, what is with supermicro having weird power, the X8DTT is powered by a 12v 24 pin, i dont mean its a standard 24 pin that only has 12v and not 5v/3v i mean, there are no CPU 8 pins, there is just a single 24 pin, for a dual processor server(there are 2x24 pin connectors, but the manually apparently says you cant use two power supplies, but i have tested, you can chain two boards together off of the same power supply)
It's compact, has a lot of hot components, it'll generate a lot of heat, and the fans will need to run hard so it'll be noisy - DC or home shed only. Applications can only really be some sort of network switch / firewall. No servers for normal use need that sort of connectivity. Seems a bit impractical for typical server use.
While the chassis is not conducive for it, the board would be fine used in a network storage platform.
VMware uses these in their NanoEdge servers. I’m running 3 of these in a vSAN cluster as well and while they’re not quiet, you can’t hear them through a closed door.
@@dcprom0396 good to know, thanks.
It would be much nicer if Supermicro makes a EPYC 3000 version of this.
The unit on the left of this video that I mention has the extra storage space is EPYC 3000 based. See the review here: www.servethehome.com/supermicro-as-e301-9d-8cn4-review-embedded-epyc-appliance/
The issue I see with the current generation of embedded epyc systems is that we have to use add-in cards to get 10g networking. I'm hoping this is something we'll see on a future generation.
apakah model ini bisa di isi RouterOS Mikrotik???
Can we get a red hoodie like that ?
Depending on price, that motherboard would make a good unraid server.
Interesting. I'm currently fighting with a BananaPI R64 which comes with 2 mini PCIe slots and one SIM card, basically I have a mini PCIe 5G modem on it and am currently fighting to actually build a recent version of OpenWRT for it (already managed to boot it and actually work but the existing OpenWRT images are caputz and do not work properly, the older ones do work but don't have 4G/5G modem support).
If you have a good OpenWRT build or a better solution to run on this baby please let me know.
One way or another once I have a properly working image I will share it for everybody to use and not have to suffer the lengthy OpenWRT configuration and compilation lengthy waiting delays.
Is there a new latest/greatest Supermicro tiny Xeon machine for 2023?
👍
Proxmox + True NAS + Firewall
Does it come with the bonus Chinese spy ware chips ?
If you are referring to the Bloomberg pieces, remember, the named sources/ organizations including Tim Cook (Apple) and Andy Jassy (Amazon) have said Bloomberg's first story was false. The second story was centered around Yossi Appleboum where he was so upset about how Bloomberg twisted what he said that he actually gave me the follow-up interview: www.servethehome.com/yossi-appleboum-disagrees-bloomberg-is-positioning-his-research-against-supermicro/
Hardware security is important, and this stuff happens all the time, but the Bloomberg reports were really poorly done (Bloomberg even promoted the team behind it.) Check out the Yossi Appleboum follow-up interview I did and compare to what Bloomberg published.
Do you know what the cs notation means in products like these? Compact server?
I am not 100% sure but CSE I believe means case or chassis enclosure or something like that. Supermicro's chassis lines are generally CSE even if they are large towers or 4U servers.
@@ServeTheHomeVideo ah I was looking at the cs01 today so it made me wonder. That and all the super micro stuff started to make me wonder.
Does this come with a PCIE riser at all?
So long ago that I do not remember. The risers are under $20 IIRC. We have bought a lot of them over the years.
Pfsense / Untangle Firewall box !!
What exactly is your present use for this?
@J Fz That seems like overkill. Must be something else.
@J Fz I'm intrigued with the product, but I run pfsense with 1156 motherboard and i5-655k processor and it's not stressed at all. Just wondering about the possibilities.
why would someone complain about the price? Server Hardware is Expensive.
But can it run Crysis?
someone is selling this for 900 USD, is that good deal?
They have been lower used, but not bad
I have a e300 for a Jira Server
Pity there is no redundant power feature
That CPU doesn't have Intel Quickassist. Don't think pfSense supports it in anything but the hardware from Netgate, but still ...
Discussed this a bit more in the article version, but that is true. Having done QAT articles before, Intel needs to get better QAT integration since it is still painful.
Exactly. Until I can run LUKS with QuickAssist without a ton of pain, it’s pretty worthless and not worth the added cost.
I wonder if these servers are compromised by China as well?
I actually have a bit of a different opinion of the Bloomberg series. I got the exclusive follow-up interview to the sole source on Bloomberg's second piece where the source did not agree with Bloomberg's spin of his words. See www.servethehome.com/yossi-appleboum-disagrees-bloomberg-is-positioning-his-research-against-supermicro/
Is this really SFP+ it looks like SFP?
SFP and SFP+ are physically identical
Its definitely SFP+
Got 3 of these in a rack.
512GB memory with 4 core cpu? Why not? Some applications require a lot of memory but not much CPU.
Price you mentioned is not accurate. Add about $300 or more to that. Please show me a link where you can get this for the price you mentioned.
Quite a lot has changed with systems pricing in the last 10+ months. What was $850-900 10 months ago is now $1000-1050 (many resellers selling in that range.) Hard to update a video that has been online that long. You can get this system for $500-590 in a rackmount chassis instead forums.servethehome.com/index.php?threads/supermicro-10gb-xeon-d-router-590.34994/ - If you really want the E300 chassis you can swap the motherboard from that system into an E300 and be well under the $850 price tag.
This seems like a tinyminimicro project server
There was a 30s discussion of that in the original draft, but it got pulled out since I did not want to confuse the TMM series.
@@ServeTheHomeVideo This seems like its in the spirit of the TMM series! Haha
For a lot of people that are looking for huge amounts of memory/ networking and less CPU, I think it is a very good option.
@@ServeTheHomeVideo do you think this kind of form factor servers and appliances might get more popular? Because i think for the most part no one really needs even a full fat 1U chassis for a lot of use cases. Getting the small form factor revolution come down to servers and not just desktop pcs would be awesome to see.
Edge and embedded will be big with 5G so perhaps. Big 1U/2U servers are still much better for running VMs/ containers from a cost perspective.
this looks like i could install it in a normal micro atx case
Flex ATX is quite a bit smaller than mATX
the screw holes look like some micro atx layout, and the cpu fan can be ziptied onto the heatsink if there is no aftermarket cooler available
It's hilarious to me that this system can be configured with 512GB of DDR4 ECC LRDIMM's. Like 512GB in that, with 4 cores and so forth, just funny.
That sounds like a good config for a very dense memcached node.
@@GGBeyond This, I am running Redis in mine. Only problem with these units is that they are noisy for home use. I am struggling to keep mine cool enough
"inches are stupid" change my mind
BMC / out of band licenses should not be a thing, I always avoid brands that use them.
Supermicro includes the base OOB functionality. There are licensed features such as the $20 upgrade to update BIOS via the web UI. Many SM resellers include these licenses on systems they sell.
@@ServeTheHomeVideo I was flabbergasted when our new HPE servers refused to show the remote console beyond POST, had no clue it was a thing after working with Gigabyte mainly.
These servers are really expensive. They are good, but expensive. Certainly not an average to below average household price.
If you came out with a 2021 review for a small footprint box like this for pfsense ,untangle....that was a lot cheaper, i think it would be a big hit. But maybe concentrate on newer technology. You seem to do a lot of reviews on stuff you have laying around....
The Xeon D-2100 series is still the current-gen part in this segment. So this box is still current-gen what you would buy today in 2021. Embedded product lifecycles are much longer.
You are NOT going to find this server anywhere for the price you mentioned. Please prove me wrong and show me where you can buy this for the price you mentioned.
..
Too bad it’s over $800.
Supermicro can’t be trusted imho…
Strange comment?
@@ServeTheHomeVideo yup,sorry… my first time dealing with S.M. They recommended the A1SRI 2758 505-2 for my application.. they only lasted a week … It wasn’t easy explaining to my boss why I needed more budget to replace…. Atom c2000 bug..
Too much words, not much info....
Yep. Came here to check how loud the fans were but that was cut out. Probably so all the "funny" stories could fit in. He really likes to hear himself talk.
Would this chassis fit in a 10 inch rack?