I can’t say for sure- but, there is a good chance I might have a problem.
The main picture attached to this post, is a pair of dual bifurcation cards, each with a pair of Samsung PM963 1T enterprise NVMes.
It is going into my r730XD. Which… is getting pretty full. This will fill up the last empty PCIe slots.
But, knock on wood, My r730XD supports bifurcation! LOTS of Bifurcation.
As a result, it now has more HDDs, and NVMes then I can count.
What’s the problem you ask? Well. That is just one of the many servers I have laying around here, all completely filled with NVMe and SATA SSDs…
Figured I would share. Seeing a bunch of SSDs is always a pretty sight.
And- as of two hours ago, my particular lemmy instance was migrated to these new NVMes completely transparently too.
You must log in or register to comment.
Love this. Apart from hosting an instance, what are you using it for? Self-cloud?
I host a few handfuls of websites, some discord bots.
I hoard Linux isos. I use it for general purpose learning and experimentation.
There is also kubernetes running, source control, and a bit of everything else.
Amateur data hoarder here; teach me your ways
Backups backups backups.
Anything you don’t want to lose, follow the 3.2.1. rule.
Snapshots / Raid are not backups.
Also, unraid is fantastic for handling bulk media. ZFS is fantastic for keeping things safe. (and fast).
And ceph is great for squeezing 20k IOPs out of 6 million IOPs worth of enterprise SSDs!
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:
Fewer Letters More Letters NVMe Non-Volatile Memory Express interface for mass storage PCIe Peripheral Component Interconnect Express SATA Serial AT Attachment interface for mass storage SSD Solid State Drive mass storage
4 acronyms in this thread; the most compressed thread commented on today has 3 acronyms.
[Thread #13 for this sub, first seen 8th Aug 2023, 21:55] [FAQ] [Full list] [Contact] [Source code]
Good bot
Good bot
Fantastic bot, honestly.
Ive been interested in this, but i havnt figured out if my motherboard supports bifurcation. I have an AORUS B450 i mini itx, so just the 1 PCIe slot (gree as i use an APU 4650G ). Is bifurcation more of a premium feature for more expensive boards?
I believe it’s much more common places these days.
Although, of the… 10 or so computers I have laying around my house, only two of them supports bifurcation… although, most of my computers are a decade old.
Having a large flash pool really makes your life so much better.
Until you fill up all your space and have to buy more :p
Hopefully that doesn’t happen soon! I don’t have too much room for more flash, lol.
But, I have quite a bit of available space, so, there shouldn’t be any concerns. Also- tomorrow, after a few adapters arrives, I’ll be adding another 2x 1T flash drives my Optiplex 5060 SFF.
Is your problem that you are bragging about your drives?
I’m out of room to add more drives!
Every one of my servers is basically completely full on disks. I need more servers.
I need some drives
What software are you running on all of this?
From https://lemmyonline.com/comment/768355
A bit of everything. Publicly facing websites. Lemmyonline.com. A few popular discord bots.
Linux ISO collection and streaming.
Lots of automation.
Lots of things around software development. Lots of things around systems and network administration.
Some kubernetes too.
A bit of everything, and nothing in particular.
What management interface is that though and is it part of the OS? What OS are you using anyway?
The bottom screenshot, is from proxmox, which is the top-level OS in play.
Ah okay. Maybe I should try that at some point. It’s been years since I used it last.
I honestly just started using it again a week or two ago. I have been extremely pleased with the features it offers.
The first screenshot is of Dells built in system tools for servers. Being a Dell server he should have Dell’s iDRAC, which is a lights out management module. It is really fantastic.
I wasn’t talking about that. I was talking about the second screenshot. Thanks anyway
I’m confused. Why do those cards have a heatsink? I needed a card like that because my motherboard did not support bifurcation. So had to use a splitting card. The cards I know that require bifurcation do not even need a controller or heatsink. They are just wired pretty much directly to the pci-e bus.
I actually looked up the chip numbers, and its a “splitter”.
I, don’t know WHY there is a splitter, as a splitter isn’t needed, and these cards are advertised to only work on motherboards supporting bifurcation. However, there is indeed, a splitter.
The documentation is also, REALLY horribly translated.
Note: Without pcie splitter function in this host adapter (ASM1182E chip), so motherboard must support PCIe Bifurcation. Otherwise, only one M.2 PCIe SSD will be recognized. If you are not sure PCIe Bifurcation of your motherboard, please consult motherboard munufacture or contact us via amazon message
Here is the documentation for the chip itself: https://www.asmedia.com.tw/product/213yQcasx8gNAzS4/b7FyQBCxz2URbzg0
I, am not 100% certain how, where, or why it fits in there. Perhaps, its for link power management? Or something.
But, I can confirm, these cards DO require bifurcation to be enabled. Without bifurcation, you only see the first drive.
Wierd, but thanks for the info. The card i’ve used before pretty much only has 2 slots and a few random components on it l, like capacitors and such. So I assumed it was never needed. My motherboard didn’t support bifurcation, so I never got that to work though, so maybe it couldn’t work at all… only found that out after installing it.
If your motherboard doesn’t support bifurcation, you can always use these cards: https://static.xtremeownage.com/blog/2022/r720xd-bifurcation/
I have had good experiences with them.
Oh yeah I fixed that issue already. Got a different card for it that uses a controllerchip. Its working great, without bifurcation requirement.
Do you happen to have a link to those cards?
Dual Slot Bifurcation Card Those are the ones I just picked up.
If you have a x16 slot, and can fit a full-height card, and use 4x4x4x4 bifurcation, the ASUS Hyper M.2 is really good.
Sweet!
I’ve got a gen3 hyper M.2 but I was looking for something for the 8x slots in one of my servers without needing full height cards.
That’s the exact use case I got these for
This does seem like an issue, I can help you free up some PCIe slots if you’d like
I don’t see any problem here…
There are no free PCIe slots left! That is a huge problem!
The only problem I see is using 8x slots instead of 16x slots for double the storage
Whats the problem?
Each NVMe uses 4 lanes. For each of these x8 slots, they have two NVMes, for a total of 8 lanes.
The x16 slot already has 4x NVMe in it, lol. The other x16 slot has a GPU, which is located in that particular slot due to the lovely 3d-printed fan shroud.
One of the other full-height x8 slots also has a PLX switch, and is loaded with 4 more NVMes.
Does the plx introduce noticeable latency, and does it get hot?
I want to get a few, but I don’t really have the airflow you do, so I’m a bit worried.
I have not noticed any issues with it.
And- prior to Jan of this year, I used two of them in an r720xd because it didn’t support bifurcation. And- can’t say I ran into any issues.
I also, have not checked to see if it was hot either though.
I’ll gladly take those problems out of your hands for free
Well this seems to be a good problem to have hahah. If you need to get rid of some of those ssds count with me.
ebay! You can pick up these “used” enterprise NVMe and SSDs for CHEAP. All 10 arrived with less than 5% wear.
Good to know I will take a look thank you.
If that’s a problem then I don’t want to be solved.
Its only a problem when you get the electric bill! (Or the wife finds your ebay receipts)
I doubt these use much power compared to their spinning rust anticedents.
I meant my general electric bill. My server room averages 500-700watts.
Was curious how many watts this machine pulls? Also curious if you had ever filled it will spinning disks - would flash be less power hungry?
This one averages around 220-250.
It’s completely full of spinning disks. Flash would be less power usage, but, would cost significantly more, and would end up being drastically more expensive.
Wondering what software you’re running to have all the storage managed and then your containers and things on top? Is it all on the 730XD?
The picture of the GUI at the end is Proxmox.
Proxmox is really powerful and great for a few servers.
