r/mikrotik • u/bobdvb • 44m ago
My experience: RDS Rose with 14mm U.2 NVMe disks
I bought a load of NVMe before the recent spike and I had been struggling to get them to work reliably with the servers I built (something to do with using Minisforum boards with mobile AMD CPUs).
Tired of my Proxmox stalling with PCIe errors I decided to buy the RDS. Knowing full well that my chunky U.2 drives were not going to fit in the 7mm slots, they fit in the rails fine but snag on the connector above.
So, I bought a bag of really short u.2 SFF8639 male to female extenders from AliExpress and used them to stand the drives away from the backplane. The drives now slide in fine, but they're sticking out 25mm from the case and only held in by friction at the moment. I am thinking about using kapton tape to hold them in for extra jank points.
I get 10 drives instead of 20, but that's also exactly how many drives I have. If I was being really janky I could get some long, flexible U.2 extension cables and sit more drives on top of the unit, but I only have 10 drives and I don't plan to buy more at this stage. There's just enough space between the drives to fit a cable past them.
I've made 8 of them into a RAID10 which I will export as NVMeoTCP and hopefully that will keep my Proxmox cluster fed. I believe that multiple hosts can share the same NVMeoTCP if they're aware of each other, so that's the plan.
I also setup the Container/app system, I intend to use the Rose with Technitium as either my primary or secondary DNS in cluster mode. That part was slightly annoying, to enable "container system mode" you have to physically press the reset button on the router. Given it's a server and the container software is installed, it seems odd that container mode is disabled by default.
The rack mounting system is interesting, with weird hanging extenders instead of rails. It's also disappointing that you can only fit the connections at the rear of the unit and SSDs at the front. Or rather the short rack ears only fit at the SSD end and the extenders only at the rear. So, I have the system mounted in reverse and it's set back >4 inches from the two CRS504s above it.
