2018-11-09 00:27:48
Not sure how failover would be
Fireduck
2018-11-09 06:55:50
and using that nvme makes the box crash
Fireduck
2018-11-09 06:55:52
great
Fireduck
2018-11-09 06:55:59
I hate hardware some times
Fireduck
2018-11-09 07:08:48
put it in a different machine, still only detected one NVME.
Fireduck
2018-11-09 07:09:02
@Clueless I'll be come all day tomorrow, want to come get this thing and see if you can do something with it?
Fireduck
2018-11-09 07:09:15
I just don't have that much mucking with hardware time.
Fireduck
2018-11-09 16:41:51
I love it when a GFCI trips taking down the server that takes 30 minutes to load the chunks back into ram
Fireduck
2018-11-09 19:53:15
fibre channel?
Rotonen
2018-11-09 20:58:51
here's a decent writeup of why i like to push 35W TDP non-turboable processors on people
https://www.anandtech.com/print/13544/why-intel-processors-draw-more-power-than-expected-tdp-turbo Why Intel Processors Draw More Power Than Expected: TDP and Turbo Explained
Rotonen
2018-11-09 21:25:07
I like my processors to actually be on fire
Fireduck
2018-11-09 21:26:25
you need a sparc
Rotonen
2018-11-09 21:26:50
a spark is like fire
Fireduck
2018-11-09 21:27:08
sparc, were those those fancy purple boxes that no one ever let teenage me touch?
Fireduck
2018-11-09 21:28:11
no, I am thinking of the SGI stuff
Fireduck
2018-11-09 21:29:12
well, at least XFS survived that
Rotonen
2018-11-09 21:29:43
ultrasparc hardware was also purple themed so could be you blend the two at this point already
Rotonen
2018-11-09 21:30:40
yeah
Fireduck
2018-11-09 21:31:03
https://www.itinstock.com/ekmps/shops/itinstock/images/Sun-SunFire-V240-2-x-1.5Ghz-UltraSPARC-IIIi-2Gb-RAM-Rack-Server-540-6600-01-20801-p.jpg 400x243px image
Rotonen
2018-11-09 21:31:32
i'd call those fancy purple boxes
Rotonen
2018-11-09 21:32:19
looking it up, I was remembering the sgi machines that were big purple cubes
Fireduck
2018-11-09 21:32:37
if you remember this, you fiddled with one
Rotonen
2018-11-09 21:32:44
you could bring down the X11 very easily on irix
Rotonen
2018-11-09 21:33:31
I was never allowed to touch one
Fireduck
2018-11-09 21:34:11
always in the context of "hey, look at this fancy lab with fancy boxes" as part of a quick tour
Fireduck
2018-11-09 21:34:59
I did help carry hardware around when Virginia Tech decided to build one of the largest (at the time) super computers out of Mac towers and infiniband.
Fireduck
2018-11-09 21:35:38
They wanted the 1U mac servers, but those weren't ready yes so phase 1 was towers, three on a shelf. 3 or 4 shelfs to a rack.
Fireduck
2018-11-09 21:35:57
We had to unbox, install infiniband card, haul to shelf
Fireduck
2018-11-09 21:36:08
m68k supercomputing, or wut?
Rotonen
2018-11-09 21:36:20
this was probably in 2003 or 2004
Fireduck
2018-11-09 21:36:42
so ppc
Rotonen
2018-11-09 21:36:49
probably
Fireduck
2018-11-09 21:37:56
heh, nested access interleaving is becoming a thing - let's hope they do not trip up on their own cleverness
https://www.anandtech.com/print/13579/in-the-lab-double-capacity-2x32gb-ddr4-from-gskill-and-zadak In The Lab: Double Capacity 2x32GB DDR4 from G.Skill and ZADAK
Rotonen
2018-11-09 21:38:03
@Rotonen do our shit consumer motherboards support PCI-E bifurcation?
Fireduck
2018-11-09 21:38:15
probably not
Rotonen
2018-11-09 21:38:22
We are having trouble with this card: https://dlcdnets.asus.com/pub/ASUS/mb/accessory/HYPER_M2X16_CARD/E13224_HYPER_M.2_X16_Card_UM_WEB.pdf
Fireduck
2018-11-09 21:38:32
nothing sees anything other than first slot
Fireduck
2018-11-09 21:38:45
the specs sheet of the asus card is so mum i'm very sceptical of recommending it
Rotonen
2018-11-09 21:38:57
it seems more like a workstation card by design, and they're not actually telling what it is
Rotonen
2018-11-09 21:40:33
amazon reviews say people have had 1-3 slots working and in general apparently badly put together
Rotonen
2018-11-09 21:40:52
now this is gonna sound weird, but heat it up with a hair dryer for a bit and try again
Rotonen
2018-11-09 21:41:02
probably bad solder reflow
Rotonen
2018-11-09 21:41:27
google for the ps3 fix, probably same problem
Rotonen
2018-11-09 21:45:34
actually it's software lock-out of VROC it seems - ASUS should never have made that a consumer product
Rotonen
2018-11-09 21:45:35
https://communities.intel.com/thread/125632 Mainboard: ASUS WS SAGE x299 CPU: i9 7980xe 4x Intel 1TB 760p M2 The Problem is: Only 1 of 4 Intel SSD show up in BIOS. I tried it with both the
Rotonen
2018-11-09 21:46:01
what i'm parsing from that your motherboard can implement hackery to fake a license key and fake the IDs of your SSD to be in line with what intel expects
Rotonen
2018-11-09 21:46:14
so update UEFI and hope for the best?
Rotonen
2018-11-09 21:48:08
hair dryer over oven at some low temp?
Fireduck
2018-11-09 21:48:13
@Rotonen customer reviews say that it works as a multinvme card on motherboards with pcie bifurcation, and the manual says the VROC only works on a specific motherboard thing.
Clueless
2018-11-09 21:48:40
I don't think our motherboards have pcie bifurcation.
Clueless
2018-11-09 21:48:45
@Fireduck depends on the solders used, but probably not that issue you are facing
Rotonen
2018-11-09 21:49:04
dunno if it's *only* that, it would seem like the motherboard also needs to lie to the intel chip on the asus riser
Rotonen
2018-11-09 21:49:35
that intel community thread is a bit vague and repeatitive, but seems like all the essentials are actually covered there
Rotonen
2018-11-09 21:50:43
@Fireduck I don't like the idea of relying on badly documented, one off products. :/
RAM might be more reliable.
Clueless
2018-11-09 21:51:39
pci-e is very complicated beyond 'plug gpu in'
Rotonen
2018-11-09 21:51:53
Ha. Fun times.
Fireduck
2018-11-09 21:51:57
it's just legos / tinker toys
Clueless
2018-11-09 21:53:33
ok, so, yeah, you do need bifurcation for the base operation - you need to be able to explicitly set the slot to 4x/4x/4x/4x
Rotonen
2018-11-09 21:53:33
@Fireduck I say we try a specifically pcie bifurcation motherboard, or give up on this card.
Clueless
2018-11-09 21:53:45
unless their specific motherboards are common and cheap.
Clueless
2018-11-09 21:53:59
damn i'm like 5 years behind on what's going on in pci-e, this is good stuff i'm encountering
Rotonen
2018-11-09 21:54:12
so, extra fun, but not all bifurcation can split into 4
Rotonen
2018-11-09 21:55:12
so it could just as well be you've not set up the UEFI settings for the slot right
Rotonen
2018-11-09 21:56:19
and apparently that's not a hardware feature either, just UEFI level implementations
Rotonen
2018-11-09 21:56:35
so you might be able to just hack in an uefi script as that's a handshake rewrite under the hood
Rotonen
2018-11-09 21:56:44
really, that's cool
Clueless
2018-11-09 21:56:57
ref. https://software.intel.com/en-us/articles/efi-shells-and-scripting Introduction Extensible firmware interface (EFI) brings new flexibility and opportunities to users by allowing them to work in the layer between their OS and BIOS, without altering either one. This paper explains how to use EFI shell commands, create a script file and set up the boot menu with shells and scripts. In addition, this paper demonstrates dual boot selection for the 64-bit Red Hat Linux* 7.1 and 64-bit Microsoft Windows* XP Professional operating systems.
Rotonen
2018-11-09 21:58:25
and here's your entry ticket
https://github.com/chipsec/chipsec/wiki/Creating-a-Bootable-USB-drive-with-UEFI-Shell
Rotonen
2018-11-09 21:58:44
oh god, I don't want to get into that. :(
Clueless
2018-11-09 21:59:23
chipsec is good stuff to have in your browser caches when getting caught at border crossings :stuck_out_tongue:
Rotonen
2018-11-09 22:00:56
backup your stuff to the cloud, take out your storage from your computer when you travel.
Clueless
2018-11-09 22:02:04
easier to just buy a laptop on-site if going on a trip like that
Rotonen
2018-11-09 22:05:42
@Rotonen so what do you suggest we do from here?
Clueless
2018-11-09 22:06:09
try to write our own uefi thing to handle pcie bifurcation?
find a cheap motherboard that supports bifurcation?
give up and use ram
Clueless
2018-11-09 22:06:36
@Fireduck so what causes your ram machine failure anyway?
My guess is power, I have an extra UPS if you want to try that out.
Clueless
2018-11-09 22:07:31
@Clueless email the motherboard vendor, email asus
Rotonen
2018-11-09 22:11:34
@Fireduck on another website
```
Check (960 PRO pic here). Note that the ASUS Hyper M.2 X16 Card will only work on motherboards supporting PCIe bifurcation, which allows the CPU to split PCIe lanes into subgroups without the need of a PLX chip. You can see two bifurcated modes in the above screenshot
```
Clueless
2018-11-09 22:19:26
Vs $200 for a real 4 nvme card?
Fireduck
2018-11-09 22:21:58
$399 - http://a.co/d/1wy14oi with 4x4x4x4 bifurcation (supposedly)
Clueless
2018-11-09 23:03:31
i’m still avoiding from even recommending motherboards as there is no clarity on a cheap do-it-all board
Rotonen
2018-11-09 23:09:15
$400 is a lot. Hard to build cheap with one component being that high
Fireduck
2018-11-09 23:10:52
However, if these Intel cards do what they say you can load that guy up
Fireduck
2018-11-09 23:14:17
at that point it's cheaper to get multiple motherboards and processors already?
Rotonen
2018-11-09 23:15:17
or an actual 16x ssd?
Rotonen