archive snowblossom slack mining
prev 2018-11-22 next
2018-11-22 21:14:45
Rotonen
@dbag12345 boo
2018-11-22 21:15:52
dbag12345
here we go :slightly_smiling_face:
2018-11-22 21:17:58
Fireduck
Are we winning?
2018-11-22 21:19:25
Rotonen
@Fireduck so this is the one whom helped me figure out the curiosity of prefetches missing on windows is a non-issue as the per thread penalties are low enough for being able to just pave over it with wider/deeper fetch spamming - as the intel memory guide said it would
2018-11-22 21:20:26
Rotonen
but he’s having some ~300kH/s to ~400kH/s gap as per ram channel population asymmetries you might be able to help him pave over with arktika
2018-11-22 21:20:43
Fireduck
Cool
2018-11-22 21:20:56
Rotonen
he’s been getting to 1,1MH/s as far as i can see
2018-11-22 21:21:09
Rotonen
dual socket xeon (workstation?)
2018-11-22 21:21:15
dbag12345
the hourly average is ~1.162ish
2018-11-22 21:21:46
Rotonen
decimals will jitter
2018-11-22 21:22:36
Rotonen
but you should be able to get up to around 1,5 - at least i reckon
2018-11-22 21:22:42
dbag12345
yeah dual socked zeon workstation
2018-11-22 21:22:54
dbag12345
https://www.asus.com/Commercial-Servers-Workstations/Z9PED162L/HelpDesk_CPU/ Through innovative ASUS design, the Z9PE-D16/2L offers high power efficiency up to 90%, quad Intel® LAN, great virtualization support, and high I/O expandability. Users also obtain complete manageability via the latest ASMB6.
2018-11-22 21:24:20
dbag12345
12 memory slots filled with 16gb modules
2018-11-22 21:26:13
dbag12345
2x Xeon E5-2670 CPUs
2018-11-22 21:26:42
Rotonen
so @Fireduck has been spotting java 11 being around 10% faster at this and @fydel has slapped enough many parametres on the jvm to also get abou the same boost - now what is interesting to me is whether these are mostly the same thing (better defaults) or divergent enough to be (at least partially) stackable
2018-11-22 21:27:58
dbag12345
that's interesting - borrow some of the divergent parameters into Java 11
2018-11-22 21:28:02
dbag12345
?
2018-11-22 21:28:28
Fireduck
maybe
2018-11-22 21:28:32
Fireduck
I haven't done a ton of tuning
2018-11-22 21:46:25
dbag12345
would mixing 16 & 32gb memory modules be a bad idea?
2018-11-22 21:47:14
Fireduck
I have no idea
2018-11-22 21:50:56
dbag12345
I think it might be possible to continue with all RAM for snowfield 8 by mixing 12x 16gb & 4x 32gb modules
2018-11-22 21:51:50
Fireduck
in my experimentation, it seems that memory bandwidth is way higher than needed even for ddr2
2018-11-22 21:51:55
Fireduck
so a mix is probably fine
2018-11-22 21:52:01
Fireduck
as long as it actually works
2018-11-22 21:52:40
Fireduck
however, I should note that with Arktika you can spread the ram over multiple machines
2018-11-22 21:52:53
Fireduck
and have them use each other for access to it
2018-11-22 21:52:58
dbag12345
oh interesting
2018-11-22 21:53:02
Fireduck
and very likely support additional cpu worker nodes
2018-11-22 21:54:08
dbag12345
thanks for the link there
2018-11-22 21:54:21
Fireduck
no problems
2018-11-22 21:54:39
Fireduck
my old ass ddr2 box is maxing out 1gbe network, just switched to 10gbe last night
2018-11-22 21:55:07
dbag12345
yeah that's interesting
2018-11-22 21:55:24
Fireduck
my general plan is to have a fleet of cheapish 64gb or 128gb nodes
2018-11-22 21:55:40
Fireduck
as many as needed for the current field (plus 1 so there is room for OS and such)
2018-11-22 21:56:28
Fireduck
with 64gb nodes, the bandwidth in an out is probably less than 1gb so probably don't even need spring for 10g networking
2018-11-22 21:57:01
Fireduck
but I am still figuring it out. For some reason my wife doesn't want me to drop $6k on hardware
2018-11-22 21:57:13
dbag12345
:slightly_smiling_face: stealth mode
2018-11-22 21:57:37
Fireduck
ha, hard to hide 4 or 5 systems of parts
2018-11-22 21:58:02
dbag12345
yeah, RAM is easy to hide, thus my approach
2018-11-22 21:58:09
Fireduck
I do have an electrician coming to put in more circuits on Monday
2018-11-22 21:59:05
dbag12345
I'm gonna think about those smaller networked nodes - sounds very cool
2018-11-22 21:59:26
dbag12345
probably requires skills that I don't have to setup though
2018-11-22 22:00:02
Fireduck
nonsense
2018-11-22 22:00:17
Fireduck
it is pretty easy, as long as you are ok with throwing up a few linux boxes
2018-11-22 22:00:30
Fireduck
and maybe host the snow files on NFS to not need much storage on each
2018-11-22 22:00:48
Rotonen
should be a non-issue on windows too
2018-11-22 22:01:05
Rotonen
CIFS should do just as well, if need be
2018-11-22 22:01:11
Fireduck
I haven't tested it much, but windows should be fine
2018-11-22 22:01:20
Fireduck
I was running one of my memory nodes on windows for a bit
2018-11-22 22:01:39
dbag12345
I have a freenas server running and some laptops running fedora so I can do a little there
2018-11-22 22:02:05
Rotonen
windows is only an issue for anything hitting the disk as the os itself is noisier when ’idle’
2018-11-22 22:02:40
Rotonen
the networked field does not need to be that performant either
2018-11-22 22:03:01
Rotonen
you just pull the chunks off it into ram
2018-11-22 22:03:05
Clueless
@Fireduck You can PXE boot and use network storage to store the snowfield so you don't have to buy excess parts, or worry about copying stuff around.
2018-11-22 22:03:36
Fireduck
I have absolutely done PXE boot for things like that
2018-11-22 22:03:42
Fireduck
spent all my time screwing with that
2018-11-22 22:03:58
Fireduck
these days, I'd rather screw the cheapest m2 drive I can find to the motherboard
2018-11-22 22:04:01
Fireduck
no clutter, easy
2018-11-22 22:04:26
Rotonen
no wires is indeed the appeal
2018-11-22 22:04:34
Fireduck
yeah
2018-11-22 22:04:54
Clueless
I like the concept of pxe and don't think it should be that hard
2018-11-22 22:04:56
Fireduck
previously I've used little usb boot drives
2018-11-22 22:04:58
Clueless
but it depends on what's doing it
2018-11-22 22:05:10
Rotonen
i’m hoping someone does a mobo with a barrel jack instead of the 24 pin atx
2018-11-22 22:05:14
Clueless
ooh, I have a script that delivers bootable ISOs!
2018-11-22 22:05:36
Fireduck
yeah, 24pin atx in basically insane with modern on board voltage regulation
2018-11-22 22:05:56
Rotonen
you could just put the dc-dc conversions onto the motherboard, laptops do that
2018-11-22 22:06:01
Fireduck
google had a paper calling for simple 12v only power like a decade ago
2018-11-22 22:06:05
Clueless
uh...
2018-11-22 22:06:06
Fireduck
yep
2018-11-22 22:06:12
Clueless
I don't think they're going to do that.
2018-11-22 22:06:34
Rotonen
i thought google runs on per aisle +12 -12
2018-11-22 22:06:36
Clueless
on board voltage regulation isn't nearly as safe as PSU
2018-11-22 22:06:37
Fireduck
12v to the motherboard anyways, probably an AC->DC at the top of each rack
2018-11-22 22:06:57
Rotonen
at least the one in hamina does
2018-11-22 22:07:05
Fireduck
I have no idea,the datacenter stuff was often pretty secret and I never did one of the tourws
2018-11-22 22:07:21
Clueless
and the SBCs I've seen do it, often had power issues. Inserted video noise, hard drive noise, and other stuff that'd cause the things to occassionally brown out.
2018-11-22 22:07:39
Clueless
a higher clocked cpu/ram is also far more... touchy.
2018-11-22 22:07:45
Rotonen
the sauna in hamina is a good one in case life ever pushes you that way
2018-11-22 22:12:33
Fireduck
is the sauna heated by the datacenter?
2018-11-22 22:19:48
Rotonen
no, the fish farm is
2018-11-22 22:20:43
Rotonen
@Clueless why’d you need a script if your dhcp points at a tftp source?
2018-11-22 22:21:08
Rotonen
see also: https://netboot.xyz/ uses iPXE to network boot Operating System installers and utilities from an easy to use menu.
2018-11-22 22:30:54
Clueless
@Rotonen oh, the script gives you a bootable ISO file. basically, it strips down a debian install and sets up whatever you want via script and wraps it out in a nice iso bundle, perfect for kiosks. It originated out of paranoia, building a kernel without network modules for bitcoin wallet usage and stuff.
2018-11-22 22:31:03
Clueless
anyway, debian base is like 200MB
2018-11-22 22:31:22
Rotonen
gentoo
2018-11-22 22:31:46
Fireduck
Gentoo. Top kek
2018-11-22 22:31:53
Clueless
I mean, if I want to be a freak, I can get raspberry pi builds down to 10MB
2018-11-22 22:32:13
Clueless
really cool for running from ram
2018-11-22 23:00:55
Rotonen
here's a starting point for tinkerers https://betsol.com/2017/06/java-memory-management-for-java-virtual-machine-jvm/ Java memory management is an ongoing challenge and a skill that must be mastered to have properly tuned applications that function in a scalable manner. Fundamentally, it is the process of allocating…