archive snowblossom slack dev
prev 2018-08-10 next
2018-08-10 22:04:12
Rotonen
looked into openmpi again for miner tuning, and urgh, javac wrappers and all the trimmings https://www.open-mpi.org/faq/?category=java
2018-08-10 22:05:54
Fireduck
oh god, mpi
2018-08-10 22:06:12
Fireduck
that takes me back
2018-08-10 22:06:39
Rotonen
interconnects, funfun
2018-08-10 22:06:44
Rotonen
i think arktika will do for now
2018-08-10 22:06:49
Rotonen
for quite a while :smile:
2018-08-10 22:06:49
Fireduck
the great, I am a scientist who can barely program but I need a bunch of machines to work on this problem language
2018-08-10 22:07:11
Fireduck
if it could fail in a bunch of strange ways, that would be a big plus
2018-08-10 22:07:17
Rotonen
oh, the archaea of computing duct tape of academia
2018-08-10 22:07:35
Rotonen
all the fun is exiting from those stacks as universities form joint companies to do shared data centres to do things proper
2018-08-10 22:10:01
Rotonen
i think your 80s cluster approach to within-miner heterogeny is actually the way most things are going to work in the end
2018-08-10 22:10:08
Fireduck
one job I had was at a place that could checkpoint and restart mpi cluster jobs
2018-08-10 22:10:15
Fireduck
which of course the software having no idea
2018-08-10 22:10:34
Fireduck
since it was likely some night mare code no one could change
2018-08-10 22:10:44
Rotonen
sounds like some shared memory flush side effect hack is the way there
2018-08-10 22:11:08
Rotonen
like a distributed ACPI hibernate
2018-08-10 22:11:57
Fireduck
it was basically rolling partition of state through the cluster. Things on one side got suspended if they tried to talk to the other.
2018-08-10 22:12:18
Fireduck
as long as you can intercept every IO call and suspect all the memory state, it worked nicely
2018-08-10 22:12:26
Fireduck
suspend
2018-08-10 22:13:15
Fireduck
Anyways, Arktika could use some discovery mechanisms to make it easier to setup
2018-08-10 22:13:20
Fireduck
or at least notice if something is wrong
2018-08-10 22:13:52
Fireduck
but if you write the configs right and don't screw up it works pretty well
2018-08-10 22:14:42
Rotonen
oh, discovery mechanisms, my favourite ones were from a chinese MMO we localized for some european market, the data centre got angry at us when it blasted some 400Mbps worth of UDP for hours across the data centre just to find the game nodes
2018-08-10 22:14:47
Rotonen
instead of doing something sane like mDNS
2018-08-10 22:14:59
Fireduck
rockin
2018-08-10 22:15:14
Fireduck
I'd use multicast and assume it is probably a single local network
2018-08-10 22:15:33
Rotonen
sad how multicast is advanced futuristic still
2018-08-10 22:15:39
Fireduck
hah, yeah
2018-08-10 22:15:49
Rotonen
ran a student network in 2005, we had iptv multicast going then
2018-08-10 22:15:52
Fireduck
and if someone has some multicast aware routers and spread it around, that is fine too
2018-08-10 22:15:53
Rotonen
and hdtv since 2007
2018-08-10 22:16:14
Rotonen
hpe, cisco and juniper compete to sponsor that network - that was not an issue... :smile:
2018-08-10 22:16:24
Fireduck
nice
2018-08-10 22:16:39
Rotonen
also ISPs and TV channels liked to use it as their field lab for multicast
2018-08-10 22:16:39
Fireduck
if we can just get everyone on ipv6...
2018-08-10 22:16:43
Rotonen
~5k users
2018-08-10 22:16:52
Rotonen
dunno, the zeroconf stuff is scary
2018-08-10 22:17:17
Fireduck
it seems like it would be easy to advertise your node as an ipv6 router and start collecting traffic
2018-08-10 22:17:33
Rotonen
or, let's say zeroconf being used to software define OSI L2 is scary
2018-08-10 22:19:13
Rotonen
actually ipv6 is probably as safe or even safer for the arktika zeroconf as multicast is, might even be likelier to work well with whatever people have in their home networks
2018-08-10 22:19:48
Fireduck
I mostly use ipv6 on my home network
2018-08-10 22:20:12
Fireduck
but my automatic config consists of machines putting a dns entry into route53 after they get an ipv6 address
2018-08-10 22:21:10
Rotonen
.ch is sadder in that, i got a symmetric 10G fibre at home, but cannot get ipv6 for that
2018-08-10 22:21:32
Rotonen
way too many local services have AAAA records, but nothing sensible answers there, so cannot do that to consumers
2018-08-10 22:21:45
Rotonen
like cities, media outlets, the like
2018-08-10 22:22:05
Rotonen
maybe you should just use netbios?
2018-08-10 22:26:01
Fireduck
IPX
2018-08-10 22:34:45
Rotonen
yeah, kali sucks, so gotta go the whole mile