2018-06-29 00:16:27
@Rotonen as I retool a bunch of miner code, anything I should do to make life easier for optimizations?
Fireduck
2018-06-29 00:17:05
If we at some point magic up a numa aware memory store that can go in modularly in the new setup
Fireduck
2018-06-29 00:17:22
Or any other novel data sources
Fireduck
2018-06-29 00:17:42
Like redis or memcache
Fireduck
2018-06-29 00:25:00
@Fireduck nothing trivial, unless you go for hwloc levels of hw awareness, it's best to let the os do its thing as much as possible
Rotonen
2018-06-29 16:25:17
makes sense
Fireduck
2018-06-29 16:26:37
@Rotonen, I forget, did you repro the miner slowdown from 1.06 to 1.07?
Tyler Boone
2018-06-29 16:26:49
i've not yet had time to do a benchmark sweep
Rotonen
2018-06-29 16:27:03
prolly gonna start fiddling with that earliest sunday evening
Rotonen
2018-06-29 16:27:15
yeah, no pressure or anything. just curious
Tyler Boone
2018-06-29 16:27:33
no pressure, it's just also in my interest as well to help with that
Rotonen
2018-06-29 19:32:35
I wonder if there is any reason to not do huge byte arrays in java as opposed to a larger number of smaller ones
Fireduck
2018-06-29 19:32:43
like 1gb byte array
Fireduck
2018-06-29 19:36:45
@Fireduck NUMA
Rotonen
2018-06-29 19:37:11
@Fireduck it's easier for the OS scheduler to shuffle 1G chunks around unfragmented than to figure out how to fragment big chunks
Rotonen
2018-06-29 19:37:50
so that is in favor of big chunks?
Fireduck
2018-06-29 19:38:19
to me, big = 1gb, small = 1mb
Fireduck
2018-06-29 19:38:33
I could also do anything in between
Fireduck
2018-06-29 19:39:25
ah no, for me small < 32GB
Rotonen
2018-06-29 19:39:38
1G is a good size for various reasons
Rotonen
2018-06-29 19:39:43
alright
Fireduck
2018-06-29 19:39:58
also makes it easier for people to reason about it, with a leaky abstraction, but "where can i put one of these where it's fast to get from"
Rotonen
2018-06-29 19:40:07
and then just repeat until you have the full snowfield somewhere
Rotonen
2018-06-29 19:55:00
building a sweep of the deploy jars, but prolly not gonna have time to test before sunday
```
#!/usr/bin/env bash
for version in $(git tag | grep -E '^1' | gsort -V)
do
bazel clean
git checkout "$version"
for target in $(grep name BUILD | cut -d'"' -f2)
do
jar_name="$target"_deploy.jar
bazel build ":$jar_name"
mv bazel-bin/"$jar_name" "$version"-"$jar_name"
done
done
# EOF
```
(explicit gnu coreutils version sort as per building on a mac)
Rotonen