2018-06-29 00:16:27
                        
                             
                            
                    
@Rotonen as I retool a bunch of miner code, anything I should do to make life easier for optimizations?
                    
                 
                            Fireduck
                        
                        2018-06-29 00:17:05
                        
                             
                            
                    
If we at some point magic up a numa aware memory store that can go in modularly in the new setup
                    
                 
                            Fireduck
                        
                        2018-06-29 00:17:22
                        
                             
                            
                    
Or any other novel data sources
                    
                 
                            Fireduck
                        
                        2018-06-29 00:17:42
                        
                             
                            
                    
Like redis or memcache
                    
                 
                            Fireduck
                        
                        2018-06-29 00:25:00
                        
                             
                            
                    
@Fireduck nothing trivial, unless you go for hwloc levels of hw awareness, it's best to let the os do its thing as much as possible
                    
                 
                            Rotonen
                        
                        2018-06-29 16:25:17
                        
                             
                            
                    
makes sense
                    
                 
                            Fireduck
                        
                        2018-06-29 16:26:37
                        
                             
                            
                    
@Rotonen, I forget, did you repro the miner slowdown from 1.06 to 1.07?
                    
                 
                            Tyler Boone
                        
                        2018-06-29 16:26:49
                        
                             
                            
                    
i've not yet had time to do a benchmark sweep
                    
                 
                            Rotonen
                        
                        2018-06-29 16:27:03
                        
                             
                            
                    
prolly gonna start fiddling with that earliest sunday evening
                    
                 
                            Rotonen
                        
                        2018-06-29 16:27:15
                        
                             
                            
                    
yeah, no pressure or anything.  just curious
                    
                 
                            Tyler Boone
                        
                        2018-06-29 16:27:33
                        
                             
                            
                    
no pressure, it's just also in my interest as well to help with that
                    
                 
                            Rotonen
                        
                        2018-06-29 19:32:35
                        
                             
                            
                    
I wonder if there is any reason to not do huge byte arrays in java as opposed to a larger number of smaller ones
                    
                 
                            Fireduck
                        
                        2018-06-29 19:32:43
                        
                             
                            
                    
like 1gb byte array
                    
                 
                            Fireduck
                        
                        2018-06-29 19:36:45
                        
                             
                            
                    
@Fireduck NUMA
                    
                 
                            Rotonen
                        
                        2018-06-29 19:37:11
                        
                             
                            
                    
@Fireduck it's easier for the OS scheduler to shuffle 1G chunks around unfragmented than to figure out how to fragment big chunks
                    
                 
                            Rotonen
                        
                        2018-06-29 19:37:50
                        
                             
                            
                    
so that is in favor of big chunks?
                    
                 
                            Fireduck
                        
                        2018-06-29 19:38:19
                        
                             
                            
                    
to me, big = 1gb, small = 1mb
                    
                 
                            Fireduck
                        
                        2018-06-29 19:38:33
                        
                             
                            
                    
I could also do anything in between
                    
                 
                            Fireduck
                        
                        2018-06-29 19:39:25
                        
                             
                            
                    
ah no, for me small < 32GB
                    
                 
                            Rotonen
                        
                        2018-06-29 19:39:38
                        
                             
                            
                    
1G is a good size for various reasons
                    
                 
                            Rotonen
                        
                        2018-06-29 19:39:43
                        
                             
                            
                    
alright
                    
                 
                            Fireduck
                        
                        2018-06-29 19:39:58
                        
                             
                            
                    
also makes it easier for people to reason about it, with a leaky abstraction, but "where can i put one of these where it's fast to get from"
                    
                 
                            Rotonen
                        
                        2018-06-29 19:40:07
                        
                             
                            
                    
and then just repeat until you have the full snowfield somewhere
                    
                 
                            Rotonen
                        
                        2018-06-29 19:55:00
                        
                             
                            
                    
building a sweep of the deploy jars, but prolly not gonna have time to test before sunday
```
#!/usr/bin/env bash
for version in $(git tag | grep -E '^1' | gsort -V)
do
  bazel clean
  git checkout "$version"
  for target in $(grep name BUILD | cut -d'"' -f2)
  do
    jar_name="$target"_deploy.jar
    bazel build ":$jar_name"
    mv bazel-bin/"$jar_name" "$version"-"$jar_name"
  done
done
# EOF
```
(explicit gnu coreutils version sort as per building on a mac)
                    
                 
                            Rotonen