archive snowblossom slack general
prev 2018-08-27 next
2018-08-27 11:19:17
mjay
@Fireduck can we mark the now obsolete snowfields 0 to 6 as such on the torrent page?
2018-08-27 12:39:51
0x
is snow on any exchange?
2018-08-27 12:43:21
mjay
not yet
2018-08-27 12:43:30
mjay
http://qtrade.io is working on it
2018-08-27 14:33:31
bilounet
Is it normal that when I launch client version 1.3.2, I have that message : FAILED TO INITIALIZE LOGGING: java.io.FileNotFoundException: configs\logging.properties And indeed, there's no logging.properties file as there was in 1.3.0.
2018-08-27 14:35:16
bilounet
Forgot to add, it's working, it gives me my balance and an address, but I have that message at the beginning
2018-08-27 14:37:34
mjay
I also have this message, everything is working as intended
2018-08-27 15:07:56
0x
I started the poolminer for 15 mins. hash power seems 0 ...
2018-08-27 15:08:00
0x
INFO: 1-min: 0.000/s, 5-min: 0.000/s, hour: 0.000/s Aug 27, 2018 11:06:21 PM snowblossom.miner.PoolMiner printStats INFO: we seem to be stalled, reconnecting to node Aug 27, 2018 11:06:21 PM snowblossom.miner.PoolMiner subscribe INFO: Subscribed to work Aug 27, 2018 11:06:21 PM snowblossom.miner.PoolMiner printStats INFO: Shares: 0 (rejected 0) (blocks 0) Aug 27, 2018 11:06:22 PM snowblossom.miner.SnowMerkleProof readWord INFO: pre-caching snowfield: loaded 4 gb of 7 (55%) Aug 27, 2018 11:06:36 PM snowblossom.miner.PoolMiner printStats INFO: 15 Second mining rate: 0.000/sec - at this rate ∞ minutes per share (diff 22.000) Aug 27, 2018 11:06:36 PM snowblossom.miner.PoolMiner printStats INFO: 1-min: 0.000/s, 5-min: 0.000/s, hour: 0.000/s Aug 27, 2018 11:06:36 PM snowblossom.miner.PoolMiner printStats INFO: we seem to be stalled, reconnecting to node Aug 27, 2018 11:06:36 PM snowblossom.miner.PoolMiner subscribe INFO: Subscribed to work Aug 27, 2018 11:06:36 PM snowblossom.miner.PoolMiner printStats INFO: Shares: 0 (rejected 0) (blocks 0) Aug 27, 2018 11:06:38 PM snowblossom.miner.SnowMerkleProof readWord INFO: pre-caching snowfield: loaded 5 gb of 7 (69%)
2018-08-27 15:17:23
mjay
It is still pre-caching the snowfield. What kind of storage are you using?
2018-08-27 15:23:24
mjay
how much ram?
2018-08-27 15:23:55
mjay
you won´t get a lot of hashrate with this config
2018-08-27 15:24:18
mjay
you need to place the snowfield on a ssd or nvme drive
2018-08-27 15:25:24
mjay
otherwise it will take a long time to precache (as you experienced), and will end up with 30 hashes/sec or less
2018-08-27 15:26:05
0x
ok, I have another 250g ssd. how much hashrate could get with that?
2018-08-27 15:26:33
mjay
depends on the ssd. Somewhere between 20 and 200kh/s
2018-08-27 15:27:12
0x
well, that's a huge difference.
2018-08-27 15:27:34
mjay
some nvme drives do pretty well on this
2018-08-27 15:27:46
mjay
you can also run several in parallel to get more hashes
2018-08-27 15:29:12
0x
ok, thanks
2018-08-27 15:29:16
mjay
970 evo is great
2018-08-27 15:29:48
mjay
you´re welcome
2018-08-27 15:31:17
Fireduck
I get about 70kh/s from mine
2018-08-27 16:19:40
Fireduck
torrent for chunked 10 is up
2018-08-27 17:10:53
Clueless
so far that's 10TB of torrents
2018-08-27 17:10:57
Clueless
I can handle that. :)
2018-08-27 17:13:10
mjay
which ones are downloaded most?
2018-08-27 17:31:50
Fireduck
snowblossom.7, since that is the active field right now
2018-08-27 18:39:44
Fireduck
@Clueless thinks we should completely replace all social media platforms with something decentralized
2018-08-27 18:41:40
Clueless
yes
2018-08-27 18:43:31
Fireduck
The plan we have seems solid, except I can't see a way to prevent people from basically doing a DoS on a channel by registering an avalanche of bullshit peers for an item
2018-08-27 18:45:36
Fireduck
Shouldn't be a problem for long running channels with an active community, since they should have a peer list for that channel already so doesn't matter what the directory nodes have to say
2018-08-27 18:45:59
Fireduck
but people are basically terrible and are always trying to silence each other so this will absolutely be a thing
2018-08-27 19:33:32
Rotonen
@Clueless look up mastodon
2018-08-27 19:35:05
Rotonen
@mjay i get 160k on a 960 pro, 200k with unsafe kernel patches, 200k is what i get per memory channel with ram
2018-08-27 19:35:19
Rotonen
@mjay and 1h rate after 2h
2018-08-27 19:36:35
Rotonen
also, precache only helps if you have other things trying to fill your fscache, on an otherwise idle system that is unnecessary
2018-08-27 19:37:23
mjay
@Rotonen what unsafe kernel patches are you using?
2018-08-27 19:38:44
Fireduck
He just comments out lines of code that offend him
2018-08-27 19:39:00
Rotonen
i rolled my own for fun early on, but those are *actually* crashy
2018-08-27 19:39:01
Fireduck
basically anything that says CHECK(...)
2018-08-27 19:39:27
Rotonen
yep, pretty much
2018-08-27 19:39:31
mjay
I did something similar actually :smile:
2018-08-27 19:39:43
Rotonen
introduced memory leaks too
2018-08-27 19:39:57
mjay
I manually inlined some functions
2018-08-27 19:40:15
mjay
crappy looking code for a few % performance
2018-08-27 19:41:08
Rotonen
the way to go would be to write nvme direct userspace code into the miner and let it use a whole device
2018-08-27 19:42:15
Rotonen
IIRC cavium was investigating that for memory-wide HPC a while back
2018-08-27 19:42:50
mjay
can this be done in java actually?
2018-08-27 19:43:27
Rotonen
well, sorta
2018-08-27 19:43:39
Fireduck
Does it do something other than 4k reads?
2018-08-27 19:43:55
Rotonen
not really
2018-08-27 19:44:21
Rotonen
it just gets the filesystemy bits out of the way as much as possible
2018-08-27 19:44:26
Fireduck
yeah...that does seem to be the trouble
2018-08-27 19:44:27
Fireduck
cool
2018-08-27 19:44:58
Rotonen
you could be able to just dd an image to a drive and blindly read per pointer?
2018-08-27 19:45:50
mjay
Hmm .. if I remove the snowblossom.7.snow and replace it with a block device pointing to an nvme ssd containing the data directly .. I´ll try
2018-08-27 19:46:12
Rotonen
or just wait for heterogenous memory to land and extend ram onto nvme
2018-08-27 19:46:41
Fireduck
or use arktika and build a ram fleet
2018-08-27 19:46:57
Fireduck
it seems that 64gb nodes are the sweet price point right now, at about $1000 each
2018-08-27 19:47:00
Rotonen
well, everything is a file in unix, should work
2018-08-27 19:47:45
Rotonen
that’ll clock in at $1000/Mh?
2018-08-27 19:48:30
Fireduck
I'm not sure. I suspect if you have a fleet of 3 64gb nodes and spread field 7 over them, you should be able to support about 3 MH/s
2018-08-27 19:48:45
Fireduck
but that will depend on a bunch of cores of processing nodes attached to the network
2018-08-27 19:49:00
Fireduck
don't need memory on the processing nodes, just enough to run the OS
2018-08-27 19:49:20
Rotonen
seems some ddr3 is actually cheap currently
2018-08-27 19:49:29
Fireduck
Right now my old as hell Dell R900 is supporting about 1 MH/s
2018-08-27 19:49:49
Fireduck
ddr3 is a problem, I can't get higher density that 32gb per MB as far I can tell.
2018-08-27 19:50:12
mjay
ddr3 registered is even cheaper if you buy used, and old server boards are also
2018-08-27 19:50:28
Rotonen
yeah, half to quarter the price
2018-08-27 19:51:02
Rotonen
also server gear usually gives one more memory channels per core
2018-08-27 19:51:46
mjay
like the dl180 g7
2018-08-27 19:52:42
Rotonen
@mjay i guess you’ll symlink the device to the snow field location for your experiment?
2018-08-27 19:53:12
mjay
Thats the plan. I currently dd´ the file to the device
2018-08-27 19:53:25
Rotonen
dunno how the nvme root device likes the dd to begin with
2018-08-27 19:53:50
mjay
I don´t boot from nvme, shouldn´t be a problem
2018-08-27 19:56:18
Rotonen
i’d rather get the i3-8300T, 35W and plenty beefy enough
2018-08-27 19:57:26
mjay
500$ for the ram is a lot
2018-08-27 19:57:51
Fireduck
That is what it costs, as far as I can tell
2018-08-27 19:59:57
Rotonen
@Fireduck the T suffix is meaningful
2018-08-27 20:00:15
Fireduck
As far as I can tell the 'T' means unavailable :wink:
2018-08-27 20:01:22
Rotonen
i got a 7700T, they usually have like 2 week shipping times unless you buy from a specialist vendor
2018-08-27 20:04:04
mjay
the 8300T is in stock at my local vendor
2018-08-27 20:05:06
Fireduck
Whenever they are close enough, I always go with AMD to make sure Intel has a competitor
2018-08-27 20:05:41
Rotonen
the 35W AMD parts are not close enough, IMO
2018-08-27 20:05:51
Rotonen
but i like my systems fanless
2018-08-27 20:09:03
Fireduck
fair enough
2018-08-27 20:36:56
mjay
file vs block device: Almost the same speed, maybe half a percent faster
2018-08-27 20:38:22
Fireduck
cool
2018-08-27 20:38:42
Fireduck
I wasn't sure that was going to work
2018-08-27 20:38:58
Fireduck
couldn't remember if any of the read logic used the total file length as part of the calculation
2018-08-27 20:44:11
mjay
@Fireduck It is expected, but easy to patch
2018-08-27 20:45:08
mjay
total_words = snow_file.length() / SnowMerkle.HASH_LEN_LONG; Just put the number in there
2018-08-27 20:45:26
Fireduck
I should really have that get it from the NetworkParams
2018-08-27 20:45:32
Fireduck
which is what I think I have arktika do
2018-08-27 22:02:44
cXplexus
How’s the exchange going
2018-08-27 22:08:34
aikida3k
I have some questions about pool mining and artika. First, I have the client, node and pool miner installed on a windows workstation. I am planning on using the windows workstation as my wallet. I currently have 2 shares mining on this off of the HDD, for fun to get started. How do I access the CLI to check my balance? Next I am about to install the pool miner on a server and mine from RAM. For this I don't need the client and the node for pool mining, correct? Next, to start installing artika on this server when I have the field 7 chunk downloaded, where do I store the artika node.conf files? I start with that, thanks for your help
2018-08-27 22:10:58
Clueless
@aikida3k run `client.bat` (assuming you're already running a node)
2018-08-27 22:13:28
aikida3k
It comes up with an unused address, says to press any key and then exits
2018-08-27 22:15:36
Clueless
@aikida3k ah, open up the batch file and change it to "balance" play with it. :P
2018-08-27 22:16:03
Rotonen
@Clueless you're telling him how to use the wallet client, he's after how to set up arktika
2018-08-27 22:16:23
Rotonen
i guess @Fireduck is the only one who has set one up so far?
2018-08-27 22:16:38
Clueless
@Rotonen "How do I access the CLI to check my balance?" :P
2018-08-27 22:16:52
aikida3k
ok, I also see now it looks like there is a total balance below the timestamp and above the number of wallet keys available
2018-08-27 22:16:53
Rotonen
i too, apparently, skip lines too much
2018-08-27 22:17:10
Clueless
@Rotonen I didn't even notice the arktika uqestion
2018-08-27 22:17:19
aikida3k
well... both actually
2018-08-27 22:17:21
Rotonen
now this just got silly :smile:
2018-08-27 22:17:58
Clueless
@aikida3k I'm in the middle of something, I'll come back with some answers. ;)
2018-08-27 22:18:22
aikida3k
ok that's cool. thanks
2018-08-27 22:18:24
Clueless
probably 10-20 min
2018-08-27 22:18:28
aikida3k
no rush
2018-08-27 22:22:01
aikida3k
@Rotonen If I mine to my windows workstation address and just install the pool miner on my server, I don't need the client or node installed on the server, correct?
2018-08-27 22:22:23
Rotonen
correct
2018-08-27 22:22:46
Rotonen
for the solo miner you need a node, for the pool miner you just need either a local wallet file or an address
2018-08-27 22:23:39
aikida3k
So for the artika conf file, that probably gets stored in the same location as the pool miner conf file
2018-08-27 22:28:43
Clueless
@aikida3k I'm going to take another look at it since it's been awhile and I want to make sure its friendly
2018-08-27 22:28:59
aikida3k
alrighty
2018-08-27 22:38:37
aikida3k
@Clueless So the questions I have now are, 1) is the artika node conf file stored in the same location as the pool-miner conf. 2) Does the pool-miner.conf need to be deleted to mine with artika? 3)Should the memory server in an artika configuration have 2 layers: one layer for RAM (mem) and one layer for HDD (file) 4) In the 3 nodes and 1 worker example configuration, why does the worker.conf initialize each layer node as having 30 threads, but in the node.conf files, the conf for node1.conf has 6 threads for layer_0 and 1 thread for all other nodes except the worker node, layer_3 which is set at zero.
2018-08-27 22:42:09
Rotonen
1) one per each artika node 2) no 3) whatever, however, per arktika node 4) to demonstrate you can, and should, configure them appropriately, for whatever you run them on
2018-08-27 22:42:42
Fireduck
1) yes 2) no 3) yes 4) I don't know
2018-08-27 22:43:18
Fireduck
4) to do some mining on the memory nodes
2018-08-27 22:45:43
aikida3k
okay more on 4) So worker.conf sets layer_0...layer_2 with 30 threads and the layer_3 thread as 0 to tell it to use threads to mine with memory on the other nodes.
2018-08-27 22:46:26
aikida3k
So on the node1.conf why not set layer_0_threads to 30 instead of 6?
2018-08-27 22:47:03
Fireduck
there is a trade off
2018-08-27 22:47:17
Fireduck
the the memory node is using all the cpu to mine, it won't be able to serve requests as well
2018-08-27 22:47:24
Fireduck
so there is some sort of middle ground to find
2018-08-27 22:47:31
Rotonen
there's a benchmark mode in arktika, try to find your sweet spot with that
2018-08-27 22:48:58
aikida3k
ok. And I store the worker.conf file on the server I store the chunked snowfield on, correct?
2018-08-27 22:49:19
aikida3k
The one with the big HDD
2018-08-27 22:56:37
Fireduck
All nodes that do any mining need access to all the chunks
2018-08-27 22:56:52
Fireduck
To do the proof work for a share
2018-08-27 22:57:00
Fireduck
Doesn't need to be fast
2018-08-27 22:57:23
Fireduck
NFS is fine
2018-08-27 23:05:00
aikida3k
So I have a 1.2 TB SAS HDD with 288 GB RAM so in an artika configuration, with 2 64GB RAM the configs would look like:
2018-08-27 23:05:11
aikida3k
worker.conf mine_to_address=addr_here pool_host=http://snowday.fun layer_count=4 layer_0_type=remote layer_0_range=0,63 layer_0_threads=30 layer_0_host=10.138.0.2 layer_1_type=remote layer_1_range=64,127 layer_1_threads=30 layer_1_host=10.138.0.3 layer_2_type=mem layer_2_range=0,127 layer_2_threads=30 layer_3_type=file layer_3_path=/home/arktika/snow layer_3_threads=0 selected_field=7
2018-08-27 23:07:14
aikida3k
node3.conf mine_to_address=addr_here pool_host=http://snowday.fun layer_count=4 layer_0_type=remote layer_0_range=0,63 layer_0_threads=1 layer_0_host=10.138.0.2 layer_1_type=remote layer_1_range=64,127 layer_1_threads=1 layer_1_host=10.138.0.3 layer_2_type=mem layer_2_range=0,127 layer_2_threads=6 layer_3_type=file layer_3_path=/home/arktika/snow layer_3_threads=0 selected_field=7
2018-08-27 23:09:01
aikida3k
node2.conf mine_to_address=addr_here pool_host=http://snowday.fun layer_count=4 layer_0_type=remote layer_0_range=0,63 layer_0_threads=1 layer_0_host=10.138.0.2 layer_1_type=mem layer_1_range=64,127 layer_1_threads=6 layer_2_type=remote layer_2_range=0,127 layer_2_threads=1 layer_2_host=10.138.0.4 layer_3_type=file layer_3_path=/home/arktika/snow layer_3_threads=0 selected_field=7
2018-08-27 23:09:08
aikida3k
etc for node1.conf
2018-08-27 23:09:12
aikida3k
Correct?
2018-08-27 23:09:46
Rotonen
you have the ram, just mine in ram with the pool miner for now
2018-08-27 23:10:05
Rotonen
and arktika is for involving multiple computers over a lan into a single miner
2018-08-27 23:10:27
aikida3k
Yeah, I don't have the chunks downloaded either, but I have the other servers I would like to use
2018-08-27 23:10:57
Rotonen
also, the poolminer does not know how to use the chunked snowfield
2018-08-27 23:11:17
Rotonen
if your servers have the ram, just pool mine individually on them for now
2018-08-27 23:11:41
aikida3k
Anyways, I think I get it, thanks @Rotonen, @Fireduck @Clueless
2018-08-27 23:12:12
Rotonen
the next hurdle you'll climb is figuring out suitable thead counts for your hardware
2018-08-27 23:12:13
Fireduck
I use arktika with a 256gb server to share the chunks to all my other computers
2018-08-27 23:12:18
Fireduck
and max out all their cpus
2018-08-27 23:13:00
mjay
what network type are you using for this?
2018-08-27 23:13:01
aikida3k
but your 256 GB server mines, too, right?
2018-08-27 23:13:14
aikida3k
Gigabit ethernet
2018-08-27 23:14:10
mjay
@Fireduck, what network type are you using?
2018-08-27 23:14:34
mjay
I can get my hands on a couple of infiniband cards for cheap, if that would make any sense
2018-08-27 23:14:42
Fireduck
Gige
2018-08-27 23:14:59
mjay
oki, no need to invest then I guess
2018-08-27 23:15:21
Fireduck
roughly 1 gbit/s = 1 MH/s
2018-08-27 23:16:07
mjay
for one nonce this is 6*16 bytes + .. 6*37 bits for the request?
2018-08-27 23:17:18
mjay
96MB/s for 1MH/s, numbers add up :smile:
2018-08-27 23:17:46
Fireduck
Request is a big bundle
2018-08-27 23:18:46
Rotonen
i'd have a 10gig fibre to the premises, but cannot run noisy hardware so no SFP+ in house, until someone actually finally makes something sensible
2018-08-27 23:19:08
Rotonen
the macchiatobin is close, but waiting for this one https://www.crowdsupply.com/traverse-technologies/five64 Quad-core ARM64 Networking Platform with Mainline Linux Support
2018-08-27 23:30:09
Clueless
@aikida3k So, in the release zip, there should be a file `cmd_here.bat` run that and you'll have a cmd open ready for commands
2018-08-27 23:30:42
Clueless
try, `client balance` or `client help`
2018-08-27 23:50:31
aikida3k
so that's gotta be in 1.3.2, not 1.3.0
2018-08-27 23:50:45
aikida3k
i'll try that later this evening