2018-06-26 00:02:29
@Clueless @Fireduck should I be getting 0h/s while hybrid mining loads cache into mem?
Shoots
2018-06-26 00:02:47
I don't remember, but I think so
Clueless
2018-06-26 00:02:53
once it's loaded, what do you get?
Clueless
2018-06-26 00:03:04
it never seems to fully load
Shoots
2018-06-26 00:03:08
and it stays at 0
Shoots
2018-06-26 00:03:39
Shoots
2018-06-26 00:17:26
Usually what happens is out of memory error and then it restarts. Not ideal. On bug list.
Fireduck
2018-06-26 00:19:16
I think @Tyler Boone is in charge of that
Fireduck
2018-06-26 00:19:23
@Tyler Boone has joined the channel
Tyler Boone
2018-06-26 00:20:14
People like being volunteered for things, right,?
Fireduck
2018-06-26 02:01:58
So now I'm trying to use the prebuilt release. It only uses 170gb compared to 210 with the other miner that I built, but it doesn't seem to be fully utilizing the cores. Its only using about half of my cpu and the hr is only half of what it should be. Threads are set to 96 on a 48core
Shoots
my hash too low only 1.48M
Am I setting something wrong?
2018-06-26 12:37:52
@ppp is mining in memory and is getting about 1.48M/s I think this is normal, can anyone verify if that looks right?
Clueless
2018-06-26 12:45:30
@Shoots was speaking of that 2 weeks ago, i think its because of threading, each thread take a part ram to ping pong through hash and mine, more thread > more ram used , prebuilt dont use much ram but not enough precached to ba able to maximize core use, build from source use core at max but at the cost of more ram by thread, but probably to much depending on the freq of you core.
bl0ckchain
2018-06-26 12:49:39
I suggest you try this, given that you are running into a thread limit.
1. Turn off your miners.
2. Create a "Ram Disk" using a windows utility
(a ram disk make a *temporary* disk in ram, that shows up like *D:/*)
3. *copy* (do not delete/move) *copy* the snow folder to the ram disk
4. Modify your miner.conf to use the new disk, eg `snow_path=D:/snow`
4. Run *multiple miners*
You'll be able to use more than 64 threads
Clueless
2018-06-26 12:49:43
---
Clueless
2018-06-26 12:50:09
But, that might not help at all. You might already be saturating your ram IO
Clueless
2018-06-26 15:00:11
@Clueless you’re just adding syscall overhead per seek there
Rotonen
2018-06-26 15:00:57
@ppp that’s not bad - how many memory channels?
Rotonen
2018-06-26 15:13:57
network hashrate is piling back on
Shoots
2018-06-26 15:32:14
`15.453 minutes per share ` wow
stoner19
2018-06-26 15:32:36
@stoner19 at what diff?
Rotonen
2018-06-26 15:32:40
29
stoner19
2018-06-26 15:33:03
Did the pool upgrade to the latest check-in?
Fireduck
2018-06-26 15:33:07
how’d the diff creep up that high for you?
Rotonen
2018-06-26 15:33:13
no idea
stoner19
2018-06-26 15:33:27
Makes diff increase for pool shares less aggressive
Fireduck
2018-06-26 15:33:30
@Fireduck is it the pool or the miner?
Rotonen
2018-06-26 15:34:19
still would be nice to know who is running vauxhall. still no stats coming from them other than on the explorer page about what blocks they get
stoner19
2018-06-26 15:34:29
@Fireduck bumped my pool yesterday as i saw diff 30 on a miner of mine - now it drops miners from stats if their diff creeps up too high
Rotonen
2018-06-26 15:35:45
damn vauxhall just got 7 blocks in 15 minutes
Shoots
2018-06-26 15:35:50
I have a feeling they have a lot of hr
Shoots
2018-06-26 15:36:26
@Shoots seems like the early whale - also pumped diff at will
Rotonen
2018-06-26 15:36:58
yeah 5yg at it again
Shoots
2018-06-26 15:37:22
he was with us on protopool but it went down last night, ran out of mem again. Protovist has it back up and running and I think he has it setup to restart now
Shoots
2018-06-26 15:37:40
seems like the pool has a memory leak or something
Shoots
2018-06-26 15:37:53
ate through 24gb of memory like nothing
Shoots
2018-06-26 15:38:22
mine has yet to exceed 300MB, but i have a managed jvm where i slot that in
Rotonen
@Rotonen two
2018-06-26 15:51:45
@ppp sounds implausibly high for a dual channel system - which processor?
Rotonen
2686v3
2018-06-26 16:50:44
@ppp that’s a 4 channel processor
https://ark.intel.com/products/81055/Intel-Xeon-Processor-E5-2683-v3-35M-Cache-2_00-GHz
i’m getting about 850k per socket on haswell E5s - you have two sockets? Intel® Xeon® Processor E5-2683 v3 (35M Cache, 2.00 GHz) quick reference guide including specifications, features, pricing, compatibility, design documentation, ordering codes, spec codes and more.
Rotonen
2018-06-26 16:52:06
@Rotonen The pool drops miners from stats if they get too high? That sounds like correct or reasonable at all. Is that something you can reproduce?
Fireduck
@Rotonen How many memory sticks can build four channels
x10dai
2018-06-26 18:20:24
@Shoots the pool really shouldn't have any memory problems. Not impossible since it has to keep a bunch of pending work units and share information in memory but it really shouldn't happen.
Fireduck
2018-06-26 19:00:47
@Fireduck ’toi high’ as in something like over 1h per share
Rotonen
2018-06-26 19:01:49
@ppp you are confused over terms and what is what - go read up on motherboard block diagrams and also on how memory channels work
Rotonen
2018-06-26 19:02:43
@Fireduck at this point i find it more likely the operator gave the pool a high heap size and then the oom reaper did its thing
Rotonen
2018-06-26 19:24:39
@Rotonen ok, cool. That all makes sense.
Fireduck
2018-06-26 19:54:06
@Fireduck Jun 26, 2018 5:14:24 AM snowblossom.miner.MiningPoolServiceAgent recordShare
INFO: Share recorded for snow:vx8pglccl7nepzre9h3fraetreqn924yw7mlww4s - (32 sha
res) (134217728 hashes)
OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x0000000723880000, 24
641536, 0) failed; error='Cannot allocate memory' (errno=12)
Protovist
2018-06-26 19:54:36
32GB VM
Protovist
2018-06-26 19:54:41
@Protovist can you tell me what jvm args that was run with?
Fireduck
2018-06-26 19:55:17
default
Protovist
2018-06-26 19:57:24
2895 ubuntu 20 0 13.784g 1.379g 24160 S 0.3 4.5 0:56.76 java
Protovist
2018-06-26 19:57:39
Will check it later to see if it's grown. :slightly_smiling_face:
Protovist
2018-06-26 19:58:10
it should be no where near that large
Fireduck
2018-06-26 19:58:14
looking into it
Fireduck
2018-06-26 21:03:56
@Protovist is it possible someone is mining with a huge fleet (thousands of clients) ?
Fireduck
2018-06-26 21:04:23
It was around 500 at the peak IIRC.
Protovist
2018-06-26 21:04:40
hum, that should be no problem
Fireduck
2018-06-26 21:04:46
currently 159 workers
Protovist
2018-06-26 21:04:58
I don't see a way where the memory would go out of control
Fireduck
2018-06-26 21:18:25
If you were to capture a heap dump while running, that would be helpful
Fireduck
2018-06-26 21:19:53
jmap -dump:format=b,file=dump.bin PID
Fireduck
2018-06-26 21:20:54
and send me that stupid file
Fireduck
2018-06-26 21:21:25
or open it up in mat and tell me what the hell is has way too many of: https://www.eclipse.org/mat/ The Eclipse Foundation - home to a global community, the Eclipse IDE, Jakarta EE and over 350 open source projects, including runtimes, tools and frameworks.
Fireduck
2018-06-26 21:21:39
Basically, the the pool any object we have more than 100,000 of is wrong
Fireduck
2018-06-26 22:09:24
here's an example of something which will probably not be great for snowblossom, but will lure people with price:
https://www.anandtech.com/print/13010/realtek-nvme-pcie-rts5762-rts5763dl-controllers New Realtek PCIe 3.0 x4 NVMe Controllers: RTS5762 & RTS5763DL up to 3.5 GB/s
Rotonen
2018-06-26 22:10:05
basing on the fact random reads are almost hidden in all materials
Rotonen
2018-06-26 22:10:07
I remember back when realtek was the bane of any networked pc
Fireduck
2018-06-26 22:11:27
and the enterprise connector space is getting confusing:
https://www.anandtech.com/print/13015/aic-shows-dual-nf1-to-u2-ssd-adapter AIC Shows Dual NF1 to U.2 SSD Adapter
Rotonen
2018-06-26 22:12:12
but hey, more passive small stuff (seasonic does not do sfx so silverstore reigns there):
https://www.anandtech.com/print/13019/silverstone-launches-nj450sxl-psu-fanless-sfx-l-450w Silverstone Launches NJ450-SXL Power Supply: Fanless SFX-L, 80Plus Platinum, 450W
Rotonen
2018-06-26 22:13:13
very cool
Fireduck
2018-06-26 22:14:01
probably not, but robust :stuck_out_tongue:
Rotonen
2018-06-26 22:14:24
right
Fireduck
2018-06-26 22:14:29
one probably wants that at the top of a case and nothing else on top of it
Rotonen
2018-06-26 22:14:48
what if the cat likes to sleep there?
Fireduck
2018-06-26 22:15:07
cats are self directing in that, they'll just move away if it's not pleasant
Rotonen
2018-06-26 22:15:23
the psu should not care, unless the cat goes into the case and into the air inlet
Rotonen
2018-06-26 22:15:34
but then the psu is probably not the biggest issue at that point
Rotonen
2018-06-26 22:15:54
I usually have a least a few systems with no case
Fireduck
2018-06-26 22:17:49
wall mounting is an art form
Rotonen
2018-06-26 22:18:09
power 9 and epyc look pretty damn good for snowblossom based on the pg and 7zip benchmarks
https://www.phoronix.com/scan.php?page=article&item=power9-talos-2&num=4 Phoronix is the leading technology website for Linux hardware reviews, open-source news, Linux benchmarks, open-source benchmarks, and computer hardware tests.
Rotonen