archive snowblossom slack dev
prev 2018-06-09 next
2018-06-09 05:57:33
GitHub
[snowblossomcoin/snowblossom] Release - 1.0.6 - pooled mining
2018-06-09 06:14:58
Fireduck
@bl0ckchain can I use those arts you uploaded?
2018-06-09 06:25:21
bottob88
Does the 1.0.6 release have improvements for linux too? Afaik it’s only small changes and some for windows
2018-06-09 06:26:43
Fireduck
@bottob88 yeah, nothing much in 1.0.6. Mostly just packaging in PoolMiner
2018-06-09 06:29:09
Fireduck
@bl0ckchain I did weird shit to it, I hope you can forgive me
2018-06-09 09:30:27
bl0ckchain
no problem you make what you want with it :slightly_smiling_face:
2018-06-09 09:52:18
bl0ckchain
favicon on the explorer look good :wink:
2018-06-09 17:49:44
Tyler Boone
I'm thinking the best way to make a decent explorer is to have something that is running and pumping all the data into a SQL database and then host a website off the SQL database
2018-06-09 17:50:42
Fireduck
Maybe. At Bitcoin scale that doesn't work very well, at least not with MySQL
2018-06-09 17:51:45
Fireduck
If you need other data views you can stub them out and tell me to write them
2018-06-09 17:52:06
Clueless
@Tyler Boone Databases are usually more for complex and large lookups and referencing and such.
2018-06-09 17:52:25
Clueless
These blockchains to some referencing, but it's mostly static.
2018-06-09 17:52:47
Clueless
It'd be best to do some sort of direct IO based recording in a determinisitic fashion?
2018-06-09 17:53:08
Clueless
Lower the database overhead, ram requirement, and do lookups basically as needed (for an explorer)
2018-06-09 17:53:27
Tyler Boone
it depends on what you want the explorer to do
2018-06-09 17:53:43
Tyler Boone
for example, how can I list all outgoing transactions from an address?
2018-06-09 17:53:47
Tyler Boone
maybe it's possible with the trie
2018-06-09 17:53:56
Tyler Boone
but if not, then you have to iterate the entire blockchain
2018-06-09 17:54:10
Clueless
We're not trying to cross reference, **give me all the >20 age, green eyed, people that liked milk, and show them all the ads for egg related products**
2018-06-09 17:55:04
Clueless
I think you'd build an address index
2018-06-09 17:55:11
Tyler Boone
yes, but we are trying to serve views of data quickly and at minimal expense
2018-06-09 17:56:02
Tyler Boone
"build an address index". build that in what?
2018-06-09 17:56:54
Clueless
I'm advising against a database , because they have tons of overhead aimed at tons of overkill procedures we don't need.
2018-06-09 17:57:23
Fireduck
We need an address history index for like clients anyways I plan on making it
2018-06-09 17:57:45
Clueless
We're interested in just the referencing. For each block, index each transaction, index the the amount in address, reference list of transactions to addresses
2018-06-09 17:58:43
Clueless
@Fireduck Sweet, so if you make the framework for clients to go back, 10-100 blocks, we could just extend that to nodes or explorer to do it for the entire chain.
2018-06-09 17:59:44
Tyler Boone
if the trie contains the data and a way to traverse it, then a client would request just the trie nodes needed.
2018-06-09 17:59:46
Clueless
*we* lel
2018-06-09 18:00:01
Clueless
I don't know how that works. :P
2018-06-09 18:00:15
Fireduck
Trie is only utxo
2018-06-09 18:00:30
Tyler Boone
OK, well that answers that
2018-06-09 18:00:32
Fireduck
Need separate address history
2018-06-09 18:00:43
Clueless
I think a simple address index would do nicely
2018-06-09 18:00:48
Clueless
We just limit the size for the application.
2018-06-09 18:01:50
Clueless
Clients need last 10 blocks to see they received a payment, from a person at time, whatever. Nodes need last 1000 blocks worth, because a family might collectively review payments. Explorer stores entire chain's worth of index.
2018-06-09 18:02:19
Clueless
but I don't actually know. >.>
2018-06-09 18:18:00
Tyler Boone
@Fireduck, in snowblossom.proto TransactionInner has a CoinbaseExtras, but the class generated from that (TransactionInner) doesn't have it. am I insane?
2018-06-09 18:19:00
Tyler Boone
I am insane
2018-06-09 18:19:04
Tyler Boone
it's there
2018-06-09 18:20:17
Fireduck
Yep
2018-06-09 18:20:41
Fireduck
I plan on making address_idx an optional node option like tx_index
2018-06-09 18:20:43
Tyler Boone
I was mistyping because I'm on my laptop
2018-06-09 18:20:56
Fireduck
To better serve light clients and explorer
2018-06-09 18:21:32
Tyler Boone
ok
2018-06-09 18:21:38
Tyler Boone
makes sense
2018-06-09 18:22:05
Tyler Boone
just to confirm what that means. it's a new map in the DB class which will be saved onto disk using rocksDB
2018-06-09 18:22:26
Tyler Boone
so a new key-value lookup stored by the node
2018-06-09 18:24:15
Fireduck
Yes
2018-06-09 18:24:44
Fireduck
Using range queries in rocksdb for speed but you get the idea
2018-06-09 18:25:14
Fireduck
Since it is key to set rather than key to single value
2018-06-09 18:25:38
Fireduck
Old hat from my jelectrum days
2018-06-09 18:25:51
Tyler Boone
what kind of "set"?
2018-06-09 18:26:10
Tyler Boone
you have an example in here already?
2018-06-09 18:33:04
Fireduck
For an address the set of transactions involving it
2018-06-09 18:37:34
Tyler Boone
end of the day a ProtoDbMap stores a single message for a single value
2018-06-09 18:37:51
Tyler Boone
obviously a message can have a list in it. is that what you mean?
2018-06-09 18:37:56
Fireduck
Yes. Won't be using that.
2018-06-09 18:38:02
Tyler Boone
ok
2018-06-09 18:38:20
Fireduck
Don't want to rewrite entire set on new entry
2018-06-09 18:38:41
Fireduck
You can look in jelectrum code for set map examples
2018-06-09 18:38:54
Fireduck
I'll do something similar but better
2018-06-09 18:39:00
Fireduck
I know more now
2018-06-09 18:50:36
Fireduck
Basically key: address/txid value: null
2018-06-09 18:50:57
Fireduck
Query is get everything that starts with address/
2018-06-09 18:51:12
Fireduck
Rocks does that fast
2018-06-09 18:53:42
Tyler Boone
ah
2018-06-09 18:54:55
Fireduck
In Bitcoin some addresses have a million tx
2018-06-09 18:57:51
Tyler Boone
hmm, just started a new node with new db on my laptop and haven't had any indication of progress for 5 minutes...
2018-06-09 19:01:05
Fireduck
There is an open issue for that.
2018-06-09 19:01:21
Fireduck
No feedback while downloading headers
2018-06-09 19:02:30
Tyler Boone
in snowdb what is the 00003.log file?
2018-06-09 19:02:48
Tyler Boone
it's binary which is weird
2018-06-09 19:02:56
Tyler Boone
I would expect logs to be text
2018-06-09 19:03:42
Fireduck
It is rocks write ahead log
2018-06-09 19:03:48
Fireduck
Aka db journal
2018-06-09 19:04:27
Tyler Boone
ok
2018-06-09 19:12:48
Fireduck
@Clueless Can you give me a chunk of your pool logs? i want to know how fast and hard the shares are coming in to know how to prioritize issuing dynamic share difficulty to miners
2018-06-09 19:13:31
Tyler Boone
collusion!
2018-06-09 19:13:34
Clueless
still kicking myself on not having file logging yet, but luckily the systemd setup I scripted for everyone logs to syslog by default. :D
2018-06-09 19:18:30
Tyler Boone
hmmmm, I added a println statement into considerBlockHeader and I'm not seeing anything. let me see if I can get a stacktrace
2018-06-09 19:19:20
Fireduck
Might be not getting in touch with any peers
2018-06-09 19:20:06
Tyler Boone
WARNING: Please consider reporting this to the maintainers of com.google.protobuf.UnsafeUtil WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release Jun 09, 2018 12:16:38 PM snowblossom.node.BlockIngestor <init> INFO: Loaded chain tip: 0 00000023440885bee85d7664235028ce89e21dae18edbdda2fe2ba35e3b664b7 Jun 09, 2018 12:16:38 PM snowblossom.node.Peerage <init> INFO: Loaded 183 peers from database Jun 09, 2018 12:16:38 PM snowblossom.node.Peerage start INFO: Starting peerage
2018-06-09 19:20:11
Tyler Boone
looks likely
2018-06-09 19:21:12
Fireduck
Many of those peers don't actually accept connections
2018-06-09 19:21:20
Tyler Boone
a-holes
2018-06-09 19:21:26
Fireduck
It could take a while to find one that does
2018-06-09 19:21:35
Fireduck
Open an issue
2018-06-09 19:22:13
Fireduck
Maybe add a known good flag or use some of the peer info values for that
2018-06-09 19:24:08
GitHub
probably connecting to lots of bad peers.
2018-06-09 19:24:51
Tyler Boone
ok, lunch time
2018-06-09 19:43:49
GitHub
[snowblossomcoin/snowblossom] Issue opened by fireduck64
2018-06-09 19:44:17
GitHub
[snowblossomcoin/snowblossom] Issue opened by fireduck64
2018-06-09 22:04:48
GitHub
[snowblossomcoin/snowblossom] Issue closed by fireduck64
2018-06-09 23:08:20
GitHub
[snowblossomcoin/snowblossom] Issue closed by fireduck64
2018-06-09 23:35:55
Tyler Boone
sigh... hacking on a someone else's already hacky codebase is hard
2018-06-09 23:38:24
Fireduck
Sorry, I did try to make it not a hack but had a tight timeline
2018-06-09 23:40:42
Tyler Boone
it's understandable
2018-06-09 23:40:51
Tyler Boone
actually I was just saved by one of our conversations
2018-06-09 23:41:03
Tyler Boone
I'm working on the hybrid mem-disk miner
2018-06-09 23:41:09
Tyler Boone
and I was getting shit hashrate
2018-06-09 23:42:16
Tyler Boone
and I remember you said you got shit hashrate because of sharing file handles across threads.
2018-06-09 23:44:14
Fireduck
Sweet, the hybrid miner should be fun
2018-06-09 23:45:04
Tyler Boone
looks like I it is starting to work...
2018-06-09 23:45:21
Tyler Boone
not as big an improvement as I was expecting. I might be doing something stupid...
2018-06-09 23:45:50
Tyler Boone
I mean... stupidity guaranteed
2018-06-09 23:47:34
Tyler Boone
INFO: Mining rate: 96518.365/sec - at this rate 1271.742 hours per block
2018-06-09 23:48:21
Tyler Boone
probably need to get a little more clever like we were talking about to take advantage of the memory more
2018-06-09 23:50:45
Fireduck
Probably a synchronize problem
2018-06-09 23:52:47
Tyler Boone
are you not operating a pool?
2018-06-09 23:55:05
Fireduck
Nope