archive snowblossom slack mining
prev 2018-12-05 next
2018-12-05 00:35:13
Fireduck
I have merkle roots
2018-12-05 00:35:22
Fireduck
But that doesn't help you
2018-12-05 02:03:16
penfold
I thought we were agreed tentacle roots is where it’s at?
2018-12-05 11:02:35
mjay
does anyone know how to actually add a http source to a torrent file?
2018-12-05 11:40:29
Rotonen
so apparently there are two competing unapproved BEPs on that https://wiki.theory.org/index.php/BitTorrentSpecification#WebSeeding
2018-12-05 11:40:50
Rotonen
one of which requires dynamicity on the webfront
2018-12-05 11:41:08
mjay
I have the links for field 7 ready
2018-12-05 11:41:13
Rotonen
and damn, getright is still around
2018-12-05 11:42:05
Rotonen
i wonder what blizzard does in its updaters
2018-12-05 11:42:20
Rotonen
or microsoft these days for that matter too
2018-12-05 11:43:14
Rotonen
seems simple enough, just add a list http://bittorrent.org/beps/bep_0019.html
2018-12-05 11:43:30
Rotonen
that should be encodable as a magnet uri as well
2018-12-05 11:43:54
mjay
url-list
2018-12-05 11:45:10
mjay
(anyone can already use the above links)
2018-12-05 11:51:55
Rotonen
@mjay so i guess just grab the current torrent, edit and try
2018-12-05 12:36:16
mjay
@Rotonen how to edit? Looks like binary
2018-12-05 13:03:01
Rotonen
last i looked they were plaintext, compression?
2018-12-05 13:03:15
Rotonen
but it has been over 10 years
2018-12-05 13:15:46
mjay
I have the raw files on the servers - I need to change url-list instead I guess
2018-12-05 17:21:04
Rotonen
or just make a magnet uri of it and add ws= parametres to the query string
2018-12-05 17:21:51
Rotonen
and add the tracker as a tr=
2018-12-05 17:22:08
Rotonen
and urlencode
2018-12-05 17:23:00
Rotonen
http://torrent2magnet.com/ Torrent to Magnet online converter
2018-12-05 17:23:27
Rotonen
magnet uris are IMO neater to deal with than .torrent files
2018-12-05 17:35:06
Rotonen
the info hash for field 7 is 9760e073e3cf6dbe6f2525040f1550b8d3a73eb6
2018-12-05 17:36:17
Rotonen
so that as btih, tr pointing to the tracker of @Fireduck and multiple ws parametres pointing to the servers should do the trick
2018-12-05 17:36:43
Rotonen
some assembly required, cannot conveniently enough pull that off on a mobile
2018-12-05 17:42:47
Clueless
I'll probably setup a tracker as well
2018-12-05 17:45:42
Rotonen
DHT should cover most users
2018-12-05 17:45:52
Rotonen
or just using open trackers
2018-12-05 17:46:09
Rotonen
unless you explicitly want to monitor the swarm easier
2018-12-05 23:06:34
mjay
can someone set this up? torrents are nothing I'm experienced with
2018-12-05 23:09:22
mjay
My part is setting up the mirrors
2018-12-05 23:13:31
Rotonen
at a terminal now, will try
2018-12-05 23:15:06
mjay
field 8 and 9 are also ready, same ip's
2018-12-05 23:16:16
Rotonen
so, starting point, here is a valid magnet uri for the field 7 torrent `magnet:?xt=urn:btih:9760e073e3cf6dbe6f2525040f1550b8d3a73eb6`, next step is to add the tracker to that
2018-12-05 23:21:18
Rotonen
working magnet uri with the tracker in there `magnet:?xt=urn:btih:9760e073e3cf6dbe6f2525040f1550b8d3a73eb6&tr=http%3A%2F%2Ftracker.1209k.com%2Fannounce`
2018-12-05 23:21:37
Clueless
goes to setup a tracker
2018-12-05 23:21:43
Clueless
@Rotonen you suggest any trackers?
2018-12-05 23:21:51
Rotonen
no, i roll with DHT
2018-12-05 23:21:57
Rotonen
i do not see the point of trackers
2018-12-05 23:25:34
Rotonen
@mjay not a 100% on how that works for directories and not single file torrents - can you symlink or move the one on 136.243.82.213 to match the directory structure from the torrent? it could be fine you just offer one of the files (as in the large one), but i suppose it needs to match the file list by path
2018-12-05 23:25:54
Rotonen
at least pointing the webseed parametre at the file or the root of the server does nothing for me
2018-12-05 23:26:45
Rotonen
heh, getright documented it well enough http://getright.com/seedtorrent.html Award-winning GetRight download manager software for Windows. For faster download speeds, automated downloads, and more, download GetRight today!
2018-12-05 23:27:29
Rotonen
`For Multi-File torrents, this gets a bit more interesting. Normally, BitTorrent clients use the "name" from the .torrent info section to make a folder, then use the "path/file" items from the info section within that folder. For the case of Multi-File torrents, the 'url-list' should be a root folder where a client could add the same "name" and "path/file" to create the URL for the request. ` so yeah, as suspected, you need to have the subdirectory structure as it is in the .torrent
2018-12-05 23:28:36
Rotonen
and it will get the file list / other metadata from the peers once it finds any off the dht or off the tracker
2018-12-05 23:28:56
Rotonen
so i guess that's fine so long as there are > 0 peers
2018-12-05 23:29:17
Rotonen
but dunno if i can actually encode that into the magnet uri itself, but figuring that out should come later
2018-12-05 23:32:11
Rotonen
so preliminary full answer `magnet:?xt=urn:btih:9760e073e3cf6dbe6f2525040f1550b8d3a73eb6&dn=snowblossom.7&tr=http%3A%2F%2Ftracker.1209k.com%2Fannounce&ws=http%3A%2F%2F136.243.82.213%2F`
2018-12-05 23:32:21
Rotonen
and the tracker may be omitted by anyone whom dislikes trackers
2018-12-05 23:32:24
mjay
I moved it over to this directory
2018-12-05 23:32:49
Rotonen
anything in your access log?
2018-12-05 23:33:41
mjay
213.55.165.17 - - [06/Dec/2018:00:33:31 +0100] "-" 408 0 "-" "-"
2018-12-05 23:33:47
mjay
thats probably not you
2018-12-05 23:34:12
Rotonen
that is me, but via a browser
2018-12-05 23:37:36
Rotonen
but where i'm testing from is ``` 144.76.2.138/27 144.76.46.6/29 144.76.2.153/27 2a01:4f8:190:7289::4/64 2a01:4f8:190:7289::3/64 2a01:4f8:190:7289::2/64 ```
2018-12-05 23:38:18
mjay
not in the logs
2018-12-05 23:38:29
Clueless
``` 15:27:28 torrents.public Torrent a3647e5b5ac9685eb40f738f858e3e976f734ed1 - snowblossom.9 - <2 Available Seeders 10m 42s No 2 actions 15:27:28 torrents.public Torrent 7f66b2966d92d368ace6160a94cd0304f4766831 - snowblossom.11 - <2 Available Seeders 10m 42s No 2 actions ```
2018-12-05 23:38:35
mjay
no 144.76.x.x at all
2018-12-05 23:39:09
Rotonen
7 is very busy so i get full 1gbit saturation on the downlink from the swarm, put the 8 up that way as well
2018-12-05 23:39:24
Rotonen
could be it just prefers low latency, i'm assuming you're on a different continent
2018-12-05 23:39:37
mjay
try pinging it
2018-12-05 23:39:41
mjay
should be quite fast
2018-12-05 23:40:04
Rotonen
fair enough, seems you're just a few racks over in falkenstein actually :stuck_out_tongue:
2018-12-05 23:40:13
mjay
:wink:
2018-12-05 23:40:50
Rotonen
heh, 200 microsecond pings, their network is pretty good
2018-12-05 23:42:06
mjay
move snowblossom.8 also over to a directory?
2018-12-05 23:42:12
Rotonen
yes
2018-12-05 23:42:51
Clueless
once I've finished downloading those fields, they'll be up to the 2 or so.
2018-12-05 23:43:36
Clueless
@Rotonen do magnet links work without a tracker?
2018-12-05 23:43:38
Rotonen
seems i forgot the trailing slash in the 7 uri actually
2018-12-05 23:43:55
Rotonen
@Clueless all torrents work without a tracker, it's not a metadata dependent feature
2018-12-05 23:44:18
Clueless
neat, so they can work dht without tracker, nice
2018-12-05 23:44:28
Rotonen
the only thing you actually need is the content hash, then it discovers peers until it finds one whom can give the full set of metadata for that
2018-12-05 23:44:32
Clueless
never looked into DHT tables before
2018-12-05 23:44:50
Rotonen
but of course if you have a http accessible tracker, that helps people in networks with certain restrictions
2018-12-05 23:45:05
Rotonen
and the other way around, dht helps people in other situations
2018-12-05 23:45:38
Rotonen
i just like the elegance of `magnet:?xt=urn:btih:9760e073e3cf6dbe6f2525040f1550b8d3a73eb6` being a 100% valid way to grab field 7
2018-12-05 23:47:54
Rotonen
@mjay anything in the logs?
2018-12-05 23:48:20
mjay
148.251.122.19 - - [06/Dec/2018:00:09:39 +0100] "GET /snowblossom.8.snow HTTP/1.1" 200 154559569232 "-" "Wget/1.18 (linux-gnu)"
2018-12-05 23:48:43
mjay
oh well thats me :wink:
2018-12-05 23:48:47
mjay
no nothing
2018-12-05 23:48:59
Rotonen
also getting link saturation on field 8
2018-12-05 23:49:13
Rotonen
but `magnet:?xt=urn:btih:a83c3c8e5a8f68ffb1004dd0e62d380b6fa46805&dn=snowblossom.8&tr=http%3A%2F%2Ftracker.1209k.com%2Fannounce&ws=http%3A%2F%2F136.243.82.213%2Fsnowblossom.8%2F`
2018-12-05 23:49:54
mjay
moved all files in directories, on all servers
2018-12-05 23:51:33
mjay
37.201.195.53 - - [06/Dec/2018:00:50:45 +0100] "GET /snowblossom.8/snowblossom.8/snowblossom.8.deck.b HTTP/1.1" 404 487 "-" "Transmission/2.92" 37.201.195.53 - - [06/Dec/2018:00:50:45 +0100] "GET /snowblossom.8/snowblossom.8/snowblossom.8.deck.a HTTP/1.1" 404 487 "-" "Transmission/2.92" 37.201.195.53 - - [06/Dec/2018:00:50:45 +0100] "GET /snowblossom.8/snowblossom.8/snowblossom.8.deck.a HTTP/1.1" 404 487 "-" "Transmission/2.92" 37.201.195.53 - - [06/Dec/2018:00:50:45 +0100] "GET /snowblossom.8/snowblossom.8/snowblossom.8.snow HTTP/1.1" 404 485 "-" "Transmission/2.92" 37.201.195.53 - - [06/Dec/2018:00:50:47 +0100] "GET /snowblossom.8/snowblossom.8/snowblossom.8.deck.b HTTP/1.1" 404 487 "-" "Transmission/2.92" 37.201.195.53 - - [06/Dec/2018:00:50:47 +0100] "GET /snowblossom.8/snowblossom.8/snowblossom.8.deck.a HTTP/1.1" 404 487 "-" "Transmission/2.92" 37.201.195.53 - - [06/Dec/2018:00:50:47 +0100] "GET /snowblossom.8/snowblossom.8/snowblossom.8.snow HTTP/1.1" 404 485 "-" "Transmission/2.92" 37.201.195.53 - - [06/Dec/2018:00:50:47 +0100] "GET /snowblossom.8/snowblossom.8/snowblossom.8.deck.a HTTP/1.1" 404 487 "-" "Transmission/2.92"
2018-12-05 23:51:44
mjay
thats me using the magnet link above
2018-12-05 23:52:20
mjay
well, i could add another directory ...
2018-12-05 23:52:57
Rotonen
yeah, it's a bit dumb as it seems to add the display name to it
2018-12-05 23:53:06
Rotonen
but that's sorta in the spec, maybe
2018-12-05 23:53:19
mjay
add another dir?
2018-12-05 23:54:21
Rotonen
so field 8 deeper url `magnet:?xt=urn:btih:a83c3c8e5a8f68ffb1004dd0e62d380b6fa46805&dn=snowblossom.8&tr=http%3A%2F%2Ftracker.1209k.com%2Fannounce&ws=http%3A%2F%2F136.243.82.213%2Fsnowblossom.8%2Fsnowblossom.8%2F`
2018-12-05 23:54:54
Rotonen
does that nesting also happen for you if you strip the `dn=` parametre out of the query string?
2018-12-05 23:55:43
mjay
37.201.195.53 - - [06/Dec/2018:00:55:33 +0100] "GET /snowblossom.8/snowblossom.8/snowblossom.8/snowblossom.8.deck.a HTTP/1.1" 404 501 "-" "Transmission/2.92"
2018-12-05 23:55:47
mjay
with the link above
2018-12-05 23:56:01
Rotonen
oh
2018-12-05 23:56:07
Rotonen
so one less
2018-12-05 23:56:09
Rotonen
neat
2018-12-05 23:56:36
Rotonen
`magnet:?xt=urn:btih:a83c3c8e5a8f68ffb1004dd0e62d380b6fa46805&dn=snowblossom.8&tr=http%3A%2F%2Ftracker.1209k.com%2Fannounce&ws=http%3A%2F%2F136.243.82.213%2F` ?
2018-12-05 23:57:12
Rotonen
that's neat
2018-12-05 23:57:27
Rotonen
so you just point the webseed at the root of your webserver
2018-12-05 23:57:32
Rotonen
https://www.urlencoder.org/ Decode from or Encode to URL encoded (also known as Percent-encoded) format - Here, with our simple online tool.
2018-12-05 23:57:47
Rotonen
just urlencode and add more `&ws=` things into the query string
2018-12-05 23:58:20
Rotonen
and use any torrent inspector to grab the hash from the .torrent files
2018-12-05 23:58:47
Rotonen
and remember to amend the `dn=` to match the field name
2018-12-05 23:59:43
Rotonen
@Fireduck would you mind switching your .torrent files to magnet uris on the site? makes it easier to point to http(s) seed sources