sounds like early bittorrent client problems

maybe peek into the history of those for inspiration

yeah, I was trying to do that part quick. It has several big TODOs for improvements

evaluating the historical order of addressed issues of similar things is usually worth the trawl

yeah. I looked at the file structure a bit and the network features but not very closely

when I am looking to improve that part I will certainly look closer

I am already passing around some useful information on which nodes have which chunks

but not acting on it yet

ok, that was dumb. I ended up writing my own HTTP multipart upload parser since the apache commons one was incompresensible

A bit of the complexity in the apache commons one is dealing with situations where the files don't fit in memory, but I don't really care about that right now.