Yeah, I am going to leave that exception printing code in that test as a monument to how stupid that was
TLDR: new versions of grpc or netty or something will ignore your TrustManager and do whatever the hell they want
Of course I didn't find any documentation on that, I just guessed the dumbest thing I could think of and it was that