Many years ago when I mounted an analog TV antenna on a roof, the kit came with some of what looked like chewing gum that I thought was plumbers' putty, but may have been tar (thanks @EcnerwalEcnerwal!). The tar sticks went under the leg plates of the antenna stand, and the screws went through the tar sticks. For the year I had the house, I didn't see a leak.
I would try adding tar around the bolts, with some fender washers: