So after hosing down the bathroom, I started to hear some cracking. I looked at the tiles and they were bulging out from the center. I guess water got into the top and loosened the tiles.
I started to gently remove the very loose tiles by hand, so they wouldn't fall and break. The wall is concrete and the remaining adhesive is pretty rock hard. Not sure if I should remove it all and re tile or is this fixable?