The ground-neutral voltage is no big deal.  You ought to have some voltage difference if there's any load on the circuit.  

If the panel filter does nothing, That suggests the noise source is there in the barn, but I suspected that anyway.  

I would suggest turning off each electrical load in the barn, one at a time, and see if the noise goes away. 

 I suspect the fluorescent lights.  

In the common 4’ fluorescent lights, it's fairly easy to change ballasts.  The cheapie electronic ballasts can be quite noisy.  To a certain extent, ballasts are noisy by nature, but they can function on audible (2k) or inaudible (50KHz) range dependong on design.  GE makes ballasts of superlative quality for about 30% over their top tier competitors.  If the lights are the issue, try one and see if that corrects it.  

Another option is to go LED, but they too have switching power supplies so beware of quality issues.