It is difficult to test without a ground reference. One way to do this is with a very sensitive (very high impedance) voltmeter such as a digital voltmeter. Make absolutely sure you are not grounded (and no pets or children are around). Make sure the digital voltmeter is definitely on the voltage setting. Plug one probe into one hole of the outlet, while the other probe is stretched out some distance. There should be a "phantom voltage" reading of somewhere between a few volts to nearly the full line voltage (for you in North America that would be around 120 volts) when plugged into the hot side. On the cold (neutral) side, there can also be some phantom voltage but it should be much less.
There is a potential harm in having the polarity reversed. Lamps with screw in bulb sockets should always be polarized so the rim of the socket (which is more easily touched) is connected to the cold side. That way to be shocked you'd have to stick your finger all the way inside the socket (you would not do that). With the polarity reversed, the hazard exists at the rim, which may have some exposure even with the bulb all the way in.
The hazard can also exist with older appliances that have the cold side intentionally connected to the appliance metallic frame. That was the only way to make them safer before the grounded outlets became widespread. But it required the outlet polarity be correct.
You can mitigate the hazard by using a ground fault current interrupting (GFCI) receptacle even without a ground wire available. These devices do their intended function even without a ground wire attached. The test button also should work (it cheats by running its 5ma current test between hot on the load side and neutral on the supply side ... not ground). If you find a device where the test function fails to trip it, do not use it. Mark the device as "UNgrounded" for circuits with no ground available. Do not use an alternate ground source that is not part of the supply cable for this purpose. Never use the neutral as a ground.
The most common hazard to people is being grounded when coming into contact with one wire that happens to be hot. The GFCI will trip in this situation even though the current is as low as 2ma. If a metal appliance has internally faulted where a hot wire has nicked or damaged insulation and is contacting the frame, this hazard exists with the frame of the appliance. In grounded situations the ground wire would cause that to short circuit.