Or should I just get a floor mat? Obviously I'd rather have the soft casters, if they do the job, but if they don't it's not worth it. What should I do?
If they are the soft urethane ones like those that are used at roller skating rinks, should be fine.
Check out the chart here and note that for hardwood floors, the wheel type is a function of (your + chair's) weight.
declaration: not affiliated, related, in hock to or friends with caster city