You can probably save yourself some time by just picking up an inexpensive outlet tester (less than $10 at most home improvement stores). If you're going to test all of your outlets, this method is fast, reliable, and safe. The one I've linked will let you test ground fault interrupters (GFCIs) too.
You can do the same tests (except the GFCI) with your meter, of course. It's a matter of measuring the voltage between the three conductors on each outlet. The "hot" conductor on an outlet is the smallest (narrow) slot, and obviously the ground is the larger, round pin. It doesn't matter which way you connect the meter, and of course you'd want to be set to AC Voltage.
- Hot to Neutral: 105-125 VAC
- Hot to Ground: 105-125 VAC
- Neutral to Ground: 0
These correspond to the three lights on the outlet tester. I'd still recommend the tester for two reasons: You're not going to zap yourself with it (which you might if, say, you're not careful with the meter's probes or the wires connected to them). Newer outlets are often Tamper Resistant ("TR"), which means they have a shutter designed to block things like meter probes; but a dedicated tester won't have a problem with these.
Neither method will, unfortunately, tell you about resistance or other problems. This is very difficult to measure safely on a live circuit (with high resistance but no load, you'd still see normal-looking voltages) and is probably best left to a qualified electrician.