I just finished tearing my office down to the studs, insulating, and then having drywall installed. The crew did the drywall install today. I have a light switch which is a dimmer that powers 4 "cans" AKA recessed lights. After the drywall install I flipped the switch and the lights came on with a loud POP noise. I turned the switch off and then on again. This time nothing happened for about 5 seconds and then the lights came on. I turned the light off and on about 50 more times and now it always works but there's a low hum that did not exist before. I suspect an electrical short situation was created during the drywall install but I'm not much of an electrician. Where should I look for problems and how should I solve this? Will my house possibly burn down?
This sounds like a rather dangerous situation. The drywall installers no doubt did not install metal straps on the studs wherever an electrical wire crossed through the stud. Most likely a drywall screw or nail has gone into the stud and entered a wire that crossed the stud in the same place.
The fix for this may require a professional electrician unless you are pretty familiar with electrical wiring work. It will be necessary to cut the power to the circuits and open all the applicable electrical boxes and disconnect the various lights, switches and power feed wires. Then shorts checks can be made using an appropriate ohm meter for all the wires in the area between the boxes.
Once the short is located it will likely be necessary to remove the drywall in that area to replace the wire.
Do not leave this problem go. It sounds like you have a medium resistance short in some wire/stud crossing. I say medium because you did not mention that it is tripping a breaker. The resistive short can produce a lot of heat and could definitely lead to a fire in your wall or ceiling.