You will never be able to repair the door so it will look undamaged. Here are a couple of suggestions to repair the door so the repair isn't obvious:
If you used a hole saw and saved the door chunk that was drilled out find how it was oriented in the door. next lay the door on a flat surface. apply tape over the opening on the inside face of the door. Remove the door latch (lock) and knob (handle).
Screw a piece of wood over the tape so it completely covers the damaged section. Screw several course threaded screws to the inside edge of the damaged section. Leave about 1" of the screw head above the wood. These will be anchor points for the next step.
At this point you have some options on fill-type. 2 part epoxy is the strongest and more costly. Car filler (Bondo) is the next best filler to use. In either case place the remnants of the drilled door piece in place (if it's large and unbroken enough).
Pour in the epoxy or press in the putty. You'll need to sand the dried putty and drill for a new latch opening.