Below is my original answer - which is still valid when looking for hidden or stolen energy usage.
However, given that your house is all electric, it is quite possible that your usage is normal. Taking some very basic Google'd round numbers, a 900 square foot house might have a 30,000 BTU furnace. That translates to almost 9 kW! If it runs only 4 hours per day, that's 1/4 of your billed 4,000 kWh/month. Colder weather = longer runtime = more kWh. Plus electric hot water, electric clothes dryer and all the regular loads, and 4,000 kWh does not appear to be unusual.
Stolen electricity is a thing. But I suspect much more common in certain areas of the world where temperatures are not measured in F. Plus much easier in apartment buildings - in fact sometimes accidentally if a building started as one tenant and was later split but the circuits not all moved to separate panels/meters correctly. Simply using a lot of power is the more likely situation, and Occam was very well-shaved.
When it is a nice day (you need to do this in the day, so you can see, and you don't want to do this in the rain or snow), do the following:
- Turn off or unplug everything electrical in your house that you can - lights, computers, hot water heater (if it is electric), phone chargers, clocks, heat & air conditioning, etc. I would probably even unplug the refrigerator, for just an hour that would be safe (just don't open it while the power is off).
- Read the meter. Read it again an hour later. There should be very low usage, if any at all. Actually, there will probably be a little usage, because there will inevitably be something you can't unplug - e.g., hardwired doorbell or thermostat transformer.
If that still shows significant usage, the next step is to turn off your main circuit breaker(s) (you could have up to 6 breakers or big fuses). Read the meter again an hour later. If the usage is down to 0 then the problem is somewhere inside your house, or at least drawn from your panel. If you get a question or complaint from one of your neighbors during this time then you likely have your answer.
If the usage is still not down to 0, then you have something wrong between the meter and your panel - likely an illegal tap of some sort. That is much harder to pin down because there is usually no safe way to cut power at that point other than to pull the meter - but that requires cooperation from the utility.