Depends on the building codes where you are located to determine if a pole barn is an acceptable structure for habitation. In most jurisdictions it would still require all of the same creature comforts such as insulation, plumbing and electrical to be habitable.
At that point it's really just a house framed like a pole barn which would give you the ability to have lots of free interior space without the need to put in supporting walls. You would most likely need some interior beams and posts but no need for full walls.
I've been to several "venues" that were old barns converted into entertainment spaces. On really hot days it seemed like you could smell the 100 year old wood leaching out the chemical smells of urine from decades of farm animals peeing on the walls. So just a thought when considering living in a barn. If it wasn't used for housing animals you probably wouldn't have the smell issue.