Yes - for the 1" your are describing. The chimmy or pipe itself will be rising away from the wall. Normally behind that rock façade is a metal mesh, some type of backboard, the 2x4 framing, etc. So a 1" hole is not close to hitting the chimmy pipeflute.