Your goats must love to climb on the rocks. I guess that is partly why they let themselves out.

Our goats get out of our fence all the time. They are perpetual 3 year olds.