Quoted from GRUMPY:I just typed my name and state into the computer and in all of Minnesota there are only two of us. And it gave me my name, phone number, address, sex and age. So I don't think there is any more harm letting Pinsiders know where I live.
In the end, this is the fundamental issue. Anyone with an internet connection and a very easy to acquire level of knowledge is very easily able to find out an alarmingly complete and detailed set of information about virtually anyone. This includes not only where you live but past addresses, phone numbers, spouses/relatives, etc. Usually it can be done for free but if you want to pay a little bit of money you can find out even more.
If a random person of the general population wants to they are almost certainly able to find out more about you than you probably want them to know. If it's a pro that is targeting you then you have no chance, none.
I suppose you could minimize it by going full infosuicide ala Mark Pilgrim, or maybe more famously Taylor Swift just recently....