You have to get them pretty tight to stay in place give it another try.

I definitely can understand what your saying and why you do it that way. I prefer to do it the same way myself. That said, for those new to getting them adjusted the holes with the rubbers on is probably the best thing to shoot for. From there they can tinker a bit for a smoother transition once they get comfortable with the general position they want them adjusted at. I have had to help some friends with little experience get the adjustment right because they had it too far one way or the other but if I tell them to try to get it close to the holes then they can get them adjusted pretty well even without having too much experience with it.