I have the same thing going on with mine. I think I am going to epoxy them in place for now and put it on my list to buy new ones when I do paint. They aren't very expensive.
If you remove the glass the part that creates the stay put force can be repaired. Some are staked in place, some are riveted and others are screwed in place.
A photo fo the mirror would help determine the way it is built.