Rear View Mirror Problem

Is there any way I can tighten the ball joint on the moving rear view mirror? It’s very loose and everytime I drive somewhere bumpy I’d have to readjust the mirror (it’s very annoying). I’ve tried twisting it around multiple times to get it tightened but to no avail.

I can’t put my broadway on there anymore =( It’ll droop over to one side.