If the castlenut is really on tight, squirt some Kano Kroil Oil or Liquid Wrench on it and let it sit for a few minutes. Then use a small brass punch and a mallet or hammer to loosen it. Be sure to remove the set screw in front of the sight first. Also, if you use a steel punch, it will bugger-up the castle nut!