Prism values are because your eyes are not aligning properly, so I imagine it messes up your depth perception at best, and gives you double vision at worst.
However for shooting, it's a non-issue. You are aiming with one eye, so all of that goes away.
The only thing I'd say is in considering options of if you add power to a set of glasses, or add a lens in the hood, I would keep my distance vision glasses with the prism value, and just add a +0.50 in the hood of the rifle, so you don't have to put on/take off/put on/take off your glasses every time you take a shot.