The throttle side wasn't too bad, probably because I tried taking the left grip off first so I wouldn't mess up the throttle if I did something wrong!  I worked a small screwdriver under the rubber from the inboard end, then I kinda rolled it back until I pulled it off.  Had to use a dremel for a while and sand everything smooth.  Didn't have any good cleaners in my garage, so I sprayed brake cleaner on a shirt and wiped it off with that.  Applied glue and hoped I wouldn't be seen soon walking down the street with a nice grip, and both of my hands glued to my forehead.