Removing friction fit hand grips can be very difficult if approached incorrectly! They are not made to simply come off by pulling on them. There are a few different ways to remove grips depending on what tools you have. The simplest ways are explained in the video below.
If your bike has lock on grips, You will just need the correct sized Allen wrench to loosen the lock collars, then the grip slides right off.