Sometimes there is a set screw retaining the key on the shaft, and holding the bushing solid on the shaft. Yes, removing it will allow the tapered bushing to slide off, it may need a set of pullers to remove, or some light taps from a hammer all around. Sometimes if there is a split, a...