Unfortunately there isn’t any way to remove extensions yet, but it was brought up before. Bug Filed on 01-04-2016: PCA9685 Bug
The toolbar on the left is only for sensors. If you make a widget for something on the extension then you will see it show up there. In your case a digital in/out widget would show up for that extension. Just pick the correct source when setting it up.