Go to  (or) Settings > Wireless & networks >  Bluetooth and then press   beside the name of the device or peripheral device that you want to unpair. Then press Unpair. 

Please not that this device will be now displayed in the list of available devices. If you want to remove it from this list, turn off and then on your Bluetooth®.