That is the way they come off. There is an O ring around the plug to seal the connection, so you could try a little silicone spray to help break the seal.