Replace with this, it will never fall out.
Jim Black and Associates: Jim Black 4 Inch Black Boat Access Cover