BINGO!
Neoprene gloves with the flip-tip fingers work nicely for me if it's pretty cold, but I often wear neoprene gloves with no finger tips (rather than flip-tip) into May or even June. Keeping your whole body warm will help keep your hands warm...starting with real pants, shoes and hat.