It's possible that it is going bad. I had the actual keyed ignition switch fail in my boat. Sometimes it would start, sometimes not. It seemed worse when the engine was cold and I thought it was a fuel issue for a while. I "found" it by just turning the switch from OFF to ON and sometimes I would hear the fuel pump, sometimes not. If I "jiggled" the key, it would activate the fuel pump.
Hope this has been some help.
1997 MasterCraft 205
2008 Moomba Outback
1999 MasterCraft Sportstar OB
1992 MasterCraft 205
1999 Malibu Response LX
1987 Marlin Magnum Skier