For all, (or most all) of your boat electronics, the ground wire goes straight to a ground buss bar that is separate from the power. It certainly doesn't go to the switch. The only thing you switch...