I have the same amp and same tower speakers, and mine sounds just fine w/ just one amp. I also don't hang out blasting music with the boat off very often.

That amp runs the tower speakers and the stock cabin speakers in my boat. I have a separate amp for the sub. I can hear the music very clearly when I'm riding behind the boat. I'm actually smiling thinking of it right now.