Got 5 pairs of 651's today.. cabin swap complete!

The tower is bugging me tho. The polks fit in the cans - but the grills do not fit within the lip of the can. What have you done to make them fit? I don't want to put the speaker in without the grill.. and I guess my only option is to shave down the grill.. I'm afraid I won't do a good job and it will look shoddy :/