My port side panel does the same thing with the stock bags. I have the WM 1345 bags and the divider support kit that I need to install I just haven't had time. I am also going to be adding some aluminum angle to add height on the engine side of the channel to prevent the divider from hopping out.
2019 Makai
Raptor 450 w/ 1.76 Trans
WakeMakers 1350s in the rear & 1K in Lead