Hi, yes the red caps need to be removed before inserting the new filter. As far as removing them now, are you able to maybe bend a metal hanger or equivalent and "fish" them out? Once you get them out, the new filter should pop right in place. Let me know how the fishing was! ;-) Kelly
Be sure to click accept if this helped you out and also leave feedback if you would. I'd appreciate it!