Motorcycle Questions? Ask a Mechanic.
It's indeed nto normal. Two big things that can cause it are wron caliper slides and a aged seal on the caliper piston. The seal pulls back on the piston when the brakes are released giving the pads room to move away from the rotor.
I would clean and lube the slide bolts/pins and see how that does before replacing the caliper.