I would leave it if it is there already. It would be harder to remove and reinstall the drain, than just installing a hose on the ice maker drain. Also, it can make it easier if you ever need to remove the ice maker for service. With the drain on the side and not behind the ice maker, it is easier to reinstall. If it is behind the ice maker, it can be difficult to line up.