You are correct. There may be an abrasion. Sometimes with contacts, you can get a sterile ulcer (that is, an inflammation, not infection). Since this is Sunday, you can wait until tomorrow. However, the foreign body sensation may continue. You may have to see the doctor today just to get something to alleviate the symptoms. You can first try some artificial tear ointment to see if this relieves some of the irritation.