Ob-Gyn questions? Ask a gynecologist online.
This sounds like a blood blister. Sometimes they occur due to sexual intercourse, bike riding, or exercise. It may also be a small abcess if it is sore or begins to drain pus. Neither requires any specific treatment. You can use hot compresses which may help shrink it.