pruritis (medical term for itching) is the initial complaint for many vaginal complaints.
it is very characteristic of a yeast infection to have thick white discharge - that looks like cottage cheese for example. These infections are very common after a woman has take an antibiotic for example.
other infections that cause itching are bacterial vaginosis and trichomonas. the discharge from these infections are yellow or green/frothy/fishy odor.
if your discharge is adequately described as a yeast infection there is little harm in trying an over the counter yeast infection medication.
if you don't see the desired results in 24-48 hours I would direct you to your physician so he can do an exam.
if the SKIN on your perineum (around you vagina) is white/itchy/thin or thick and it is not discharge this would suggest something else and you would need to see your doctor.
I would see your doctor before stopping the pill.