Yes it is the ignitor. The part # XXXXX
It is an easy repair. Unplug the unit and remove the oven floor. Remove the flame spreader on the oven burner. Two screws mount the ignitor to the burner. There may be a plate to remove to access the plug. It will take you ten minutes.
Click here to order parts
Use the part number I gave you before and check your locale parts store if you would like to repair it faster.
Sorry, the reason is the ignitor will wear out with time. 3-7 years under average use. They will glow but do not consume enough power to open the valve.