Employment Law Questions? Ask an Employment Lawyer.
It probably would not be considered general civil or criminal harassment... but it is illegal discrimination and could be considered sexual harassment. He and the owner by allowing it, are creating a "hostile work environment". A hostile work environment is one where illegal discrimination is allowed to occur (not just general hostility).
It is illegal to discriminate (or make comments in this case) on the basis of race and gender. Any time an employer allows this to happen, they are facilitating illegal discrimination.
You can file an EEOC charge on the basis of sexual harassment (any negative comments about a gender qualify). Read here: http://www.eeoc.gov/laws/types/sexual_harassment.cfm
You can also file a racial discrimination claim: http://www.eeoc.gov/laws/types/race_color.cfm
The EEOC investigates and attempts to resolve claims. There is no cost to you. You cannot be fired or treated differently in retaliation for filing an EEOC charge.
File here: http://www.eeoc.gov/employees/charge.cfm