The prejudice is against men and women - assuming men stay at work. That's the reason why we don't have enough women in the halls of power - the prejudice is pushing women to go home.