Me personally? I’ve become much less tolerant of sexist humor. Back in the day, cracking a joke at women’s expense was pretty common when I was a teen. As I’ve matured and become aware to the horrific extent of toxicity and bigotry pervading all tiers of our individualistic society, I’ve come to see how exclusionarly and objectifying that sort of ‘humor’ really is, and I regret it deeply.
All the creatures we create are our children. They are all owed the unconditional love and protection of their creator. The experiences of animals are real and matter. Their suffering is identical in nature to your own. It harms us when we take pleasure in cruelty and violence.
Incidentally, just as a matter of nomenclature, what you are describing is not veganism. The environmental and personal health consequences of veganism are incidental. Veganism is about recognizing the right of all sentient creatures to exist without cruelty and unnecessary violence. You can’t do that one day a week any more than you can believe women are not property one day a week. You’d describe the diet without other connotations as “plant based”.