You have it backwards: those members were refusing to go down a fascist route to impose their personal opinions on others.
It’s really odd when folks describe it as fascist when power is NOT asserted, when authoritarian is avoided.
It undermines the term, equating it to simply people who share different opinions than my own.