@knittingknots2 I'd say that reads his reaction backwards:

It's not that it bothers him the most, but rather that he thinks he can use the accusation against Democrats the most effectively by turning it into a symbol of hypocrisy.

He's latching onto it not out of annoyance but happily and strategically.