Reading the legislation, I don't see why there would be no opportunity for appeal.
The bill seems to go out of its way to make sure an accused election official gets to give their side of the story, and removal wouldn't be legal or valid without a record of there being a problem.
It sounds to me like a reasonable way to address a complicated issue.