ROM passthrough is working!
I think on the final board, I will have a small serial eeprom that can be loaded with whatever fonts you want, and the active font will be loaded into an 8 bit SRAM.
That makes this a practical, reversible upgrade for your CGA card even if you don't care about video streaming.