After a nice long fight I finally got a customized footprint in KiCAD with different geometries on different layers to work correctly.
They were originally designed in an older program that didn't care much about rules and it took several tries to make this work.
So happy now.