Imagine a world where there’s no legal/moral/ethical/religious reason preventing you from "getting with" close relatives.

Is the only reason society doesn't like things like incest because of the biological reproductive downsides?