Gentoo install with a GUI and everything compiled from source has been accomplished. It's been 3 days but it's really quick.

I guess it's time to install the apps also from source. It just takes a few times to get it right. Maybe I'll just use Gentoo from now on.