Echoing a couple of other people here, I can't imagine a different way to get end users the experience they probably want and value.
So to build up, what are the alternative ways of doing this, if not big-data-centralized? Is there a way to get around the efficiencies of having it all in one place for processing?