@simon re: the cutoff date:
I don't fully understand how the (pre) training works, but it seems you might keep updating the "corpus" (pile of documents) while you're training, as long as it's a relatively small portion of the data.