"But the context appears to be one of colonization, not exploration."

Not necessarily. He says they "came here," not that they settled here. It's ambiguous, and to my mind the fact that he says 400 years and not 300 years itself resolves the ambiguity.