Because we're here. Obviously there exists a version of our worlds in which we're here, but if people who come from the same worlds at different times are to be believed, we're also there. So there has to be a version in which we're gone and a version in which we're not, and I wouldn't think that memories would cross between the two.
no subject
Alternatively, magic. Which is its own headache.