Popular notions of time-travel & retro-causality assumes a linear flow. Instead, try thinking of time as as infinite dimensional latent-space out which experience is user generated. As Robert Lanza put it: "The universe is the spatial/temporal logic of the animal observer".
