If you go 20 years into the future to meet your old self, you would find out that you've been missing for 20 years, amirite?

you wouldn't be visiting the same timeline. a branch in your timeline would be created and youd visit the older you from that one. it can be complicated but there are plenty of articles that discuss it and even youtube channels.

Not if you went back afterwards...