I totally understand, and I think you're a hundred percent right.
I think the impulse for me isn't to be able to retire early, but rather, to stop having to worry about money earlier rather than later. To be able to have a later life where I'm still working on things I believe in, but where I don't have to worry about whether or not those things bring in money.