You're right in a way Mooghead, but the problem is, you listen to an album a thousand times, love it, enjoy it, and slowly find yourself wanting it a little bit better, so you upgrade your speakers, then you expose the flaws in your amp, so you get a new one, which of course exposes the source, so in goes a new CD player/DAC, then you get curious about vinyl, so in goes a turntable, then you realise your cartridge is the weak link in your vinyl set-up so hey presto, new cartridge, oh and all that means a new phono amp too and let's not get started on cables!!!!
After your wife says no more on the hifi, you start dabbling in different releases, remasters, original pressings, Japanese vs UK, Mobile Fidelity, DCC. arghhhhh!
When it all comes together though, and you find a lovely early vinyl pressing or track down the DCC A Night at the Opera it's joyous..... for about 45 minutes, then you get depressed on the $1000 plus sitting in your CD drawer that you realise sound crap.... and then you get further depressed when you think how every remaster sounds worse and worse and why Steve Hoffman couldn't do the entire back catalogue... or you put on the new Fleetwood Mac Rumours remaster and get massively depressed that no future Queen release will ever sound that good.
Keeps us off the streets I suppose.