When blocks are verified it just needs to validate that sum of the outputs isn't more than the sum of the inputs. It doesn't care about tracking what went where.
Except I can literally pull up a full node and see a wallets current balance - which is because it traces all the transactions through the blockchain, verifying all of them.
Literally the only way anyone can see their wallet balance is by doing this.
I will say it again. When validating the chain all it cares about is that the sum of the output UTXO for a transaction are <= the sum of the input UTXO. All the input UTXO are no longer valid once spent and can be forgotten.