In short Software or hardware that stores the private keys controlling your on-chain assets and signs transactions with them.
The coins themselves stay on the blockchain; the wallet holds the keys. Lose the keys and the assets are unreachable — there is no "forgot password".