An exchange is where you buy Bitcoin. A wallet is where you store it securely. On an exchange, the company holds your keys – meaning they control your coins. In a non-custodial wallet, only you hold the keys.