Its important to back up your wallet so that you can recover your wallet in case of disaster
If all funds have been removed from your wallet and you do not wish to have the wallet data stored on your computer anymore, you can delete your wallet.