You could lose the rewards you’ve earned if you cancel a credit card without a plan, and a smarter option is to downgrade the card instead. When you switch to a no-annual-fee card within the same card ...