Not right away. When you delete a payee, you also delete the payment history. For this reason, we suggest you either print your payment history or deactivate the payee from inside bill payment. This will allow you to obtain your payment history at any time but remove them from your “Make Payments Screen” so errors do not occur.