Select the customer in Customers and press Delete. It needs the right to delete customers and is refused while the customer has a balance. Their past sales stay in the reports.
Open Customers and select the customer.
Press Delete and confirm. The button is shown only to users whose role allows deleting customers.