You may simply delete the advance payment by using the delete option under Action drop-down box.

Please refer below screenshot for more help.