40 CFR §13.12

Interest, penalty charges and administrative costs will continue to accrue on a debt during administrative appeal, either formal or informal, and during waiver consideration by the Agency; except, that interest, penalty charges and administrative costs will not be assessed where a statute or a regulation specifically prohibits collection of the debt during the period of the administrative appeal or the Agency review.