The penalty system for VAT is ‘points-based’. You’ll receive points for each transgression, such as making VAT submissions late, or paying the bill after the deadline.
To be really thorough, you might also receive a penalty if you accidentally (or deliberately) submit a VAT return which under-states or over-claims VAT.
There’s also a 30% VAT penalty if you don’t tell HMRC about a VAT assessment which is too low within 30 days, and a £400 fine for sending a paper VAT return without permission.
It’s well worth getting to grips with the VAT penalty system to help you make sure you don’t end up with a fine. Which is not fine. Unlike that pun, which is great.