They will if it’s more than 45 days late, when that starts is usually going to be ‘from tax day’, that can vary, but it’s usually for reasons that would typically be your fault (filed late, etc). They even use the same rates they would charge you if you were late to pay them. This has never happened to me, but I’m told that the interest accrual is automatic, supposedly don’t even have to ask.