They might. There’s peace because attacking is too dangerous (what they have now, at least with the nations not attacking them) vs peace because treaties are in place vs peace because no one wants to attack them. That middle one is risky because situations can change fast.
And there’s another angle that questions whether they wouldn’t need weapons during peace for less generous reasons.