It’s because they want to incentivize long-term, stable relationships and households because doing so statistically leads to better outcomes for society. The barrier to entry for getting divorced is quite high, so in general people tend to stay together more often if they are married than if they are not.
That all being said, the system is far from perfect for sure. Incentivizing marriages also incentivizes people to stay in bad marriages, among other issues