Lying in court is perjury, which is a criminal offense.
That being said, making a mistake on something like a date is a valid defense. Trump immediately recanting gives him a good way to claim mistake.
There’s more value to prosecution to make him seem deceptive and stupid than wasting more time with something like a super weak case for perjury. You also don’t want to give them more ways to draw out and delay the process.