This app can be configured to produce plain SVGs which can theoretically be embedded into org-mode documents and can easily be stored in git. I have always used it stand-alone though.
It’s proprietary and the UI looks like an Android app from 10 years ago but it’s the best hand-drawing experience I’ve found on Linux.