I sometimes use termux to very rarely edit stuff on a remote box via ssh and I haven’t had that kind of issue
for the most part just the fact that SSH as a protocol is not super reliable on a (sometimes) spotty wifi/mobile connection (this could be solved with something like mosh)
the other big thing is using vim with the android keyboard. which is just a major pain haha