All of the neighbor problems I and my neighbors have had, without exception, have been from short-term renters. That includes noise that continues all night, off leash, aggressive dogs, unsupervised kids, and threatening, overtly hostile renters.
The “market” can’t deal with this kind of thing, it requires regulations and enforcement.