I had a similar problem. For me it was because some of the videos were encoded with x265 which some client devices could not decode properly. Therefore the server had to decode them but it was not fast enough to do it.
I guess that is why on the Android device the videos are smooth, it can handle the decoding.