I’ve had this issue with Samsung phones and tablets I owned in the past. Working as an app developer I still see this kind of problems on heavily oem-customized versions of Android.
Personally I “solved” this by switching to Pixel phones which in my experience don’t slow down even after 3-4 years of usage and updates. I believe this is true in general for phones that stay as close to AOSP/stock Android as possible.