Ok, update. I removed some improper repos that the amdgpu-install had installed and I got things mostly working. Only problem is that rendering in Blender on GPU crashes it and I can’t seem to get good logs for the problem. I will try to get some logs and post them here.
I just realized this myself as well and posted it into an another comment. Should have replied here instead. But now the only problem is Blender crashing.