I don’t trust f-droid as well, because some of its apps crash the (un)installer and can therefore never be removed.
However, you need a trustworthy party and they have to digitally sign the APK after checking the code (changes) and compiling it themselves. They can also sign messages they send to the public.