At least for anything statically linked where the GPL code would end up as part of your binary and force you to GPL your own code I believe.
Anything more lax is fine, so you could also release your code under MIT license if you use GPL modules. Yes, it does force you to release your code but after all it’s a protection for the user. Furthermore, GPL does not mean your software has to be free of charge, you can still sell it as long as you attach the source code for the end user.