I haven’t dealt with HPC in a while, but Intel C compiler against MKL libraries were fastest CPU, and Nvidia CUDA was slightly easier to develop than OpenCL for other cards. I’m not sure if the situation’s changed.
For my current applications, I use NumPy compiled against Intel MKV installed as a binary. It works great.