I think it depends on how good your Numpy build is. Lot of Numpys are not that well built so Numba seems to help there too in that case.

For a python library to be fast it needs to be compiled for your specific hardware, vectorized, with fast math, and auto parallel. Most are probably not unless you build them youself.