MXNet accelerates performance by distributing training across multiple CPUs/GPUs. For utilizing GPU capabilities, your system needs an NVIDIA GPU, and you need to install the CUDA Toolkit and cuDNN. Instructions to install the CUDA Toolkit and cuDNN can be found at https://developer.nvidia.com/cuda-downloads and https://docs.nvidia.com/deeplearning/sdk/cudnn-install/index.html respectively.