A General Processing – Graphics Processing Unit (GPGPU) can accelerate deep learning model training and inference to a great extent. Recent advances in deep learning have been possible because of big data and cheap computation. The company, Nvidia, provides GPUs and some libraries to accelerate deep learning. Having GPU hardware for training is useful, but not necessary.