The kernel is the small window used by a CNN to slide across the feature map. As shown in the following diagram, the kernel is used to go in a sliding window motion and produce output feature maps:
The kernel can come in various sizes of rectangles and can move in longer or shorter strides.