The DL4J Spark implementation makes use of a threshold encoding scheme to perform parameter updates across nodes in order to reduce the commuted message size across the network and thereby reduce the cost of traffic. The threshold encoding scheme introduces a new distributed training-specific hyperparameter called encoding threshold.

In this recipe, we will configure the threshold algorithm in a distributed training implementation.