Information theory studies the quantification of information, its storage and communication. We introduce concepts of information entropy and information gain that are used to construct a decision tree using ID3 algorithm.
Information theory studies the quantification of information, its storage and communication. We introduce concepts of information entropy and information gain that are used to construct a decision tree using ID3 algorithm.