Entropy evaluation based on confidence intervals of frequency estimates : Application to the learning of decision trees

Conference object English OPEN
Serrurier , Mathieu; Prade , Henri;
  • Publisher: HAL CCSD
  • Subject: [ INFO.INFO-LO ] Computer Science [cs]/Logic in Computer Science [cs.LO] | Intelligence artificielle | Informatique et langage | [ INFO.INFO-LG ] Computer Science [cs]/Machine Learning [cs.LG] | Decision trees | [ INFO.INFO-CL ] Computer Science [cs]/Computation and Language [cs.CL] | [ INFO.INFO-AI ] Computer Science [cs]/Artificial Intelligence [cs.AI] | Apprentissage | Logique en informatique | Machine learning

International audience; Entropy gain is widely used for learning decision trees. However, as we go deeper downward the tree, the examples become rarer and the faithfulness of entropy decreases. Thus, misleading choices and over-fitting may occur and the tree has to be a... View more
Share - Bookmark