Consider a node with class distribution [50%, 50%]. After a split, one criterion yields children [90%, 10%] and [30%, 70%], while another criterion yields children [100%, 0%] and [40%, 60%]. In practice, which statement is most accurate about Entropy vs Gini for these two splits?

Question

Answer

Entropy always prefers more balanced splits, so it would choose the first option

Answer

Gini prefers the first split because it minimises the maximum impurity across children

Answer

Gini and Entropy always produce identical split rankings

Answer

Both criteria would prefer the split that produces the pure [100%, 0%] child, but their relative scores for the two splits may differ slightly

Crowdly

Consider a node with class distribution [50%, 50%]. After a split, one criterion...

Want instant access to all verified answers on moodle.ucu.ac.ug?