A dataset contains two identical columns (Feature X copied as Feature Y). How does this affect a Decision Tree using Information Gain?

Question

Answer

The Information Gain of both features is doubled

Answer

Both features will have identical Information Gain; the tree may arbitrarily choose either one, but the tree structure and predictions are unaffected

Answer

The tree will fail to build because it detects collinear features

Answer

The tree will use both features, creating a deeper and more complex model

Crowdly