Articles → MACHINE LEARNING → Entropy In Machine Learning

Entropy In Machine Learning

This article describes entropy in machine learning.

Purpose

The entropy is a measure of impurity or disorder in a dataset.

Consider the following table: -

ID	Outlook	Temperature	Humidity	Windy	Play Tennis
1	Sunny	Hot	High	False	No
2	Sunny	Hot	High	True	No
3	Overcast	Hot	High	False	Yes
4	Rain	Mild	High	False	No
5	Rain	Cool	Normal	False	No
6	Rain	Cool	Normal	True	No
7	Overcast	Cool	Normal	True	Yes
8	Sunny	Mild	High	False	Yes

In the above dataset, we have 3 Yes and 5 No.

Query/Feedback