Because it provides closed-form solutions for all models.

Because it avoids the use of GPUs and vectorized operations.

Because it is only useful for linear regression problems.

Because it is iterative, scales to large datasets, and works with many differentiable loss functions.