Boosting is a machine learning ensemble technique that combines multiple weak learners, often simple models like decision stumps, to create a strong overall model. It improves performance by training each new model to focus on the errors of the previous ones, sequentially reducing bias and variance, resulting in higher accuracy and robustness in predictive tasks.