Ensembles are a set of methods that use multiple machine learning algorithms to get better results. Ensemble methods often allow for higher flexibility and performance and solve some other machine learning problems, for example, overfitting. 

Ensembles may be a combination of different algorithms or the same algorithms. The most famous example of an ensemble is a random forest, which is a combination of multiple decision trees.