When Ensembling Smaller Models is More Efficient than Single Large Models