Size matters, but size is also relative! For example, a 24" umbrella at 2' will be the same size as a 48" umbrella at 4', relatively speaking. In that case, both umbrellas are equally 'soft'.
But a 48" would provide softer light at the same distance as a 24" umbrella would.