Fix setting of maximum ROOT output buffer sizes when relying on auto-flush (ie no SharedWriter)

This will limit buffer size for the very largest branches, helping to save memory.