It appears you are specifically speaking of "consensus for workgroup tasks" which is outside the scope of "social consensus" to be found in small groups of people, such as at a bar or dinner, or two couples playing cards at a meal.
When dealing with "workgroup tasks," a proper "workgroup" will be focused on the specific "task to be achieved." It shouldn't have political or social theory involved. If it's a group as small as my mom & dad preaching to my aunt and uncle who simply don't wish to hear about Jesus & Trump at every belch or fart during dinner, how small does it need to be to be "too small?"