To add a new library group, right-click on the paragraph library node and select Add Group:
A new group will be added and you can change its name in the group name field.
To delete a group, right click the group and select Delete group, you can only delete a group if it is not in use by a template.