Make user.group a nesting of the group field set (elastic#308)

Breaking change.

Field set name "group" was being used as a leaf field at `user.group`. It had different semantics as the field set: it was a keyword field, instead of being a nesting of the field set. This goes against a driving principle of ECS, and has been corrected.

We removed the `user.group` `keyword` field (introduced in elastic#204), and made the `group` field set nestable at `user.group`.

CHANGELOG.md

@@ -6,8 +6,15 @@ All notable changes to this project will be documented in this file based on the
 
 ### Breaking changes
 
+* Remove the `user.group` `keyword` field, introduced in #204. Instead,
+  the `group` field set can be nested at `user.group`. #308
+
 ### Bugfixes
 
+* Field set name "group" was being used as a leaf field at `user.group`, instead
+ of being a nesting of the field set. This goes against a driving principle of ECS,
+ and has been corrected. #308
+
 ### Added
 
 ### Improvements

README.md

@@ -271,6 +271,10 @@ Note also that the `geo` fields are not expected to be used directly at the top
 The group fields are meant to represent groups that are relevant to the event.
 
 
+The `group` fields are expected to be nested at: `user.group`.
+
+Note also that the `group` fields may be used directly at the top level.
+
 | Field  | Description  | Level  | Type  | Example  |
 |---|---|---|---|---|
 | <a name="group.id"></a>group.id | Unique identifier for the group on the system/platform. | extended | keyword |  |
@@ -501,7 +505,6 @@ Note also that the `user` fields may be used directly at the top level.
 | <a name="user.full_name"></a>user.full_name | User's full name, if available. | extended | keyword | `Albert Einstein` |
 | <a name="user.email"></a>user.email | User email address. | extended | keyword |  |
 | <a name="user.hash"></a>user.hash | Unique user hash to correlate information for a user in anonymized form.<br/>Useful if `user.id` or `user.name` contain confidential information and cannot be used. | extended | keyword |  |
-| <a name="user.group"></a>user.group | Group the user is a part of. This field can contain a list of groups, if necessary. | extended | keyword |  |
 
 
 ## <a name="user_agent"></a> User agent fields

fields.yml

@@ -770,10 +770,16 @@
     - name: group
       title: Group
       group: 2
+      type: group
       description: >
         The group fields are meant to represent groups that are relevant to the
         event.
-      type: group
+    
+      reusable:
+        top_level: true
+        expected:
+          - user
+
       fields:
 
         - name: id
@@ -1669,13 +1675,6 @@
             Useful if `user.id` or `user.name` contain confidential information and
             cannot be used.
 
-        - name: group
-          level: extended
-          type: keyword
-          description: >
-            Group the user is a part of. This field can contain a list of groups, if
-            necessary.
-    
     - name: user_agent
       title: User agent
       group: 2

schema.csv

@@ -168,7 +168,6 @@ url.scheme,keyword,extended,https
 url.username,keyword,extended,
 user.email,keyword,extended,
 user.full_name,keyword,extended,Albert Einstein
-user.group,keyword,extended,
 user.hash,keyword,extended,
 user.id,keyword,core,
 user.name,keyword,core,albert

schema.json

@@ -1917,16 +1917,6 @@
         "required": false, 
         "type": "keyword"
       }, 
-      "user.group": {
-        "description": "Group the user is a part of. This field can contain a list of groups, if necessary.", 
-        "example": "", 
-        "footnote": "", 
-        "group": 2, 
-        "level": "extended", 
-        "name": "user.group", 
-        "required": false, 
-        "type": "keyword"
-      }, 
       "user.hash": {
         "description": "Unique user hash to correlate information for a user in anonymized form.\nUseful if `user.id` or `user.name` contain confidential information and cannot be used.", 
         "example": "", 

schemas/group.yml

@@ -2,10 +2,16 @@
 - name: group
   title: Group
   group: 2
+  type: group
   description: >
     The group fields are meant to represent groups that are relevant to the
     event.
-  type: group
+
+  reusable:
+    top_level: true
+    expected:
+      - user
+
   fields:
 
     - name: id

schemas/user.yml

@@ -52,10 +52,3 @@
 
         Useful if `user.id` or `user.name` contain confidential information and
         cannot be used.
-
-    - name: group
-      level: extended
-      type: keyword
-      description: >
-        Group the user is a part of. This field can contain a list of groups, if
-        necessary.

template.json

@@ -788,10 +788,6 @@
               "ignore_above": 1024,
               "type": "keyword"
             },
-            "group": {
-              "ignore_above": 1024,
-              "type": "keyword"
-            },
             "hash": {
               "ignore_above": 1024,
               "type": "keyword"