Notification Storm After a Group Rename and Scheme Inheritance
A Jira Data Center instance has a notification scheme "Default-Notify" assigned to 30 projects. The scheme notifies: Current Assignee, Reporter, Watchers, the group developers, and the group qa-team. An admin renames qa-team to quality-engineering and creates a new empty group qa-team (because a script referenced the old name). Overnight, 30 projects' stakeholders report they stopped receiving notifications, while a handful of users report receiving duplicate emails for every change. Separately, project PAY has its own notification scheme that was cloned from Default-Notify before the rename; PAY users still get notifications. The mail queue shows a backlog of 9,000 messages.
1. Explain the split symptoms (silent group vs. duplicates) and why PAY is unaffected.
Read the worked answer
Notification schemes reference groups by name/ID at evaluation time, so the rename has two effects:
Silent group: the scheme still lists
qa-team. After the rename, the old group is now the new empty group - no members. Notifications targeted atqa-teamtherefore reach nobody. Thequality-engineeringgroup has the members but is not referenced by any scheme. Result: everyone who relied on group membership goes dark. This is not a permissions issue; the scheme is intact but points at an empty group.Duplicates: users who are members of
quality-engineeringand are also individually notified (as Current Assignee, Reporter, or Watcher) would normally get one email - Jira de-duplicates per user per event. Duplicates arise when a user is matched by two distinct notification entries that are not de-duplicated, e.g., they are in bothdevelopersand a personally-added entry, or the scheme has the same group listed twice after an edit. The rename itself doesn't create duplicates; a scheme edit that addedquality-engineeringalongside the oldqa-team(or a second identical entry) does. The admin likely added the new group without removing the old one, and some users are in both.PAY unaffected: PAY's scheme was cloned - it is a separate scheme object with its own copy of the entries. The clone snapshot still references
qa-team... which is now empty, so PAY should also be affected unless PAY's clone was edited or PAY users are individually notified. The stated fact that PAY users still get mail suggests PAY's scheme was independently updated toquality-engineering, or PAY users are assignees/reporters. This must be verified entry-by-entry, not assumed.
2. Give a remediation sequence that restores notifications, eliminates duplicates, and clears the mail queue safely.
Read the worked answer
Sequence (avoid making the backlog worse):
- Pause outbound mail (or set the SMTP relay to hold) so the 9,000-message backlog doesn't grow while you fix configuration. Do not flush yet.
- Audit every notification scheme that references
qa-teamorquality-engineering. For each, replace the emptyqa-teamentry withquality-engineeringand remove any duplicate entries (same group listed twice, or a user who is also covered by a group). Use the scheme's entry list; there is no bulk "find references" UI in all versions, so check each of the 30 projects' assigned scheme and PAY's clone. - Decide the fate of the empty
qa-teamgroup. If a script depends on the name, keep it but document that it must not be used in schemes; otherwise delete it to prevent future confusion. Do not re-add members to it - that would re-create the split. - Verify de-duplication: confirm each scheme notifies each user once per event. Jira de-duplicates identical recipients, but distinct entries (group + individual) can still double-send in some configurations; consolidate to group-only where possible.
- Drain the queue in batches after config is correct, monitoring for errors; purge messages that are now stale (e.g., >24h old) rather than delivering a flood.
- Prevent recurrence: document that group renames must be followed by a scheme audit; prefer project roles over groups for notifications so membership is managed per project; add a change-management step for group renames.