Implement custom notification level options


part of #12758
See merge request !4389