diff --git a/docs/koji/upgrading.md b/docs/koji/upgrading.md
index 98b8fde3d541a3f1956dab0ce27b4d3a9f403495..cd4ed514aff3efc07f82f4419166976382d6cf08 100644
--- a/docs/koji/upgrading.md
+++ b/docs/koji/upgrading.md
@@ -21,6 +21,16 @@ see [https://gitlab.cern.ch/linuxsupport/rpms/koji](https://gitlab.cern.ch/linux
 !!! Note ""
     Don't forget to tag the build as needed **before** shutting down Koji!
 
+## Disable alerts
+
+Make sure Roger knows something is going on:
+
+```
+roger update --all_alarms false --message OTG0062870 --duration 2h koji{10,11,20,21,22,30,31,32,33,34,35,40,41}
+```
+
+(If you change the appstate, the machines would be removed from the LB alias and the intervention will take longer)
+
 ## Shutdown Koji
 
 *puppet (disable)*
@@ -86,3 +96,12 @@ mco shell run '/usr/bin/yum clean all && /usr/local/sbin/distro_sync.sh' --dm pu
 mco puppet enable --dm puppetdb -T lsb -F 'hostgroup_1=test2'
 mco puppet runonce --dm puppetdb -T lsb -F 'hostgroup_1=test2'
 ```
+
+(You can also reboot the nodes to get the latest kernel, etc.)
+
+## Re-enable puppet and all_alarms
+
+```
+mco puppet enable --dm puppetdb -T lsb -F 'hostgroup_1=test2'
+roger update --all_alarms true koji{10,11,20,21,22,30,31,32,33,34,35,40,41}
+```