Nodes
:nodes is shc node ls live, with the wide columns shc node info
holds. This page empties a node from the HUD and puts it back, and a drain
needs one node to empty and another to take its work. Join a second machine
first. Prepare a Debian 13 machine named home02 the way home01 was prepared,
with 2 CPUs, 8 GB of memory and SHC installed. It must reach home01, and root
on it must be able to ssh home01 with a key and no prompt: the join reads
its token from home01 that way. The join asks home01 for a fresh token over
ssh and hands it to shc node join -, which reads it from standard input.
$ ssh home01 shc node token --fields token -o text | shc node join - --name home02 --cloud learn --location home✔ joined cluster as node "home02" at 188.245.229.15Run this again if home02 is still vault-locked or not ready.
$ shc node lsNAME STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTERhome01 healthy ready active learn learn/home ok 0.1.0 yes yeshome02 healthy ready active learn learn/home ok 0.1.0 no no$ tmux new -d -s hud -x 160 -y 44 shc hud$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <w> Export <ctrl-n> New <s> Shell <v> V… Cluster: 2 nodes <1> default <b> Backup <ctrl-j> Follow <o> Open <shift-a> Sort Age <y> YA Deployments: 9 (9 healthy) <shift-c> Clone <?> Help <shift-f> Port-Forward <shift-n> Sort Name Tenant: prod <c> Copy <ctrl-k> Kill <p> Protect <shift-s> Sort Status Stack: all <d> Describe <shift-l> Lease <shift-p> Repoint <shift-w> Start Environment: all <e> Edit <l> Logs <r> Restart <shift-x> Stop shc9s Rev: 0.1.2┌──────────────────────────────────────────────────────────────────── deployments(all)[6] ─────────────────────────────────────────────────────────────────────┐│ STACK↑ TENANT ENV APP STATUS NODE LEASE ACCESS EXPOSURE REASON ││ cloud prod prod nextcloud running home01 - open lan - ││ db prod prod postgres running home01 - open lan - ││ pgweb prod prod /root/learn/pgweb running home01 - open lan - ││ placed prod prod notes running home01 - open lan - ││ store prod prod /root/learn/versitygw running home01 - open lan - ││ web prod prod /root/learn/nginx running home01 - open lan - ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <deployment>Read the header before going on. The join restarted home01’s daemon a
minute in to move its store into the cluster, and that leader change froze
automatic moves: the Warning row reads moves frozen with the time and
the reason. A drain’s moves wait for the thaw like every other automatic
move. Typed now, a drain fails, home02 stays active, and shc node drain
names the freeze. The thaw comes once every signal has stayed calm for a
while, a few minutes after the join. Read the screen until the Warning
row is gone and the header opens with the daemon.
$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <w> Export <ctrl-n> New <s> Shell <v> V… Cluster: 2 nodes <1> default <b> Backup <ctrl-j> Follow <o> Open <shift-a> Sort Age <y> YA Deployments: 9 (9 healthy) <shift-c> Clone <?> Help <shift-f> Port-Forward <shift-n> Sort Name Tenant: prod <c> Copy <ctrl-k> Kill <p> Protect <shift-s> Sort Status Stack: all <d> Describe <shift-l> Lease <shift-p> Repoint <shift-w> Start Environment: all <e> Edit <l> Logs <r> Restart <shift-x> Stop shc9s Rev: 0.1.2┌──────────────────────────────────────────────────────────────────── deployments(all)[6] ─────────────────────────────────────────────────────────────────────┐│ STACK↑ TENANT ENV APP STATUS NODE LEASE ACCESS EXPOSURE REASON ││ cloud prod prod nextcloud running home01 - open lan - ││ db prod prod postgres running home01 - open lan - ││ pgweb prod prod /root/learn/pgweb running home01 - open lan - ││ placed prod prod notes running home01 - open lan - ││ store prod prod /root/learn/versitygw running home01 - open lan - ││ web prod prod /root/learn/nginx running home01 - open lan - ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <deployment>$ tmux send-keys -t hud ':nodes' Enter$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 9 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌─────────────────────────────────────────────────────────────────────── nodes(all)[2] ────────────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home01 healthy ready active learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa true true ││ home02 healthy ready active learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>The narrow columns are NAME, STATE, CONDITION, AVAIL, CLOUD,
LOCATION, ROOM, LEADER and VOTER. ctrl-w adds the id, host,
addresses, runtime, cores, memory, what is free of each, role, status,
health and age.
$ tmux send-keys -t hud C-w$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 9 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌─────────────────────────────────────────────────────────────────────── nodes(all)[2] ────────────────────────────────────────────────────────────────────────┐│ NAME↑ ID HOST INTERNAL UNDERLAY RUNTIME CORES MEMORY FREE CORES FREE MEMORY OUTSIDE RESERVED STATE CONDITION AVAIL ││ home01 node-d35e311021fd home01 10.192.0.1:4003 142.132.191.57 docker 2 7.6G 2.0 7.6G - - healthy ready active ││ home02 node-0b3ba141e0bb home02 10.192.0.2:4003 167.233.225.240 docker 2 7.6G 2.0 7.6G - - healthy ready active ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud C-wEnter on a node lists the deployments on it. l tails the daemon’s own
log on that node, the journal of its unit shc, the lines
shc cluster logs prints. The node verbs live in the
a menu: set-public-address, cordon, drain, leave and forget,
in that order, each with its key in front. The first is shc node update;
read its form and leave it. / filters the table to the node you name, and
every key after it acts on the row the filter shows.
$ tmux send-keys -t hud '/' 'home01' Enter Enter$ tmux capture-pane -pt hud...$ tmux send-keys -t hud Escape$ tmux send-keys -t hud 'l'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <c> Copy Cluster: 2 nodes <n> Next Match Deployments: 9 (9 healthy) <shift-n> Prev Match Tenant: prod <r> Toggle Auto-Refresh Stack: all <f> Toggle FullScreen Environment: all shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── Logs(node-4f8bce440e78) ───────────────────────────────────────────────────────────────────┐...└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node> <logs>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud 'a'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 9 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home01> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home01 healthy ready active learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa true true ││ ││ ││ ││ ││ ││ ││ │────────────────────────────────────────────────────────────────────────────<Actions>───────────────────────────────────────────────────────────────────────────
dress set the address peers and ingress reach this node on (shc node update) stop scheduling new work on this node, leave what is running (shc node cordon); on a cordoned or draining node, return it to service, a drain is stopped move this node's deployments off it (shc node drain); on a draining node, stop the drain and leave the node cordoned (shc node undrain) ask the node to leave the cluster gracefully (shc node leave) evict the node from the cluster (shc node forget)
────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────│ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud Enter$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 9 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home01> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home01 healthy ready active learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa true true ││ ││ ││ ││ ││ ││ ││ ┌─────────────────<set-public-address>──────────────────┐ ││ │ │ ││ │ set the address peers and ingress reach this node on │ ││ │ (shc node update) │ ││ │ address: hostname or IP │ ││ │ │ ││ │ address: │ ││ │ │ ││ │ OK Cancel │ ││ │ │ ││ └───────────────────────────────────────────────────────┘ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud C-ucordon is the second entry and Shift-K runs it: one verb that is
shc node cordon on a node in service and shc node uncordon on a
cordoned one. A cordon keeps new work off the node and touches nothing
running there. It asks for nothing, so the confirm is the next screen.
Cordon home02 and read AVAIL.
$ tmux send-keys -t hud ':nodes' Enter$ tmux send-keys -t hud '/' 'home02' Enter 'K'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 9 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home02> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home02 healthy ready active learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││┌──────────────────────────────────────────────────────────<Confirm Write nodes/node-3a2db0fe3233>───────────────────────────────────────────────────────────┐│││ ││││ Run cordon on nodes/node-3a2db0fe3233 named home02 ││││ ││││ stop scheduling new work on this node, leave what is running (shc node cordon); on a cordoned or draining node, return it to service, a drain is stopped f ││││ ││││ Changes: none, every field keeps its prefilled value ││││ ││││ Provider will run: ││││ shc node cordon node-3a2db0fe3233 ││││ ││││ ││││ Cancel Confirm Write ││││ │││└────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud Tab Enter$ shc node lsNAME STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTERhome01 healthy ready active learn learn/home ok 0.1.0 yes yeshome02 healthy cordoned cordoned learn learn/home ok 0.1.0 no no$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 9 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home02> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home02 healthy cordoned cordoned learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud ':nodes' Enter$ tmux send-keys -t hud '/' 'home02' Enter 'K'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 9 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home02> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home02 healthy cordoned cordoned learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││┌──────────────────────────────────────────────────────────<Confirm Write nodes/node-3a2db0fe3233>───────────────────────────────────────────────────────────┐│││ ││││ Run cordon on nodes/node-3a2db0fe3233 named home02 ││││ ││││ stop scheduling new work on this node, leave what is running (shc node cordon); on a cordoned or draining node, return it to service, a drain is stopped f ││││ ││││ Changes: none, every field keeps its prefilled value ││││ ││││ Provider will run: ││││ shc node uncordon node-3a2db0fe3233 ││││ ││││ ││││ Cancel Confirm Write ││││ │││└────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud Tab Enterdrain is the third entry and Shift-D runs it: shc node drain. A
drain moves every deployment the node runs to a node the placement engine
picks, one at a time, and stops the global replicas last. home02 joined with nothing on
it, so give it something to lose first. From the other shell install a third
nginx that prefers home02.
--prefer ranks a node first and pins nothing, so a drain can still move
the deployment.
$ shc install ~/learn/nginx -s web3 --expose 18082=nginx:80 --prefer node=home02installing deployment "web3"[web3] Healthy 1/1✔ nginx healthy✔ installed deployment "web3"exposure: lan$ shc ls --where stack=web3STACK TENANT ENV APP STATUS NODEweb3 prod prod /root/learn/nginx running home02Now drain home02. The form asks for a timeout and whether to force; leave
both, submit, confirm, then watch :deployments while web3 moves.
$ tmux send-keys -t hud ':nodes' Enter$ tmux send-keys -t hud '/' 'home02' Enter 'D'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 10 (10 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home02> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home02 healthy ready active learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││ ││ ┌───────────────<drain node-3a2db0fe3233>───────────────┐ ││ │ │ ││ │ timeout: seconds to wait for each deployment to move │ ││ │ (--timeout) │ ││ │ force: drain even when a deployment cannot be moved │ ││ │ cleanly (--force) │ ││ │ │ ││ │ timeout: │ ││ │ force: │ ││ │ │ ││ │ OK Cancel │ ││ │ │ ││ └───────────────────────────────────────────────────────┘ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud Tab Tab Enter$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 10 (10 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home02> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home02 healthy ready active learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││ ┌─────────────────────────────────────────────────<Confirm Write nodes/node-3a2db0fe3233>─────────────────────────────────────────────────┐ ││ │ │ ││ │ Run drain on nodes/node-3a2db0fe3233 named home02 │ ││ │ │ ││ │ move this node's deployments off it (shc node drain); on a draining node, stop the drain and leave the node cordoned (shc node undrain) │ ││ │ │ ││ │ Changes: none, every field keeps its prefilled value │ ││ │ │ ││ │ Provider will run: │ ││ │ shc node drain node-3a2db0fe3233 │ ││ │ │ ││ │ │ ││ │ Cancel Confirm Write │ ││ │ │ ││ └─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud Tab Enter$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 10 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home02> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home02 healthy drained drained learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud ':deployments' Enter$ tmux capture-pane -pt hud...Run shc node ls until home02 reads drained.
$ shc node lsNAME STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTERhome01 healthy ready active learn learn/home ok 0.1.0 yes yeshome02 healthy drained drained learn learn/home ok 0.1.0 no noweb3 runs again on home01, the one node left to take it.
$ shc ls --where stack=web3STACK TENANT ENV APP STATUS NODEweb3 prod prod /root/learn/nginx running home01$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <w> Export <ctrl-n> New <s> Shell <v> V… Cluster: 2 nodes <1> default <b> Backup <ctrl-j> Follow <o> Open <shift-a> Sort Age <y> YA Deployments: 10 (9 healthy) <shift-c> Clone <?> Help <shift-f> Port-Forward <shift-n> Sort Name Tenant: prod <c> Copy <ctrl-k> Kill <p> Protect <shift-s> Sort Status Stack: all <d> Describe <shift-l> Lease <shift-p> Repoint <shift-w> Start Environment: all <e> Edit <l> Logs <r> Restart <shift-x> Stop shc9s Rev: 0.1.2┌──────────────────────────────────────────────────────────────────── deployments(all)[7] ─────────────────────────────────────────────────────────────────────┐│ STACK↑ TENANT ENV APP STATUS NODE LEASE ACCESS EXPOSURE REASON ││ cloud prod prod nextcloud running home01 - open lan - ││ db prod prod postgres running home01 - open lan - ││ pgweb prod prod /root/learn/pgweb running home01 - open lan - ││ placed prod prod notes running home01 - open lan - ││ store prod prod /root/learn/versitygw running home01 - open lan - ││ web prod prod /root/learn/nginx running home01 - open lan - ││ web3 prod prod /root/learn/nginx running home01 - open lan - ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <deployment>The move went into the event stream as placement events: the drain bound
web3’s replica from home02 to home01 and retired the copy on home02.
:events shows the stream live, healthchecks and all; the CLI picks out one
type.
$ tmux send-keys -t hud ':events' Enter$ tmux capture-pane -pt hud...$ shc events ls -s web3 -T placement_bind -n 12026-10-09T19:47:41Z home01 bound prod/web3/prod r0 from home02 to home01 at generation 2Shift-D on a draining or drained node is shc node undrain. It leaves
the node cordoned and nothing moves back; Shift-K then returns it to
service.
$ tmux send-keys -t hud ':nodes' Enter$ tmux send-keys -t hud '/' 'home02' Enter 'D'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 10 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home02> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home02 healthy drained drained learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││ ┌─────────────────────────────────────────────────<Confirm Write nodes/node-3a2db0fe3233>─────────────────────────────────────────────────┐ ││ │ │ ││ │ Run drain on nodes/node-3a2db0fe3233 named home02 │ ││ │ │ ││ │ move this node's deployments off it (shc node drain); on a draining node, stop the drain and leave the node cordoned (shc node undrain) │ ││ │ │ ││ │ Changes: none, every field keeps its prefilled value │ ││ │ │ ││ │ Provider will run: │ ││ │ shc node undrain node-3a2db0fe3233 │ ││ │ │ ││ │ │ ││ │ Cancel Confirm Write │ ││ │ │ ││ └─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud Tab Enter$ shc node lsNAME STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTERhome01 healthy ready active learn learn/home ok 0.1.0 yes yeshome02 healthy cordoned cordoned learn learn/home ok 0.1.0 no no$ tmux send-keys -t hud ':nodes' Enter$ tmux send-keys -t hud '/' 'home02' Enter 'K'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 10 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home02> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home02 healthy cordoned cordoned learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││┌──────────────────────────────────────────────────────────<Confirm Write nodes/node-3a2db0fe3233>───────────────────────────────────────────────────────────┐│││ ││││ Run cordon on nodes/node-3a2db0fe3233 named home02 ││││ ││││ stop scheduling new work on this node, leave what is running (shc node cordon); on a cordoned or draining node, return it to service, a drain is stopped f ││││ ││││ Changes: none, every field keeps its prefilled value ││││ ││││ Provider will run: ││││ shc node uncordon node-3a2db0fe3233 ││││ ││││ ││││ Cancel Confirm Write ││││ │││└────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud Tab Enter$ shc node lsNAME STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTERhome01 healthy ready active learn learn/home ok 0.1.0 yes yeshome02 healthy ready active learn learn/home ok 0.1.0 no noThe deployments stay where the drain put them; that is the drain’s contract, and the next page of the cluster ladder covers moving them back.
leave, the fourth entry and ctrl-d, is a graceful leave and asks
whether to force; forget, the fifth and ctrl-k, is the evict. Open each on home02, read it, and
leave with esc.
$ tmux send-keys -t hud ':nodes' Enter$ tmux send-keys -t hud '/' 'home02' Enter 'a' Down Down Down Enter$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 10 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home02> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home02 healthy ready active learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││ ││ ││ ┌────────────────────────<leave>────────────────────────┐ ││ │ │ ││ │ ask the node to leave the cluster gracefully (shc │ ││ │ node leave) │ ││ │ force: force removal even when a clean handoff fails │ ││ │ │ ││ │ force: │ ││ │ │ ││ │ OK Cancel │ ││ │ │ ││ └───────────────────────────────────────────────────────┘ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud 'a' Down Down Down Down Enter$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <?> Help <shift-s> Sort Status Cluster: 2 nodes <1> default <shift-k> Cordon <ctrl-d> Leave <v> Views Deployments: 10 (9 healthy) <d> Describe <l> Logs <y> YAML Tenant: prod <shift-d> Drain <e> Set-Public-Address Stack: all <ctrl-j> Follow <shift-a> Sort Age Environment: all <ctrl-k> Forget <shift-n> Sort Name shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────── nodes(all)[1] </home02> ───────────────────────────────────────────────────────────────────┐│ NAME↑ STATE CONDITION AVAIL CLOUD LOCATION ROOM BUILD LEADER VOTER ││ home02 healthy ready active learn learn/home ok 0.1.0-rig.20261010224631.11e316f8fa false false ││ ││ ││ ││ ││ ┌──────<Confirm Write nodes/node-3a2db0fe3233>───────┐ ││ │ │ ││ │ Run forget on nodes/node-3a2db0fe3233 named home02 │ ││ │ │ ││ │ evict the node from the cluster (shc node forget) │ ││ │ │ ││ │ This is not reversible. │ ││ │ │ ││ │ Provider will run: │ ││ │ shc node forget node-3a2db0fe3233 -y │ ││ │ │ ││ │ │ ││ │ Cancel Confirm Write │ ││ │ │ ││ └────────────────────────────────────────────────────┘ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud C-uv on a node lists its relations: d deployments, v volumes, t
tasks, w workers, f the label values it carries and p the pressure on
its queues. :pressure is the queue lines of shc status, one row per
node per queue, with the depth, the age of the oldest item, the rates and
where amber and red begin. :workers is one task worker per daemon,
:tasks the operations queue; cancel in a task’s menu asks for a reason
and cancels it. The queue holds what ran in the last minutes, so its rows
differ from one read to the next and may be none.
$ tmux send-keys -t hud 'v' 'p'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <d> Describe <y> YAML Cluster: 2 nodes <1> default <ctrl-j> Follow Deployments: 10 (10 healthy) <?> Help Tenant: prod <shift-a> Sort Age Stack: all <shift-n> Sort Name Environment: all <shift-s> Sort Status shc9s Rev: 0.1.2┌───────────────────────────────────────────────────────────────────── pressure(all)[54] ──────────────────────────────────────────────────────────────────────┐│ NODE↑ QUEUE LEVEL DEPTH OLDEST REASON IN/S OUT/S DROPPED RETIRED AMBER ││ node-d637b06c91fe acme.orders green 0 certificates - - 0.0 0.0 0 - age 60m ││ node-d637b06c91fe acme.unindexed green 0 certificates - - 0.0 0.0 0 - age 5m ││ node-d637b06c91fe app.dns_releases green 0 hosts - - 0.0 0.0 0 - age 60m ││ node-d637b06c91fe app.lease_reaps green 0 deployments - - 0.0 0.0 0 - age 60m ││ node-d637b06c91fe app.orphaned_roles green 0 roles - - 0.0 0.0 0 - age 60m ││ node-d637b06c91fe app.parked green 0 deployments - - 0.0 0.0 0 - - ││ node-d637b06c91fe app.replica_docs green 0 deployments - - 0.0 0.0 0 - age 60m ││ node-d637b06c91fe backup.paused green 0 deployments - - 0.0 0.0 0 - depth 1 ││ node-d637b06c91fe backup.prune green 0 repositories - - 0.0 0.0 0 - age 6h ││ node-d637b06c91fe backup.quiesced green 0 deployments - - 0.0 0.0 0 - depth 1 ││ node-d637b06c91fe backup.stopped green 0 deployments - - 0.0 0.0 0 - depth 1 ││ node-d637b06c91fe clone.moves green 0 moves - - 0.0 0.0 0 - age 60m ││ node-d637b06c91fe clusterfs.revision_lag green 0 revisions - - 0.0 0.0 0 - age 10s ││ node-d637b06c91fe cron.fires green 0 crons - - 0.0 0.0 0 - depth 1 ││ node-d637b06c91fe db.local green 0 statements - - 0.0 0.0 0 - depth 1 ││ node-d637b06c91fe db.reader green 0 statements - - 0.0 0.0 0 - depth 1 ││ node-d637b06c91fe db.replica_missing green 0 revisions - - 0.0 0.0 0 - depth 1 ││ node-d637b06c91fe db.writer green 0 statements - - 0.0↓ 0.0 0 - depth 1 ││ node-d637b06c91fe dns.providers green 0 endpoints - - 0.0 0.0 0 - - ││ node-d637b06c91fe events.broadcast.node-3bc8877f7db3 green 0/256 events - - 0.0 0.0 0 - depth 128, ││ node-d637b06c91fe events.bus green 0/10000 events - - 0.4↓ 0.4↓ 0 - depth 5000 ││ node-d637b06c91fe events.detached_writes green 0/4096 events - - 0.0 0.0 0 - depth 1, a ││ node-d637b06c91fe events.pending_broadcast green 0 events - - 0.0 0.0 0 - depth 1000 ││ node-d637b06c91fe events.subscribers green 0/256 events - - 0.8↓ 0.8↓ 0 - depth 192, ││ node-d637b06c91fe health.retries green 0 deployments - - 0.0 0.0 0 - age 30m ││ node-d637b06c91fe leader.loops green 0 loops - - 0.0 0.0 0 - - ││ node-d637b06c91fe log.notify green 0 notifications - - 0.0 0.0 0 - depth 256, ││ node-d637b06c91fe mesh.pmtu.mesh0 green 0 rounds - - 0.0 0.0 0 - age 3m ││ node-d637b06c91fe mesh.pmtu.shc0 green 0 rounds - - 0.0 0.0 0 - age 3m ││ node-d637b06c91fe mesh.relay green 0 pairs - - 0.0 0.0 0 - age 5m ││ node-d637b06c91fe node.loops green 0 loops - - 0.0 0.0 0 - depth 1 ││ node-d637b06c91fe nodelease.renewal green 0 renewals - - 0.2 0.2 5 - depth 1, a │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node> <pressure>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud 'v' 'd' Escape$ tmux send-keys -t hud 'v' 'v' Escape$ tmux send-keys -t hud 'v' 't' Escape$ tmux send-keys -t hud 'v' 'w' Escape$ tmux send-keys -t hud 'v' 'f'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <v> Views Cluster: 2 nodes <1> default <d> Describe <y> YAML Deployments: 10 (10 healthy) <e> Edit Tenant: prod <?> Help Stack: all <shift-a> Sort Age Environment: all <shift-n> Sort Name shc9s Rev: 0.1.2┌─────────────────────────────────────────────────────────────────────── labels(all)[7] ───────────────────────────────────────────────────────────────────────┐│ LABEL↑ SOURCE NODES READY RESERVED CONSTRAINTS DEPLOYMENTS ││ cloud=learn derived 2 2 no 0 0 ││ control-plane system 2 2 no 0 0 ││ endpoint=public derived 2 2 no 0 0 ││ location=learn derived 2 2 no 0 0 ││ location=learn/home derived 2 2 no 1 1 ││ node=home02 derived 1 1 no 1 1 ││ storage=node=node-d637b06c91fe derived 1 1 no 0 0 ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <node> <label>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud ':workers' Enter$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <d> Describe Cluster: 2 nodes <1> default <ctrl-j> Follow Deployments: 10 (10 healthy) <?> Help Tenant: prod <shift-a> Sort Age Stack: all <shift-n> Sort Name Environment: all <y> YAML shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────────── workers(all)[2] ───────────────────────────────────────────────────────────────────────┐│ ID↑ NODE LEADER HEARTBEAT STARTED ││ 0bec1e29 home01 false 1s↓ 20m ││ 583ff868 home02 false 0s↓ 20m ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <worker>$ tmux send-keys -t hud ':tasks' Enter$ tmux capture-pane -pt hud...$ tmux send-keys -t hud 'g' 'a' Enter$ tmux capture-pane -pt hud...$ tmux send-keys -t hud Escape:labels is every label value, with its source, its members and the
deployments it shapes; e opens the form shc label set takes. Filter
to learn/home, the location placed’s rule names, and describe it.
:constraints is shc constraint ls; ctrl-n opens the form that sets
one and ctrl-d clears one. It opens sorted by ID, and an ID is random,
so shift-a sorts it by age to keep its rows in one order. :placement
is reached from a deployment with v then p, as the last page did.
$ tmux send-keys -t hud ':labels' Enter$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <v> Views Cluster: 2 nodes <1> default <d> Describe <y> YAML Deployments: 10 (10 healthy) <e> Edit Tenant: prod <?> Help Stack: all <shift-a> Sort Age Environment: all <shift-n> Sort Name shc9s Rev: 0.1.2┌─────────────────────────────────────────────────────────────────────── labels(all)[9] ───────────────────────────────────────────────────────────────────────┐│ LABEL↑ SOURCE NODES READY RESERVED CONSTRAINTS DEPLOYMENTS ││ cloud=learn derived 2 2 no 0 0 ││ control-plane system 2 2 no 0 0 ││ endpoint=public derived 2 2 no 0 0 ││ location=learn derived 2 2 no 0 0 ││ location=learn/home derived 2 2 no 1 1 ││ node=home01 derived 1 1 no 0 0 ││ node=home02 derived 1 1 no 1 1 ││ storage=node=node-3bc8877f7db3 derived 1 1 no 0 0 ││ storage=node=node-d637b06c91fe derived 1 1 no 0 0 ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <label>$ tmux send-keys -t hud '/' 'learn/home' Enter 'd'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <c> Copy Cluster: 2 nodes <n> Next Match Deployments: 10 (10 healthy) <shift-n> Prev Match Tenant: prod <r> Toggle Auto-Refresh Stack: all <x> Toggle Decode Environment: all <f> Toggle FullScreen shc9s Rev: 0.1.2┌─────────────────────────────────────────────────────────────── Describe(location=learn/home) ────────────────────────────────────────────────────────────────┐│ backup_repo: "" ││ created_at: 2026-10-10T18:25:00.705567543Z ││ deployment_count: 1 ││ deployments: ││ - deployment: prod/placed/prod ││ environment: prod ││ node: home01 ││ stack_name: placed ││ tenant_name: prod ││ via: where location=learn/home at deploy:prod:placed:prod ││ description: "" ││ id: location=learn/home ││ kind: location ││ members: ││ - availability: active ││ condition: ready ││ node: home01 ││ node_id: node-3bc8877f7db3 ││ source: derived ││ - availability: active ││ condition: ready ││ node: home02 ││ node_id: node-d637b06c91fe ││ source: derived ││ name: learn/home ││ origin: derived ││ ready: 2 ││ reserved: false ││ rule_count: 1 ││ rules: ││ - created_at: 2026-10-10T18:32:18.425479456Z ││ environment: prod ││ expr: location=learn/home │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <label> <describe>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud 'e'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <v> Views Cluster: 2 nodes <1> default <d> Describe <y> YAML Deployments: 10 (10 healthy) <e> Edit Tenant: prod <?> Help Stack: all <shift-a> Sort Age Environment: all <shift-n> Sort Name shc9s Rev: 0.1.2┌──────────────────────────────────────────────────────────────── labels(all)[1] </learn/home> ────────────────────────────────────────────────────────────────┐│ LABEL↑ SOURCE NODES READY RESERVED CONSTRAINTS DEPLOYMENTS ││ location=learn/home derived 2 2 no 1 1 ││ ││ ││ ││ ││ ┌──────────────<label location=learn/home>──────────────┐ ││ │ │ ││ │ The attributes of location=learn/home. │ ││ │ description: what the label value is │ ││ │ reserved: only deployments whose constraints name the │ ││ │ label value may run on its nodes │ ││ │ backup_repo: where this location's backups go; blank │ ││ │ clears it │ ││ │ │ ││ │ description: │ ││ │ reserved: │ ││ │ backup_repo: │ ││ │ │ ││ │ OK Cancel │ ││ │ │ ││ └───────────────────────────────────────────────────────┘ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <label>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud 'v' 'r' Escape$ tmux send-keys -t hud 'v' 'd' Escape$ tmux send-keys -t hud 'v' 'n' Escape$ tmux send-keys -t hud C-u ':constraints' Enter 'A'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <shift-n> Sort Name Cluster: 2 nodes <1> default <ctrl-d> Clear <v> Views Deployments: 10 (10 healthy) <d> Describe <y> YAML Tenant: prod <?> Help Stack: all <ctrl-n> New Environment: all <shift-a> Sort Age shc9s Rev: 0.1.2┌──────────────────────────────────────────────────────────────────── constraints(all)[2] ─────────────────────────────────────────────────────────────────────┐│ ID SCOPE TARGET FORM EXPRESSION REASON SET-BY CREATED↑ ││ cfd9f1d9 deployment prod/web3/prod prefer node=home02 - local: 15m ││ 03e377fd deployment prod/placed/prod where location=learn/home - local: 45m ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <constraint>$ tmux send-keys -t hud C-n$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <shift-n> Sort Name Cluster: 2 nodes <1> default <ctrl-d> Clear <v> Views Deployments: 10 (10 healthy) <d> Describe <y> YAML Tenant: prod <?> Help Stack: all <ctrl-n> New Environment: all <shift-a> Sort Age shc9s Rev: 0.1.2┌──────────────────────────────────────────────────────────────────── constraints(all)[2] ─────────────────────────────────────────────────────────────────────┐│ ID SCOPE TARGET FORM EXPRESSION REASON SET-BY CREATED↑ ││ cfd9f1d9 deployment prod/web3/pro┌───────────<a placement constraint in prod>────────────┐ - local: 16m ││ 03e377fd deployment prod/placed/p│ │ - local: 45m ││ │ A where keeps the deployments its scope covers on │ ││ │ nodes whose labels match it; a prefer ranks the nodes │ ││ │ that match first and rules none out. A scope given │ ││ │ replaces that form's row. A narrower scope only │ ││ │ narrows. Browse :nodes for the labels. │ ││ │ scope: cluster, tenant or deployment │ ││ │ stack: the deployment scope's stack │ ││ │ environment: the deployment scope's environment │ ││ │ where: a selector over node labels (key=value, key! │ ││ │ =value, & and |) the scope's deployments must run on │ ││ │ prefer: a selector over node labels the scope's │ ││ │ deployments should run on │ ││ │ reason: why the constraint exists, recorded with it │ ││ │ │ ││ │ scope: tenant │ ││ │ stack: │ ││ │ environment: │ ││ │ where: │ ││ │ prefer: │ ││ │ reason: │ ││ │ │ ││ │ OK Cancel │ ││ │ │ ││ └───────────────────────────────────────────────────────┘ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <constraint>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud 'g' C-d$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <shift-n> Sort Name Cluster: 2 nodes <1> default <ctrl-d> Clear <v> Views Deployments: 10 (10 healthy) <d> Describe <y> YAML Tenant: prod <?> Help Stack: all <ctrl-n> New Environment: all <shift-a> Sort Age shc9s Rev: 0.1.2┌──────────────────────────────────────────────────────────────────── constraints(all)[2] ─────────────────────────────────────────────────────────────────────┐│ ID SCOPE TARGET FORM EXPRESSION REASON SET-BY CREATED↑ ││ cfd9f1d9 deployment prod/web3/prod prefer node=home02 - local: 16m ││ 03e377fd deployment prod/placed/prod where location=learn/home - local: 45m ││ ││ ││ ││ ┌─────────────<Confirm Write constraints/prod/cfd9f1d9>──────────────┐ ││ │ │ ││ │ Run clear on constraints/prod/cfd9f1d9 │ ││ │ │ ││ │ clear this constraint's form (shc constraint clear) │ ││ │ │ ││ │ This is not reversible. │ ││ │ │ ││ │ Provider will run: │ ││ │ shc -e prod constraint clear --scope deployment --prefer -s web3 │ ││ │ │ ││ │ │ ││ │ Cancel Confirm Write │ ││ │ │ ││ └────────────────────────────────────────────────────────────────────┘ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <constraint>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud 'v' 'f' Escape$ tmux send-keys -t hud 'v' 'd' Escape:cluster is the cluster as one row: the leader, the voters, the host,
the mesh and the fabric, what five commands print. e opens the form that
changes the serving domain, shc cluster host set, and t reconciles the
modules, shc cluster reconcile, the verb page 00 of the seeing ladder
ran. v opens its nodes, certificates and workers.
$ tmux send-keys -t hud ':cluster' Enter$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <v> Views Cluster: 2 nodes <1> default <d> Describe <y> YAML Deployments: 10 (10 healthy) <e> Edit Tenant: prod <ctrl-j> Follow Stack: all <?> Help Environment: all <t> Reconcile shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────────── cluster(all)[1] ───────────────────────────────────────────────────────────────────────┐│ LEADER↑ VOTERS HOST MESH FABRIC ││ node-3bc8877f7db3 1/1 - on shc ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <cluster>$ tmux send-keys -t hud 'e'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <v> Views Cluster: 2 nodes <1> default <d> Describe <y> YAML Deployments: 10 (10 healthy) <e> Edit Tenant: prod <ctrl-j> Follow Stack: all <?> Help Environment: all <t> Reconcile shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────────── cluster(all)[1] ───────────────────────────────────────────────────────────────────────┐│ LEADER↑ VOTERS HOST MESH FABRIC ││ node-3bc8877f7db3 1/1 - on shc ││ ││ ││ ││ ┌────────────────────────<edit>─────────────────────────┐ ││ │ │ ││ │ change the serving domain (shc cluster host set), │ ││ │ which moves the SSO issuer and signs every session │ ││ │ out │ ││ │ setting: which one: host │ ││ │ value: the new domain │ ││ │ window: hours the old domain stays served (--grace, │ ││ │ default 24) │ ││ │ │ ││ │ setting: host │ ││ │ value: │ ││ │ window: │ ││ │ │ ││ │ OK Cancel │ ││ │ │ ││ └───────────────────────────────────────────────────────┘ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <cluster>$ tmux send-keys -t hud Escape$ tmux send-keys -t hud 't'$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <v> Views Cluster: 2 nodes <1> default <d> Describe <y> YAML Deployments: 10 (10 healthy) <e> Edit Tenant: prod <ctrl-j> Follow Stack: all <?> Help Environment: all <t> Reconcile shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────────── cluster(all)[1] ───────────────────────────────────────────────────────────────────────┐│ LEADER↑ VOTERS HOST MESH FABRIC ││ node-3bc8877f7db3 1/1 - on shc ││ ││ ││ ││ ││ ││┌──────────────────────────────────────────────────────────────<Confirm Write cluster/cluster>───────────────────────────────────────────────────────────────┐│││ ││││ Run reconcile on cluster/cluster named shc-cluster ││││ ││││ install the platform stacks the plan names and the master tenant lacks (shc cluster reconcile); starts each install and returns, and refuses a plan where ││││ ││││ Provider will run: ││││ shc cluster reconcile ││││ ││││ ││││ Cancel Confirm Write ││││ │││└────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <cluster>$ tmux send-keys -t hud Tab Enter$ tmux capture-pane -pt hud Daemon: unix:/run/shc/shc.sock (--dae… <0> all <a> Actions <v> Views Cluster: 2 nodes <1> default <d> Describe <y> YAML Deployments: 10 (10 healthy) <e> Edit Tenant: prod <ctrl-j> Follow Stack: all <?> Help Environment: all <t> Reconcile shc9s Rev: 0.1.2┌────────────────────────────────────────────────────────────────────── cluster(all)[1] ───────────────────────────────────────────────────────────────────────┐│ LEADER↑ VOTERS HOST MESH FABRIC ││ node-3bc8877f7db3 1/1 - on shc ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ ││ │└──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ <cluster>$ tmux send-keys -t hud 'v' 'n' Escape$ tmux send-keys -t hud 'v' 'c' Escape$ tmux send-keys -t hud 'v' 'w' Escape$ tmux send-keys -t hud C-cRemove web3 from the other shell.
$ shc uninstall web3 -yuninstalling deployment "web3"[web3] Complete 4/4✔ remove from home01✔ take the safety backup✔ leave every node's service VIP table✔ tear down✔ uninstalled deployment "web3"This page leaves home02 in the cluster and back in service, web3 gone, and
every other deployment on home01, where it was.
Next: Every other table.