External File Store and/or Repository in Unknown Status on Tableau Server

Issue

The External Filestore and Repository are showing as unavailable and the server is degraded.

When issuing a "tsm status -v", the output shows:

external:
        Status: ERROR
        'Tableau Server File Store 0' status is unavailable.
        'Tableau Server Repository 0' status is unavailable.

Environment

Tableau Server

Resolution

Restart the Tabadminagent services on all nodes to force the new election of service that will monitor external processes.

Option 1 - Tableau command line

From a command prompt on each node run:
- sc stop tabadminagent_0
Starting with Node 1 then on the other two run:
- sc start tabadminagent_0
Check tsm status -v and verify external processes status - move to next option if not resolved

Option 2 - Windows Services Console

Use the Windows Services Console on each node to restart the service or do to a tsm stop and restart the cluster hosts.

Cause

Tableau Server Admin Agent processes stopped monitoring external processes causing status to show as unavailable.

Additional Information

Tabadminagent logs will show the following when the external monitor stops working:

13237: 2023-02-25 20:38:16.442 -0600 ExternalStatusRequestDispatcher-0 : INFO com.tableausoftware.tabadmin.agent.status.ExternalStatusStore - Posting external status update ACTIVE for pgsql: 13.8
13248: 2023-02-25 20:38:18.144 -0600 ExternalStatusRequestDispatcher-0 : INFO com.tableausoftware.tabadmin.agent.status.ExternalStatusStore - Posting external status update ACTIVE for filestore: Successfully wrote and read back test file on network share \\corp\appdata\vacp_extracts_p\status
13413: 2023-02-25 20:38:48.148 -0600 ExternalStatusRequestDispatcher-0 : INFO com.tableausoftware.tabadmin.agent.status.ExternalStatusStore - Posting external status update DOWN for filestore
13414: 2023-02-25 20:38:48.148 -0600 ExternalStatusRequestDispatcher-0 : INFO com.tableausoftware.tabadmin.agent.status.ExternalStatusStore - Posting external status update DOWN for pgsql

Tabadmin agent log showing lost of leadership and ending of ExternalServiceMonitorCoordinator with no process taking over:

20352: 2023-02-25 21:29:44.081 -0600 SpringApplicationShutdownHook : INFO com.tableausoftware.tabadmin.agent.topology.ExternalServiceMonitorCoordinator - Stopping
20353: 2023-02-25 21:29:44.081 -0600 Curator-LeaderSelector-0 : INFO com.tableausoftware.tabadmin.agent.topology.ExternalServiceMonitorCoordinator - Interrupted in leaderCallback(); giving up leadership
20354: 2023-02-25 21:29:44.082 -0600 Curator-LeaderSelector-0 : INFO com.tableausoftware.tabadmin.agent.topology.ExternalServiceMonitorCoordinator - Lost leadership; I will stop managing external services lifecycles
20563: 2023-02-25 21:32:38.048 -0600 Thread-0 : INFO com.tableausoftware.tabadmin.agent.topology.ExternalServiceMonitorCoordinator - Joining leadership election...