fix(ci): poll the health endpoint instead of sleeping a fixed 3s
The deploy failed with "curl: (7) Failed to connect to 127.0.0.1 port 8998
after 0 ms" on a service that was in fact running. "after 0 ms" is
connection-refused, not a timeout: the check fired before uvicorn had bound the
port. A fixed "sleep 3" followed by a single curl has no retry, so it fails the
whole deploy whenever startup runs a second long.
Raising the sleep would slow every deploy and still race on a bad day. This
polls once a second for up to 60s and exits as soon as the app answers, so a
fast start costs nothing and a slow one no longer fails.
On a genuine failure it now dumps systemctl status and the last 80 journal
lines, so the cause is visible without running a second deploy to go looking.
The heredoc is quoted so the loop's $i and $(seq) expand on the remote host
rather than in the runner's shell; that block has no local variables or
${{ }} expressions, so quoting is safe here.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01HAH7vVtn7qbcn1EVheecHQ
This commit is contained in:
1 parent
25e821435d
commit
6ac4b31dfa
1 file changed
+23
-5
@@ -166,13 +166,31 @@ jobs:
|
|||||||
|
|
||||||
- name: Restart service & health check
|
- name: Restart service & health check
|
||||||
run: |
|
run: |
|
||||||
ssh $SSH_OPTS "${DEPLOY_USER}@${DEPLOY_HOST}" << REMOTE_SCRIPT
|
# Quoted heredoc: the loop's $i / $(seq) must be expanded on the
|
||||||
|
# REMOTE host, not by this runner's shell before it is sent.
|
||||||
|
ssh $SSH_OPTS "${DEPLOY_USER}@${DEPLOY_HOST}" << 'REMOTE_SCRIPT'
|
||||||
set -e
|
set -e
|
||||||
sudo systemctl restart signalplatform.service
|
sudo systemctl restart signalplatform.service
|
||||||
sleep 3
|
|
||||||
curl -fsS http://127.0.0.1:8998/api/v1/health > /dev/null \
|
# Poll instead of guessing how long startup takes. The old fixed
|
||||||
|| { echo "✗ health check failed after restart"; exit 1; }
|
# "sleep 3" then single curl raced whenever startup ran long, and
|
||||||
echo "✓ signalplatform deployed"
|
# failed the deploy with a bare "connection refused" on a service
|
||||||
|
# that came up healthy a second later. This exits as soon as the app
|
||||||
|
# answers, so a fast start costs nothing.
|
||||||
|
for i in $(seq 1 60); do
|
||||||
|
if curl -fsS http://127.0.0.1:8998/api/v1/health > /dev/null 2>&1; then
|
||||||
|
echo "✓ signalplatform deployed — healthy after ${i}s"
|
||||||
|
exit 0
|
||||||
|
fi
|
||||||
|
sleep 1
|
||||||
|
done
|
||||||
|
|
||||||
|
# Still down after a minute: this is a real failure, so leave enough
|
||||||
|
# behind to diagnose it without a second deploy.
|
||||||
|
echo "✗ health check failed: no response on :8998 after 60s"
|
||||||
|
sudo systemctl status signalplatform.service --no-pager -l || true
|
||||||
|
journalctl -u signalplatform.service -n 80 --no-pager || true
|
||||||
|
exit 1
|
||||||
REMOTE_SCRIPT
|
REMOTE_SCRIPT
|
||||||
|
|
||||||
- name: Clean up SSH key
|
- name: Clean up SSH key
|
||||||
|
|||||||
Reference in new issue
Block a user