deploy / deploy (push) Failing after 2s
The mailer moves in. Portal decides what to send and publishes it on this NATS; gdo is what hands it to a mail server, and it belongs here rather than shared, so the vel's mail leaves on the vel's own terms. It has no mail server of its own and relays through the host's - on kasse, Klingenberg Bygg's postfix - which is the one thing this stack borrows and the one line that changes if the vel ever gets a host of its own. Also: - portal v0.5.2, four releases on from the v0.3.36 this pinned. - The Kanidm setup makes the onboarding service account and its token. The vel's desks invite neighbours, and portal needs a token to do it; without one every invite fails closed. It goes in idm_people_on_boarding, which may create a person and issue a first credential reset and nothing else, plus idm_people_pii_read so an invite finds someone who already has an account instead of making them a second one. - The deploy workflow runs. It was pointed at a `tomtervel` runner label that has never existed, so every push queued and did nothing. It now runs on kasse's host runner, which is not root and may run one argumentless script that pulls this repo and brings the stack up. - The hosts default to vel.klingenbergbygg.no and id.vel.klingenbergbygg.no, which is where this actually runs. Both already resolve to kasse. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
134 lines
5.5 KiB
Markdown
134 lines
5.5 KiB
Markdown
# Tomter Vel — infrastructure
|
|
|
|
Everything the vel's own site needs on one host, as containers: Caddy
|
|
for TLS, NATS with JetStream for the records, Kanidm for who is who,
|
|
and portal, the site itself. The content (pages, forms, desks) lives
|
|
in [tomtervel/questions](https://prosjekt.klingenbergbygg.no/tomtervel/questions)
|
|
and is fetched from there; this repo owns the host.
|
|
|
|
```
|
|
Internet ──► Caddy (Let's Encrypt)
|
|
├── PORTAL_HOST ──► portal:3000 ──► NATS (records) + Kanidm (login)
|
|
└── ID_HOST ─────► kanidm:8443 (internal TLS)
|
|
```
|
|
|
|
Today the vel's draft site runs on Klingenberg Bygg's host as
|
|
vel.klingenbergbygg.no, sharing that host's Kanidm and NATS. This repo
|
|
is the same site on a host of the vel's own, with a Kanidm of its own,
|
|
so nothing about the vel's members or records depends on anyone else.
|
|
|
|
## First start
|
|
|
|
On a fresh Linux host with podman + podman-compose and openssl (run rootful,
|
|
i.e. as root, so Caddy can bind 80/443 and Kanidm sees a stable source IP):
|
|
|
|
```sh
|
|
git clone https://prosjekt.klingenbergbygg.no/tomtervel/infrastructure /srv/tomtervel/infrastructure
|
|
cd /srv/tomtervel/infrastructure
|
|
cp .env.example .env # set PORTAL_HOST and ID_HOST; DNS must point here
|
|
sudo sh bootstrap.sh # renders configs, makes the internal cert, starts, recovers Kanidm admin
|
|
sh kanidm-setup.sh # logs in, creates the portal client and desk groups, restarts portal
|
|
```
|
|
|
|
`bootstrap.sh` prints the `admin` and `idm_admin` passwords once;
|
|
write them down. After `kanidm-setup.sh`, https://PORTAL_HOST serves the
|
|
site and https://ID_HOST is the login.
|
|
|
|
## Running on kasse (behind the host Caddy)
|
|
|
|
The vel keeps its **own** Kanidm and NATS here so it can later lift onto a host
|
|
of its own unchanged — on kasse it just runs in isolation, fronted by kasse's
|
|
existing host Caddy (which owns 80/443). So the bundled Caddy stays off (it's
|
|
behind `profiles: [edge]`); run the default `podman compose up -d --build`.
|
|
The services publish loopback-only ports for the host Caddy to reach:
|
|
|
|
- portal → `127.0.0.1:3050`
|
|
- kanidm → `127.0.0.1:8443` (internal self-signed TLS)
|
|
- nats → `127.0.0.1:4223` (kasse's shared platform NATS owns 4222)
|
|
|
|
Add two host-Caddy site blocks in `/etc/caddy/conf.d/`, using the vel's `.env`
|
|
hosts (`vel.klingenbergbygg.no → :3050` already exists):
|
|
|
|
```
|
|
<PORTAL_HOST> {
|
|
reverse_proxy localhost:3050
|
|
}
|
|
<ID_HOST> {
|
|
reverse_proxy https://localhost:8443 {
|
|
transport http { tls_insecure_skip_verify }
|
|
}
|
|
}
|
|
```
|
|
|
|
Then `sudo systemctl reload caddy`, point the content repo's `lint-and-reload`
|
|
reload step at `nats://127.0.0.1:4223`, and retire the old systemd portal:
|
|
`sudo systemctl disable --now app@tomtervel-portal`.
|
|
|
|
## People and desks
|
|
|
|
Each group in the content (`qualifies:` under `questions/`) is a
|
|
Kanidm group `tomtervel_<group>`, all members of `tomtervel_members`.
|
|
Someone in `tomtervel_styret` logs in and sees the board's desk.
|
|
|
|
```sh
|
|
kanidm -D idm_admin -H https://ID_HOST person create kari "Kari Lien"
|
|
kanidm -D idm_admin -H https://ID_HOST person update kari --mail kari@example.no
|
|
kanidm -D idm_admin -H https://ID_HOST person credential create-reset-token kari
|
|
kanidm -D idm_admin -H https://ID_HOST group add-members tomtervel_styret kari
|
|
```
|
|
|
|
Membership is read at login; someone added while logged in logs out
|
|
and in again.
|
|
|
|
## Content changes
|
|
|
|
A push to tomtervel/questions is linted on push and tells the portal
|
|
to reload over NATS. That reload reaches the host it runs on: today
|
|
Klingenberg Bygg's. On this host the runner is a **host service**
|
|
(`pacman -S gitea-runner`, registered against prosjekt.klingenbergbygg.no) —
|
|
not an in-compose container — so it reaches NATS on the published
|
|
`127.0.0.1:4222`. Give the content repo's `lint-and-reload.yml` a reload job
|
|
whose `runs-on` matches that runner's host label, running
|
|
`nats --server nats://portal:$NATS_PASSWORD@127.0.0.1:4222 pub portal.content.reload ""`.
|
|
Until then, `podman compose restart portal` picks up new content.
|
|
|
|
## Upgrading portal
|
|
|
|
Bump `PORTAL_RELEASE` in `.env` (a tag of uhhm/portal) and
|
|
`podman compose up -d --build portal`. Keep `IRIS_RELEASE` in the
|
|
content repo's workflow matched to it.
|
|
|
|
## Backups
|
|
|
|
- Kanidm writes a nightly backup into its volume (`/data/backups`,
|
|
seven kept); copy that directory off the host.
|
|
- NATS JetStream data is the `nats_data` volume: every record ever
|
|
submitted and every state change. Snapshot the volume.
|
|
- Caddy's certificates regenerate; nothing to keep.
|
|
|
|
## What is not here
|
|
|
|
Mail (a person's reset link is a token you hand them), monitoring, and
|
|
the vel's current website at tomtervel.no, which stays where it is
|
|
until the vel points the apex at PORTAL_HOST.
|
|
|
|
## Mail
|
|
|
|
Portal decides what to send - a `mail:` on a state in the content, or an
|
|
invite - and publishes it on this stack's NATS. `gdo` is what hands it to
|
|
a mail server, and it runs here, in the vel's own stack, so the vel's mail
|
|
leaves on the vel's own terms.
|
|
|
|
It has no mail server of its own. It relays through the host's, which on
|
|
kasse is Klingenberg Bygg's postfix on port 25, reached from the container
|
|
as `host.containers.internal`. That is the one thing in this stack the vel
|
|
borrows, and the one thing that changes if the vel ever moves to a host of
|
|
its own: point `SMTP_HOST` at whatever that host runs.
|
|
|
|
`site.yaml` in the content repo needs a `mail.from`, or portal has nothing
|
|
to send from and says so in its log.
|
|
|
|
Replies are not read yet: `JMAP_URL`, `JMAP_TOKEN` and `MAIL_REPLY_DOMAIN`
|
|
turn a reply into a note on the record it answers, and none of them are set
|
|
here.
|