New Adventures in Administration: Docker Compose and One-Touch Setup
Sat Dec 04 14:23:58 EST 2021
As I do from time to time, this weekend I dipped a bit into the more server-admin-focused side of Domino development. This time, I had set out to improve the deployment experience for one of my client's apps. This is the sprawling multi-NSF-plus-OSGi one, and I've long been blessed to not have to worry about actually deploying anything. However, I knew in the back of my head the whole time that it must be fairly time-consuming between installing Domino, getting all the Java code in place, deploying the DBs, and configuring all the documents that associate them.
I had also had a chance this past week to give Docker Compose a swing. Though I'd certainly known of it for a good while, I hadn't actually used it for anything - all my Docker scripting involved really fiddly operations that I ended up using Bash scripts to launch a single container for anyway, so Compose didn't bring so much to the table. However, using it to tie together the process of launching a Postgres server with pre-populated user info and schema scripts whetted my appetite.
So today I set out to tinker with the Domino side of things.
Deploying To The Domino Data Directory
Some parts of this were the same as what I've done before: I wanted to deploy some JARs to jvm/lib/ext for legacy purposes and then drop ".java.policy" into the notes
user's home directory. That was accomplished easily enough with some COPY
operations in the Dockerfile:
1 2 | COPY program/ /opt/hcl/domino/notes/latest/linux/ COPY --chown=notes java.policy /local/notes/.java.policy |
What wouldn't be accomplished so easily, though, would be getting files into the data directory: the app's NTFs and the OSGi plugins. This is because of the way the Domino Docker image works, where it deploys the contents of a ZIP to /local/notesdata
on launch, in order to let you work properly with mounted volumes. Because of this, I couldn't just copy the files there in the Dockerfile, since it would conflict with the volume mount; however, I still wanted to do this in an automated way.
This was my impetus to switch away from the official Docker images on Flexnet and over to the "community-ish" Domino-on-Docker build script maintained at https://github.com/IBM/domino-docker. This script is generally more feature-rich than the official one, and one feature in particular caught my eye: the ability to add your own ZIP file (or URL, I believe) to deploy to the data directory at first launch.
So I downloaded the repo, build the image, bundled the OSGi plugins and NTFs into a ZIP, and altered my Dockerfile:
1 2 3 4 5 | FROM hclcom/domino:12.0.0 COPY program/ /opt/hcl/domino/notes/latest/linux/ COPY --chown=notes java.policy /local/notes/.java.policy COPY --chown=notes data.zip /tmp/ |
Then, I set the environment variable in my "docker-compose.yaml" file: CustomNotesdataZip=/tmp/data.zip
. That worked like a charm.
One-Touch Setup
Next up, I wanted to automate the initial server setup. I knew that Domino had been gaining some automated setup capabilities recently, and that they really came of age in V12. What I hadn't appreciated until today is how much capability this system has. I'd figured it would let you configure the server either as a new domain or additional and to create an admin user, but I hadn't noticed that it also has the ability to declaratively create and modify databases and documents. Looking over the sample file that Daniel Nashed put up, I realized that this would cover essentially all of my remaining needs.
The file there was most of what I needed: other than tweaking the server and user names, the main things I'd want to change in the basic config were to set HTTP_AllowAnonymous
/HTTP_SSLAnonymous
to "1" and also add a line to set OnBehalfOfInvokerLst
to "LocalDomainAdmins" (which allows XPages to run properly).
Then, I got to the meat of the app deployment. That's all done in the $.appConfiguration.databases
object near the bottom, and I set out to adding entries to deploy each of the NTFs I'd copied to the data directory, and adding the required documents to tie them together. This also went smoothly.
The Final Scripts
The final form of the setup is pretty clean. The Dockerfile is very similar to the above, with just an added line to copy in the config file:
1 2 3 4 5 6 | FROM hclcom/domino:12.0.0 COPY program/ /opt/hcl/domino/notes/latest/linux/ COPY --chown=notes java.policy /local/notes/.java.policy COPY --chown=notes domino-config.json /tmp/ COPY --chown=notes data.zip /tmp/ |
The docker-compose.yaml file is longer, but I think pretty explicable. It maps the ports, sets up some volumes for the various persistent-data portions of Domino, and configures the environment variables for setup:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 | services: clientapp: build: . ports: - "1352:1352" - "80:80" - "443:443" volumes: - data:/local/notesdata - ft:/local/ft - nif:/local/nif - translog:/local/translog - daos:/local/daos restart: always environment: - LANG=en_US.UTF-8 - CustomNotesdataZip=/tmp/data.zip - SetupAutoConfigure=1 - SetupAutoConfigureParams=/tmp/domino-config.json volumes: data: {} ft: {} nif: {} translog: {} daos: {} |
Miscellaneous Notes
In doing this, I came across a few things that are worth noting for anyone diving into it clean as I was:
- Docker Compose (intentionally) doesn't rebuild images on
docker compose up
when they already exist. Since I was changing all sorts of stuff, I switched todocker compose build && docker compose up
. - Errors during server autoconfig don't show up in the console output from
docker compose up
: if the server doesn't come up like you expect, check in "/local/notesdata/IBM_TECHNICAL_SUPPORT/autoconfigure.log". It's easy for a problem to gum up the whole works, such as when using"computeWithForm": true
on a created document throws an exception. - Daniel's example autoconf file above places the admin user ID in "/local/notesdata/domino/html/admin.id", so it will be accessible via http://servername/admin.id after the server comes up. Alternatively, you could snag it by copying it via Docker commands.
- This really drives home the desperate need for a full web-based admin app for Domino.
All in all, this was a delight to work with. Next, I should be able to make a script that generates the config JSON for me based on all the app's NTFs, and then include that whole thing as part of the Maven build in a distribution ZIP. That will be pretty neat.