FathomNet Validator

Important

This project is obsolete and has been supersceded by the FathomNet support project

This project contains applications that support fathomnet:

1. validate-images - An application that checks that image links are not broken (are valid). It will also grab image metadata and store it in FathomNet as needed.
2. invalid-image-notify - Notifies submitters of any image links they own that are broken.

Usage

For the most current usage of a script, run the script with the --help flag:

invalid-image-notify --help
validate-images --help

Developers

Useful commands

sbt stage      # Builds executable scripts to target/universal/stage/bin
build.sh       # Builds, pushes, and deploys to quasar a docker image

Deployment info

These tools are provided as a docker image. Example usage:

docker login   # required as this is a private container
docker pull mbari/fathomnet-validator:latest
docker run --name fv mbari/fathomnet-validator validate-images --help

quasar.shore.mbari.org

The applications are scheduled to run on quasar periodically under the user brian. The crontab entries are:

# Everyday, check for new images (but grab the last two days just in case to avoid gaps)
0 0 * * * docker run --name fv mbari/fathomnet-validator validate-images -d 2 > /u/brian/Library/Logs/quasar-validate-images-daily.log 2>&1;docker rm fv > /dev/null 2>&1

# Once a month check all the image links
0 0 1 * * docker run --name fv mbari/fathomnet-validator validate-images -f > /u/brian/Library/Logs/quasar-validate-images-monthly.log 2>&1; docker rm fv > /dev/null 2>&1

# Once a week send out a notification of invalid links to their owners
0 0 * * 0 docker run --name fv mbari/fathomnet-validator invalid-image-notify > /u/brian/Library/Logs/quasar-invalid-image-notify.log 2>&1; docker rm fv > /dev/null 2>&1