1.5. Packaging your AI model into an OCI image

Procedure

1. Prepare a Containerfile with a compatible model and model server.

   Example Containerfile with a ResNet-50 model used with the OVMS

   FROM registry.access.redhat.com/ubi9/ubi-minimal:latest
   RUN microdnf install -y wget && microdnf clean all
   RUN mkdir -p /models/1 && chmod -R 755 /models/1
   RUN wget -q -P /models/1 \
     https://storage.openvinotoolkit.org/repositories/open_model_zoo/2022.1/models_bin/2/resnet50-binary-0001/FP32-INT1/resnet50-binary-0001.bin \
     https://storage.openvinotoolkit.org/repositories/open_model_zoo/2022.1/models_bin/2/resnet50-binary-0001/FP32-INT1/resnet50-binary-0001.xml

2. Set the IMAGE_REF environment variable to simplify your process by running the following command:

   $ IMAGE_REF=<ovms-resnet50:test> 

   1

   1

   Replace <ovms-resnet50:test> with the name of your image reference. In this example, the <repo:tag> format is used. Your image reference name is specific to your use case.

3. Build the Containerfile by running the following command:

   $ sudo podman build -t $IMAGE_REF 

   1

   1

   Because CRI-O and Podman share storage, using sudo is required to make the image part of the root’s container storage and usable by MicroShift.

   Example output

   STEP 1/4: FROM registry.access.redhat.com/ubi9/ubi-minimal:latest
   Trying to pull registry.access.redhat.com/ubi9/ubi-minimal:latest...
   Getting image source signatures
   Checking if image destination supports signatures
   Copying blob 533b69cfd644 done   |
   Copying blob 863e9a7e2102 done   |
   Copying config 098048e6f9 done   |
   Writing manifest to image destination
   Storing signatures
   STEP 2/4: RUN microdnf install -y wget && microdnf clean all
   << SNIP >>
   --> 4c74352ad42e
   STEP 3/4: RUN mkdir -p /models/1 && chmod -R 755 /models/1
   --> bfd31acb1e81
   STEP 4/4: RUN wget -q -P /models/1   https://storage.openvinotoolkit.org/repositories/open_model_zoo/2022.1/models_bin/2/resnet50-binary-0001/FP32-INT1/resnet50-binary-0001.bin   https://storage.openvinotoolkit.org/repositories/open_model_zoo/2022.1/models_bin/2/resnet50-binary-0001/FP32-INT1/resnet50-binary-0001.xml
   COMMIT ovms-resnet50:test
   --> 375b265c1c4b
   Successfully tagged localhost/ovms-resnet50:test
   375b265c1c4bc6f0a059c8739fb2b3a46e1b563728f6d9c51f26f29bb2c87

4. Optional: Push the Containerfile to your registry by running the following command:

   $ sudo podman push $IMAGE_REF

   重要

   For offline use cases, include a tag other than latest. If the latest tag is used, the container that fetches and sets up the model is configured with the imagePullPolicy: parameter set to Always and the local image is ignored. If you use any other tag than latest, the imagePullPolicy: parameter is set to IfNotPresent.