About

Managing large image libraries can be a time-consuming task for editors. Manually setting focus points, tagging images with keywords, and identifying dominant colors ties up valuable editorial time and is prone to inconsistency.

The AI Image Services extension for CoreMedia Content Cloud solves this problem by automating image analysis directly inside CoreMedia Studio.

The extension integrates Amazon Rekognition as an AI backend to analyze pictures and automatically enrich them with:

• Focus Point Detection
  • Identifies the most visually relevant area of an image by recognising faces and objects, and writes the result directly to the picture's focus point coordinates.
• Metadata Generation
  • Generates descriptive keywords (labels), dominant colors, and the focus point for a picture in a single step.
• Post-Upload Automation
  • Automatically triggers metadata generation every time a new picture is uploaded, so images are always enriched without any manual intervention.

The AI actions are seamlessly integrated into the CoreMedia Studio UI.

Image Editor

AI actions are available directly inside the image editor for quick, in-context enrichment.

Picture Metadata Form

A Generate Metadata button and a Dominant Colors field appear alongside the keywords field on the picture metadata form.

Library

AI actions are available in the library toolbar for bulk processing of multiple images at once.

Upload Dialog

Option to automatically analyze pictures on upload.

The PictureAnalyzer backend interface is designed to be replaceable, making it straightforward to swap out Amazon Rekognition for any other AI image analysis service.

Installation

You can get the source code here: https://github.com/coremedia-contributions/blueprint-ai-image-services

It is provided and installed as a CoreMedia Extension.

Requirements

• CoreMedia Content Cloud
• AWS account with access to Amazon Rekognition
• AWS Access Key ID and Secret Access Key with Rekognition permissions

Support

This App is part of CoreMedia Labs. CoreMedia Labs provides access to our latest and greatest product enhancements, ideas, and early prototypes. We want to share this with our customers and partners early to collect feedback and learn how to improve our software.

The code we provide is meant to be example code, illustrating a set of features that could be used to enhance your CoreMedia experience. We'd love to hear your feedback on use-cases and further developments! Please refer to the GitHub issues section if you have problems with our code. If you already have a solution to an issue, we love to review and integrate your pull requests.