ENVI Deep Learning 1.2 provides the capability to train and classify object detection models. Object detection can be used to locate features with similar spatial, spectral, and textural characteristics. This is different than previous versions of ENVI Deep Learning that located features only on a pixel-by-pixel basis (referred to as pixel segmentation). While that method is still available, object detection is new to this release. Object detection can be used to extract objects that touch or overlap, unlike pixel segmentation. ENVI uses the RetinaNet convolutional neural network (CNN) for object detection.

The following image shows an example of using object detection to locate ships. Red bounding boxes mark the locations of ships. Click on the thumbnail to see a larger image.

Object detection involves these steps:

  1. Label features in one or more images by drawing bounding boxes around them. Bounding boxes can be in the form of rectangle annotations or polygon regions of interest (ROIs).

  2. Pass the labeled images (called object detection rasters) to a trainer. The result is a trained model in HDF5 format.

  3. Classify the same or other rasters using the trained model. The result is a set of bounding boxes drawn around identified features. Each box belongs to a particular class.

A number of changes were implemented to support object detection:

  • The Deep Learning Guide Map provides a guided path to label, train, and classify object detection models.

  • The Deep Learning Labeling Tool has a new Project Type drop-down list that lets you set up an Object Detection or Pixel Segmentation project. If you select Object Detection, the Labeling Tool lets you draw rectangle annotations around features of interest. You can also import existing annotation files for labeling. The Labeling Tool automatically creates object detection rasters when you are finished with labeling. You can then proceed with training within the Labeling Tool.

  • Mask-based pixel segmentation models (ENVINet5 and ENVINetMulti) had to be explicitly initialized before training could occur, except when using the Labeling Tool to train the models. With object detection, model initialization occurs automatically without any user input.

New standalone tools are also available for object detection. Access them from the ENVI Toolbox or the Tools menu in the Guide Map:

See the following topics to learn more about object detection:

Programming


The following objects are new:

The following tasks are new: