Evaluating edge detection? Don’t use RMSE, PSNR or SSIM.

Empirical and theoretical proof for why Determine of Advantage (FOM) is one of the best edge-detection analysis metric

Picture segmentation and edge detection are intently associated duties. Take this output from a coastal segmentation mannequin for instance:

Determine 1: going from segmention masks to edge map (supply: creator) (dataset: LICS) (CC BY 4.0)

The mannequin will classify each pixel as both land or ocean (segmentation masks). Then the shoreline is the pixels the place this classification modifications (edge map). Typically, edge detection might be performed utilizing the boundaries of the output of a picture segmentation mannequin.

I needed to make use of this relationship in my analysis to assist consider coastal picture segmentation fashions. Related analysis all use confusion matrix-based metrics like accuracy, precision and recall. These examine all pixels in a predicted segmentation masks to a floor reality masks.

The issue is these would possibly overestimate efficiency in a very powerful area — the shoreline.

Nearly all of pixels are in the course of the ocean or utterly surrounded by land. This makes them simpler to categorise than these near the shoreline. You’ll be able to see this in Determine 2. Sadly, these errors could also be shrouded within the sea of appropriately categorized pixels.