Yissum - Research Development Company of the Hebrew University

SPADE: Sub-Image Anomaly Detection with Deep Pyramid Correspondences

Posted by Yissum - Research Development Company of the Hebrew UniversityResponsive · Innovative Products and Technologies · Israel

Summary of the technology

Nearest neighbor (kNN) methods utilizing deep pre-trained features exhibit very strong anomaly detection performance when applied to entire images. A limitation of kNN methods is the lack of segmentation map describing where the anomaly lies inside the image. In this work we present a novel anomaly segmentation approach based on alignment between the anomalous image and a constant number of the nearest normal images. Our method, Semantic Pyramid Anomaly Detection (SPADE) uses correspondences based on a multi-resolution feature pyramid. SPADE is shown to achieve state-of-the-art performance on unsupervised anomaly detection and localization while requiring virtually no training time.
Project ID : 47-2020-10918

Yissum - Research Development Company of the Hebrew University
Yissum - Research Development Company of the Hebrew University

Description of the technology

Category

Computer vision

Keywords

Anomaly detection, Nearest-neighbors, Feature pyramid

Development stage

Looking for industrial POC

Application

A key human talent is the ability to detect the novel images that deviate fromprevious patterns triggering particular vigilance on the part of the human agent.Due to the importance of this task, allowing computers to detect anomalies is akey task for artificial intelligence. An example of this as a real world application is fault detection at assembly lines in which the challenge would be to replace a human operator with computer vision solutions.

The algorithms for anomaly detection will be trained to deal with unexpected images that were unavailable during the training set.In addition, and in particular, for the visual anomalies detection – the localization of the part of the anomalous image segment is crucial for building trust between operators and novel AI systems.

Our Innovation

Our researcher has developed a new method for solving the task of sub-image anomaly detection and segmentation. Our method does not require an extended training stage; it is fast robust and achieves state-of-the-art performance. The method has been extensively evaluated on an industrial product dataset as well as a surveillance dataset in a campus setting. Our method achieves state-of-the-art performance both on the image-level and pixel-level anomaly detection.

Fig. 1. An evaluation of SPADE on detecting anomalies between owers with or without insects (taken from one category of 102 Category Flower Dataset) and bird varieties (taken from Caltech-UCSD Birds 200). (left to right) i) An anomalous image ii) The retrieved top normal neighbor image iii) The mask detected by SPADE iv) The predicted anomalous image pixels. SPADE was able to detect the insect on the anomalous ower (top), the white colors of the anomalous albatross (center) and the missing red spot on the anomalous bird (bottom).

Fig. 2. (top rows) Anomaly detection on images from the Cable and Grid categories of the MVTec dataset

In the experiments conducted, the researcher compared the SPADE method against several methods that were recently introduced, as well as longer standing baselines such as OCSVM. For each setting, we compared against the methods that reported the suitable metric.

Opportunity

Anomaly detection is can be useful across an array of industries and for a variety of purposes, including IT and DevOps, manufacturing, healthcare, banking and finance, and in the public sector.

Project manager

Anna Pellivert
VP, BUSINESS DEVELOPMENT

Project researchers

Yedid Hoshen
HUJI, School of Computer Science and Engineering
Computer Science

Related keywords

  • Information Processing, Information System, Workflow Management
  • IT and Telematics Applications
  • Multimedia
  • Computers
  • Computer Graphics Related
  • Specialised Turnkey Systems
  • Scanning Related
  • Peripherals
  • Computer Services
  • Computer Software Market
  • Other Computer Related
  • Computer Science & Engineering
  • Neural Networks

About Yissum - Research Development Company of the Hebrew University

Technology Transfer Office from Israel

Yissum Research Development Company of the Hebrew University of Jerusalem Ltd. Founded in 1964 to protect and commercialize the Hebrew University’s intellectual property. Ranked among the top technology transfer companies, Yissum has registered over 8,900 patents covering 2,500 inventions; has licensed out 800 technologies and has spun-off 90 companies. Products that are based on Hebrew University technologies and were commercialized by Yissum generate today over $2 Billion in annual sales.

Send your request

By clicking "Send your request" you are signing up and accepting our Terms of Service and Privacy policy

Technology Offers on Innoget are directly posted and managed by its members as well as evaluation of requests for information. Innoget is the trusted open innovation and science network aimed at directly connect industry needs with professionals online.