Based on prof.

Iwanowski's slides
Intelligent vision systems
2
What is an intelligent vision system (IVS)?
Intelligent vision system consits of:
Vision sensor (camera)
Image processing and analysis unit (computer, microcontroller,
specialized circuit)
System observes a region of interests of the real world
and based on it generates the output signal which
can be:
Information on the position of elements of vision scene
Identification of the elements of vision scene
Recognition of information present within the vision scene
Signal is further transmited to higher-level control system
which makes decision based upon the output of the
vision system.
3
Properties of the IVS
In most of cases it cooperates with other
systems (control, supervisory..)
It is the real-time system. The image acquisition
and processing must be performed as fast as
the given task requires
It acquires and analyzes (recognizes) the visual
scene artificial intelligence !
4
Types of the IVS (1)
Systems in industrial manufacturing facilities:
Cameras are observing industrial processes
The distance between the camera and elements of visual scenes is
short
The position of the camera and observed objects of visual scene is
fixed
Constant lighting
Stationary camera
Single images are analized
Output: classification of produced goods: properly/improperly
manufactured/located, object classification, character/codes
recognition
5
Types of the IVS (2)
Biometric systems
Camera read an image of biometric data (fingerprints,
iris, etc.)
The distance between the camera and elements of
visual scenes is short
The posision of the camera and observed objects of
visual scene is fixed
Constant lighting
Stationary camera
Single images are analized
Output biometric data of a person (feature vector)
6
Types of the IVS (3)
Security systems (supervision):
Cameras are observing the scene of the real world
(streets, rooms etc.)
Long distance between the camera and observed
objects
Objects of the visual scene can move
Irregular illumination
Still or moving camera
Often: analysis of image sequences
Output: location of objects and their identification,
tracking
7
Types of the IVS (4)
Mobile robotic systems:
Cameras are observing the surroundings of the moving robot
Variable distance between the camera and observed objects
Moving objects of the visual scene
Irregular illumination
Camera installed on the mobile robot, moves together with it
Analysis of image sequences
Output: location of objects and its identification, creation of maps
of the working area
8
Tasks of IVS
Classification:
Right/wrong (shape, color, etc.)
Correctly/incorrectly located
Recognition:
Characters
Bar codes, other kinds of codes
Biometric features
Position estimation:
Location of object(s) relative to the camera
Creation of maps of the working area
Tracking:
Objects of given properties
9
Structure of the IVS
Integrated devices
Camera and processing unit in single housing
Modular specialized systems
Camera connected with specialized vision
system
PC-based sysems
Camera connected to the PC-computer
through a frame-grabber card
10
Software
Libraries of procedures/functions of image processing
to implement in ones own application (most often
C/C++) e.g. OpenCV
Work environments with user interfaces
MATLAB + Image Processing Toolbox + Image
Acquisition Toolbox:
Well-known powerful engineering application (Unix and Win)
Easy to use (command line)
Possibility to design windows appliactions
Set of precedures of image processing and pattern recognition
(IP Toolbox)
11
Character/codes recognition
12
Object detection
13
Quality control (1)
Detection of missing and badly placed
chocolates
14
Quality control (2)
15
Quality control (3)
16
Quality control (4)
17
Cherry sorting system
3 cameras (FireWire, 1280x960)
Color sorting according to color (97% accuracy)
Infrared contour detction
Monochrome with filter defect detection (85% acc.)
Image acquisition rate 3x10 fps
http://www.ellips.nl/