Documentos de Académico
Documentos de Profesional
Documentos de Cultura
ComputerVision
Today!
Definition RelatedDisciplines WhyisComputerVisionDifficult? RecognitionMethodology TheThreeProcessingLevels Applications
26/4/2009
Computer visions great trick is extracting descriptions of the world from pictures or sequences of pictures
(Forsyth/Ponce: Computer Vision)
ComputerVision:
Isanattempttorealizehumanvisualabilityby engineering Itisasonofartificialintelligence Itisabrotherofimageprocessingaswellaspattern recognition,butdefersbecause Itthinksmuchofthreedimensional informationaswell asknowledge ofthesubjectinthescene as knowledge of the subject in the scene
26/4/2009
ComputerVision
Human visual system Object recognition Virtual heritage
1978
1980
1986
1996
Shape-from-shading
SomeRelatedDisciplines
ImageProcessing ComputerGraphics PatternRecognition Robotics ArtificialIntelligence
26/4/2009
ImageProcessing
ImageRestoration(e.g.,correctingoutfocusimages)
ComputerGraphics
Geometricmodeling
26/4/2009
ComputerVision
RoboticVision
Applicationofcomputervisionin robotics. b ti Someimportantapplicationsinclude:
Autonomousrobotnavigation Inspectionandassembly
26/4/2009
PatternRecognition
Hasaverylonghistory(researchworkinthisfield startedinthe60s). started in the 60s). Concernedwiththerecognitionandclassificationof2D objectsmainlyfrom2Dimages. Manyclassicapproachesonlyworkedundervery constrainedviews(notsuitablefor3Dobjects). Ithastriggeredmuchoftheresearchwhichledto todaysfieldofcomputervision. todays field of computer vision Manypatternrecognitionprinciplesareusedextensively incomputervision.
Prof.GeorgeBebis, ComputerVisionLaboratory, University of Nevada
ArtificialIntelligence
Concernedwithdesigningsystemsthatareintelligent andwithstudyingcomputationalaspectsofintelligence. and with studying computational aspects of intelligence. Itisusedtoanalyzescenesbycomputingasymbolic representation ofthescenecontentsaftertheimages havebeenprocessedtoobtainfeatures. Manytechniquesfromartificialintelligenceplayan importantroleinmanyaspectsofcomputervision. Computervisionisconsideredasubfieldofartificial Computer vision is considered a sub field of artificial intelligence.
26/4/2009
WhyisComputerVision Difficult?
Itisamanytoone mapping
A a iety of u fa e Avarietyofsurfaceswithdifferent material a d ith diffe e t ate ial and geometrical properties,possiblyunderdifferent lighting conditions,couldleadtoidenticalimages Inversemappinghasnonuniquesolution(alotof informationislost inthetransformationfromthe3D worldtothe2Dimage)
Factorsthatinfluencetheimage
Illuminationcondition Objectshape Cameracharacteristics
26/4/2009
Image
Aimageisamatrixof g pixels Eachpixel
brightness Color Distance
KatsushiIkeuchi,cvl sec@cvl.iis.utokyo.ac.jp
PracticalConsiderations
Imposeconstraints torecoverthescene
G h Gathermoredata(images) d ( ) Makeassumptionsabouttheworld
Computabilityandrobustness
Isthesolutioncomputableusingreasonableresources? Isthesolutionrobust?
Industrialcomputervisionsystemsworkverywell
Makestrongassumptionsaboutlighting conditions Makestrongassumptionsabouttheposition ofobjects Makestrongassumptionsaboutthetype ofobjects
26/4/2009
RecognitionMethodology
imageformatione.g.perspectiveor orthographicprojection conditioning labeling grouping extracting a i g matching
Conditioning
Conditioningisbasedonamodelthatsuggeststhatthe Conditioning is based on a model that suggests that the observedimageiscomposedofaninformativepattern modifiedbyuninterestingvariationsthattypicallyadd toormultiplytheinformativepattern. e.g.noisesuppression, backgroundnormalization b k d l
26/4/2009
Labeling
Labelingisbasedonamodelthatsuggeststhatthe Labeling is based on a model that suggests that the informativepatternhasstructureasaspatial arrangementofevents,eachspatialeventbeingasetof connectedpixels. e.g.thresholding,edgedetection, cornerfinding f d
Grouping
Thegroupingoperationidentifiestheeventsby The grouping operation identifies the events by collectingtogetheroridentifyingmaximalconnected setsofpixelsparticipatinginthesamekindofevent. beforegrouping:pixels aftergrouping:setsofpixels e.g.segmentation,edgelinking
10
26/4/2009
Extracting
Theextractingoperationcomputesforeachgroupof pixelsalistofitsproperties. pixels a list of its properties. exampleproperties:centroid,orientation, area,spatialmoments e.g.regionholes,arccurvature g g
Matching
Matchingoperationdeterminestheinterpretationof Matching operation determines the interpretation of somerelatedsetofimageevents,associatingthese eventswithsomegiventhreedimensionalobjectortwo dimensionalshape. e.g.templatematching
11
26/4/2009
Typicalschemeofprocessing
feature extraction make description
input
matching
memorize (learn)
AnIndustrialComputerVisionSystem
12
26/4/2009
TheThreeProcessingLevels
Lowlevelprocessing
Standardproceduresareappliedtoimproveimagequality Proceduresarerequiredtohavenointelligentcapabilities.
TheThreeProcessingLevels(contd)
Intermediatelevelprocessing
E Extractandcharacterizecomponentsintheimage d h h Someintelligentcapabilitiesarerequired.
13
26/4/2009
TheThreeProcessingLevels(contd)
Highlevelprocessing
Recognition and interpretation Recognitionandinterpretation. Proceduresrequirehighintelligentcapabilities.
RecognitionCues
Scene interpretation, even of complex, cluttered scenes is a straightforward task for humans.
14
26/4/2009
RecognitionCues(contd)
How are we able to discern reality and an image of reality? What clues are present in the image? What knowledge do we use to process this image?
Theroleofcolor
What is this object? Does color play a role in recognition? Might this be easier to recognize from a different view?
15
26/4/2009
Theroleoftexture
Characteristicimagetexturecanhelpusreadilyrecognize objects.
Theroleofshape
16
26/4/2009
Theroleofgrouping
Illusionduetotheprojection
KatsushiIkeuchi, cvlsec@cvl.iis.utokyo.ac.jp
17
26/4/2009
MathematicsinComputer Vision
Intheearlydaysofcomputervision,visionsystems employedsimpleheuristicmethods. l d i l h i i h d Today,thedomainisheavilyinclinedtowards theoretically,wellfoundedmethodsinvolvingnontrivial mathematics.
Calculus LinearAlgebra ProbabilitiesandStatistics SignalProcessing ProjectiveGeometry ComputationalGeometry OptimizationTheory ControlTheory
Prof.GeorgeBebis, ComputerVisionLaboratory, University of Nevada
ComputerVisionApplications
Industrialinspection/qualitycontrol Surveillanceandsecurity Facerecognition Gesturerecognition Spaceapplications Medicalimageanalysis Autonomousvehicles Virtualrealityandmuchmore...
Prof.GeorgeBebis, ComputerVisionLaboratory, University of Nevada
18
26/4/2009
VisualInspection
CharacterRecognition
19
26/4/2009
DocumentHandling
SignatureVerification
20
26/4/2009
Biometrics
FingerprintVerification/ Identification
21
26/4/2009
FingerprintIdentificationResearchat UNR
Minutiae Matching
DelaunayTriangulation
ObjectRecognition
22
26/4/2009
ObjectRecognitionResearch atUNR
referenceview1referenceview2
novelviewrecognized
IndexingintoDatabases
Shapecontent
23
26/4/2009
IndexingintoDatabases
Color,texture
TargetRecognition
DepartmentofDefense(Army,Airforce, Navy) N )
24
26/4/2009
InterpretationofAerial Photography
Interpretation of aerial photography is a problem domain in both computer vision and photogrammetry photogrammetry.
AutonomousVehicles
Land,Underwater,Space
25
26/4/2009
TrafficMonitoring
FaceDetection
26
26/4/2009
FaceRecognition
FacialExpressionRecognition
27
26/4/2009
HumanActivityRecognition
MedicalApplications
skincancer breastcancer
28
26/4/2009
InsertingArtificialObjectsintoaScene
Conclusion
29