Yosua
Patents Application Grant English Chinese
Establishmentmethodofpornographic
detectionmodelandpornographicdetection
method
CN101819638B
ABSTRACT
Theinventionprovidesanestablishmentmethodofapornographicdetection
model,comprisingthefollowingsteps:extractingvideocharacteristicsandaudio
characteristicsfromasampleaudiovideoobjectwithmarkedinformation
accordingtothemarkedinformation,trainingrespectivelymodelsforvariousaudio
characteristicsandvideocharacteristicsinthesampleaudiovideoobject,and
thencalculatingfusionparametersamongthemodelsbyvirtueofaweighed
averagefusionmethodbasedonseqencinginthevalueintervalofanergodic
parameterornessoftheweighedaveragefusionmethodbasedonseqencing,calculatingcorrespondingfusionparametersforthevaluesoftheparameterorness
calculatingtheeffectoffusionparametersbythesampleaudiovideoobjectandthenselectingthefusionparameterswiththebesteffectasthefusionparameters
amongthemodels.Comparedwithrelevantmethodsinthepriorart,thepornographicdetectionmodeloftheinventionsyntheticallyusesthevideocharacteristicsand
theaudiocharacteristics,thusgreatlyimprovingthedetectionaccuracy.
DESCRIPTIONtranslatedfromChinese
PornDetectionmodelingmethodsandpornographydetectionmethod
TechnicalField
[0001]Thepresentinventionrelatestothefieldofimagedetection,inparticularto
apornographicdetectionmodelingmethodsandpornographydetectionmethod.
Background
[0002]AstheInternetandtherapiddevelopmentofmultimediatechnology,
especiallydigitalvideonetworkvideoapplicationhasbeenwidelyknown.In
peoplefreeaccesstoavarietyofnetworkdata,whilealargenumberofundesired
informationhasincreasinglybecomeapublichazardoftheInternet.Inparticular
theproliferationofInternetpornographyvideoinformation,theInternethasnotonly
problems,evenbecomingaglobalsocialissues.Becauseofthesebad
information,pornographydetectiontechnologytoachieveaharmoniousand
healthyInternetenvironmentisimportant.
[0003]ThecurrentoftheprimarymeansofInternetpornographydetectionthere
arethree:1,lookingforsensitiveinformationviatextkeywordanalysis2,simple
colordetectionmodel3,theimagevisualfeaturessingleSVMmodeltraining.
Eachoftheabovethreemethodshaveshortcomings.Thefirstwaytodojust
pornographyviatextmessagedetection,hasahighrateoffalsepositivesin
actualuse,anumberofnormalpagescontainingkeywordsisofteneasytobe
blockedandwhenthesexualcontentinanontextappearsuchaspicturesor
videos,suchmethodswillbecomepowerless.Thesecondmethoddetectedonly
byskincolorfeaturepornography,falsedetectionofthismethodiseasytohavea
similarskincolormistakenlyidentifiedasanoneroticimageseroticimages,
suchasthosecontainingayellowdoorandwallimagescouldeasilybemistaken
seizedpornographicimages.ThethirdsingleSVMmodelmethodusedinthe
imageduetotheimpactoflightandenvironmentaldiversityandpooradaptive
defect,andthenatureofmachinelearningmakessuchmethodstopromotelow
performance.
Findpriorart Discussthispatent View PDF Dow nloadPDF
Publicationnumber CN101819638B
Publicationtype Grant
Applicationnumber CN201010143777
Publicationdate Jul11,2012
Filingdate Apr12,2010
Prioritydate Apr12,2010
Alsopublishedas CN101819638A
Inventors ,,,,
Applicant
ExportCitation BiBTeX,EndNote,RefMan
Classifications(1),LegalEvents(3)
ExternalLinks:SIPO,Espacenet
CLAIMS (12)translatedfromChinese
Aporndetectionmodelingmethodcomprisingthestepsof:1),toextractvideo
andaudiofeaturescharacteristicinformationfromasamplelabeledwiththeaudio
andvideoobjectsStep2),accordingtothelabelinformationforthesound
samplesallkindsofvideoobjectaudiofeatures,videofeaturesaretrainingmodel,
andthenusethemodeltocalculatethefusionparametersfusionmethodbased
ontheweightedaveragebetweenthesortwhereinthetraversalparameterstaken
ornesssortedbasedontheweightedaverageFusionvaluerangecalculatedfor
eachvalueoftheparametercorrespondingornessfusionparameters,andthen
usethesampleobjectcomputingintegrationofaudioandvideoparametersfor
eacheffect,thebestfusionparameterselectioneffectparameterasafusion
betweenthemodelstheparametersornessusedtodenotefusion"or"level.
2.Eroticdetectionmodelaccordingtoclaim1,whereinthemethodfor
establishing,characterizedinthatsaidmodelSVMmodel.
Eroticdetectionmodelaccordingto1orclaim2,whereinthemethodfor
establishing,characterizedinthatinsaidstep1),thevideofeature
extractioncomprising:stepa),tomakeaudioandvideoobjectimage
colorspaceconversionstepsb),extractcolorcorrelationchartfromthe
image,thehistogramcolorandedgehistogram.
Eroticdetectionmodelaccordingtoclaim3,whereinthemethodfor
establishing,characterizedinthatinsaidstepa),thecolorspace
conversioncomprisingthestepsof:a),byshiftingthecolorspace
conversioncalculatedcoefficientexpressedbytheformulatoconvert
floatingpointtofixedpointstepa_2),thecolorspaceconversion
formulasintheoriginalcolorspacevalues
foreachdimensionofanarray
ofstoragestepa3),thestepa)obtainedincoefficientandthe
proceduresusedtofixedpointrepresentationa_2)arrayofvalues
used
torepresenteachdimensionoftheoriginalcolorspaceconversion
formulatobecalculatedinaccordancewiththecolorspaceStepa4),
tostepa_calculated3)Theresultsmaketheshift,theshiftdownratio
andthesamestepa_l)theshiftofmagnification.
[0004]Insummary,thelackofstageonedetectionaccuracyrate,andhasa
strongadaptabilityandbetterpromotionofpornographicdetectionmethod.
DISCLOSURE
[0005]Theobjectofthepresentinventiontoovercomethepriorarttesting
methodspornlowaccuracy,pooradaptabilitydefects,therebyprovidingahigh
detectionaccuracy,adaptabilitygoodporndetectionmethod.
[0006]Toachievetheaboveobject,thepresentinventionprovidesamethodfor
modelingeroticdetection,comprising:
[0007]Step1),toextractvideoandaudiofeatureswithamarkedcharacteristic
informationfromasampleaudioandvideoobjects
[0008]Step2~),basedonthelabelinginformationfortheaudiosamplesof
varioustypesofvideoobjectaudiofeatures,videocharacteristicsweretrained
modelandthemodelbasedontheuseoffusioncalculatedweightedaveragesort
fusionbetweenparameterwherein,
[0009]Thetraversalsortedbasedontheweightedaveragevalueinterval
parametersornessfusionmethodtocalculatetheappropriateintegration
parametersforeachvalueoftheparameterornessandthenusethesampleaudio
andvideoobjectcomputingintegrationparametersforeacheffect,selectthe
bestfusionparametersasafusionparametersmodels.
[0010]thetechnicalproposal,themodelSVMmodel.
Theabovetechnicalsolution,saidstep1),thesaidextraction[0011]Thevideo
featuresinclude:
[0012]Thestepsa),docolorspaceforaudioandvideoobjectimageconversion
[0013]stepsb),extractcolorcorrelationchartfromtheimage,thehistogram
colorandedgehistogram.[0014]Intheaboveaspect,insaidstepa),thecolor
spaceconversioncomprising:
[0015]Stepa),byshiftingthecolorspaceconversioncoefficientiscalculatedby
convertingfloatingpointtofixedpoint
[0016]Stepa2),thecolorspaceconversionformulasintheoriginalcolorspace
values
foreachdimensionofanarrayofstorage
[0017]Stepa3),thecoefficientStepsa)obtainedinusingfixedpoint
representationa_2)arrayofvalues
usedtorepresenteachdimensionofthe
originalcolorspaceconversioncalculatedinaccordancewiththecolorspace
formulatocalculate
[0018]Stepa4),stepa_3)calculationresultsdoshift,theshiftmultiplesofthe
stepdowna_lsame)isshiftedmagnification.
[0019]theabovetechnicalsolution,insaidstepb),therelevantfigureincludes
144colordimension,relatedtotheextractionof144dimensionalcolorgraphs
include:
[0020]Stepb1l),intheRGBcolorspaceoftheimageincoloraredividedinto36
intervalsMn1,bin2,.,bin36..
[0021]Stepb12),statisticsfromtheinformationonthecolorforeachinterval:
Setfourdistancespandis={1,3,5,7},thecolorcorrelationchartCijisdefinedas
theintervalbiniColorClkjdistanceoflessthanorequalprobability.
[0022]Theabovetechnicalsolution,saidstepb)inthecolorhistogramcomprises
of64peacekeepersthe64dimensionalcolorhistogramextractioninclude:
[0023]Stepb2l),theimageinYUVcolorspacewasdividedintofourportions
eachinterval
[0024]Stepb22),eachsectionofthecolorhistogramisdefinedas:h(i)=Force
Porndetectionmodelaccordingtoclaim3,whereinthemethodfor
establishing,characterizedinthatsaidstepb),therelevantfigure
includes144colordimension,relatedtotheextractionof144
dimensionalcolormapcomprisesthestepsof:b1l),RGBcolorspace
inthecoloroftheimageisdividedinto36intervalsinbothbini,bin2,...,
bin36stepb12),statisticsforeachdistanceintervalcolorInformation:
setfourdistancespandis={1,3,5,7},thecolorcorrelationchartis
definedastheprobabilityofbinicolorrangeofdistanceorless.
Eroticdetectionmodelaccordingtoclaim3,whereinthemethodfor
establishing,characterizedinthat,insaidstepb),includingthe64
dimensionalcolorhistogramthe64dimensionalcolorhistogram
extractioncomprisesthestepsof:b2l),theimageinYUVcolorspace
wasdividedintofourportionseachintervalstepb22),eachsectionof
thecolorhistogramisdefinedas:h(i)=,/,i=1,2,...,kwhere,Ni
isthenumberofpixelvalues
ofi,Nisthetotalnumberofpixelsofthe
image,Kisthesizeoftheinterval.
Eroticdetectionmodelaccordingtoclaim3,whereinthemethodfor
establishing,characterizedinthat,insaidstepb),saidedgehistogram
comprises73dimensionsthe73dimensionaledgehistogramextraction
comprisesthestepsof:b3l),foreachpixelgrayscaleimagesona
calculationusingSobeloperatoredgedirectionandlengthstepb32),
accordingtothethresholdwhichdeterminestheimagepixelsisan
edge,whichpixelspointisnotedgestepb33),determinedasthe
edgepixelsinaccordancewithsection5oftheintervalisdividedinto72
parts,wherebythefrontedgeofthe72dimensionalhistogram,thepixel
isnotanedgeasthefirst73dimensions.
8.Amethodofestablishingadetectionmodelaccordingtopornographic
or2oftheprecedingclaims,characterizedinthatsaidstep2),bythe
respectivevalues
oftheparametersornesscalculatethecorresponding
fusionparametersinclude:Step21),selectavalueofparameter
ornessthestep22),thevalueoftheparameterornessreverse
calculationfusionparameterstoobtainapluralityofsetscorresponding
totheparameterornessfusionparametersStep2,fromsaidplurality
ofsetsChoosefusionparametersdivergencethemaximumsetof
parametersasauniquefusionparametervaluecorrespondingtothe
ornessthehashvaluecalculatedbythefollowingformula:Dispersion
(W)=WjInffjwhere,Wrepresentsthefusionparameters,j
representsintegrationparameterjthcomponent.
Aporndetectionmethodcomprisingthestepsof:1)theuseofclaim18
pornographydetectionmodeltoestablishamethodofestablishing
pornographydetectionmodelparameterstocalculatethefusionbetween
themodelsStep2,,fromaudioandvideoobjectstobedetected
extractingvideoandaudiocharacteristicfeaturemagicstep,usingsaid
detectionmodeleroticrespectivelyextractedcharacteristicvideoand
audiocharacteristicstobetested,andthenfusedtothefusion
parameterusingsaidmodelforeachofthetestresultsobtained,
generatingdiscriminationtobedetectedintheaudiovideoobject
containstestresultspornographiccontent.
10.pornographydetectionmethodaccordingtoclaim9,whereinfurther
comprising:step4),accordingtothetestresultinstepmagicselection
isbelievedtocontainpornographyimagesfromaudioandvideoobjects
tobedetected,theseimagesoflifefacedetectionandtexturefeature
recognition,electedbyfalsedetectionofpornographicimagesofimage
basedonfacedetectionandthetexturefeaturerecognitionresults.
11.Amethodofdetectingpornographyaccordingtoclaim10,wherein
saidstep4)comprisesthestepsof:41),accordingtotestresultstaken
audioandvideotobedetectedobjectimageisconsideredtocontain
/N,i=1,2,...,kwherein,Misthevalueofiisthenumberofpixels,Nisthe
totalnumberofpixelsoftheimage,Kisthesizeoftheinterval.
[0025]Intheaboveaspect,insaidstepb),saidedgehistogramcomprises73
dimensionsthe73dimensionaledgehistogramextractioncomprising:
pornographyStep4,theseimagesforfacedetection,iftheratioof
thefaceareaandfoundtheentireimageareaislargerthanthefirst
thresholdvalue,maybethattheimagedoesnotcontainpornographic
content,otherwise,thenextstepinfacedetectionStep4,makethe
imagetexturerecognition,iftexturehasalargeproportionofthetotal

[0026]Stepb3l),foreachpixelgrayscaleimagesonacalculationusingSobel pixelpixelisgreaterthanthesecondthresholdvalue,itisconsidered

operatoredgedirectionandlength
[0027]Stepb32),accordingtothethresholdwhichdeterminestheimagepixels
isanedge,whichisnotanedgepixel
[0028]Stepb33),willbedeterminedasthepixeledgespacinginaccordance
withsection5degreesinto72parts,wherebythefrontedgeofthe72dimensional
histogram,thepixelisnotanedgeasthefirst73dimensions.
[0029]Theabovetechnicalsolution,inthestepofmagicforeachvalueofthe
parameterornesscalculatethecorrespondingfusionparametersinclude:
[0030]Step21),selectavalueoftheparameterorness
[0031]Step22),thevalueoftheparameterornessreversecalculationfusion
parameterstoobtainmultiplesetsoffusionparameterscorrespondingtothe
parametersorness
thattheimagedoesnotcontainpornographiccontent,otherwise,the
imagecontainssexuallyexplicitcontent.
12.Theporndetectionmethodaccordingtoclaim11,whereinsaidstep
of4include:step431),useskincolormodelimageofskincolor
pixelsstep43,skincolorpixelsontheadoptionofregional
connectivityalgorithmandcorrosionsmoothingalgorithmtodetermine
possibleskinareaStep43,Sobeledgecomputingpossiblecolor
area,butthecoloredgeitselfisnotincludedTheprocedureof43,will
havegreatertexturepixelstotalpixelsstep434),accordingtothe
numberandthethresholdvalueoftheSobeledgedeterminedtohavea
largerpixeltexturefeaturesandexperimentallydeterminedthreshold,if
theratioisgreaterthanthethresholdvalue,theimagedoesnotcontain
animagepornographiccontent,orcontentthatcontainspornographic
images.

[0032]Step2,selectthemaximumdivergenceofasetofparametersasa
uniquefusionparametervaluecorrespondingtotheornessfusionfrommultiplesetsofparametersinthethedivergence
valuecalculatedbythefollowingformula:

[0033]Dispersion(W)=WjInffj

[0034]wherein,Wrepresentsthefusionparameter,jrepresentsthefusionparameterjthcomponent.

[0035]Thepresentinventionalsoprovidesaporndetectionmethodcomprising:

[0036]Step1),usingthemodelofpornographicdetectionmethodtoestablishpornographicdetectionmodelparametersto
calculatethefusionbetweenthemodels

[0037]Step2,,extractvideofeaturesandaudiofeaturesfromaudioandvideoobjectstobedetected

[0038]Stepmagic,theuseofpornographicdetectionmodelrespectivelytheextractedvideoandaudiocharacteristicfeature
betested,andthenusetheparameterstothefusionoffusionofthetestresultsobtainedforeachmodel,tobegeneratedfor
determiningthedetectingaudioandvideoobjectcontainssexualcontenttestresults.

[0039]thetechnicalproposal,whichalsoincludes:

[0040]Step4),accordingtothetestresultinstepmagicselectionisbelievedtocontainpornographicimagesfromthevideo
andaudioobjectstobedetected,thesehumanfacedetectionandimagetexturerecognition,accordingtothefacedetection
andtexturefeaturerecognitionTheelectionresultsarefalsepositivesaspornographyimages.

[0041]Intheabovetechnicalscheme,saidstep4)comprises:

[0042]Step41),accordingtotestresultstakenaudioandvideoobjectstobedetectedisbelievedtocontainpornographic
images

[0043]Step4,oftheseimagesforfacedetection,iftheratioofthefaceareaandfoundtheentireimageareaislargerthan
thefirstthresholdvalue,maybethattheimagedoesnotcontainpornographiccontentfacedetection,otherwise,execution
Next

[0044]Step4,maketheimagetexturerecognition,iftexturehasalargeproportionofthetotalpixelpixelisgreaterthan
thesecondthresholdvalue,itisconsideredthattheimagedoesnotcontainpornographiccontent,otherwise,theimage
containspornographiccontent.

[0045]Intheabovetechnicalscheme,thestepofthe4
include:

[0046]Step431),useskincolormodelimageofskincolorpixels

[0047]Step43,skincolorpixelsontheadoptionofregionalconnectivityalgorithmandcorrosionsmoothingalgorithmto
determinepossibleskinarea
[0048]Step43,Sobeledgecomputingpossiblecolorarea,butthecoloredgeitselfisnotincluded

Pixels[0049]Step434),accordingtothenumberandthethresholddeterminationoftheSobeledgewithalargertexture
features

Points

[0050]Step435),willhavealargerpixeltextureoftheratioofthetotalpixelexperimentallydeterminedthreshold,iftheratio
isgreaterthanthethresholdvalue,theimagedoesnotcontainsexualcontentimage,orimagescontainingpornographic
content.

Advantages[0051]Thepresentinventionis:porndetectionmethodofthepresentinventioncomparedwiththepriorart
methodusingacombinationofvideorelatedfeaturesandaudiofeatures,ithasgreatlyimprovedthedetectionaccuracy.

BriefDescription

[0052]FIG.1aflowchartofpornographicdetectionmethodofthepresentinvention

[0053]FIG.2isOWAintegrationprocessoftheinventionusedinthefusionwithothertypesoffusionmethodscomparison
chart

[0054]FIG.3porndetectionmethodofthepresentinventionandthepriorarteroticdetectthecorrectratecomparisonchart.
DETAILEDDESCRIPTION

[0055]belowinconjunctionwiththeaccompanyingdrawingsandspecificembodimentsofthepresentinventionisfurther
describedbelow.

[0056]porndetectionmethodofthepresentinventionismainlyforaudioandvideoobjectstobedetectedbothvideofeature
alsohastheaudiofeature,ifthesoundofmovies,TVshows,videoclipswithaudio.Nomatterwhattypeofaudioandvideo
objectstobedetected,theporndetectionprocessisbasicallythesame,sothefollowingexamplesalthoughanexamplein
whichthedramaoftheimplementationprocessofpornographicdetectionmethodofthepresentinventionwillbedescribedin
detail,butthemethodofthepresentinvention,Thesameappliestoothertypesofaudioandvideoobjectstobedetected.

[0057]ReferringtoFigure1,pornographydetectionmethodofthepresentinventionintwostages,SJietrainingandtesting
phase.Thetrainingphase,thefirstlabelinformationfromtheband(thelabelinformationindicatingwhetheranimagecontains
explicitsexualcontent)oftheimageinformationextractedsampledramafeaturesarevideoandaudiofeatures,andthen
SVMtrainingseparatelyforthesefeaturestoobtainapluralityofThesefeaturescorrespondtoSVMmodel.FinallyOWA
integrationalgorithmparametersformultiplemodels.Duringthetestingphase,thefirstmarkinginformationnevertobetested
inthedramawereextractedvideoimageinformationfeaturesandaudiofeatures,andthenusethetestfeaturemultipleSVM
modeltrainingphasetoobtainapluralityoftestresultsobtained,thefinalstageoftheuseofthetrainingalgorithmofOWA
fusionparametersfusionresultsoftheseteststogetaresult,itcandeterminewhetherthedramatobedetectedcontain
pornographiccontent.Thefollowingstepbystepmethodwillbedescribedindetails.

[0058]Thetrainingphase

[0059]Step1),toextractvideofeature.Thoseofordinaryskillshouldbeunderstoodthatthevideoisacombinationofmulti
frameimage,extractingthevideofeatureontheTVseriesisessentiallycomposedofdramaonasingleimageforeachframe
ofvideofeatureswereextracted.Therefore,inthisembodiment,theimagemaybe,forexample,theextractionprocesswill
bedescribedvideofeatures.

[0060]Thepresentinventionisextractedvideofeaturesincludecolorcorrelationchart(ColorCorrelogranuCC),color
histogram(ColorHistogram,CH)andedgehistogram(EdgeHistogram,EH).Inthepresentembodiment,thecolormapis
basedonthefeatureassociatedRGBcolorspace,basedonthecolorhistogramfeatureistheYUVcolorspace,whichisthe
edgehistogrambasedongrayscalecharacteristic.Ascanbeseenfromtheabovedefinition,colorcorrelationchartandcolor
histogramsthesetwotypesofvideofeaturesonadifferentcolorspace,butintheprocessofreadingtheimagefeature
extractionvideobefore,oftenonlygetanimageinacolorspaceTheinformation,therefore,beforeextractingthevideofeature
needstobeextractedimageinformationfromonecolorspacetoanothercolorspace.Colorspaceconversionofcommon
knowledgeintheart,thefollowingequation(1)giveninthepriorarttoconvertfromRGBtoYUVcolorspaceformula:

"0.30.590.11"R[0061]0.150.290.44GW0.61a0.520.096B

[0062]TheuseofthisformulacanachievetheconversionfromRGBtoYUVcolorspace.TheformulafortheYUVtoRGB
colorspaceconversion,canbeobtainedbytheequation(1)isobtainedbydeforming.

[0063]Aftercompletionofthecolorspaceconversion,youcanachievecolorcorrelationchart,colorhistogramandedge
histogramextraction.Thefollowingwereassociatedwith144dimensionalcolormap,64and73dimensionalcolorhistogram
dimensionaledgehistogram,forexample,toillustratethesevideosfeatureextractionmethods,withreferencetothemethods
knownintheartcombinedwithcommonsense,thesamecanbeachievedonotherdimensionThecolorcorrelationchart,
colorhistogramandedgehistogramextraction.

[0064]Intheextractionof144dimensionalcolorcorrelationchart,thefirstcolorintheRGBcolorspaceimagesaredivided
into36intervalsinbini,bin2,.,bin36,thenthecolorofstatisticswithineachintervaldistanceinformation.:setfourdistance
spandis={1,3,5,7},thecolorcorrelationchartCijisdefinedastheintervalwithinbinicolorofthedistanceislessthanor
equalto(probabilityIkj,thedimensionobtainedbytheaboveoperationsofthecolorcorrelationchartof144(36X4).

[0065]Whentheextractionof64dimensionalcolorhistogram,sincetheYUVcolorspaceislinear,theimageinYUVcolor
spaceforeachofaportion(i.e.Y,uandV)weredividedintofourintervals,thecolorofeachportionthehistogramisdefined
as:h(i)=,/,i=l,2,...,k,where,Njisthenumberiofthepixelvalues,Nisthetotalnumberofpixelsoftheimage,KIt
istheintervalsize(i.e.,k=4).Dimensionobtainedbytheaboveoperationcolorhistogramis6M4X4X4).

[0066]Intheextractionof73dimensionaledgehistogram,thefirstofeachpixelgrayscaleimageonSobeloperatorto
calculatethedirectionandlengthoftheedge,andthenthethresholdvalueisdeterminedwhichpixelsintheimagewhichis
anedgepixelnoteventuallyidentifiedasedgepixelsinaccordancewithsection5ofthespacer72isdividedintoparts,
wherebythefrontedgehistogramdimension72,andthelastonedimensionalimageistodeterminethetotalnumberof
pixelsisnottheedge.

[0067]Stepmagic,extractaudiofeatures.ThepresentinventionisextractedaudiofeaturesincludeMelFrequencyCepstral
Coefficients(MFCC).SaidMelfrequencyCepstral(MFCC)audiofeaturewasfirstputforwardinthefieldofspeechrecognition
research,whichfocusesonhearingcharacteristicsofthehumanear(thehumaneartohearthevoiceoftheleveland
frequencyofthesoundintoanonlinearrelationship),ThelinearfrequencyscaleisconvertedtoMelfrequencyscale,
emphasizingbassaudioinformation,highlightingconducivetohumanearidentifiableinformationwhileshieldinghigh
frequencynoise.Anditsparameterswithoutanyassumptions,versatilityandrobustnessstrong,suitableasaudio
recognitionfeatures,inthepresenceofchannelnoiseandspectraldistortionofthesituation,canproducehighrecognition
accuracy.MFCCbasedextractofcommonknowledgeinthefieldoftechnicalpersonnel,andthereforethepresentinvention
isnotrepeated.

[0068]WhileinthepresentinventionMFCCastoextracttheaudiofeatures,thoseskilledintheartwouldunderstand,the
priorartusedforothertypesofaudiofeatures,suchaspitch,shorttimeenergy,shorttermzerorate,spectralcentroid,
formant,steppageDomainBandwidth,FPBW(FeatureParameterBasedonWaveletanalysis)HekouLPCC(Linear
PredictionCepstrumCoefficient),etc.,itcanalsobeusedinthepresentinvention.

Afterthe[0069]Stepmagic,respectivelyvideofeaturesandaudiofeaturesinstep1)andstep2),thebindingannotation
informationforeachofthesefeaturesofthetrainingSVMmodelandcalculatethesefusionparametersSVMmodel.

[0070]fromthefrontstep1)and2)thedescriptionalreadymentioned,theimagethatcanbeextractedfromthedramaof
videofeaturesincludethreecategories:colorcorrelationchart,colorhistogramandedgehistogram.Andcanextractaudio
featuresincludeMFCC,therefore,forthevideoandaudiofeaturescharacteristicSVMmodeltrainingthatisspecifictothe
colorcorrelationchart,respectively,colorhistogram,edgehistogramandMFCCtrainingSVMmodel.Onhowtousevideo
features,audiofeaturesandlabelinformationtotrainSVMmodelmethodinthepriorarthasbeendescribedindetail,itisnot
repeatedinthepresentinventiondescribedbelowwillbeexplainedthepurposeofcalculatingtheparametersofSVMmodel
ofintegration.

[0071]Inasubsequentteststage,needtousethecolorcorrelogram,colorhistogram,anedgehistogramandMFCC
respectiveSVMmodelobjecttobedetectedvideoandaudiofeaturescharacteristicdetected,thentheresultantpluralityof
detectionTheresultstobeintegration.Inthepresentinventionusesafusionfusionmethodbasedontheweightedaverage
sort(OrderedWeightedAverage,OffA)toachieveanumberoftestresultsbetween.OWAmethodofdeterminingafirstsetof
saidconvergenceparameterW=[W1,W2,W3...],whereinWAWJW3+...=1,thentheuseofthesetofparametersto
fusionFusionsortedpluralityoftestresults,andthustogetthefinalresult.Forexample,supposeyouhavethreetestresults
for1,0,1(1forpornography),sortingofthesetestresultsbackas1,1,0.Thetestresultsandtheintegrationofparameters
correspondingtothree,becauseofthetestresultshasbeendonetosort,soavalueof1,thetopsurfaceofthetestresults,
thetestresultis0attheback,sowhentheintegrationparameterW=[10,0],said,"or"thatis,aslongasthevalueofitem
1inthepresenceofthetestresults,thenthefinalresultwillbe1(iepresencesexualcontent),suchastestresultsandthe
precedingsortedTheresultofthisfusionparametersafterthecombinationof1X1+1X0+0X0=1(pornography).Conversely,
whentheintegrationparameterW=[0,0,1],said,"and"thatis,onlythetestresultsare1items,thefinalresultwillbe1,
suchastheaforementionedsortedResultsofthetestresultsandthefusionparametersafterthecombinationof1X0+1X0+
0X1=0(nonpornographic).Intheaboveexample,thepurposeofclarityofillustration,thetestresults,numericalintegration
parameters,andtheconsequencesarefusedwith0,1asimplified,butinfactmayhavedifferentvalues,thevalueisgenerally
between01.

[0072]ThemethoddescribedaboveisessentiallyafusionOWAstudyvariouspendingintegrationoftherelationshipbetween
thedataoftwoextremeformof"pay"and"or",theotherisacompromiseofthesetwoextremecases.Ascanbeseenfrom
theabovedescription,thecoreOWAintegrationmethodishowtodeterminetheparameters,sincethefusionparametersare
usuallyasetofdata,andthisdatasetindividualvalues
aremanypossibilities,andthereforethepresentinventionisalso

definedAnotherparameteriscalled"orness"of.Thevalueofthisparameter

Rangebetween01,whenthevalueis0,whichmeans"cross",theparametervalueof1means"or."Fromthe

Definetheparametersofview,thisargumentisessentiallyusedtorepresentthefusionof"or"level,whichiscalculatedas
follows:

[0073]

[0074]Intheaboveequation,representsthetotalnumberoffusionfusionparameterscontainedintheparameterset,Wi
representstheithfusionparameters.

[0075]Thefusionparameterslistedpreviously[1,0,0]issubstitutedintotheformulatocalculatetheresultingornessis1.
Similarly,thefusionparameters[0,0,1]intotheformulatocalculatetheresultingornessis0.Clearly,integrationparameters,
meaningornessvaluedidnotchangebeforeandafterthecalculations.

[0076]Inthedefinitionofparametersornesslater,OWAintegrationprocesshowtodeterminetheparametersoftheproblem
becomesaproblemtofindasetofbestornessvaluecompliance(makingfusionresultswiththehighestaccuracy)fusion
parameters.Artfusionmethodusingavarietyofstrategiestoachievefindthebestparameters,butnottraverseavarietyof
fusionoftherealsense.TheOWAmethodoftheinventionistowalktheentire(0,1)ornessvalueinterval,forallvalues
within

theintervalornesscalculatethecorrespondingfusionparameters,andthencalculatetheparametersofeacheffectfusion
annotatedbasedontestdata,selectthemostAgoodsetofparametersasafusiongenuineuseinthepresentinvention.

[0077]Howornessvaluecalculationmethodbythefusionparametersbelongtothepriorart,theskilledintheartcanbe
achieved.Butintheprocessofcalculationofthepresentapplicantshavefoundthat:refertotheprecedingequation(1)bya
groupoffusionparameterscanbecalculatedonlyoneornessvalue,butinthereversecalculationvaluebyoneornessfusion
parameters,theremaybemoregroupdifferentfusionparameterscorrespondingtotheornessvalue.Sohowtochoosea
groupisaproblemtobesolvedfrommultiplesetsoffusionparameters.Throughtestingwefound:Foraparticularvalueof
ornessfusionparameterscorrespondingtothedifferent,theactualtestresultsaresimilar,soinoneembodiment,canbe
chosenarbitrarilysetasaparameter.Takingintoaccounttheconvergencestabilityandrobustnessoftheresults,ina
preferredembodiment,alsoaccordingtoShannonentropytheory,fromavaluecorrespondingtoapluralityofsetsorness
fusionparameters,choosedivergencevalueDispersion(W)=WdnWjlargestgroupintegrationastheonlyparameterthat
parametervalues
correspondingorness.Figure2istheexperimentalresultsonthedatamadeTRECVIDexperiment,the

resultsshowedthat:0WAeffectfusionmethodwassignificantlyhigherthanothermethods.

[0078]beta

[0079]Step4),duringthetrainingphasetogivemoreofthevideofeature,afterSVMmodelparametersofthemodelandthe
convergencebetweenaudiofeaturescalculatedtoextractvideoandaudiocharacteristicfeaturestobetestedinthedrama,
andthenusingsaidmultipleSVMmodeltotestnewfeaturesextractedfromvideoandaudiofeatures,apluralityoftest
resultsobtained,thefusionparametersFinally,theintegrationofthesetestresultstogetthefinaltestresults,thefinaltest
resultshowsthedramatobedetectedPornextent,aslongastheresultofasetthresholdarecompared,itcanbejudgedto
bedetecteddramacontainspornographiccontent.

[0080]Inthetestphasetoextractthevideoandaudiofeaturesandcharacteristicsofthetypeofextractionmethodandthe
sametrainingphase,andthereforewillnotberepeated.HowSVMmodeltofeaturevideoandaudiofeaturestotest,andhow
tousefusionparametersfusionofmultipletestresultsareknowntothoseskilledintheart.

[0081]Colorspaceconversionacceleration

[0082]Intheembodimentsdescribedabove,theintroductionofanimplementationpornographydetectionmethodofthe
presentinvention,theuseofthisimplementationcanalreadybedetected,includingTVshowscontainsexualcontentobject
detection.Intheforegoingdescriptionhasbeenmentionedbeforeimplementingvideofeatureextraction,wemustfirstmake
theimagecolorspaceconversion,buttheartofthecolorspaceconversionmethodisoftenmoretimeconsuming,affecting
thetimelinessentireporndetectionmethod.Thus,inyetanotherembodimentofthepresentinvention,thecolorspace
conversionacceleratedimplementationinordertoimprovedetectionmethodspornvideofeatureextractionefficiency.[0083]
Inthepresentembodiment,acceleratecolorspaceconversionmethodincludesshiftingalgorithmtoconvertfloatingpointto
fixedpointcalculations,andtheuseofspacefortimemethodstoimproveefficiency.Supposetheimagereadingobtained
whentheRGBcolorspaceinformation,inordertoextractthecolorhistogramfeaturerequiredvideoRGBtoYUVcolorspace
conversion.Intheforegoingdescriptionhasbeengivenofthepriorartconversionformula,thatformula(1),itcanbeseenfrom
theequation,thereareseveraldecimalintheformula,soyouneedtodofloatingpointcalculations.Thoseskilledintheart
wouldunderstand,onthecomputertodofloatingpointoperationsthanthefixedpointarithmetictakesmoreresources,so,in
thisembodiment,theshiftoperationbythefloatingpointtofixedpointconversion,whichconvertsthefloatingpoint
calculationsfixedpointcalculations.Specifically,theequation(1),ifthecoefficientmatrixmagnificationof1000,andthe
resultis1000timessmallercanavoidfloatingpointoperations,fasterconversionspeed.Amongthem,thereasonforthe
coefficientmatrixtobe1,000timeslargermultipleselectedtakeintoaccounttwomainfactors:Firstshiftoperationsfaster
thandivision,and1000andIOMisveryclose,thecoefficientmatrixby1024,thentheresultsright10bit,youcangetthe
valueoftheYUV.Theaforementionedequation(1)aftertheconversionformulashowninEquation(3)below:

[0084]

[0085]TheskilledpersonknowstherangeR,G,Bisusuallyanintegerof0255inside,andwhenthevalues
ofthese

variableswithinalimitedrange,itcanbenaturaltothinkoftheestablishmentof256dimensionalarraytosavetheresultsin
advancemultiplication.Ascalculatedbytheaboveequationvariable(3)theresultingequationYEquation(4)below:

[0086]Y=(300XR+590XG+110XB)>>10(4)

[0087]Itcandefineanarrayofthreedimensional256:YK[256],YJ256]and,[256],where=300,YG[i]=590,YB[i]=
arraydefinedabove,afterIlOXi0Theforegoingequation(4)canberewrittenastheequation(5):

[0088]Y=(YE[R]+Yg[G]+Yb[B])>>10(5)

[0089]Inotherwords,theoriginalvalueoftheoperationatthetimeofthecolorspaceconversionlessefficientmultiplication
convertedintoefficientdirectaddressing.

[0090]Ascanbeseenfromtheabovedescription,forexample,employedinthepresentembodiment,thecolorspace
conversionaccelerationmethodcansignificantlyimprovecolorspaceconversionspeed,speeduprealtimethroughoutthe
pornographydetectionmethod.

[0091]Theresultsofpostprocessing

[0092]Inthefirsttwoexamples,itisadirecttreatmenttodetectwhetheranobjectcontainssexuallyexplicitmaterialto
makejudgmentsbasedontestresultsSVMmodel.Thoseskilledinthearthavefoundthat,SVMtrainingmethoditself
understandablepoordefect(thattheywerefalsedetectiondataSVMcannotunderstandorexplain,anditisdifficultto
improvebySVMmodelcorrected),therefore,Yetanotherembodimentofthepresentinvention,theporndetectionmethodof
thepresentinventionalsoincludesrulesbasedpostprocessingstep.

[0093]Theimageofthousandsoffalsedetectionbyscreeningandstatistics,theApplicanthasfound22%offalsedetections
appearinthepicture,olderpeopleface,while37%offalsedetectionspicturesincludescenesfigureskincolordoesnot
appearTherefore,basedontheforegoing,thepresentinventionisbasedontheruleofpostprocessingstepsincludeface
detectionandtexturedistinguishtwoaspects.Forlargerfacefalsedetectionpicture,wecanfacedetectiontoexcludefor
classcharactercolorscenedoesnotappearfalsedetectionpicture,becauseofitstexturemore(evenintheskincolorarea),
youcanedgeinformationthresholdlawtoexclude.

[0094]Specifically,whenthetestresultsdoaftertreatment,accordingtotestresultsfirstremovetheaudioandvideoobjects
tobedetectedareconsideredtocontainpornographicimages,andtheseimagesforfacedetection,iffoundinFace
Detectiontheproportionofthefaceareaandtheentireimageareaisgreaterthanathresholdvalue(thethresholdvaluecan
besetbyexperiment),youcanthinkthattheimagedoesnotcontainpornographiccontent,otherwise,continuetodotexture
imagerecognitioniftheclasshasalargeinternalcolortexturepixelsproportionoftotalpixelsthantheotherthreshold(the
thresholdtestcanalsobeset),itisconsideredthattheimagedoesnotcontainpornographiccontent.If,aftertheimageof
thefacedetectionandrecognitionaftertextureisstillbelievedtocontainpornographiccontent,theimageispornographic
images.

RelatedMethods[0095]Facedetectionbasedcommonknowledgeinthefieldofbelowusedfortexturefeaturebased
recognitionthresholdedgeinformationexclusionwillbedescribed.Themethodcomprisesthestepsof:

[0096]stepsa),useskincolormodelimageofskincolorpixels

[0097]stepsb),ofsaidskincolorpixelusingregionalconnectivityalgorithmandcorrosionsmoothingalgorithmtodetermine
possibleskinarea

[0098]Stepc),thecalculationSobeledgeintheregionofpossiblecolor,butthecoloredgeitselfisnotincluded
[0099]stepd),accordingtothenumberandtheSobeledgethresholdpixeldeterminedtohavealargertexturefeatures

[0100]Stepe),willhavealargertexture(Sobeledge)pixelstotalpixelratioexperimentallydeterminedthreshold,iftheratio
isgreaterthanthethresholdvalue,theimagedoesnotcontainsexualcontentimage,orimagescontainingpornographic
content.Becauselesseroticscenecolorpartoftheinternaltexturecharacteristics,andthereforehavegreatertexture
featuresbasedon(Sobeledge)pixelstotalpixelsproportionsandexperimentallydeterminedthresholdtoexcludenon
pornographiccontenttypecolorimageisjustified.

[0101]Themethodofthepresentinventionwillbeaudioandvideofeaturesdoporndetectionfeaturecombined,compared
withthepriorartdetectionmethodspornographyonlyusingvideofeatureontheaccuracyisgreatlyimproved.Isgivenin
Figure3oftheROC(ReceiverOperatingCharacteristiccurve)curvecanbeseenfromthefigure,thepresentinventionwillbe
pornvideofeaturedetectionmethodsandtheintegrationofaudiofeaturescomparedwiththepriorartusingonlypornvideo
featuredetectionmethodsimproveontheaccuracyof,andinthepostprocessingstepisadded,furtherimprovedaccuracy
andmore.

[0102]Finally,shouldbenotedthattheaboveembodimentsaremerelyprovidedfordescribingthetechnicalsolutionsofthe
presentinvention,notlimitation.Althoughthereferencetotheembodimentofthepresentinventionhasbeendescribedin
detail,thoseskilledintheartwillappreciate,thetechnicalaspectofthepresentinventioncanbemodifiedorequivalents,
withoutdepartingfromthespiritandscopeofthepresentinventionthetechnicalsolution,itshouldbeencompassedbythe
presentinventionAmongthescopeoftheclaims.

CLASSIFICATIONS

InternationalClassification G06K9/66

LEGALEVENTS

Date Code Event Description

Sep1,2010 C06 Publication
Oct20,2010 C10 Requestofexaminationastosubstance
Jul11,2012 C14 Granted

GoogleHomeSitemapUSPTOBulkDownloadsPrivacyPolicyTermsofServiceAboutGooglePatentsSendFeedback