NN A uy United States «2 Patent Application Publication (10) Pub. No.: US 2022/0347571 Al Khim (43) Pub. Date: Nov. 3, 2022 (5) METHOD OF DETECTING IDLE GAME Ase 13285 (2006.01) CONTROLLER nose 17318 (2006.01) (2) Usa (1) Apoican: Sony Interactive Entertainment LLC co ABSP 149 (2014.09), AOSP 13/428 San Mateo, CA (US) (2014.00): agg 157255 (2014.09), Hod (201501), (72) Inventor: Jeansoo Khim, San Mateo, CA (US) (21) Appl. Nos 17/306,706 “ ABSTRACT (22) Files May 3, 2021 ie dt wa oni inline contol i ide and, ths, that he ) stool! be paused immaiely withoot (31) Ime ‘wating for an "AwayFromKeyboard” mer to time out by Publication Clasitiation dar rviee (toe) poor amy ce sapy so epoca. 500~ Identify Controller Motion 502~} Identify Wireless Signal Strength 504~4 Identify Controller Power 506 Identify Microphone Amplitude 508~ Identify Terms In Microphone Signal 510~ Identify Images From Camera 512~ Determine Confidence 514~j Based On Confidence Establish Timer Period(s) 516~) At Elapse Of First Period, Slow Game Down; Prompt 518~ At Elapse Of Second Period, Pause GamePatent Application Publication Nov, 3,2022 Sheet 1 of 4 US 2022/0347571 Al yo Source zee 14 16 18 20 24 12. \ \ ‘ \ Display Speaker et Network | Processor Input Port 26 28~\ Memory 30~) Receiver 32~\ Camera 344 Bluetooth 36 Near Field Sensor | OTA | Infrared Communication 38 40 42 44 46 22 52~) Server 54~| Processor 56~) Memory | Network 58 interface FIG. 1Patent Application Publication Nov, 3,2022 Sheet 2 of4 US 2022/0347571 Al 200 218 236 Display 202~| 228 Server 230 I/F IMU uw | [Mic 232 234 222 250 252240 242 254 ‘ as \ 264~| up| m | Mic] camera 256~| 24a ye | imu | ops boogg y 262~| 238~| a ca Game Console 260~| FIG. 2Patent Application Publication 202: 400~| 402~ 4124] Nov. Receive Sensor Signals Re Controller Receive Other Motor Indicia Remove Matching Components From Controller Motion Determine Confidence Based On Confidence, Alter Game FIG. 4 2022 Sheet 3 of 4 US 2022/0347571 AL 408 Continue MonitoringPatent Application Publication Nov, 3,2022 Sheet 4 of 4 US 2022/0347571 Al 500: 502 504: 506- 508~ 510~| 512~ 514~| 516~| 518~| Identify Controller Motion Identify Wireless Signal Strength Identify Controller Power Identify Microphone Amplitude Identify Terms In Microphone Signal Identify Images From Camera Determine Confidence Based On Confidence Establish Timer Period(s) ‘At Elapse Of First Period, Slow Game Down; Prompt At Elapse Of Second Period, Pause Game FIG. 5 600 202 Are You Still Interested? Game Characters FIG. 6US 2022/0347571 Al METHOD OF DETECTING IDLE GAME. ‘CONTROLLER FIELD. 0001] ‘The present application relates 10 technically inventive, nomroutine solutions that are nvessarily root in computer technology and that praduoe eoncrte fecal improvements BACKGROUND 0002] As understood herein, when a user puts down @ ‘computer simulation eontollr such as a computer game ‘contre, the game does not know if useris away or simply not responding. SUMMARY 0003] Present principles make it possible forthe game system or the gime © determine Whether the user has abandoned playing the game or simply i ona short break, So hat the simulation system can take immediate action ‘without waiting for the elapse a an AvayT-romKeyboard timer. By immediately detecting an "away" state, the user ‘experience is enhanced [W004] Accordingly, a device includes at east one com- Per memory that is nota transitory signal and that ia tora Inches instictions exocwlable by’ atleast one processoe to ‘emily 4 motion sate ofa controller ofa computer sim- Taton, and at least in pact responsive to dhe mation sate hoing sationary, slaw down oF pause presentation of the ‘computer simulation [0005] "In example implementations the insteuctons can be ‘executable fo, at least in part responsive tothe motion sate boing stationary, intially slow down presentation of the ‘computer simulation and afer an elapse of «period, pase preseatation ofthe computer simulation [0006] In example embodiments the instrctions may be ‘excoutable fo, at ast in part responsive tothe motion state being stationary and responsive to a confidence satist¥ing & threshold, slow down or pause presentation of the eoapater simulation, or put the computer simulation in non-active state per the context of the simulation. The motion sate bring stationary ean be hase at leas in part om motion oF Position sensor in the controller, whereas the confidence In’ bo determined atleast in part based on signals from a Sensor other than the motion or positon sensor in the ‘contre, The seasor can include least one camer, a least one microphone, atleast one wireless receiver, and ‘combinations thereof. When the sensor isa wireless receiver that signals inclode signal strength indications [0007] In some embodiments the instrctions may be ‘executable to establish at east one perio base at Teast in Paton the confidence, with the period being associated with Slowing down or pausing the computer simulation. Ia ‘examples, the instuetons can be executable to identify the ‘motion slate being stationary af least in part by accounting {or mation ofa platform on which the controle i dispose {0008} In another aspect, a method inchudes identifying that a contoler of a computer simulation is not moving relative w platform sopporing the controller and base at seas in part on te dentlyng, slowing down or pausing the ‘computer simulation [0009] "Inanosber aspect, an apparatus includes at east one contrller of a computer simulation that is configured for Nov. 3, 2022 ‘contol presentation of the computer simulation om at least one display. The computer simulation is received rom a Teast one source of computer simulations. At last one processor is programmed with asinctons executable by the processor 10 aller & speed of presentation of the computee lation at Teast in part Based on @ motion state ofthe at least one contol 0010} The dels ofthe present application, bot as tots Sroctre and operation, ean best be understood in reference to the accompanying drawings, in which like reference numerals refer to Tike pats, din which [BRIEF DESCRIPTION OF THE DRAWINGS. 0011) FIG. 1 is a block diagram of an example system ‘inching an example in scondance with present principles 0012] FIG. 2 illuseates an example specific system con- Sistont with present principles 0013] FIG. 3 iustates an example screenshot fom @ ‘comptter simalation such as a computer game consistent ‘vith present principles. [0014] FIGS. 4 and § illusuate example logic in example flow chart format consistent with resent principles and 10015] FIG. 6 iustates an example sereen shot fom @ ‘compiter simulation such s+ a computer pamse consstet ‘vith present principles. DETAILED DESCRIPTION 0016] ‘This disclosure relates generally to computer cco- system including aspects of consumer electrons (CE) ‘device networks such as but ot nite to computer game networks, system herein may include server and client ‘components which may be connected over a network such that data may be exchanged between the cleat and server ‘components. The client components may include ne oF tore computing devices incliding game consoles such as Sony PlayStation ora game console made hy Microsof' ae Nintendo or ether manufacturer, viewal reality (VR) eod- sets, augmented realty (AR) headsets, portable televisions (eg. smn IVs, lnerat-enabled IVs), portable computers such os laptops and tablet computers, and other mot ‘devices including smart phones. and TV set top boxes, desktop computers, any” computerized. Inemet-enabled implantable device, and additonal examples diseussed helo. These elisa devices may operate With a varity af ‘opezating envioaments. For example, some of the clicat ‘computers may employ, as examples, Linux operating sy tems, operating systems from Microsofl ora Unix operating sytem, oF operating systems produced By Appl, Ine. ar ‘Google. These operating environments may be used 10 ‘exec one or more browsing programs, sich as a browser made by Microsoft or Google or Mozilla or other browser program that can acoest websites hosted hy the Intemet fervers discussed below. bo, an operating envionment according t present principles may be used to execute one ‘oF mire computer game progras, 0017] Servers andor gateways may include one oe more processors exoeuting instructions that configure the severs {o receive and transmit data over @ network such as the Intemet. Or acient and server can be connected over local intranet or a viral private network. server or controler may be instantiated by game console sueh as a Sony PlayStation®, personal compurer, et;US 2022/0347571 Al 0018] Information may be exchanged over a network hotwcen the clients an servers. To this end and for scart, servers andor clients can include firewalls, load balancer, Temporary storages, and proxies, and other network inf strocture Tor reliably ahd security. One o¢ more servers ‘nay form an apparatus tht implement methods of proving 4 secure community such as an online social website 10 network members. [0019]. processor may bea single or multi-chip proces- sor that can exeete logic hy meats of various fines sch ts ‘addess Fines, data Fines, and conto ins and eegistrs and shit registers [0020] Components included in one embodiment ca be ‘sod in other embodiments in any appropriate combination. For example, any of the various components described hhercia andior depicted in the Figures may be combined, interchanged, or excluded from other embodiments 0021] “A system having at least one of A, B, and C™ (Gikewise “a system having at east one of A, B, or C” and “a sytem having atleast one of A,B, C") includes systems that have alone, B alone, C alone, A and B gether, And (Ctogether, B and C together andlor A,B, and C together, 022] Now specifically refering to FIG. 1, an example system 10 is shone, which may include one or more ofthe ‘example deviees mentioned above and described further below in accordance with present principles. ‘The first ofthe ‘example devies ineluded in the system 10 is 2 consumer electrons (CE) device soch as an audio video device (AVD) 12 such as but not Fimited wo an Interetenabled TV ‘with a TV ter (equivalently set op box conteollng @ TV), The AVD 12 altematively muy also be a computerized Intemet enabled (“san”) wlephone, a tablet computer, 2 rolebook computer, a HMD, «1 wearable computerized view, a computerized Internet-enabled music player, com- puterized.Interecenabled headphones, computerized Tnemet-enabled implantable deviee such es an implantable skin device ete. Regalos, i isto be understood thatthe AVD 12 is configured to undentake present priniples (2. ‘communicate with other CE deviees to undertake preset Principles, execute the loge desribed herein, and perform Any other funetions andlor operations deseribed herein), 023] _Acconigly, to undertake such principles the AVD 12 can be established by some or all ofthe components shown in FIG. 1. Por example, the AVD 12 can include one for more displays 14 that may be implemented by a igh ‘definition or ulr-high definition "4K" or higher Mat screen land that may be touchrenabled for receiving ser input signals via touches onthe display. The AVD 12 may include ‘onc or more speakers 16 for outputting sudo in accordance with present priniples, and atleast one ational inpat vee 18 such san adi receivermicropone for entering ladle commiands t the AVD 12 to contol the AVD 12. ‘The example AVD 12 may also include one oF mote network interfaces 20 for communication over at least ane network 22 suchas the Intemet, an WAN, an LAN, ete under contol ‘fone or more processors 24. prophies processor may also ho included. Thus, the interface 20 may be, without Finite tion, 2 Wi-Fi transeiver, which isan example of wireless ‘computer network interlace, such as but hot limited to a imesh network transceiver It isto be understood thatthe processor 24 controls the AVD 12 to undertake preset Principles, including the other elements of the AVD 12 ‘eseribed herein sch as controlling te display 18 to present Nov. 3, 2022 images thereon and receiving input therefrom. Furthermore, note the network interface 20 may be a wired or wireless modem or router, or other appropriate interlace such as @ Wireless telephony transceiver, or WiFi transceiver as men- tioned above, ete 0024] nation to the foregoing, she AVD 12 may also Ince one or more input ports 26 such os «high-definition ‘multimedia interface (HDMD port or a USB post physi cally connect to another CE deve andr a headphone poe. to connect headphones to the AVD 12 for presentation a studio fom the AVD 12 to a user trough the headphones For example, the input por 26 may be eonnscted via wire oF swirlesly toa cable of satelite source 269 of sudo video ‘content Ths, the source 260 may bea separate integrated fet iop box, or sitelitereeiver Or the source 260 maybe {game convole or disk player containing content. The fource 26a when implemented 28 game console my include some or all ofthe components described below ia retin tothe CE device 44, 0025] The AVD 12 may funber include one or more ‘computer memories 28 such as disk-based or soidesate Storage that are not transitory signals, in some cases emibod- id in the chaste of the AVD a standalone devices ot as & personal video recording device (PVR) or video disk player ther internal oF external to the chassis of the AVD. for ie memory media, the AVD 12 can include & ‘bo, in some embodiments Position or location receiver such as but aot limited t ellphone receiver, GPS receiver andor altimeter 30 that is configured fo receive geographic position information from 2 satellite of colons hase station and provide the infor: Imation to the processor 24 andor deteratine an lite at ‘which the AVD 12 is disposed in conjunction with the processor 24. The componcat 30 may also be implemented by an inoril measurement unit (IMU) that typically inches « combination of accelerometers, ey70s60 magnetometers to determine the locaton ad orient the AVD 12 in three dimensions. 0026] Continuing the description of the AVD 12. in some ‘embodiments the AVD 12 may include one or mone cameras 32 that may be a thermal imaging camera, a digital eamera ‘uch a @ webcam, nde eamera integrate into the AV 12 and contolable by the processor 24 to gather pictures! images andor vido in accordance with present principles. Also includod oa the AVD 12 may bea Blstooth transceiver $4 and other Nea Field Communication (NEC) element 36 Tor communication with other devices using Blustot and! ‘or NFC technology, epectvely. An example NFC element ‘canbe a radio frequency identification (RFID) element. 0027] Further sil, the AVD 12 may include one or more auxiliary sensors 38 (ex, a motion sensor such as an accelerometer, gyroscope, eyelometer, ora magnetic sensor, fn inffared (IR) sensor, an optical sensor, a speed andlor ‘cadence sensor, a gesture senso (efor sensing gesture ‘commana, providing input w the processor 24. The AVD 12 tay inclide an overhear TV broadcast port 40 for reeciving OTA TV broadeasts providing input to the pro- ‘cost 24 In ation to the foregoing, is noted thatthe AAVD 12 may also include an nfated (TR transmitter andlor IK roveiver andor IR teanscciver 42 such as an IR data association (IRDA) device. battery (aot shown) may be provided for powering the AVD 12, as may he a kincic ‘energy harvester that may turn kinetic energy into power 10 change the tatery andlor power the AVD 12.8 graphicsUS 2022/0347571 Al procesing unit (GPU) 44 and feld programmable gated nay 46 ao may be inl. [0028] Sill fering w FIG. 1 ination tothe AVD 12, the system 10 may include one or more ler CE device types. In one example, a fist CE device 48 may be 8 computer game console that ean be used 1 send computer ‘eame abdio and video to the AVD 12 via commands seat Sircetlyto the AVD 12 andor though the below eseribed server while second CE device $0 may include sine components ste fist CF device 4. Inthe example shown, the second CE device 80 may be coafigure as #computet same contoler manipolated by a player ora head-mounted Cisplay (FMD) worn by a player Inthe example shown, ‘aly two CE devices are sown it being understood that fewer or greater davies may be wed. A devie herein may implement some or all of the components shown forthe AVD 12. Any of the componeats shown ia the following figures may incorporate some oF all of the components shown in the eae of the AVD 12 [0029] Now in reference to the afie-mentioned at feast ‘ne serve 82, tins at east one server processor 84, at Teast one tangible computer readable storage medium 36 such as disk-based or slidstate storage, and atleast one network interface $8 that, under contol of the server peo cessor 54 allows for communication withthe oer devices OF FIG. 1 over tbe network 22. and indeed may fecltate ‘communication between servers and elent devices in accor dance with present priniples, Not that the network inter= face $8 may’ he, ep 9 Wire of wireless mdm or rer, Wi-Fi tramsceiver, or ther appropriate interface such a, eg, a wiles telephony tramceiver [0030] Accontingl, in some embodiments te server $2 nay be an Internet sever or an etre server “arm” and may include and perform “loud” fnetons such thatthe devices ofthe system 10 may acces “loud” eavironment Via the Server 82 in example embodiments fore. network gaming Applications. Orth server 82 may be implemented by one ‘or more game consoles o other computers in the same room asthe other devies shown in FIG. Lor nearby. {W031} The components shown ia the following ures ‘nay include some or all components shown in FIG, 1 {0032} FIG. 2 ilustates a specific example system. ‘computer simulation contller (CSC) 200" that may be handheld and inelode operating keys to con] presentation cf compar simulation on display device 202i shown The CSC 200 may be, for example, « Play Sution Dual Shock® comtlle. [0033] As shown in FIG. 2, the comtoller 200 may includ, in addition © operating Keys, one or more mie’ ‘phones 204, one or more cameras 206, and one OF more Tocstion sensors 208 such as global posioning satelite (GPS) sensor. The controler 200 may further inelode one fr more inet! measuremet nits (IMU) 210 such as one for more of an aovelerometr, gyroscope, magnetometer, and ‘combinations there {0034} Moreover, the controler 200 may include one oF ‘ore communication interfaces 212 such as wited oe wie= Tess ansceivers including inffared (TR) transceivers, Bhi tooth transceivers, and Wi-Fi transceivers, and combina- tions thersot One or more processors 214 acessing instcactions om one or more computer storages 216 may be provided t0 conto the components ofthe eontrlier 200, 10038) Similar if desired the display 202 may ineude is aition to video display 248 an one or more speakers Nov. 3, 2022 220, one o¢ more microphones 222, one of more cameras 224, snd one or more loction sensors 226 such as GPS Sensors. The display 202 may further include one oF more IMU 238, 10036] Moreover, the display. 202 may include one or ‘more communication interfaces 280 such a wired or wie less transceivers incloding IR. tansceivers, Bluetooth transceivers, and Wi-Fi transceivers, and_ combinations therwor- One or more processors 292 seessing insntions fon one of more complier storages 234 may be provided to ‘con the components of the display 202, 0037] The simulation presented on the display 202 under ‘control ofthe contoler 200 may be seat from one oF more Sources of computer simulations suchas one or more servers 236 communicating with various components herein via @ ‘wide area computer network and one oF more computer "mmlaton consoles 238 communicating with varios com- ponents herein via wirel andior wireless paths, In the ‘xample show, the coasole 238 may inelude one or more Inicrophones 240, one or more cameras 242, and one ‘more location sensors 244 such as GPS sensors The console 238 may funber include one or more IMU 246. 10038] Moreover, the console 238 may include one or ‘more communication interfaces 248 such at wired or wite- less transceivers including IR. tanseevers, Bluetooth® transceivers, and Wisi Iransceivers, and combinations therwot- One or more processors 250 aoeessing insntins ‘on one of more computer storages 282 may be provided to ‘contr the components ofthe console 238 10039] In addition, one or more ancillary devices such as 8 wireless smartphone 254 may be provided. In ation to ‘Keypad and witless clephony transceiver 256 he phone 254 may include micrphone(s), camera(s), one or more location sensors 258 such as GPS sensors, one or more IMU 260, one or more communication interfaces 262 such as ‘wired oF wirsless transceivers including IR transceivers, iuetooth truscevers, and Wi transceivers, and com binations thereof, on ar more processors 264 aceossing instuetios on one or more compte storages 26610 coat] the components ofthe phone 284, 0040] 11 is wo be understood that Jogie herein may’ be ‘implemented oa say’ one oF more af the storages shown ia FIG. 1 or 2 and exeeuted by any one of more processors ‘described herein, and that motionTocation signals and sig nals fiom sensor oer than motiwToeation sensors may be implemented by any ofthe appropriate sensors shown andor described herein, 0041] As discussed herein, motion ofthe controller 200 ‘ean bo wsed to infer whether user has slopped paying ‘attention to simltion resented onthe display device 202 ‘or has simply stopped inputting signals but may stil be ‘watching the simulation, withthe simulation being altered sccoringly. For example, a motion slate ofthe controller 200 can be ientfed using signals from motion sensors ‘described herein and the simblstion slower dowa (played a a slower spood, but faster than @ complate pause) andor paused at least in part responsive to the mation state being tionary, if desired based on a confidence in the inference ‘ofa stationary state using signals from seasrs other han the ‘motion sensors. Also, whethce the controller 200 is in the Sationary state can depend on whether its moving relative to platform supporting the conaller 200, to acount TorUS 2022/0347571 Al motion of a controller that may be located on & moving plstform stich as a ship. vehicle, or indeed @ swaying high-rise building 0042] FIG. 3 illastrtes that altering presentation of the simulation responsive tothe motion sate ofthe controler 200 may aliematively or further inlude changing the pose ‘of simulation charter 300 ssocited withthe user Irom “an aetion pose shown in the let in FIG, 340 an inactive pose 302 (such as a prone of supine pose) when itis determined ‘that the user fas lst interes inthe simlation seeonding 0 Jogic below: Other examples of altering game play based on Principles herein include poling a racing game into sto- ‘rive mode when the users determined o ave lost intrest 0043], Accordingly, and turning aow to FIG. 4, lock 400 Indicates that sensor signals are received from tbe controler 200 by any one or more of the processors deverbed herein. By way’ of example, signals fom the GPS. 208 andlor IMU 210 of the controller 200 may be receive, iniating motion {er no motion) ofthe coalle 200 0044] Other motion indicia may be rceveda block 402 By way of example, signals trom the GPS andor IMU of any one or more ofthe display 202, ge console 238, and phone 284 maybe received, indicating motion (or no ‘motion of the component from whence the signals orii- hate. Note that triangulation of signals from various com- ponents abo muy be use to detenmine mation [045] Procooding to block 404, components in motion Signals from the conller 200 that match components in background motion signals from any one or more of the clisplay 202, me console 238, and phone 284 are removes, Such that any remaining movoa-indicating signals fom the controller 200 repeesent motion ofthe controller relative 10 the platiorm supporting the controle I these remaining ‘motion-indicaing signals from the contoller 200 represeat ‘motion of the contoler at decision dismond 206, te logic fof FIG. 4 essentially continues to monitor for signals ‘eseribed herein st block 408, [046] "On the other hand, ifthe motion indicating signals from the conifer 200 represent moon of the controler 200 i.2, the controler 200s sstionary ast would bei ak down on a surace bythe user). the logic proceeds to block ‘410, At block 410, a confidence in the determination tha the motion state ofthe controller 200i stationary is determined ‘as desribed Further here, Moving o block 412, based on the confidence determined st block 410, presentation of the ‘computer simulation s altered 0047] For example, if low coafidence of no motion is ‘termined, the simtltion may proceed at current play back. speed by # pose of the character 300 (FIG. 3) altered to indicate that the user may have lost attention. 1F medium ‘confidence of n0 motion is determined, the simulation may ‘proceed but ata slower speed than normal pay back sped ‘wheres if high confidence of no motion js determing the Simulation maybe paused. Whea the user i binge watching 4 sirviming video servie, the service may keep playing While the user is holding the controller a indicated by ‘motion signals from the contoller and paused shor afer the user away wien controller i detected o be saionary (eg. on the floor or dropped.) [048] FIG. § illustrates further dois. Commencing st block $00, motion of the control 200 ie identified as described above. If desired, wireless signal strength of Wireless signals om the controller 200 is identified st lock ‘802, Contller power also may be det at block $0435. Nov. 3, 2022 determined by identifying whether the controler sin an on ‘or off state a indiated by the absence of signals fom the controller in response 1, eg, queries from other compo- 10049] Also, if desired the amplitude of acoustic signals such as voice signals sensed by any of the microphones here may be identified at Block 806. Voice recognition may be implemented om the geouste signals at Blok $08 o identify terms in the voice signals. Funbemore, images in signals {fon any ofthe eamiras herein may be recognized a lock 510, Based on any one or nor of theabove, confidence may be determined a Block S12 10050], For example, if wireless signal stength of the ‘coniller 200 or ofa wireless headset wom bythe use such 8 described in the case of the CE device 80 in FIG. 1 remains above a threshold at block S02, confidence that the tinct hos lost attention in the simmlation by vet of laying the controller down may he low, on the Bass that the see has not walked away om the display 202!console 238 (sich may be wed to dotet the signal strength) although the user may have set the contoller dowa. Similarly. i ‘wireless signal stent of the controller 200 (or headset) drops below a tesold at block 802, confidence thatthe tse has los attention in the simulation hy virtue of laying the controller down may be high, on the basis thatthe user hag walked away from the display 202/console 238 and then laid the controller dowa, 051] Ifthe controller remains energized at identified at block $04, confidence may’be high thatthe user has not st atteation in the simulation by virtue of maintaining the ‘conrller energized, wherees ithe controller is identified a block 504s being deenerized, confidence may be high that th user has lost attention i the simulation by virwe af turning of the como 10052] Turing to the determination at block 12 using the microphone signals at Block $06, f amplitude of salible Signals such as vole rceived fom the microphone of the ‘conirller or of other microphone herein remains above 3 Threshold, confidence thatthe user hat lost attention in the simulation by virtue of laying the controller down may be Tow, oa the bass that the wser has remained ear the monitoring microphone (eg. the microphone on the display 202iconsole 238 although the user may have set the Con- troller down, Similarly if acoustic signal strength from the microphone used for monitoring at block $06 deops below a threshold, confidence that the user has lost tention in the simulation by vite of laying the controller down may be high, on the basis thatthe user has walla sway from the slsplay 202/onsole 238 10053] Turing tothe determination at block $12 using the ‘vocal term recognition a lock S08, confidence that the usce has lst attention in the simulation by vite of speaking ‘eran tems (eg, “time for lune”) may be high, on the hss thatthe terms indicate a loss of imeest. Simi, ‘confidence that the user has lost tention in the simulation by vice of speaking cern tems (e., "time fora Kill shot") may be low. on the basis that the terms indicate interest in the simlation 0054] Tuning to the determination at block $12 using the Image ecogntion at block 810, confidence may be high that the vser has lost attention ia the simulation by virwe of reeopnizing, using face recognition, tht the user is staringUS 2022/0347571 Al ito space wit gaze diverted from the display deviee 202 or has walked away from the controller. On the other hand confidence may be high that the user hts aot lst attention inthe simulation by vimue of recognizing, using Tace ree- ‘nition, that the user is looking atthe display device 202 10085] "When multiple blocks in FIG. § are used to deter ‘mine confidence, each block may be accorded a respective Weight, such that one determination of high confidence ia lack of interest may outweigh another detennination of low confidence of lack of interest, For example, the controller being deenersized as determined at block 804, indicating high confidence in lick of interest, may outweigh loud signals from a microphone as detemined at block $06, ‘therwise indicating Tow confidence of lack of interest. Likewise, images fom a camera at lock 810 indicating that the user i staring intently atthe display device, indicating high conidence of interest, may outweigh terms identified at block S08 that otherwise would indiate low conidence of [0056] |The weights may be determines empirically andor by machine leaning (ML) models using, ex, neural ne ‘works such as convolutional neural networks (CNN) athe Tike. AML model may'be tained on ating et of motion signals with accompanying sensor sigials and ground th ‘of interest interest foreach tuple in the taining set (or leas foreach ofa percentage othe tuples). raining may’ be supervised, unsupervised. or semi-supervisd, 0087] Block S14 of FIG. $ indicates tha the confience ‘elermined at block $12 may be used to establish one of ‘mor timer periods. A fist time period may be the time Peto aftr which the similation i slowed (nit at paused). nda second time period may be the period after slowing the Simulation that the simulation i paused, abseat a change in ‘motion signals fom the controller 200 0088] For example, i tis detemnined thatthe controller isina sate of no motion, bl confidence low thatthe use thas lost interes, relatively long peri or periods may be ‘established. On the other hand, ifs determined thatthe ‘contre is ina state of no motion and confidence i high thot the user fas lst inert, clatively shorter period oF peices may be established [0059], Proceeding to block $16, abseat a change of motion signals andor a change in confidence that the user tas los interest, a the elapse ofthe fst (sorter) period the simulation is slowed. If desire, 2s indiated at 600 in FIG. 6, visual or audible prompt may be presented on the lsplay device 202 tthe sero alert the user that the system believes the user may be lesing interest in the simlation. Block 818 indicates that absent change! motion/confience signalsdeterminations, athe elapse ofa second period after the simulation was slowed, the simulation may’ be paused ‘uni such time asthe controller 200 is manipulated again by the user or signals fam sensors described herein indicate thatthe user has regained interest, with a high confidence [060] Present principles may be used to detect when the ‘game system should be tumed put in seep mode. When hinge watching seaming video service, an option may be provided to keep ft playing while holding the controller 200 fr the phone 284 and pase shortly afer the wer is sway ‘when the controler wa detected on oor or dropped when the option to do so was enabled by the system or By the user. 061] Ie wil be appreciated that whilst presen principals have been sdeseribod with reference some” exaniple cemodiments hese are not intend tobe limiting, and tat Nov. 3, 2022 ‘various altemative arrangements may be use t implement the subject matter claimed herein 1.4 device comprising: at Teast one computer memory that is not transitory signal and tha comprises instructions executable by at least one processor to identify a motion state of a controller of a computer ‘simulation; and at least in part responsive to the motion state being stationary and responsive 10a confidence satisfying & threshold, slow down or pause presentation of the computer simulation, the motion state being stationary being bse atleast in port on a motion sensor in the controller, the confidence being determined atleast in part based on signals from fis sensor te Hirst sensor $oing other than the motion sensor in the controll aad the fist sensor being othr than fie. 2, The device of elsim 1, whersin the instructions are ‘execuable to at east in part responsive to the motion state being stationary, slow down presentation of the computer sntulation 3. The device of claim 1, wherein the insrvtions are ‘executable to: at least in part responsive 10 the motion state being stationary, pause presentation ofthe compute simul 4. The device of claim 1, whersin the instructions are ‘executable to at least in part responsive to the motion state being stationary, inialyslow down presenaton of the com pole simltion and after am elapse of a period, pase presentation ofthe computer simulation, 5, (canceled) 6. The device of claim 1, whervin the firs sensor com prises atleast one camera 7. The device of elim 1, whersin the firs sensor eom= prises atleast one microphone. 8, The device of claim 1, whercin the first sensor com prises atleast one wireless receiver 9, The device of elim 8, wherein the signals from the wireless receiver comprise sgl strength indications 10, The device of elsim 1, wherein the insttions are ‘executable to ‘stablish a east one period based at feast in part om the sonfidence, the pend being associated with slowing ‘dven of pausing the computer simulation, 11, The device of ela 1, wherein the instructions are ‘execable to identify the motion state being stationary at lost in part by accountng for motion of platform on which the controller is dispose 12. The device of cltim 1, comprising the atleast one processor exsetting the insrctions. 13. A method comprising: identifying thot controller of » computer simulation is ‘not moving relative toa platform supporting the con- teller, and ‘based atleast in parton the identing, slowing doin or pausing the computer simulationUS 2022/0347571 Al 14. The maiod of chim 13, comprising ‘sd test apron tect wing down he compete simstion 15, The method of chi 1, compesing aed at tin pr on the Meno, posing the computer imuaion 16. The method of chim 13, compesng: eda eatin pt on he ening. nally slowing dw presentation th compte alton a ale a lapse of 9 period, pausing pecan of he Snare sma 17 The method of ein 13, compesng ‘asda feat npr onthe ening tnd responsive conten sinving a tho slowing down fouwing esatton ote computer simian, he esi se being satay teag ose at es parton amoien o postion snsor nthe conte the Mite bing detcminad a et in part bal on Sian fom a nse thant mation poston Shor inte conc 1. An appari compen {kas oe somoler of" compute simulation, the ni sig cotigued fe contin prseaton ofthe comput simulation om test one ay. he omputr simulation Ding received rr at Feast one sowre of eompitersimsltions; ad 0 Tem one pence programe wih isictons excuse bythe tt one pocesror Nov. 3, 2022 responsive to a fist sigal from at last one of camera, ‘tmicrophone, a wireless transceiver, present the com pater simulation at normal play back speed and alter @ pose of at least one character inthe computer sm ‘ion indicate that player ofthe computer simulation ray have lost attention, responsive to s second signal from at feast one of the “mers, the mietophone, the wireless transceiver, play back the computer simulation a a slower speed than normal play back spoed and higher than ze; and responsive 10 a tied signal from at lest one of: the “umers the microphone, the wireless transceiver, pause the compute simulation. 19. The apparats of claim 18, wherein the atleast one processor sin the souree andthe source comprises atleast ‘one computer simulation console, 20. The apparatus of elim 18, whersin the at least one processor si the source and the sourve comprises at lest ‘one server communicating withthe display over a wide area ‘computer network. 21, The device of claim 1, comprising accounting for ‘motion of a platform on which the controller is disposed st least in part by anoving components in motion signals from the conwoller that mutch components in motion signals representing motion of the pltfonn,