JP7397118B2 - Information processing device and control method - Google Patents

Description

The present invention relates to an information processing device and a control method.

Some devices transition to a usable operating state when a person approaches, and transition to a standby state in which all but some functions are stopped when the person leaves. For example, Patent Document 1 discloses a technology that uses an infrared sensor to detect the strength of infrared rays to detect whether a person is approaching or whether the person has moved away, thereby controlling the operating state of equipment. Disclosed.

Furthermore, as a method for detecting a person, there is also a method using an ultrasonic sensor instead of an infrared sensor (for example, Patent Document 2). By outputting ultrasonic waves and detecting the reflected waves, it is possible to detect the presence or absence of a person. When detecting a person using an ultrasonic sensor in an information processing device such as a PC (personal computer), an existing speaker and microphone are used to receive the output of the ultrasonic sensor and reflected waves. This has the advantage that there is no need to add a new device such as an infrared sensor.

Japanese Patent Application Publication No. 2016-148895 JP2019-138760A

However, when detecting a person using an ultrasonic sensor, there is an advantage that it can be realized using an existing speaker and microphone, but there is a problem that power consumption is large when outputting ultrasonic waves.

The present invention has been made in view of the above-mentioned circumstances, and one of the objects of the present invention is to provide an information processing device and a control method that reduce power consumption when detecting a person using an ultrasonic sensor. .

The present invention has been made to solve the above problems, and an information processing device according to a first aspect of the present invention includes a sound output unit capable of outputting ultrasonic waves, and a sound pickup unit capable of collecting ultrasonic waves. a memory that temporarily stores an OS (Operating System) program; and a processor that realizes the functions of the OS by executing the program, and the processor is configured to generate ultrasonic waves from the sound output unit. a detection process of detecting a person based on the ultrasonic waves collected by the sound collection unit by outputting a When a predetermined period of time has elapsed since the start of the detection process, the detection process is paused, and if the specific event occurs while the detection process is being executed, the specific event is stopped even if the predetermined time has not elapsed. and detecting operation control processing that suspends the detection processing in response to the occurrence of an event.

Further, the information processing device according to the second aspect of the present invention includes a sound output unit capable of outputting ultrasonic waves, a sound collection unit capable of collecting ultrasonic waves, and a program for an OS (Operating System) that is temporarily stored. and a processor that realizes the functions of the OS by executing the program, and the processor outputs the ultrasonic waves from the sound output section to generate the ultrasonic waves collected by the sound collection section. A detection process that detects a person based on sound waves, and if a specific event does not occur while the detection process is paused, the detection process is started when a predetermined time elapses after the detection process is paused. and, if the specific event occurs while the detection process is paused, the detection operation control process starts the detection process after the predetermined time has elapsed since the specific event occurred. ,I do.

In the information processing apparatus, the specific event may be that a person is detected by the detection process.

In the information processing apparatus, the processor may further perform an input detection process for detecting an input by a user, and the specific event may be that an input by the user is detected by the input detection process.

In the information processing device, the processor further performs an input detection process to detect an input by a user, and as a function of the OS, if a state in which no input by the user is detected by the input detection process continues for a preset time; A function restriction process may be further performed to restrict the use of at least some functions of the OS, and if the function restriction process is disabled, the detection process may be suspended.

In the information processing device, if the specific event does not occur while the detection process is being executed, the processor controls at least one of the OSs when a predetermined period of time has elapsed after starting the detection process. The use of certain functions may be restricted.

Further, according to a third aspect of the present invention, a sound output section capable of outputting ultrasonic waves, a sound collection section capable of collecting ultrasonic waves, and a memory temporarily storing an OS (Operating System) program; A control method for an information processing apparatus includes a processor that realizes the functions of the OS by executing the program, wherein the processor outputs ultrasonic waves from the sound output section to collect sound by the sound collection section. performing a detection process to detect a person based on the ultrasonic waves generated by the user; and if a specific event does not occur while the detection process is being executed, a predetermined period of time has elapsed since the start of the detection process; Then, the detection processing is paused, and if the specific event occurs while the detection processing is being executed, the detection processing is stopped in response to the occurrence of the specific event even if the predetermined time has not elapsed. The method includes a step of performing detection operation control processing to pause the detection processing.

Further, according to a fourth aspect of the present invention, a sound output unit capable of outputting ultrasonic waves, a sound collection unit capable of collecting ultrasonic waves, and a memory temporarily storing an OS (Operating System) program; A control method for an information processing apparatus includes a processor that realizes the functions of the OS by executing the program, wherein the processor outputs ultrasonic waves from the sound output section to collect sound by the sound collection section. performing a detection process to detect a person based on the ultrasonic waves generated by the user; and if a specific event does not occur while the detection process is paused, a predetermined period of time has elapsed since the detection process was paused. Then, the detection process is started, and if the specific event occurs while the detection process is paused, the detection process is started in response to the elapse of the predetermined time after the specific event occurs. The method includes a step of performing a detection operation control process to start the process.

According to the above aspect of the present invention, the information processing device can reduce power consumption when detecting a person using an ultrasonic sensor.

FIG. 3 is a diagram illustrating an overview of HPD processing of the information processing apparatus according to the embodiment. FIG. 1 is a perspective view showing an example of an external configuration of an information processing device according to an embodiment. FIG. 3 is a diagram illustrating an example of a detection range of a person of the information processing apparatus according to the embodiment. FIG. 3 is an explanatory diagram of intermittent detection operation of HPD processing according to the embodiment. FIG. 3 is a diagram illustrating an example of control of a detection state and a hibernation state of HPD processing according to an embodiment. FIG. 1 is a schematic block diagram illustrating an example of a hardware configuration of an information processing device according to an embodiment. FIG. 1 is a schematic block diagram showing an example of a functional configuration of an information processing device according to an embodiment. 5 is a flowchart illustrating an example of detection operation control processing when the HPD processing according to the embodiment is in a dormant state. 5 is a flowchart illustrating an example of detection operation control processing when the HPD processing according to the embodiment is in the detection state.

Embodiments of the present invention will be described below with reference to the drawings.
[overview]
The information processing device 1 according to the present embodiment is, for example, a notebook PC (Personal Computer). Note that the information processing device 1 may be any type of information processing device such as a desktop PC, a tablet terminal device, or a smartphone.

The information processing device 1 is capable of transitioning between at least a normal operating state (power-on state) and a standby state as the operating state of the system. The normal operating state is an operating state in which processing can be executed without any particular restrictions, and corresponds to, for example, the S0 state defined in ACPI (Advanced Configuration and Power Interface). The standby state is a state in which at least some functions of the system are restricted. For example, the standby state may be a standby state, a sleep state, etc., and may be a state equivalent to modern standby in Windows (registered trademark) or the S3 state (sleep state) defined by ACPI. . Further, the standby state may include at least a state in which the display on the display unit is OFF (screen OFF) or a state in which the screen is locked. Screen lock is a state in which a preset image (for example, a screen lock image) is displayed on the display so that the content being processed cannot be viewed, and cannot be used until the lock is released (for example, by user authentication). It is.

Hereinafter, the transition of the operating state of the system from the standby state to the normal operating state may be referred to as activation. In the standby state, the degree of activity is generally lower than in the normal operating state, so activating the system of the information processing apparatus 1 activates the system operation of the information processing apparatus 1.

FIG. 1 is a diagram illustrating an overview of HPD processing of the information processing device 1 according to the present embodiment. The information processing device 1 detects a person (that is, a user) existing in the vicinity of the information processing device 1 . This process of detecting the presence of a person is referred to as HPD (Human Presence Detection) process. The information processing device 1 detects the presence or absence of a person by HPD processing, and controls the operating state of the system of the information processing device 1 based on the detection result. For example, as shown in FIG. 1A, the information processing device 1 changes from a state in which a person does not exist (absence) to a state in which a person exists (presence) in front of the information processing device 1, that is, information processing. When it is detected that a person approaches the device 1, it is determined that the user has approached, and the system is automatically activated and transitioned to a normal operating state. Further, as shown in FIG. 1B, in a state where a person is present in front of the information processing device 1 (Presence), the information processing device 1 determines that a user is present and continues the normal operation state. . Then, as shown in FIG. 1C, the information processing device 1 changes from a state in which a person is present (Presence) in front of the information processing device 1 to a state in which a person does not exist (Absence). When it is detected that a person has left the information processing device 1, it is determined that the user has left, and the system is transitioned to a standby state.

[External configuration of information processing device]
FIG. 2 is a perspective view showing an example of the external configuration of the information processing device 1 according to the present embodiment.
The information processing device 1 includes a first housing 10, a second housing 20, and a hinge mechanism 15. The first housing 10 and the second housing 20 are coupled using a hinge mechanism 15. The first housing 10 is rotatable relative to the second housing 20 around a rotation axis formed by a hinge mechanism 15. The opening angle due to the rotation of the first housing 10 and the second housing 20 is shown as "θ".

The first housing 10 is also called an A cover or a display housing. The second housing 20 is also called a C cover or a system housing. In the following description, of the side surfaces of the first housing 10 and the second housing 20, the surfaces provided with the hinge mechanism 15 are referred to as side surfaces 10c and 20c, respectively. Among the side surfaces of the first housing 10 and the second housing 20, the surfaces opposite to the side surfaces 10c and 20c are referred to as side surfaces 10a and 20a, respectively. In the illustration, the direction from the side surface 20a to the side surface 20c is called "rear", and the direction from the side surface 20c to the side surface 20a is called "front". The right and left sides of the rear are called "right" and "left", respectively. The left side surfaces of the first housing 10 and the second housing 20 are called side surfaces 10b and 20b, respectively, and the right side surfaces are called side surfaces 10d and 20d, respectively. Further, a state where the first housing 10 and the second housing 20 overlap and are completely closed (opening angle θ=0°) is referred to as a "closed state". The surfaces of the first casing 10 and the second casing 20 that face each other in the closed state are referred to as their "inner surfaces," and the surfaces opposite to the inner surfaces are referred to as their "outer surfaces." Further, a state in which the first casing 10 and the second casing 20 are open compared to the closed state is referred to as an "open state."

The external appearance of the information processing device 1 shown in FIG. 2 shows an example of an open state. The open state is a state in which the side surface 10a of the first housing 10 and the side surface 20a of the second housing 20 are separated. In the open state, the inner surfaces of the first casing 10 and the second casing 20 are exposed. The open state is one of the states when the user uses the information processing device 1, and is typically used in a state where the opening angle θ is about 100 to 130°. Note that the range of the opening angle θ for the open state can be arbitrarily determined depending on the range of angles in which the hinge mechanism 15 can rotate.

A display section 110 is provided on the inner surface of the first housing 10. The display unit 110 includes a liquid crystal display (LCD), an organic EL (electro luminescence) display, and the like. Furthermore, an imaging section 120 and a microphone 131 are provided in the inner surface of the first housing 10 in a region around the periphery of the display section 110 . For example, the imaging unit 120 and the microphone 131 are arranged on the side surface 10a side of the peripheral area of the display unit 110. In the illustrated example, one microphone 131 is placed on the left side and one on the right side with the imaging unit 120 interposed therebetween. The microphone 131 is, for example, a sound collection device for collecting user's utterances in applications such as voice calls, video calls, and video conferences.

Note that the positions where the imaging unit 120 and the microphone 131 are arranged are merely examples, and may be located at other locations as long as they can face the inner surface of the first housing 10 (forward). Further, the number of microphones 131 is not limited to two, and may be one or three or more.

In the open state, the imaging unit 120 images a predetermined imaging range in a direction facing the inner surface of the first housing 10 (forward). The predetermined imaging range is a range of angles of view determined by the imaging device of the imaging unit 120 and the optical lens provided in front of the imaging surface of the imaging device.

A keyboard 151 and a touch pad 153 are provided on the inner surface of the second casing 20 as input devices that accept user operation inputs. Note that as an input device, a touch sensor may be provided instead of or in addition to the keyboard 151 and the touch pad 153, or a mouse or an external keyboard may be connected. In the case of a configuration in which a touch sensor is provided, an area corresponding to the display surface of the display unit 110 may be configured as a touch panel that receives operations. Further, the input device may include a microphone into which audio is input.

Furthermore, a speaker 132 is provided on the inner surface of the second housing 20. For example, one speaker 132 is arranged on the left and right sides of the inner surface of the second housing 20 on the side surface 20c side. Note that the position where the speaker 132 is placed is just an example, and the speaker 132 can be placed at any position. The speaker 132 can, for example, listen to the voice uttered by the other party in an application such as a voice call or video call, the voice uttered by a participant in an application such as a video conference, the voice during music playback or video playback, and various notifications. This is an audio output device for outputting sounds etc.

Further, a power button 140 is provided on the side surface 20b of the second housing 20. The power button 140 is an operator used by the user to instruct power on or off, transition from a standby state to a normal operating state, transition from a normal operating state to a standby state, and the like.

Note that in the closed state where the first housing 10 and the second housing 20 are closed, the display unit 110, the imaging unit 120, and the microphone 131 provided on the inner surface of the first housing 10 and the second housing The keyboard 151, touch pad 153, and speaker 132 provided on the inner surface of the device 20 are each covered by the other casing surface, and are unable to function.

The information processing device 1 uses the existing speaker 132 and microphone 131 as ultrasonic sensors to detect the presence of a person in a predetermined range in front (on the front side) using ultrasonic waves. For example, the information processing device 1 causes the speaker 132 to output ultrasonic waves. Here, the ultrasonic waves output from the speaker 132 are set to a frequency within the frequency range that can be output by the existing speaker 132, and is set to 23 kHz as an example. The ultrasonic waves output from the speaker 132 are reflected by a person or object existing in the space, and among the reflected ultrasonic waves (reflected waves), the reflected waves arriving from the front of the information processing device 1 are collected by the microphone 131 . The information processing device 1 detects a person based on the ultrasonic waves collected by the microphone 131. For example, the information processing device 1 detects the distance to a person in front based on the time difference between when an ultrasonic wave is output from the speaker 132 and when a reflected wave is collected by the microphone 131. Note that since the reflected wave reflected by an object is a reflected wave from a completely stationary object, it is possible to distinguish it from at least a reflected wave from a moving person.

FIG. 3 is a diagram showing an example of a person detection range of the information processing device 1 according to the present embodiment. In the illustrated example, a detection range FoV (Field of View: detection viewing angle) in front of the information processing device 1 is the range in which a person can be detected. This detection range FoV corresponds to the range in which the microphone 131 can collect sound. The range in which sound can be collected is determined by the position and direction in which the microphone 131 is placed and the directivity of the microphone 131. The information processing device 1 determines whether or not a person exists within the detection range FoV using ultrasonic waves, thereby determining whether a user has approached (Approach), the state of presence (Presence), and the user has left the detection range FoV. Detects what has been done (Leave), etc.

Furthermore, when detecting a person using ultrasound, the information processing device 1 consumes a large amount of power when outputting the ultrasound, so the information processing device 1 suppresses power consumption by performing the detection operation intermittently.
FIG. 4 is an explanatory diagram of the intermittent detection operation of the HPD process. The information processing device 1 is in a state in which it outputs ultrasonic waves from the speaker 132 to perform HPD processing to detect a person (hereinafter referred to as a "detection state"), and in a state in which the output of ultrasonic waves from the speaker 132 is suspended. The intermittent operation is performed by alternately repeating a state in which the HPD processing is stopped (hereinafter referred to as a "dormant state").

As for the basic intermittent operation, when the detection state passes for a predetermined time Td, it shifts to the rest state, and when the rest state passes for a predetermined time Tn, it shifts to the detection state, and this repeats. The predetermined time Td and the predetermined time Tn may be set to the same time or may be set to different times. Further, the predetermined time Td and the predetermined time Tn may be settable by the user. As an example, the initial values of the predetermined time Td and the predetermined time Tn are set to 30 seconds.

In this way, power consumption can be suppressed by intermittent operation of the HPD process and halting the output of ultrasonic waves from the speaker 132 during the hibernation period, but even if this intermittent operation is performed, the power consumption may be reduced unnecessarily. It may be in a detection state. Therefore, the information processing device 1 according to the present embodiment performs the intermittent operation of the HPD process, and if a specific event occurs, the information processing device 1 may shift the detection state to the dormant state even if the predetermined time Td has not elapsed. , the dormant state may be continued for longer than the predetermined time Tn.

The specific event is, for example, that a person is detected in a detection state, that is, that a state in which a user is present (presence) is detected. If the presence of the user is detected, there is no need to continue the detection state, so the information processing device 1 enters the hibernation state in response to the detection of Presence even if the predetermined time Td has not elapsed. Migrate.

Further, the specific event may be, for example, detection of an input by a user. The input by the user is, for example, input to an HID (Human Interface Device) such as an input device such as the keyboard 151 or the touch pad 153 (hereinafter referred to as "HID input"). If a HID input is detected, it is considered that the user is present. Therefore, when the HID input is detected in the detection state, the information processing device 1 shifts to the hibernation state in response to the detection of the HID input even if the predetermined time Td has not elapsed. Further, when the HID input is detected in the hibernation state, the information processing device 1 continues the hibernation state until a predetermined time Tn has elapsed after the HID input was detected, and detects the HID input after the predetermined time Tn has elapsed. transition to the state.

Furthermore, as a function of the OS (Operating System), the information processing device 1 executes a sleep process that transitions the operating state of the system to a standby state when a state in which no HID input is detected continues for a preset time. The information processing device 1 puts the device into a hibernation state if the sleep processing by this OS function is disabled. The sleep processing by the OS function is disabled, for example, during a period when a moving image is being played, or when the sleep processing is set to be disabled by the user.

FIG. 5 is a diagram showing an example of control of the detection state and hibernation state of the HPD process according to the present embodiment. In this figure, the horizontal axis is time (t), and the transition between the detection state and the dormant state is shown in chronological order. Furthermore, in the example shown in this figure, the user is in a state of presence (Presence) before time t6, the user leaves (Leave) at time t6, and is in a state of absence (Absence) after time t6. do.

Assume that the hibernation state starts at time t0. When the user starts watching a video (Watching movie) at time t1 before the predetermined time Tn has elapsed since the start of the hibernation state, the sleep process by the OS function is disabled while the video is being played, and the predetermined The dormant state continues regardless of the passage of time Tn.

Next, when the viewing of the video (playback of the video) ends at time t2, the time measurement of the hibernation state is reset, and the hibernation state continues until a predetermined time Tn has elapsed from the time t2. If no video is viewed and no HID input is detected until the predetermined time Tn has elapsed from time t2, the state shifts to the detection state at time t3 after the predetermined time Tn has elapsed.

When transitioning to the detection state at time t3, Presence is immediately detected because the user is present. Alternatively, HID input is detected. When Presence or HID input is detected at time t4, the device shifts to the dormant state even if the predetermined time Td does not elapse after shifting to the detection state.

After transitioning to the hibernation state at time t4, if an HID input is detected at time t5, which is before a predetermined time Tn has elapsed since transition to the hibernation state, the clock for the hibernation state time is reset, and at time t5. The dormant state continues until a predetermined time Tn has elapsed. If no video is viewed and no HID input is detected until the predetermined time Tn has elapsed from time t5, the state shifts to the detection state at time t7 after the predetermined time Tn has elapsed.

Since the user has left the device at time t6, presence is not detected even if the state shifts to the detection state at time t7. Also, HID input is not detected. At time t8, when a predetermined time Td has elapsed since the transition to the detection state, it is detected that the user has left (Leave), and the device immediately transitions to a standby state (for example, a state where the screen is locked).

In this way, as shown in FIG. 4, the information processing device 1 can shorten the time for outputting ultrasonic waves from the speaker 132 rather than operating the HPD process intermittently at predetermined time intervals, thereby further reducing power consumption. can be realized.

Note that in the example shown in FIG. 5, the state may be shifted to the detection state when the viewing of the video (playback of the video) at time t2 is completed. Further, it is also possible to provide a standby time after the user's leaving is detected at time t8 and before transition to a standby state (for example, a state where the screen is locked).

[Hardware configuration of information processing device]
FIG. 6 is a schematic block diagram showing an example of the hardware configuration of the information processing device 1 according to the present embodiment. In FIG. 6, components corresponding to those in FIG. 2 are given the same reference numerals. The information processing device 1 includes a display section 110, an imaging section 120, an audio system 130, a microphone 131, a speaker 132, a power button 140, an input device 150, a communication section 160, a storage section 170, an EC (Embedded Controller) 200, and a main processing section. 300 and a power supply section 400.

The display unit 110 displays display data (images) generated based on system processing executed by the main processing unit 300 and processing of an application program running on the system processing.

The imaging unit 120 captures an image of an object within a predetermined imaging range (angle of view) in a direction facing the inner surface of the first housing 10 (front), and outputs the captured image to the main processing unit 300. For example, the imaging unit 120 is a visible light camera (RGB camera) that captures images using visible light. Note that the imaging unit 120 may further include an infrared camera (IR camera) that captures images using infrared rays.

The audio system 130 is connected to a microphone 131 and a speaker 132, and performs input/output, recording, and reproduction of sound data. For example, the audio system 130 changes sound data into an electrical signal and outputs it as a sound wave or an ultrasonic wave from the speaker 132 in accordance with an instruction from the main processing unit 300. Furthermore, the audio system 130 converts the electric signal of the sound wave or ultrasonic wave picked up by the microphone 131 into sound data, and outputs the sound data to the main processing unit 300 .

Power button 140 outputs an operation signal to EC 200 in response to a user's operation. The input device 150 is an input unit that receives user input, and includes, for example, a keyboard 151 and a touch pad 153. The input device 150 outputs an operation signal indicating the content of the operation to the EC 200 in response to receiving an operation on the keyboard 151 and touch pad 153. Note that the input device 150 may be a touch panel that detects a touch operation on the display surface of the display unit 110.

The communication unit 160 is communicably connected to other devices via a wireless or wired communication network, and transmits and receives various data. For example, the communication unit 160 includes a wired LAN interface such as Ethernet (registered trademark), a wireless LAN interface such as Wi-Fi (registered trademark), and the like.

The storage unit 170 is configured to include storage media such as an HDD (Hard Disk Drive), an SDD (Solid State Drive), a RAM, and a ROM. The storage unit 170 stores various programs such as an OS, device drivers, and applications, as well as various data obtained through the operation of the programs.

The power supply section 400 supplies power to each section of the information processing apparatus 1 according to the operating state of each section. The power supply unit 400 includes a DC (Direct Current)/DC converter. The DC/DC converter converts the voltage of DC power supplied from an AC (Alternate Current)/DC adapter or a battery (battery pack) into voltages required by each part. Power whose voltage has been converted by the DC/DC converter is supplied to each part via each power supply system. For example, the power supply unit 400 supplies power to each unit via each power supply system based on a control signal input from the EC 200.

The EC200 is a microcomputer configured to include a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), an I/O (Input/Output) logic circuit, and the like. The CPU of the EC 200 reads a control program (firmware) stored in its own ROM in advance, executes the read control program, and exhibits its functions. The EC 200 operates independently of the main processing section 300, controls the operation of the main processing section 300, and manages its operating state. Further, the EC 200 is connected to a power button 140, an input device 150, a power supply unit 400, and the like.

For example, by communicating with the power supply unit 400, the EC 200 acquires information on the battery status (remaining capacity, etc.) from the power supply unit 400, and also supplies power according to the operating status of each part of the information processing device 1. A control signal and the like for control are output to the power supply section 400. Further, the EC 200 acquires operation signals from the power button 140 and the input device 150, and outputs the operation signals related to the processing of the main processing section 300 among the acquired operation signals to the main processing section 300.

The main processing unit 300 includes a CPU (Central Processing Unit) 301, a GPU (Graphic Processing Unit) 302, a chipset 303, and a system memory 304. Processing of various application programs can be executed.

The CPU 301 executes processing based on BIOS programs, processing based on OS programs, processing based on application programs running on the OS, and the like. The CPU 301 controls the operating state of the system based on control from the chipset 303. For example, the CPU 301 executes startup processing to transition the operating state of the system from a standby state to a normal operating state. Further, the CPU 301 executes processing for transitioning the operating state of the system from the normal operating state to the standby state. For example, the CPU 301 executes HID control processing that causes a transition from a normal operating state to a standby state (for example, a locked state) through OS processing in response to a state in which no HID input continues for a sleep setting time.

GPU 302 is connected to display unit 110. The GPU 302 performs image processing under the control of the CPU 301 to generate display data. The GPU 302 outputs the generated display data to the display unit 110.

The chipset 303 has functions such as a memory controller and an I/O controller. For example, the chipset 303 controls reading and writing of data from the system memory 304, the storage unit 170, etc. by the CPU 301 and the GPU 302. Furthermore, the chipset 303 controls input/output of data from the communication section 160, the display section 110, and the EC 200. Additionally, the chipset 303 has a function as a sensor hub. For example, the chipset 303 temporarily stores image data of a captured image captured by the imaging unit 120 in the system memory 304. Additionally, the chipset 303 causes the speaker 132 to output sound waves or ultrasonic waves via the audio system 130 . Furthermore, the chipset 303 acquires sound data of the sound waves or ultrasonic waves picked up by the microphone 131 via the audio system 130 . For example, the chipset 303 performs HPD processing to detect a person (user) by outputting ultrasonic waves from the speaker 132 and acquiring reflected waves of the ultrasonic waves from the microphone 131. Furthermore, the chipset 303 controls the operating state of the system based on the result of detecting a person through HPD processing.

The system memory 304 is used as a reading area for programs executed by the CPU 301, a work area for writing processing data, and the like. Further, the system memory 304 temporarily stores image data of a captured image captured by the imaging unit 120, sound data outputted via the audio system 130, sound data acquired via the audio system 130, and the like.

Note that the CPU 301, the GPU 302, and the chipset 303 may be configured as one integrated processor, or some or each of them may be configured as individual processors. For example, in the normal operating state, the CPU 301, GPU 302, and chipset 303 are all operating, but in the standby state, at least a portion of the chipset 303 is operating. In the standby state, at least the functions necessary for HPD processing at startup operate intermittently, and unnecessary functions are suspended.

[Functional configuration of information processing device]
Next, the functional configuration related to HPD processing executed by the information processing device 1 will be described in detail.

FIG. 7 is a schematic block diagram showing an example of the functional configuration of the information processing device 1 according to the present embodiment. The information processing device 1 includes an HID input detection section 210, a system processing section 310, and an HPD processing section 330 as functional configurations related to HPD processing.

The HID input detection unit 210 is a functional configuration included in the EC 200 shown in FIG. 6, and detects the presence or absence of an HID input based on an operation signal from the input device 150 or the like. When there is an HID input, the HID input detection section 210 outputs HDI input information indicating that there is an HID input to the system processing section 310 and the HPD processing section 330.

The HPD processing unit 330 is a functional configuration that executes HPD processing by processing of the chipset 303. For example, the HPD processing section 330 includes a detection processing section 331, a detection operation control section 332, a detection timer 333, a pause timer 334, and a system operation control section 335.

The detection processing unit 331 performs HPD processing to detect a person based on the ultrasonic waves (reflected waves) collected by the microphone 131 by outputting ultrasonic waves from the speaker 132 via the audio system 130 . For example, the detection processing unit 331 uses ultrasound to detect when a user approaches the information processing device 1 (Approach), when the user is present in front of the information processing device 1 (Presence), and when the user approaches the information processing device 1 (Presence). A state in which a user leaves (Leave), a state in which a user does not exist in front of the information processing device 1 (Absence), etc. is detected.

If a specific event does not occur in the detection state in which HPD processing is being executed, the detection operation control unit 332 suspends the HPD processing and transitions to the dormant state when a predetermined time Td has elapsed after starting the HPD processing. let Furthermore, if a specific event occurs in the detection state where HPD processing is being performed, the detection operation control unit 332 performs HPD processing in response to the occurrence of the specific event even if the predetermined time Td has not elapsed. Pause and transition to hibernation state.

The specific event in the detection state is, for example, the detection of a state in which a user is present (Presence) or the detection of an HID input. The detection operation control unit 332 acquires information indicating that Presence has been detected from the detection processing unit 331. The detection operation control unit 332 also acquires HDI input information indicating that there is an HID input from the HID input detection unit 210.

In addition, if a specific event does not occur in the hibernation state in which the HPD processing is suspended, the detection operation control unit 332 starts the HPD processing when a predetermined time Tn has elapsed since the HPD processing is suspended, and enters the detection state. Move to. Furthermore, if a specific event occurs in a dormant state in which HPD processing is suspended, the detection operation control unit 332 starts the detection processing after a predetermined time Tn has elapsed since the occurrence of the specific event. Shift to detection state. A specific event in the dormant state is, for example, that a HID input is detected.

The detection timer 333 is a timer for measuring the elapsed time of the detection state. The pause timer 334 is a timer for measuring the elapsed time of the pause state. The detection operation control unit 332 uses the detection timer 333 to measure the elapsed time after starting the detection state, and determines whether the predetermined time Td has elapsed. Furthermore, the detection operation control unit 332 uses the pause timer 334 to measure the time elapsed since the start of the pause state, and determines whether a predetermined time Tn has elapsed.

Further, the detection operation control unit 332 causes the device to enter a hibernation state when sleep processing by the OS function is disabled. The sleep processing by the OS function is disabled, for example, during a period when a moving image is being played, or when the sleep processing is set to be disabled by the user.

The system operation control unit 335 outputs instruction information indicating the operating state of the system to the system processing unit 310 based on the detection result of the HPD processing performed by the detection processing unit 331. For example, when the detection processing unit 331 detects a user's approach to the information processing device 1 in the standby state, the system operation control unit 335 sends instruction information instructing the system startup to the system processing unit 310. Output. Further, when the detection processing unit 331 detects that the user leaves the information processing device 1 in the normal operating state, the system operation control unit 335 sends instruction information to the system processing unit to transition the system to the standby state. Output to 310.

The system processing unit 310 is a functional configuration realized by the CPU 11 executing BIOS and OS processing. For example, the system processing unit 310 includes a sleep processing unit 311, an operating state control unit 315, and a sleep processing control unit 316 as functional configurations based on OS processing.

The sleep processing unit 311 uses a function of the OS to execute sleep processing that causes the system to transition to a standby state if there is no HID input for a certain period of time in the normal operating state. For example, the sleep processing section 311 includes an HID information acquisition section 312, a sleep timer 313, and a sleep instruction section 314.

The HID information acquisition unit 312 acquires HDI input information indicating that there is an HID input from the HID input detection unit 210. The sleep timer 313 measures the sleep setting time. The HID information acquisition unit 312 resets the sleep timer 313 every time it acquires HDI input information indicating that there is an HID input from the HID input detection unit 210. In other words, the sleep timer 313 measures the duration of a state in which there is no HID input. When the time counted by the sleep timer 313 reaches the sleep setting time, the sleep instruction unit 314 outputs instruction information for transitioning the system from the normal operation state to the standby state to the operation state control unit 315.

The sleep processing control unit 316 controls enabling or disabling sleep processing by the OS function executed by the sleep processing unit 311. For example, the sleep processing control unit 316 allows the sleep processing to function effectively in the normal operating state, but disables the sleep processing during a period when a video is being played or when the sleep processing is set to be disabled by the user. . Furthermore, the sleep processing control section 316 outputs information indicating whether sleep processing is enabled or disabled to the HPD processing section 330 (detection operation control section 332).

The operating state control unit 315 controls the operating state of the system. For example, the operating state control unit 315 controls the operating state of the system to a normal operating state, a standby state, etc. based on control from the HPD processing unit 330. As an example, when the operating state control unit 315 acquires instruction information instructing startup from the HPD processing unit 330, the operating state control unit 315 transitions the operating state of the system from the standby state to the normal operating state. Further, when the operating state control unit 315 receives an instruction to transition the operating state of the system to the standby state from the HPD processing unit 330, the operating state control unit 315 shifts the operating state of the system from the normal operating state to the standby state.

[Operation of HPD operation control processing]
Next, the operation of the detection operation control process in which the detection operation control unit 332 controls the HPD process between the detection state and the dormant state will be described. First, with reference to FIG. 8, the operation of the detection operation control process when the HPD process is in a dormant state will be described.

FIG. 8 is a flowchart showing an example of the detection operation control process when the HPD process according to the present embodiment is in a dormant state.

(Step S101) When the detection operation control unit 332 starts the hibernation state, it starts measuring the elapsed time from the start of the hibernation state using the hibernation timer 334. Then, the process advances to step S103.

(Step S103) The detection operation control unit 332 determines whether a predetermined time Tn has elapsed since the start of the hibernation state, based on the elapsed time measured by the hibernation timer 334. When the detection operation control unit 332 determines that the predetermined time Tn has elapsed (YES), the process proceeds to step S105. On the other hand, when the detection operation control unit 332 determines that the predetermined time Tn has not elapsed (NO), the process proceeds to step S107.

(Step S105) The detection operation control unit 332 causes the state to shift from the rest state to the detection state when the predetermined time Tn has elapsed in the rest state. Then, the detection operation control process during the hibernation state ends.

(Step S107) The detection operation control unit 332 determines whether an HID input is detected based on the HDI input information from the HID input detection unit 210. When the detection operation control unit 332 determines that the HID input is detected (YES), the process proceeds to step S109. On the other hand, when the detection operation control unit 332 determines that the HID input is not detected (NO), the process proceeds to step S111.

(Step S109) When the HID input is detected, the detection operation control unit 332 resets the pause timer 334, returns to the process of step S101, and starts counting the elapsed time.

(Step S<b>111 ) The detection operation control unit 332 determines whether or not sleep processing by the OS function is disabled based on information indicating whether sleep processing is enabled or disabled and output from the sleep processing control unit 316 . If the detection operation control unit 332 determines that the sleep process by the OS function is invalid (YES), the process proceeds to step S113. On the other hand, if the detection operation control unit 332 determines that the sleep process by the OS function is effective (NO), the process returns to step S103.

(Step S113) The detection operation control unit 332 stops the sleep timer 334 when the sleep processing by the OS function is invalid. Then, the process advances to step S115.

(Step S115) The detection operation control unit 332 determines whether sleep processing by the OS function is enabled based on information indicating whether sleep processing is enabled or disabled and output from the sleep processing control unit 316. When the detection operation control unit 332 determines that the sleep process by the OS function remains disabled (NO), the detection operation control unit 332 performs the process of step S115 again. On the other hand, if the detection operation control unit 332 determines that the sleep process by the OS function is enabled (YES), the process proceeds to step S117.

(Step S117) The detection operation control unit 332 resets the pause timer 334, returns to the process of step S101, and starts counting the elapsed time.

Next, with reference to FIG. 9, the operation of the detection operation control process when the HPD process is in the detection state will be described.
FIG. 9 is a flowchart showing an example of the detection operation control process when the HPD process according to the present embodiment is in the detection state.

(Step S201) When the detection operation control unit 332 starts the detection state, it starts measuring the elapsed time from the start of the detection state using the detection timer 333. Then, the process advances to step S203.

(Step S203) Based on the elapsed time measured by the detection timer 333, the detection operation control unit 332 determines whether a predetermined time Td has elapsed since the detection state was started. When the detection operation control unit 332 determines that the predetermined time Td has elapsed (YES), the process proceeds to step S205. On the other hand, when the detection operation control unit 332 determines that the predetermined time Td has not elapsed (NO), the process proceeds to step S209.

(Step S205) When the detection state has elapsed for a predetermined time Td, the detection operation control unit 332 shifts the detection state to the rest state. Then, the process advances to step S207.

(Step S207) The detection processing unit 331 detects the user's departure from the information processing apparatus 1 when the predetermined time Td has elapsed in the detection state. As a result, the system operation control unit 335 outputs instruction information for transitioning the system to the standby state to the system processing unit 310. Then, the detection operation control process in the detection state is ended.

(Step S209) The detection operation control unit 332 determines whether Presence or HID input is detected. For example, the detection operation control unit 332 determines whether a user is present in front of the information processing device 1 based on the detection result of the HPD process performed by the detection processing unit 331. Furthermore, the detection operation control section 332 determines whether or not an HID input is detected based on the HDI input information from the HID input detection section 210.

When the detection operation control unit 332 determines that neither Presence nor HID input is detected (NO), the process proceeds to step S211. On the other hand, when the detection operation control unit 332 determines that the Presence or HID input is detected (YES), the process proceeds to step S213.

(Step S211) The detection operation control unit 332 determines whether the sleep processing by the OS function is disabled based on the information indicating whether the sleep processing is enabled or disabled and output from the sleep processing control unit 316. If the detection operation control unit 332 determines that the sleep process by the OS function is invalid (YES), the process proceeds to step S213. On the other hand, if the detection operation control unit 332 determines that the sleep process by the OS function is effective (NO), the process returns to step S203.

(Step S213) The detection operation control unit 332 shifts from the detection state to the rest state, and ends the detection operation control process in the detection state.

[Summary of embodiment]
As described above, the information processing device 1 according to the present embodiment includes a speaker 132 (an example of a sound output section) capable of outputting ultrasonic waves, and a microphone 131 (an example of a sound collection section) capable of collecting ultrasonic waves. ), a system memory 304 (an example of a memory) that temporarily stores an OS program, and a CPU 301 (an example of a processor) that realizes the functions of the OS by executing the OS program. The CPU 301 performs HPD processing (an example of detection processing) of detecting a person based on the ultrasound picked up by the microphone 131 by outputting ultrasound from the speaker 132 . For example, if a specific event does not occur in a state in which HPD processing is being executed (for example, in a detection state), the CPU 301 executes Pause processing. In addition, if a specific event occurs in a state in which HPD processing is being executed (for example, in a detection state), the CPU 301 determines that the specific event will occur even if a predetermined time (for example, a predetermined time Td) has not elapsed. The HPD process is stopped depending on the situation.

Thereby, when performing HPD processing using the microphone 131 and the speaker 132 as an ultrasonic sensor, the information processing device 1 can reduce power consumption by suspending detection depending on the situation.

In addition, if a specific event does not occur while the HPD process is suspended (for example, in a dormant state), the CPU 301 executes the Start processing. Further, if a specific event occurs while the HPD process is in a paused state, the CPU 301 starts the HPD process after a predetermined time (for example, a predetermined time Tn) has elapsed since the specific event occurred. .

As a result, when performing HPD processing using the microphone 131 and speaker 132 as an ultrasonic sensor, the information processing device 1 starts detection according to the situation from a state where detection is paused, thereby reducing power consumption. However, it is possible to appropriately detect a person.

For example, a specific event in a state in which HPD processing is being executed (for example, in a detection state) is that a person is detected by HPD processing.

As a result, once a user is detected in the detection state, the information processing device 1 does not need to continue the HPD process and detect the user many times, so the information processing device 1 is suspended even if the predetermined time Tn does not elapse. By shifting to the state, power consumption can be reduced.

Further, the CPU 301 further performs input detection processing to detect an input (HID input) by the user. For example, a specific event in a state in which HPD processing is being executed (e.g., detection state) and in a state in which HPD processing is inactive (e.g., inactive state) is determined by the input detection processing by the user (HID input). It is to be detected.

As a result, when the information processing device 1 detects an HID input in the hibernation state, it is known that the user is present, so there is no need to perform HPD processing immediately, and the information processing device 1 exits the hibernation state. By continuing, power consumption can be reduced. In addition, even in the detection state, if the HID input is detected, the information processing device 1 knows that the user is present, so there is no need to immediately perform HPD processing, and the information processing device 1 waits for a predetermined period of time. By shifting to the hibernation state even if Tn has not elapsed, power consumption can be reduced.

In addition, as a function of the OS, the CPU 301 performs at least some functions of the OS when a state in which a user's input (HID input) is not detected by input detection processing continues for a preset time (for example, a sleep setting time). A sleep process (an example of a function restriction process) that restricts the use of (for example, transitions to a standby state) is further performed. Then, if the sleep processing by this OS function is disabled, the CPU 301 suspends the HPD processing.

As a result, if the sleep processing by the OS function is disabled, the information processing device 1 does not need to detect the user's departure and transition to the standby state, so by suspending the HPD processing, Power consumption can be reduced.

Further, if a specific event does not occur in a state in which the HPD process is being performed (for example, in a detection state), the CPU 301 executes a process when a predetermined time (for example, a predetermined time Td) has elapsed after starting the HPD process. Restrict use of at least some functions of the OS (for example, transition to standby state).

Thereby, the information processing device 1 can transition the system to a standby state when the user leaves, thereby increasing safety.

Further, the control method in the information processing apparatus 1 according to the present embodiment includes an HPD process (detection process) in which the CPU 301 outputs ultrasonic waves from the speaker 132 to detect a person based on the ultrasonic waves collected by the microphone 131. For example, if a specific event does not occur during the HPD process (e.g., detection state), a predetermined time (e.g., predetermined time Td) after starting the HPD process. If a specific event occurs while HPD processing is in progress (e.g., detection state), the HPD processing is paused even if a predetermined time (e.g., predetermined time Td) has not elapsed. The method includes a step of performing detection operation control processing to suspend HPD processing in response to the occurrence of an event.

Thereby, when performing HPD processing using the microphone 131 and the speaker 132 as an ultrasonic sensor, the information processing device 1 can reduce power consumption by suspending detection depending on the situation.

Further, the control method in the information processing apparatus 1 according to the present embodiment includes an HPD process (detection process) in which the CPU 301 outputs ultrasonic waves from the speaker 132 to detect a person based on the ultrasonic waves collected by the microphone 131. If a specific event does not occur in a state where HPD processing is paused (for example, in a dormant state), a predetermined period of time (for example, predetermined time Tn) after stopping HPD processing is performed. If a specific event occurs while HPD processing is paused, HPD processing is started after a predetermined time (for example, predetermined time Tn) has elapsed since the specific event occurred. and a step of performing a detection operation control process to start the detection operation.

As a result, when performing HPD processing using the microphone 131 and speaker 132 as an ultrasonic sensor, the information processing device 1 starts detection according to the situation from a state where detection is paused, thereby reducing power consumption. However, it is possible to appropriately detect a person.

Although the embodiments of the present invention have been described above in detail with reference to the drawings, the specific configuration is not limited to the above-described embodiments, and includes designs within the scope of the gist of the present invention. For example, the configurations described in the above embodiments can be combined arbitrarily.

Note that in the above embodiment, an example has been described in which the information processing apparatus 1 performs HPD processing to detect a person using ultrasound, but the information processing apparatus 1 is not limited to this. For example, the information processing device 1 may use other detection methods instead of or in addition to ultrasound. Other detection methods may be, for example, a detection method using an infrared sensor or an infrared laser, or a detection method using an UWB (Ultra Wide Band) radar. Alternatively, a detection method may be used in which a person is detected by detecting a face from an image captured by the imaging unit 120.

Furthermore, the above-described standby state may include a hibernation state, a power-off state, and the like. The hibernation state corresponds to, for example, the S4 state defined by ACPI. The power-off state corresponds to, for example, the S5 state (shutdown state) defined by ACPI. Note that among the standby states, a standby state, a sleep state, a hibernation state, a power-off state, and the like are states in which power consumption is lower than in a normal operating state (a state in which power consumption is suppressed).

Note that the information processing device 1 described above has a computer system inside. Then, a program for realizing the functions of each component included in the information processing device 1 described above is recorded on a computer-readable recording medium, and the program recorded on this recording medium is read into a computer system and executed. Processing in each of the configurations included in the information processing device 1 described above may be performed by the following. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing the program on the computer system. The "computer system" here includes hardware such as an OS and peripheral devices. Further, a "computer system" may include a plurality of computer devices connected via a network including the Internet, a WAN, a LAN, a communication line such as a dedicated line, etc. Furthermore, the term "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into computer systems. In this way, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.

The recording medium also includes a recording medium provided internally or externally that can be accessed from the distribution server for distributing the program. Note that the program may be divided into a plurality of programs, downloaded at different timings, and then combined into each component of the information processing device 1, or the distribution servers that distribute each of the divided programs may be different. Furthermore, a ``computer-readable recording medium'' refers to a storage medium that retains a program for a certain period of time, such as volatile memory (RAM) inside a computer system that serves as a server or client when a program is transmitted via a network. This shall also include things. Moreover, the above-mentioned program may be for realizing a part of the above-mentioned functions. Furthermore, it may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

Further, a part or all of the functions included in the information processing device 1 in the embodiment described above may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function may be implemented as an individual processor, or a part or all of them may be integrated into a processor. Further, the method of circuit integration is not limited to LSI, but may be implemented using a dedicated circuit or a general-purpose processor. Further, if an integrated circuit technology that replaces LSI emerges due to advances in semiconductor technology, an integrated circuit based on this technology may be used.

Further, the information processing device 1 of the above embodiment is not limited to a PC, a tablet terminal device, a smartphone, etc., but may be a game device, a multimedia terminal, etc.

1 information processing device, 10 first housing, 20 second housing, 15 hinge mechanism, 110 display unit, 120 imaging unit, 130 audio system, 131 microphone 131 speaker, 140 power button, 150 input device, 151 keyboard, 153 touch pad, 160 communication section, 170 storage section, 200 EC, 300 main processing section, 301 CPU, 302 GPU, 303 chipset, 304 system memory, 210 HID input detection section, 310 system processing section, 311 sleep processing section, 312 HID information acquisition unit, 313 sleep timer, 314 sleep instruction unit, 315 operating state control unit, 316 sleep processing control unit, 330 HPD processing unit, 331 detection processing unit, 332 detection operation control unit, 333 detection timer, 334 pause timer, 335 System operation control section, 400 Power supply section

Claims (8)

a sound output section capable of outputting ultrasonic waves;
A sound collection unit capable of collecting ultrasonic waves;
A memory that temporarily stores OS (Operating System) programs;
a processor that realizes the functions of the OS by executing the program;
Equipped with
The processor includes:
a detection process of detecting a person based on the ultrasound collected by the sound collection unit by outputting ultrasound from the sound output unit;
If a specific event does not occur while the detection process is being executed, the output of ultrasonic waves from the sound output section is stopped after a predetermined period of time has elapsed since the detection process was started, and the detection process is continued. If the specific event occurs in a state where the detection process is executed and the detection process is executed, the sound output section outputs a signal in response to the occurrence of the specific event even if the predetermined time has not elapsed. a detection operation control process that suspends the output of the ultrasonic wave and suspends the detection process;
An information processing device that performs a sound output section capable of outputting ultrasonic waves;
A sound collection unit capable of collecting ultrasonic waves;
A memory that temporarily stores OS (Operating System) programs;
a processor that realizes the functions of the OS by executing the program;
Equipped with
The processor includes:
a detection process of detecting a person based on the ultrasound collected by the sound collection unit by outputting ultrasound from the sound output unit;
If a specific event does not occur while the output of ultrasound from the sound output unit is stopped and the detection process is stopped, the detection process is restarted when a predetermined period of time has elapsed since the detection process was stopped. If the specific event occurs in a state in which the output of ultrasonic waves from the sound output unit is stopped and the detection process is paused, the predetermined process is performed after the specific event occurs. a detection operation control process that starts the detection process after a lapse of time;
An information processing device that performs The specific event is that a person is detected by the detection process;
The information processing device according to claim 1. The processor includes:
Further performs input detection processing to detect input by the user,
The specific event is that an input by a user is detected by the input detection process;
The information processing device according to claim 1 or claim 2. The processor includes:
Further performs input detection processing to detect input by the user,
As a function of the OS, if a state in which no user input is detected by the input detection process continues for a preset period of time, the OS further performs a function restriction process that restricts the use of at least some functions of the OS;
If the function restriction processing is disabled, the output of the ultrasonic wave from the sound output unit is stopped and the detection processing is stopped.
The information processing device according to claim 1 or claim 2. The processor includes:
If the specific event does not occur while the detection process is being executed, restricting the use of at least some functions of the OS after a predetermined period of time has elapsed after starting the detection process;
The information processing device according to claim 1 or claim 3. A sound output unit capable of outputting ultrasonic waves, a sound collection unit capable of collecting ultrasonic waves, a memory that temporarily stores an OS (Operating System) program, and a function of the OS by executing the program. A control method in an information processing device comprising:
The processor,
performing a detection process of detecting a person based on the ultrasound collected by the sound collection unit by outputting ultrasound from the sound output unit;
If a specific event does not occur while the detection process is being executed, the output of ultrasonic waves from the sound output section is stopped after a predetermined period of time has elapsed since the detection process was started, and the detection process is continued. If the specific event occurs in a state where the detection process is executed and the detection process is executed, the sound output section outputs a signal in response to the occurrence of the specific event even if the predetermined time has not elapsed. performing a detection operation control process of suspending the output of the ultrasonic wave and suspending the detection process;
control methods including. A sound output unit capable of outputting ultrasonic waves, a sound collection unit capable of collecting ultrasonic waves, a memory that temporarily stores an OS (Operating System) program, and a function of the OS by executing the program. A control method in an information processing device comprising:
The processor,
performing a detection process of detecting a person based on the ultrasound collected by the sound collection unit by outputting ultrasound from the sound output unit;
If a specific event does not occur while the output of ultrasound from the sound output unit is stopped and the detection process is stopped, the detection process is restarted when a predetermined period of time has elapsed since the detection process was stopped. If the specific event occurs in a state in which the output of ultrasonic waves from the sound output unit is stopped and the detection process is paused, the predetermined process is performed after the specific event occurs. performing a detection operation control process that starts the detection process in response to the passage of time;
control methods including.

Images