JP7143598B2 - Information processing device, information processing method, and information processing program - Google Patents

Description

The present invention relates to an information processing device, an information processing method, and an information processing program.

2. Description of the Related Art Conventionally, there is known a terminal equipped with an audio output function for giving notifications and the like, and which can be installed and used at an arbitrary position. When using such a terminal, it is necessary to appropriately adjust the volume and the like according to the positional relationship between the terminal and the user.
For example, Japanese Patent Laid-Open No. 2002-200002 discloses a technique related to such adjustment of volume and the like. With the technology disclosed in Patent Document 1, the user can manually adjust the volume and the like according to the positional relationship between the terminal and the user.

JP-A-2001-125579

However, general techniques such as the technique disclosed in Patent Literature 1 require user operations to adjust the volume and the like, which is complicated.

SUMMARY OF THE INVENTION The present invention has been made in view of such circumstances, and it is an object of the present invention to easily adjust notification output.

In order to achieve the above object, an information processing device according to one aspect of the present invention includes:
An information processing device having a notification unit that notifies information by outputting sound ,
Wearing position determination means for determining which position of the user's body the information processing device is worn on, based on motion data generated with the user's movement;
Control means for controlling volume output from the notification unit based on the mounting position of the information processing device determined by the mounting position determination means;
characterized by comprising
Further, the information processing method of one aspect of the present invention includes:
An information processing device having a notification unit for notifying information by outputting sound at a position corresponding to which part of the user's body based on motion data generated along with the movement of the user is worn. a mounting position determination step for determining whether the
a control step of controlling the volume output from the notification unit based on the mounting position of the information processing device determined by the mounting position determination step;
characterized by comprising
Further, an information processing program according to one aspect of the present invention includes
An information processing device having a notification unit for notifying information by outputting sound at a position corresponding to which part of the user's body based on motion data generated along with the movement of the user is worn. A mounting position determination function that determines whether the
a control function for controlling the volume output from the notification unit based on the mounting position of the information processing device determined by the mounting position determination function;
is realized by a computer .

ADVANTAGE OF THE INVENTION According to this invention, adjustment regarding a notification output can be performed simply.

It is a figure which shows the use condition of the information processing apparatus which concerns on one Embodiment of this invention. 2A and 2B are diagrams illustrating an external configuration and a system configuration of the information processing apparatus of FIG. 1; FIG. 2 is a block diagram showing the hardware configuration of the information processing apparatus in FIG. 1; FIG. 2 is a functional block diagram showing a functional configuration for executing volume adjustment processing among the functional configurations of the information processing apparatus of FIG. 1; FIG. 5 is a flow chart showing the flow of volume adjustment processing executed by the information processing apparatus having the functional configuration of FIG. 4; 4 is a flowchart showing the flow of reference data generation processing according to one embodiment of the present invention; 2 is a diagram showing reference waveform data of a gyro sensor when the information processing apparatus of FIG. 1 is worn on the shoulder, back, or waist; FIG. FIG. 4 is a diagram showing output waveform data of an acceleration sensor when the exercise state is a resting state, walking state, or running state; 12 is a table showing the number of steps calculated from the output waveform data of the acceleration sensor in the exercise state determination process of FIG. 11; FIG. 6 is a flow chart showing the flow of mounting position determination processing in FIG. 5 ; FIG. FIG. 6 is a flow chart showing the flow of exercise state determination processing in FIG. 5 ; FIG. FIG. 6 is a table showing adjustment levels in the audio adjustment of FIG. 5; FIG. It is a figure which shows the structure of the external appearance in the modification of this invention. It is a table which shows the adjustment level of the sound volume in the modification of this invention.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a usage state of an information processing apparatus according to one embodiment of the present invention. The information processing device 10 is attached to any part of the body of the user U in use, and is used as a data logger for trekking, for example.

As shown in FIG. 1, the information processing device 10 is worn on the waist W, the chest B, or the shoulder S for use, for example. The information processing device 10 outputs audio information according to the user U's state. The audio information to be output is, for example, a notification of the current distance traveled, biometric information of the user U, guidance prompting the user U to take a break, or the like.

As described in detail below, the information processing device 10 of one aspect of the present invention includes a notification unit that outputs audio information, a mounting position determination unit, and a control unit. The wearing position determination unit determines a position corresponding to which part of the user's body the information processing device 10 is worn. The control unit controls the notification strength of the notification unit based on the mounting position of the information processing device determined by the mounting position determination unit.
Thereby, the information processing device 10 can output an appropriate sound volume according to the mounting position of the information processing device 10 .

[System configuration]
FIG. 2 is a diagram showing the external configuration and system configuration of the information processing apparatus 10. As shown in FIG. The information processing apparatus 10 performs the functions of the present invention by itself, but is configured to be able to communicate with an external device (not shown). The information processing apparatus 10 incorporates various sensors such as sensors for detecting angular velocity and acceleration. These sensors detect the motion state of the user U based on the three-dimensional orthogonal coordinate system shown in the figure. Here, the traveling direction of the user U is the Z-axis direction, the vertical direction is the Y-axis direction, and the horizontal direction is the X-axis direction. The motion state of the user U is decomposed into an X-axis component, a Y-axis component, and a Z-axis component and detected as various feature quantities. As will be described in detail below, the information processing apparatus 10 uses the detected feature amount to adjust the volume output from the speaker 16 .

[External configuration]
The information processing device 10 includes a display section 12 and a back surface 14 . A display screen (not shown) having a touch panel, for example, is formed on the display unit 12, and the user U can operate the information processing apparatus 10 through the display screen. The imaging unit (not shown) is provided on the same surface as the display unit 12, for example, and can capture an image of the user U while the information processing device 10 is worn by the user U. FIG. A clip (not shown) is detachably provided on the back surface 14, and the user U attaches the information processing apparatus 10 to the body by attaching the clip to clothing or the like. The information processing apparatus 10 is equipped with a speaker 16 from which various sounds such as audio information, music, and warning sounds are output.

[Hardware configuration]
FIG. 3 is a block diagram showing the hardware configuration of the information processing apparatus 10 according to one embodiment of the present invention.
The information processing device 10 is configured as, for example, a data logger.

The information processing apparatus 10, as shown in FIG. It has an output unit 18 , an input unit 26 , a display unit 12 , a detection unit 27 , a storage unit 30 , a communication unit 28 , a drive 29 and a removable medium 100 .

The CPU 21 executes various processes according to programs recorded in the ROM 22 or programs loaded from the storage unit 30 to the RAM 23 .
The program is, for example, a module for executing reference data generation processing, volume adjustment processing, mounting position determination processing, and exercise state determination processing, which will be described later. Other programs include general modules for controlling electronic devices, such as programs that make up the operating system of the information processing apparatus 10 .

The RAM 23 also stores data necessary for the CPU 21 to execute various processes.

The CPU 21 , ROM 22 and RAM 23 are interconnected via a bus 24 . An input/output interface 25 is also connected to this bus 24 . The input/output interface 25 is connected with the imaging unit 17 , the output unit 18 , the input unit 26 , the display unit 12 , the detection unit 27 , the storage unit 30 , the communication unit 28 and the drive 29 .

The imaging unit 17 includes an optical lens unit and an image sensor (not shown).

The optical lens section is composed of a lens for condensing light, such as a focus lens and a zoom lens, in order to photograph an object.
A focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. A zoom lens is a lens that can freely change the focal length within a certain range.
The optical lens unit is also provided with peripheral circuits for adjusting setting parameters such as focus, exposure, white balance, etc., as required.

The image sensor is composed of a photoelectric conversion element, an AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens section. Therefore, the photoelectric conversion element photoelectrically converts (pictures) a subject image, accumulates an image signal for a certain period of time, and sequentially supplies the accumulated image signal to the AFE as an analog signal.
The AFE executes various signal processing such as A/D (Analog/Digital) conversion processing on this analog image signal. A digital signal is generated by various signal processing and output as an output signal of the imaging unit 17 .
Such an output signal of the imaging unit 17 is hereinafter referred to as a "captured image". The data of the captured image is appropriately supplied to the CPU 11, an image processing unit (not shown), and the like.

The input unit 26 is composed of various buttons, a microphone, etc., and inputs various kinds of information in accordance with the user's instruction operation. The button is, for example, a switch for starting/stopping the reference data generation process or the sound adjustment process described below, or a mode changeover switch in the reference data generation process.
The output unit 18 is composed of the speaker 16 and the like, and outputs sound.
The storage unit 30 is composed of a hard disk, a flash memory, or the like, and stores, for example, exercise information of the user U, climate information such as temperature and humidity, or various data such as position information.
The communication unit 28 controls communication with another device (not shown) via a network including the Internet. For example, the communication unit 28 transmits data stored in the storage unit 30 to another electronic device. Alternatively, the communication unit 28 communicates with a position detection device conforming to a standard such as GPS (Global Positioning System) in order to acquire user U's position information.

A removable medium 100 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is mounted in the drive 29 as appropriate. A program read from the removable medium 100 by the drive 29 is installed in the storage unit 30 as required. The removable medium 100 can also store various data stored in the storage unit 30 in the same manner as the storage unit 30 .

[Functional configuration]
FIG. 4 is a functional block diagram showing a functional configuration for executing audio adjustment processing among the functional configurations of the information processing apparatus 10 of FIG.
In the sound adjustment process, after the control unit 211 collects the feature amount corresponding to the movement of the user U, the wearing position of the information processing device 10 and the exercise state of the user U are determined from the feature amount, and output A series of processes for adjusting the volume of the unit 18 . The feature amount is, for example, the number of steps of the user U during a predetermined period of time.

When executing the volume adjustment process, as shown in FIG. do.
A motion data storage unit 301 is set in one area of the storage unit 30 . The motion data storage unit 301 stores data corresponding to the motion of the user U detected by the detection unit 27 .

The control unit 211 controls the overall operation of the information processing device 10 . For example, the control unit 211 controls the operation of each unit performed by the CPU 21 and adjusts the volume of the speaker 16 in volume adjustment processing, which will be detailed later.

The data analysis unit 212 collects and analyzes data output from the detection unit 27 in reference data generation processing and volume adjustment processing, which will be described later. For example, the data analysis unit 212 acquires electrical signals according to the movement of the user U detected by an acceleration sensor or a gyro sensor provided in the detection unit 27 . The data based on the electrical signal acquired by the data analysis unit 212 is stored in the motion data storage unit 301 and used in the mounting position determination process and the exercise state determination process, which will be described later.
The data analysis unit 212 generates data used as a criterion for determination in the reference data generation process. The generated reference data is used in the mounting position determination process and exercise state determination process, which are subroutines of the volume adjustment process.

The mounting position determination unit 213 determines the position where the information processing apparatus 10 is mounted in the mounting position determination process of the volume adjustment process described later.
The wearing position determining unit 213 determines the wearing position by, for example, comparing the data output from the gyro sensor among the data indicating the movement of the user U and the reference data.

The exercise state determination unit 214 determines the exercise state of the user U in the exercise state determination process of the sound volume adjustment process described later.
For example, the exercise state determination unit 214 determines the exercise state by comparing the data output from the acceleration sensor among the data indicating the movement of the user U and the reference data.

The notification intensity determination unit 215 adjusts the volume output from the speaker 16 in volume adjustment processing, which will be described later. The notification intensity determination unit 215 determines the volume corresponding to the mounting position of the information processing device 10 with respect to the user U and the exercise state of the user U by referring to the volume adjustment table.

[motion]
FIG. 5 is a flowchart for explaining the flow of volume adjustment processing executed by the information processing apparatus 10 having the functional configuration of FIG.
The volume adjustment process is started when the user operates the input unit 26 to start the volume adjustment process. In the volume adjustment process, a mounting position determination process and an exercise state determination process are performed as subroutines.
FIG. 6 is a flowchart for explaining the flow of reference data generation processing executed by the information processing apparatus 10. As shown in FIG.
The reference data generation process is started when the user operates the input unit 26 to start the reference data generation process. Since the reference data generated by the reference data generation process is used in the mounting position determination process and the motion state determination process of the volume adjustment process, the reference data generation process must be performed prior to the volume adjustment process.

[Reference data generation processing]
(Generation of mounting position reference waveform data)
FIG. 6 is a flowchart showing the flow of reference data generation processing. The reference data generation process is a process of generating reference data for the mounting position determination process and the exercise state determination process, which will be described in detail below. As described above, the reference data generation process is executed before the volume adjustment process is performed. This is because, when determining the exercise state of the user U and the mounting position of the information processing device 10, data that serves as a determination reference is necessary.

In step S1, the user U presses a mode changeover switch provided in the input unit 26 to set the operation mode of the information processing apparatus 10 to the "walking reference data generation mode". Here, it is assumed that there are three types of modes: a "walking reference data generation mode", a "running reference data generation mode", and a "stationary reference data generation mode".

In step S2, the user U wears the information processing device 10 on the shoulder and walks. During this time, the data analysis unit 212 acquires electrical signals according to the movement of the user U from the gyro sensor and acceleration sensor provided in the detection unit 27 . The data analysis unit 212 records data based on the acquired electrical signals in the exercise data storage unit 301 .
In this data collection, the data analysis unit 212 generates mounting position reference waveform data.
FIG. 7 is a diagram showing reference waveform data of the gyro sensor when the information processing device 10 is worn on the shoulder, back, or waist. As shown in the upper graph of FIG. 7, "when worn on shoulder", electrical signals are detected in the X-axis component, Y-axis component, and Z-axis component in order from the top. In the case of the “shoulder”, every time the user U takes a step, the left and right rotational motion of the body occurs in the Z-axis component, and the front-back rotational motion occurs in the Y-axis component. In addition, the front-rear rotational motion of the upper body of the user U occurs in the X-axis component. Note that the output tendency of the output signal does not depend on the mode. That is, regardless of whether the mode is "for walking" or "for running", similar waveforms appear in each component.

In step S3 of FIG. 6, the user U determines whether or not data has been collected for a predetermined period of time. The predetermined time is, for example, one minute. If the predetermined time has not elapsed, the process returns to step S2 to continue collecting data. In step S3, when the user U determines that the collection of data for a predetermined period of time has been completed, the user U presses the stop switch provided on the input unit. When the stop switch is pressed, the collected data is recorded in the motion data storage unit 301 as "shoulder-wearing reference data" when walking with the device worn on the shoulder.

In step S4, the user U wears the information processing device 10 on the back and walks. The data analysis unit 212 records the acquired data in the motion data storage unit 301 in the same manner as when the device is worn on the shoulder.
The graph of "when worn on the back" in the middle of FIG. 7 shows the reference waveform data of the gyro sensor when the information processing apparatus 10 is worn on the back. As shown in the middle graph of FIG. 7, "When the device is worn on the back", the electrical signals of the X-axis component, Y-axis component, and Z-axis component are minute in order from the top. In the case of the "back", since the information processing device 10 is located in the center of the body, rotational movement in the left, right, front, and back directions is not likely to occur. Therefore, almost no electrical signal is output to each component.
In step S5, the user U determines whether data collection has been completed for a predetermined period of time, and the process of step S4 is continued until the data collection is completed. When the user U determines that the data for the predetermined time has been collected, the user U presses the stop switch. When the stop switch is pressed, the collected data is recorded in the exercise data storage unit 301 as "reference data when worn on the back" when walking with the device worn on the back.

In step S6, the user U wears the information processing device 10 on the waist and walks. A series of processes in steps S6 to S7 are the same as those for the "shoulder" and "back" mounting positions, and thus description thereof is omitted.
The graph of "when worn on waist" in the lower part of FIG. 7 is a diagram showing the reference waveform data of the gyro sensor when the information processing device 10 is worn on the waist. As shown in the graph of the lower part of FIG. 7, "when attached to the waist", the electric signal is almost not output to the X-axis component, but appears to be large in the Y-axis component and the Z-axis component, in order from the top. In the case of the "waist", every time the user U takes a step, the left-right rotational movement of the body occurs in the Z-axis component, and the front-back rotational movement occurs in the Y-axis component.
The data collected by the processing in steps S6 to S7 are recorded in the exercise data storage unit 301 as "reference data when worn on the waist" when walking while worn on the waist.

In this way, the generation of the reference data representing the movement of the user U during walking in the "walking reference data generation mode" is completed by the above-described steps S1 to S7.

In step S8, the user U presses the mode switch to switch the mode from "for walking" to "for running".

When the mode is switched in step S8, the process proceeds to step S9. In step S9, the user U determines whether or not the termination condition is satisfied. The termination condition is, for example, the completion of generation of mounting position reference waveform data for all modes. Here, as described above, the generation of the mounting position reference waveform data for "walking" has been completed, but the generation of data for other modes such as "for running" has not been completed. Therefore, the user U determines in step S9 that the termination condition is not satisfied, and causes the data analysis unit 212 to execute the processing of steps S1 to S7 in the "running" mode.
In the "running" mode, the user U wears the information processing device 10 on the "shoulder", "back", or "waist" and runs for a predetermined time. In the "stationary" mode, the user U wears the information processing device 10 on the "shoulder", "back", or "waist" position and keeps it stationary for a predetermined period of time.

In step S9, when the user U determines that the generation of the mounting position reference waveform data in all modes has been completed, the mounting position reference waveform data generation processing ends. The end condition here is that data collection is completed in all modes of "running" mode, "walking" mode, and "stationary" mode.

(Generation of motion state reference waveform data)
Also, by collecting the above-described reference data, motion state reference waveform data is generated based on the output signal from the acceleration sensor.
FIG. 8 is a graph showing the output waveform data of the acceleration sensor when the motion state of the user U is stationary, walking, or running.
The graph of "at rest" in the upper part of FIG. 8 is a diagram showing the reference waveform data of the acceleration sensor when the user U is at rest ("for rest" mode). At rest, the output signals in all of the X-axis, Y-axis, and Z-axis components are very small, close to zero.
The middle graph of “Walking” in FIG. 8 shows the reference waveform data of the acceleration sensor when the user U is walking (“Walking” mode). Here, since the traveling direction of the user U is the Z direction, the vertical movement of the user U is output as the Y-axis component, and the horizontal movement is output as the X-axis component. For example, when the user U is walking, the movement of the user U appears prominently in the vertical direction, so that the electrical signal is largely output in the Y-axis component and hardly output in the X-axis component and the Z-axis component.
The middle graph of "running" in FIG. 8 is a diagram showing the reference waveform data of the acceleration sensor in the running state of the user U ("running" mode). Compared to the walking state in the middle of FIG. 8, the output of the Y-axis component indicating vertical movement is different. That is, the frequency of the vertical movement of the user U is higher during running than during walking, so the frequency of the Y-axis component output signal tends to be relatively high.
It should be noted that the output tendency of the output signal in FIG. 8 does not depend on the mounting position. That is, the same waveform is obtained regardless of whether the wearing position is "shoulder", "back" or "waist".

[Generate step count table]
Furthermore, the data analysis unit 212 calculates the number of steps, which is the feature quantity of each exercise state of the user U, based on the above exercise state reference waveform data.
As a characteristic of walking and running, the movement of the Y-axis component, which is the vertical component of the body, remarkably occurs due to the steps of the user U, as shown in the motion state reference waveform data of FIG. 8 . The data analysis unit 212 converts the Y-axis component signal of the exercise state reference waveform data into the number of steps of the user U during 10 seconds during walking and running.

FIG. 9 is a "step count table" showing the number of steps corresponding to each exercise state as a feature amount. The number of steps converted from the exercise state reference waveform data is indicated as "number of steps in 10 seconds". Specifically, the number of steps is "0" in the stationary state, the number of steps is "15" in the walking state, and the number of steps is "30" in the running state. In the exercise state determination process, which will be described later, the exercise state of the user U is determined using the "determined step value" shown in FIG. Specifically, when the number of steps calculated from the sensed motion state of the user U is "0 to 10", the motion state of the user U is "still", and when the number is "11 to 29", the user U's motion state is "still". The exercise state is the “walking” state, and if the user U takes 30 steps or more, the exercise state is determined to be the “running” state.

As described above, in the reference data generation process, data that serves as a reference for determining the mounting position is generated from the output of the gyro sensor, and data that serves as a reference for determining the exercise state of the user U is generated from the output of the acceleration sensor. be.

[Volume adjustment process]
The volume adjustment process will be described with reference to FIG. In step S<b>11 , the control unit 211 activates a gyro sensor and an acceleration sensor as so-called motion sensors provided in the detection unit 27 . The data analysis unit 212 starts sensing by detecting a signal output from the detection unit 27 according to the movement of the user U. The detected signal is recorded in the motion data storage unit 301 as collected waveform data, which is so-called motion data.

In step S12, the control unit 211 determines whether or not the data analysis unit 212 has been able to collect data corresponding to the user's movement for a predetermined period of time. If the control unit 211 determines that the data for the predetermined time has not been collected, the control unit 211 causes the data analysis unit 212 to continue the processing of step S12 until the predetermined time elapses. When the control unit 211 determines that the data analysis unit 212 has successfully collected the data for the predetermined time, the process proceeds to step S13.

In step S13, the mounting position determination unit 213 determines whether or not the mounting position of the information processing device 10 has been determined. For example, when the user U previously inputs the mounting position of the information processing device 10 via the input unit 26, the mounting position determining unit 213 determines that the mounting position has been determined. If the mounting position has been determined, the process proceeds to step S15, which will be described later.

In step S13, if the mounting position determination unit 213 determines that the mounting position of the device has not been determined, the process proceeds to step S14. In step S14, the mounting position determination unit 213 performs mounting position determination processing shown in FIG.
In the mounting position determination process, the mounting position of the information processing device 10 is determined. The wearing position determination unit 213 determines that the position where the information processing device 10 is worn is any one of "shoulders", "back", or "waist". The mounting position determination process will be described in detail below.

When the mounting position of the information processing device 10 is determined in step S14, the process proceeds to step S15. In step S15, the exercise state determination unit 214 performs the exercise state determination process shown in FIG.
In the exercise state determination process, the user U's exercise state is determined. The exercise state determination unit 214 determines that the user U's exercise state is one of "still", "walking", and "running". The exercise state determination process will be described in detail below.

When the exercise state of the user U is determined in step S15, the process proceeds to step S16. In step S16, the control unit 211 determines whether or not the processes of steps S11 to S15 have ended normally. If the processes have not ended normally, the process returns to step S11. In step S16, when the control unit 211 determines that the processes of steps S11 to S15 have been completed normally, the process proceeds to step S17.

In step S17, the notification intensity determination unit 215 performs volume adjustment. Referring to FIG. 12, appropriate sound volumes corresponding to the wearing position and exercise state of the user U are shown as a table. “Low”, “Medium”, or “High” shown in the table are indices representing the degree of output from the speaker 16 . "Low" means low volume, "medium" means medium volume, and "high" means loud volume. The notification intensity determination unit 215 refers to the table and determines the volume based on the wearing position determined in step S14 and the exercise state determined in step S15.

For example, in FIG. 12, when it is determined that the exercise state of the user U is "still" and the wearing position of the information processing device 10 is "shoulder", the volume shown in the table is "low". . This volume is determined for the following reasons. The fact that the motion state of the user U is "stationary" means that the noise caused by the motion of the user U himself is small. Further, the fact that the information processing device 10 is worn on the "shoulder" means that the distance between the speaker 16 of the information processing device 10 and the ear of the user U is short. Therefore, even if the volume from the speaker 16 is relatively low, the user U can hear the voice information. For this reason, the notification intensity determination unit 215 determines the volume to be "low".

As another example, in FIG. 12, when it is determined that the exercise state of the user U is "running" and the wearing position of the information processing device 10 is "waist", the volume is "high". When the motion state of the user U is "running", it means that the noise caused by the motion of the user U is relatively large compared to when the motion state is "still". In addition, when the information processing device 10 is worn at the "waist" position, the distance between the speaker 16 of the information processing device 10 and the ears of the user U is greater than when the information processing device 10 is worn at the "shoulder" position. means relatively far away. Therefore, unless the volume from the speaker 16 is set relatively high, the user U cannot hear the audio information clearly. Therefore, the notification intensity determination unit 215 determines the volume to be "high".

In step S17, when the notification intensity determination unit 215 determines the volume, the control unit 211 controls the speaker 16 according to the determined volume. That is, the control unit 211 reduces the output of the speaker 16 when the volume is determined to be "low", and increases the output of the speaker 16 when the volume is determined to be "high".
The sound adjustment process is completed by the series of processes of steps S11 to S16 described above.
Note that when the user U presses the stop switch provided in the input unit 26 after the audio adjustment process is started, a so-called key interrupt occurs and the process ends.

Below, the mounting position determination process and the exercise state determination process, which are subroutines of the volume adjustment process, will be described.

[Wearing position determination processing]
FIG. 10 is a flowchart showing the flow of mounting position determination processing.
In step S14 of the sound adjustment processing shown in FIG. 5, the control unit 211 calls the mounting position determination processing module from the volume adjustment processing module.

In step S21, the wearing position determination unit 213 performs pattern matching between the "reference data when worn on the shoulder" prerecorded in the exercise data storage unit 301 and the collected waveform data sensed in step S11, and determines the waveform. Calculate the match. After the degree of matching is calculated, the process proceeds to step S22.

In step S22, the wearing position determining unit 213 performs pattern matching between the "reference waveform data when worn on the back" and the collected waveform data sensed in step S11, and calculates the matching degree of the waveforms. After the degree of matching is calculated, the process proceeds to step S23.

In step S23, the wearing position determining unit 213 performs pattern matching between the "waist-wearing reference waveform data" and the collected waveform data sensed in step S11, and calculates the degree of matching of the waveforms. After the degree of matching is calculated, the process proceeds to step S24.

In step S24, if the degree of coincidence between the collected waveform data and the "reference waveform data when worn on the shoulder" is higher than that of the "reference waveform data when worn on the back", the process proceeds to step S25. move on. On the other hand, if it is determined in the comparison that the degree of matching is low, the process proceeds to step S26.

In step S25, if the degree of matching between the collected waveform data and the "reference waveform data when worn on the shoulder" is higher than that of the "reference waveform data when worn on the waist", the wearing position determination unit 213 determines in step S27 that the The position is determined to be "shoulder". On the other hand, if the degree of matching is determined to be low in the comparison, it is determined that the wearing position is the "waist" in step S28.

In step S26, if the degree of matching between the acquired waveform data and the "reference waveform data when worn on the back" is higher than that of the "reference waveform data when worn on the waist", the wearing position determination unit 213 determines in step S28 that the The position is determined to be "waist". On the other hand, if the degree of matching is determined to be low in the comparison, it is determined that the wearing position is the "back" in step S29.

When the mounting position is determined in any of steps S27 to S29, the process proceeds to step S30. In step S30, the mounting position determination unit 213 determines whether or not the end condition is satisfied. The termination condition is, for example, that the mounting position has been determined. If the mounting position determination unit 213 determines that the end condition is not satisfied, the process returns to step S21, and if it is determined that the end condition is satisfied, the mounting position determination process ends.

[Exercise state determination process]
FIG. 11 is a flowchart showing the flow of exercise state determination processing.
In step S15 of the sound adjustment processing shown in FIG. 5, the control unit 211 calls the exercise state determination processing module from the volume adjustment processing module.

In step S41, the exercise state determination unit 214 calculates the number of steps of the user U for 10 seconds from the collected waveform data. After the number of steps is calculated, the process proceeds to step S42.

In step S42, the exercise state determination unit 214 refers to the “step count table” shown in FIG. 9 to determine whether the number of steps calculated in step S41 is greater than the “running” step count of the “determined step value”. judge. When the calculated number of steps is larger than the number of steps of "running", the exercise state determination unit 214 determines that the exercise state of the user U is the "running" state in step S46. The exercise state determination unit 214 sets "running" in the exercise state information.

If it is determined in step S42 that the number of steps calculated in step S41 is less than the minimum number of steps for "running" ("30" in the "step count table") of the "determined step count", the process proceeds to step S43. In step S43, the exercise state determination unit 214 refers to the "step count table" shown in FIG. Then, it is determined whether or not the number is greater than "11"). If the calculated number of steps is greater than the minimum number of steps for "walking" of the "determined step count", the exercise state determination unit 214 determines that the exercise state of the user U is "walking" in step S44. The exercise state determination unit 214 sets "walking" in the exercise state information.

If the exercise state determination unit 214 determines in step S43 that the calculated number of steps is less than the minimum number of steps for "walking" in the "determined step value", then in step S45 the exercise state of the user U is "still". Determine that there is. The exercise state determination unit 214 sets the exercise state information to "still".

In step S47, the exercise state determination unit 214 determines whether or not the termination condition is satisfied. The end condition is, for example, that any one of "running", "walking", or "still" is set in the exercise state information. When the exercise state determination unit 214 determines that the end condition is satisfied, it ends the exercise information determination process.

According to the configuration of the information processing apparatus 10 according to the above embodiment, the following effects are obtained.
The information processing device 10 can adjust the volume of the speaker 16 based on the exercise state of the user and the mounting position of the information processing device 10 .
The wearing position determination unit 213 determines whether the information processing device 10 is worn on the user's body at any position of the "shoulder", "waist" or "back" based on the output signal of the gyro sensor. . The exercise state determination unit 214 determines whether the user's exercise state is "walking", "running", or "still" based on the output signal of the acceleration sensor.
The control unit 211 controls the notification strength of the notification unit based on the exercise state and the wearing position determined by the wearing position determination unit 213 and the exercise state determination unit 214 .
Thereby, the information processing device 10 can output an appropriate sound volume according to the mounting position of the information processing device 10 .

[Modification]
In the above-described embodiment, the information processing apparatus 10 is configured to include the imaging section 17, but may be configured to not include the imaging section 17. FIG.

As another modification, the wearing position determination unit 213 may determine the detailed position of the wearing position from the user's image captured by the imaging unit 17 .
Specifically, the imaging unit 17 can capture an image of the user U with the information processing device 10 attached. The wearing position determination unit 213 can analyze the imaged data and identify where on the user U's body the information processing device 10 is worn.
For example, it is assumed that the imaging unit 17 is a camera capable of capturing images in all directions. In the captured image data, when the image of the right shoulder is larger than the image of the left shoulder, the wearing position determination unit 213 can estimate that the information processing device 10 is worn near the right shoulder.
Note that the captured image data may be recorded in an image storage section (not shown) formed in one area of the storage section 30 .

As another modification, the mounting position determination unit 213 may more accurately identify the mounting position by analyzing the sensed collected waveform data in more detail.
Specifically, among the collected waveform data, the mounting position determination unit 213 analyzes the output signal of the gyro sensor shown in FIG. Generally, it is known that the rotational motion of the stepped foot is relatively small between the stepped foot and the other foot. When the wearing position is the "shoulder" or "waist", the size of the rotational movement of the foot is significantly reflected in the output signal of the gyro sensor. Therefore, the wearing position determination unit 213 analyzes the magnitude of the output signal of the gyro sensor to determine whether the wearing position is "right shoulder", "left shoulder", "right waist" or "left waist". can be identified.

The speaker 16 shown in FIG. 2 may have directivity. For example, as described above, the wearing position determination unit 213 identifies one of "right shoulder", "left shoulder", "right waist", or "left waist" as the wearing position. At this time, when the wearing position is "left shoulder" or "left waist", the notification strength determining unit 215 may direct the sound to the upper right direction and further increase the volume. Alternatively, when the wearing position is "right shoulder" or "right waist", the sound may be directed to the upper left direction and the volume may be further increased. This makes it easier for the user U to hear the voice information.

As another modification, as shown in FIG. 13, a configuration in which a plurality of speakers are provided may be used. The speakers 16 and 42 are arranged to output audio information in directions opposite to each other in the Y-axis direction, and the speakers 40 and 41 are arranged to output audio information in directions opposite to each other in the X-axis direction.
Here, assuming that the back surface 14 is worn on the shoulder S of the user U, when viewed from the user U side, the speaker 16 is on the upper side, the speaker 40 is on the left side, the speaker 41 is on the right side, and the speaker 42 is on the lower side. to output
FIG. 14 is a table showing volume adjustment levels when adjusting speaker volume in detail. When the mounting position is accurately specified by the method described above, the notification intensity determination unit 215 adjusts the volume based on the table shown in FIG. For example, when the exercise state of the user U is "rest" and the wearing position is "right shoulder", the volume of both the upper speaker 16 and the left speaker 40 may be low. Also, when the user's exercise state is the "running" state and the wearing position is the "right waist", the volume of both the upper speaker 16 and the right speaker 40 should be high.
In addition, when the mounting position is the "back", the configuration may be such that only the volume of the upper speaker 16 is adjusted. For example, when the exercise state of the user U is the "running" state, the volume of the speaker 16 may be set high, and when the user U is in another exercise state, the volume of the speaker 16 may be moderate.
By accurately identifying the mounting position in this way, the volume of the speakers arranged in four directions can be individually adjusted. This makes it easier for the user U to hear the voice information.
Although four speakers are provided in this modified example, the number of speakers is not limited to this. For example, when the information processing apparatus 10 is a triangular housing, it may be configured such that three speakers are provided at positions corresponding to three sides.

As another modified example, the configuration may be such that the volume is adjusted in consideration of the geomagnetic waveform pattern. The geomagnetic waveform pattern is recorded in the ROM 22, for example. In the mounting position determination process described above, the mounting position may be determined in consideration of the influence of geomagnetism on the sensed waveform.
As a result, the mounting position can be determined more accurately.

Alternatively, the volume may be adjusted based on either exercise state or wearing position. Even with a configuration in which the volume is adjusted based on only one of the determination results, the volume can be adjusted to an appropriate volume for the user U.

As another modification, in steps S3, S5, and S7 of FIG. 6, the control unit 211 may automatically determine whether predetermined time reference data has been collected.

As another modification, the information processing apparatus 10 may be configured without a display screen. In this case, the information processing apparatus 10 is operated via so-called physical buttons provided on the input unit 26 .

In the above-described embodiment, the information processing apparatus 10 notifies information through the speaker 16 and controls the volume output by the speaker 16. However, instead of the speaker 16, the information processing apparatus 10 includes a vibrator and controls the vibration intensity of the vibrator. good too. For example, it is assumed that the mounting position determination unit 213 determines the detailed mounting position of the information processing device 10 from the image of the user captured by the imaging unit 17, as described in the modified example above. In this case, the control unit 211 increases the vibration intensity when the information processing device 10 is worn on clothes or on the shoulder strap of a bag, and when the information processing device 10 is worn directly on the user's skin such as the wrist. may be controlled to weaken the vibration intensity.

The information processing device 10 may also include an LED or the like to control the intensity of light. Even in this case, the wearing position determining unit 213 determines the detailed position of the wearing position of the information processing device 10 from the image of the user captured by the imaging unit 17. may be controlled so that it shines strongly.

Further, in the above-described embodiment, the reference data generation processing was performed by the user in the main body of the information processing apparatus 10 prior to the volume adjustment processing. may be stored in

The information processing apparatus 10 configured as described above includes a mounting position determination section 213 and a control section 211 .
The information processing device 10 has a speaker 16 for notifying information.
The wearing position determination unit 213 determines a position corresponding to which part of the body of the user U the information processing device 10 is worn.
The control unit 211 performs notification control through the speaker 16 based on the mounting position of the information processing device 10 determined by the mounting position determination unit 213 .
Thereby, the information processing device 10 can output an appropriate sound volume according to the mounting position of the information processing device 10 . In addition, since the control unit 211 automatically adjusts the sound output, there is an advantage that the volume can be easily adjusted.

The wearing position determination unit 213 determines the position corresponding to which part of the body of the user U the information processing device 10 is worn, based on the collected waveform data generated along with the movement of the user U. The information processing apparatus according to claim 1, characterized by:
This makes it possible to specify the wearing position from the user's movement.

Further provided is an exercise state determination unit 214 that determines the state of motion of the user U based on the collected waveform data generated as the user U moves.
The control unit 211 adjusts the intensity of notification through the speaker 16 based on the mounting position of the information processing device 10 determined by the mounting position determination unit 213 and the movement state of the user U determined by the exercise state determination unit 214. to control.
Thereby, the volume is adjusted according to not only the wearing position but also the exercise state of the user U. It becomes easier for the user U to hear voice information and the like.

The collected waveform data includes at least one of acceleration data and angular velocity data.
By detecting the movement of the user from these data, it is possible to accurately detect the wearing position and motion state.

The movement of the user U is at least one of running, walking, and standing still.
Thereby, the volume is adjusted according to each exercise state of the user U.

Acquired waveform data is angular velocity data,
The wearing position determination unit 213 determines a position corresponding to which part of the body of the user U the information processing device 10 is worn, based on angular velocity data generated along with the movement of the user U.
By detecting angular velocity data, a more accurate mounting position can be determined.

Acquired waveform data is acceleration data,
The motion state determination unit 214 determines the motion state of the user U based on the acceleration data generated as the user U moves.
The motion state of the user U is determined more accurately by using the acceleration data.

The part of the user U's body is at least one of the shoulders, the back, and the waist.
Since the volume is adjusted according to a plurality of wearing positions, it becomes easier for the user to hear the voice.

The speaker 16 outputs sound,
Based on the mounting position of the information processing device 10 determined by the mounting position determination section 213 , the control section 211 controls at least one of the volume of the sound output from the speaker 16 and the direction of the sound.
At least one of the volume and the directivity of the sound is adjusted according to the wearing position, so the user U can hear the voice information and the like at an appropriate volume.

The information processing device 10 includes a housing having four sides,
The speakers 16 are arranged on the four sides of the housing,
The control unit 211 controls at least one of the volume and direction of sound output from the speakers 16, 40, 41, and 42 arranged on the four sides of the housing.
By providing a plurality of speakers, it is possible to adjust at least one of volume and directivity of sound so that the user U can hear the sound more easily.

The information processing apparatus 10 having the speaker 16 for notifying information includes an exercise state determination section 214 and a control section 211 .
The motion state determination unit 214 determines the state of the user U's motion.
The control unit 211 performs notification control through the speaker 16 based on the movement state of the user U determined by the exercise state determination unit 214 .
As a result, notification control is performed according to the exercise state of the user U, so that the voice information or the like is output at a volume that is easier for the user U to hear.

It should be noted that the present invention is not limited to the above-described embodiments, and includes modifications, improvements, and the like within the scope of achieving the object of the present invention.

Further, in the above-described embodiment, the information processing apparatus 10 to which the present invention is applied has been described as an example of a data logger, but it is not particularly limited to this.
For example, the present invention can be applied to general electronic devices having information processing functions. Specifically, for example, the present invention is applicable to video cameras, portable navigation devices, mobile phones, smart phones, portable game machines, and the like.

The series of processes described above can be executed by hardware or by software.
In other words, the functional configuration of the information processing device 10 is merely an example and is not particularly limited. That is, it is sufficient that the information processing apparatus 10 has a function capable of executing the above-described series of processes as a whole, and what kind of functional block is used to realize this function is not particularly limited to the example of FIG. .
Also, one functional block may be composed of hardware alone, software alone, or a combination thereof.
The functional configuration in this embodiment is realized by a processor that executes arithmetic processing, and processors that can be used in this embodiment are composed of various single processing units such as single processors, multiprocessors, and multicore processors. In addition, it includes a combination of these various processing devices and a processing circuit such as ASIC (Application Specific Integrated Circuit) or FPGA (Field-Programmable Gate Array).

When a series of processes is to be executed by software, a program constituting the software is installed in a computer or the like from a network or a recording medium.
The computer may be a computer built into dedicated hardware. The computer may also be a computer capable of executing various functions by installing various programs, such as a general-purpose personal computer.

A recording medium containing such a program not only consists of removable media 31 distributed separately from the main body of the device for providing the program to the user, but also is preinstalled in the main body of the device and delivered to the user. It consists of a provided recording medium, etc. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, or a magneto-optical disk. Optical discs are composed of, for example, CD-ROMs (Compact Disk-Read Only Memory), DVDs (Digital Versatile Disks), Blu-ray (registered trademark) Discs, and the like. The magneto-optical disk is composed of an MD (Mini-Disk) or the like. Further, the recording medium provided to the user in a state of being pre-installed in the apparatus main body is composed of, for example, the ROM 12 in which the program is recorded, the hard disk included in the storage section 19 in the figure, or the like.

In this specification, the steps of writing a program recorded on a recording medium are not only processes that are performed chronologically in that order, but also processes that are not necessarily chronologically processed, and that are performed in parallel or individually. It also includes the processing to be performed.
Further, in this specification, the term "system" means an overall device composed of a plurality of devices, a plurality of means, or the like.

Although several embodiments of the present invention have been described above, these embodiments are merely examples and do not limit the technical scope of the present invention. The present invention can take various other embodiments, and various modifications such as omissions and substitutions can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the scope of the invention described in the claims and equivalents thereof.

The invention described in the scope of claims at the time of filing of the present application will be additionally described below.
[Appendix 1]
An information processing device having a notification unit that notifies information,
Wearing position determination means for determining a position corresponding to which part of the user's body the information processing device is worn;
control means for performing notification control in the notification unit based on the mounting position of the information processing device determined by the mounting position determination means;
Information processing device.
[Appendix 2]
The wearing position determining means determines, based on the motion data generated by the movement of the user, the position corresponding to which part of the user's body the information processing device is attached to. The information processing apparatus according to Supplementary Note 1, characterized by:
[Appendix 3]
further comprising motion state determination means for determining a motion state of the user based on motion data generated with the motion of the user;
The control means, based on the mounting position of the information processing device determined by the mounting position determination means and the movement state of the user determined by the exercise state determination means, notifies the notification unit. The information processing apparatus according to appendix 2, wherein the information processing apparatus performs control.
[Appendix 4]
4. The information processing apparatus according to claim 2, wherein said motion data includes at least one of acceleration data and angular velocity data.
[Appendix 5]
5. The information processing apparatus according to any one of appendices 2 to 4, wherein the movement of the user is at least one of running, walking, and standing still.
[Appendix 6]
the motion data is angular velocity data;
The wearing position determination means determines a position corresponding to which part of the user's body the information processing device is worn on the basis of angular velocity data generated along with the movement of the user. The information processing apparatus according to any one of appendices 2 to 5.
[Appendix 7]
the motion data is acceleration data;
3. The information processing apparatus according to Supplementary Note 3, wherein the exercise state determination means determines the state of movement of the user based on acceleration data generated with movement of the user.
[Appendix 8]
8. The information processing apparatus according to any one of appendices 1 to 7, wherein the part of the user's body is at least one of a shoulder, a back, and a waist.
[Appendix 9]
The notification unit outputs a sound,
The control means controls at least one of the volume output by the notification unit and the direction of sound based on the mounting position of the information processing device determined by the mounting position determination means.
The information processing apparatus according to any one of appendices 1 to 8, characterized by:
[Appendix 10]
The information processing device includes a housing having a plurality of sides,
The notification unit is arranged on each of a plurality of sides of the housing,
The information processing apparatus according to Supplementary Note 9, wherein the control means controls at least one of a volume and a direction of sound output by the notification units respectively arranged on the plurality of sides of the housing. .
[Appendix 11]
An information processing device having a notification unit that notifies information,
motion state determination means for determining a motion state of the user;
Control means for performing notification control in the notification unit based on the movement state of the user determined by the motion state determination means;
Information processing device.
[Appendix 12]
a wearing position determining step for determining at which part of the user's body the information processing device having a notification unit for notifying information is worn;
a control step of performing notification control in the notification unit based on the mounting position of the information processing device determined by the mounting position determination step;
An information processing method comprising:
[Appendix 13]
a wearing position determination function for determining at which position on the user's body an information processing device having a notification unit for notifying information is worn;
a control function for performing notification control in the notification unit based on the mounting position of the information processing device determined by the mounting position determination function;
An information processing program that realizes on a computer.

DESCRIPTION OF SYMBOLS 10... Information processing apparatus, 21... CPU, 22... ROM, 23... RAM, 24... bus, 25... input/output interface, 17... imaging part, 26... Input unit 18 Output unit 30 Storage unit 27 Detection unit 28 Communication unit 29 Drive 100 Removable medium

Claims (12)

An information processing device having a notification unit that notifies information by outputting sound ,
Wearing position determination means for determining which position of the user's body the information processing device is worn on, based on motion data generated with the user's movement;
Control means for controlling volume output from the notification unit based on the mounting position of the information processing device determined by the mounting position determination means;
An information processing device comprising: further comprising motion state determination means for determining a motion state of the user based on motion data generated with the motion of the user;
The control means, based on the mounting position of the information processing device determined by the mounting position determination means and the movement state of the user determined by the exercise state determination means, notifies the notification unit. 2. The information processing apparatus according to claim 1, wherein the control is performed. 3. The information processing apparatus according to claim 1, wherein the motion data includes at least one of acceleration data and angular velocity data. 4. The information processing apparatus according to any one of claims 1 to 3, wherein the movement of the user is at least one of running, walking, and standing still. the motion data is angular velocity data;
The wearing position determination means determines a position corresponding to which part of the user's body the information processing device is worn on the basis of angular velocity data generated along with the movement of the user. 5. The information processing apparatus according to any one of claims 1 to 4. the motion data is acceleration data;
3. The information processing apparatus according to claim 2, wherein said motion state determination means determines the state of motion of said user based on acceleration data generated with said motion of said user. 7. The information processing apparatus according to any one of claims 1 to 6, wherein the user's body part is at least one of a shoulder, a back, and a waist. The control means also controls the orientation of the sound output by the notification unit based on the mounting position of the information processing device determined by the mounting position determination means.
8. The information processing apparatus according to any one of claims 1 to 7, characterized by: The notification unit is a speaker arranged in the housing of the information processing device,
9. The information processing apparatus according to any one of claims 1 to 8, characterized by: The housing has a plurality of sides,
The notification unit is arranged on each of a plurality of sides of the housing,
10. The information processing according to claim 9 , wherein said control means controls at least one of a volume and directionality of sound output by notification units respectively arranged on a plurality of sides of said housing. Device. An information processing device having a notification unit for notifying information by outputting sound at a position corresponding to which part of the user's body based on motion data generated along with the movement of the user is worn. a mounting position determination step for determining whether the
a control step of controlling the volume output from the notification unit based on the mounting position of the information processing device determined by the mounting position determination step;
An information processing method comprising: An information processing device having a notification unit for notifying information by outputting sound at a position corresponding to which part of the user's body based on motion data generated along with the movement of the user is worn. A mounting position determination function that determines whether the
a control function for controlling the volume output from the notification unit based on the mounting position of the information processing device determined by the mounting position determination function;
Information processing program that realizes on a computer.

Images