JP7671666B2 - Method for controlling sound processing device and control device for sound processing device - Google Patents

Description

The present invention relates to a method for controlling a sound processing device and a control device for a sound processing device for controlling a sound processing device of a vehicle.

Conventionally, there are technologies for controlling the sound processing equipment of a vehicle. For example, a technology has been proposed that increases the volume of the speaker when the vehicle is being driven by operating a remote control switch compared to when the vehicle is being driven by operating a manual switch provided on the vehicle (see, for example, Patent Document 1). With this technology, when the vehicle is being driven by operating a remote control switch, the speaker volume is corrected based on the sounds around the vehicle detected by a microphone.

JP 2006-273015 A

In the above-mentioned conventional technology, if the acoustic characteristics of the microphone are not set appropriately, it may not be possible to properly detect sounds around the vehicle, and it may not be possible to properly correct the volume of the speakers. Also, if the acoustic characteristics of the speakers are not set appropriately, it may not be possible to output sound at an appropriate volume from the speakers.

The present invention aims to appropriately set the acoustic characteristics of a vehicle's sound processing equipment.

One aspect of the present invention is a method for controlling a sound processing device of a vehicle including a sound output unit that outputs sound to the outside of the vehicle and a sound acquisition unit that acquires sound around the vehicle. The control method for the sound processing device includes a sound analysis step of analyzing the sound acquired by the sound acquisition unit when a prescribed sound having a magnitude of a feature amount of a preset type as a first value is output from the sound output unit, and acquiring a value of the feature amount of the prescribed sound included in the sound as a second value, an acoustic characteristic detection step of detecting acoustic characteristics of the sound output unit and the sound acquisition unit based on the first value and the second value, and a calibration step of performing a calibration process for the sound output unit and the sound acquisition unit based on the acoustic characteristics. The prescribed sound is a sound of a first frequency, and the first frequency includes a plurality of frequencies across a preset frequency band. The sound analysis step analyzes the sound acquired by the sound acquisition unit and acquires the frequency of the prescribed sound included in the sound as a second frequency. The acoustic characteristic detection step detects the acoustic characteristics based on the first frequency and the second frequency.

The present invention allows the acoustic characteristics of a vehicle's sound processing equipment to be appropriately set.

FIG. 1 is a simplified diagram showing an example of the configuration of the interior of a vehicle. FIG. 2 is a simplified diagram showing an example of the configuration of the interior of a vehicle. FIG. 3 is a block diagram showing an example of the functional configuration of the control device of the sound processing device. FIG. 4 is a simplified diagram showing the relationship between the environment around the vehicle and the sound output from the sound output unit. FIG. 5 is a simplified diagram showing the relationship between the environment around the vehicle and the sound output from the sound output unit. FIG. 6 is a simplified diagram showing the relationship between the environment around the vehicle and the sound output from the sound output unit. FIG. 7 is a flowchart showing an example of a calibration process in the control device of the sound processing device. FIG. 8 is a flowchart showing an example of device control processing in the control device of the sound processing device. FIG. 9 is a flowchart showing an example of a calibration process in the control device of the sound processing device.

The following describes an embodiment of the present invention with reference to the attached drawings.

[Vehicle configuration example]
1 and 2 are simplified diagrams showing an example of the configuration of the interior of a vehicle 1. Note that Fig. 1 shows a simplified view of the interior of the vehicle 1 as viewed from the right side in the left-right direction of the vehicle 1, and Fig. 2 shows a simplified view of the interior of the vehicle 1 as viewed from the rear side in the front-rear direction of the vehicle 1. In addition, in Figs. 1 and 2, for ease of explanation, illustrations are omitted except for a dashboard 2, a steering wheel 3, a windshield 4, and an agent device 80.

The agent device 80 is a small robot that is installed on the dashboard 2 of the vehicle 1. In Figs. 1 and 2, an example is shown in which the agent device 80 is a human face type robot. Note that Figs. 1 and 2 show an example in which the agent device 80 is installed on the dashboard 2, but this is not limited thereto. For example, the agent device 80 may be installed on the upper part of the windshield 4. In Figs. 1 and 2, an example is shown in which the agent device 80 is a human face type robot, but this is not limited thereto. For example, the agent device 80 may be an animal face, a virtual object face (e.g., an anime character face), or another object (e.g., a television type device, a radio type device). In addition, another device (e.g., a smartphone, a tablet terminal) may be used as the agent device 80. In this case, the agent device 80 is configured with a display panel and a speaker.

The agent device 80 executes various operations based on instructions from the control unit 50 (see FIG. 3). For example, the agent device 80 outputs various information related to driving assistance when the driver D1 performs driving operations based on the control of the control unit 50. For example, by changing the state of the agent device 80, the appearance of the agent device 80 is changed, the change is visually grasped, and information related to driving assistance is output. Specifically, information related to driving assistance can be output by voice output from the agent device 80, or by changes in the facial expression, facial color, and facial movement of the agent device 80. In addition, for example, the facial expression can be changed by changing the display on the display panel or moving each part of the face (e.g., eyes, mouth) by a drive unit (not shown). As a result, for example, when the driver D1 performs an appropriate driving operation, the agent device 80 outputs a praising action or a praising voice to the driver D1, which encourages the driver D1 to try to perform a better driving operation, leading to improved safety of the vehicle 1. In addition, the driver D1 who is praised by the agent device 80 can continue driving operations calmly and with peace of mind.

For example, the agent device 80 performs an operation to inform the driver D1 who is driving of the sounds outside the vehicle acquired by the sound acquisition unit 10 based on the control of the control unit 50. Examples of sounds outside the vehicle to be notified to the driver D1 who is driving include a warning alarm (horn), a siren or warning sound of an emergency vehicle, a police whistle, and instructions from a police officer. When these sounds are acquired by the sound acquisition unit 10, the agent device 80 performs an operation to notify the driver D1 who is driving of these sounds. For example, the agent device 80 can perform an operation to output the same sounds as those sounds, and an operation to indicate an emergency (for example, an operation to speak loudly with a surprised expression) together with this output. In this way, the agent device 80 is installed in a position where the driver D1 can be easily seen, and the face of the agent device 80 is turned toward the driver D1, so that appropriate driving support can be provided when the driver D1 performs driving operations. Also, for example, when starting up the vehicle 1 or the agent device 80, if a specified sound (specified sound) is to be output outside the vehicle as a startup sound, the state of the agent device 80 can be changed so that the face of the agent device 80 faces outside the vehicle. An example of a case where the state of the agent device 80 is changed so that the face of the agent device 80 faces outside the vehicle is shown in Figures 4 to 6.

Here, we will explain acoustic characteristics. Three elements of sound are known to determine the nature of sound (sound characteristics). These three elements of sound are pitch (frequency (Hz)), loudness (sound pressure (dB)), and timbre (waveform, frequency components). In other words, humans primarily recognize sound as a combination of these three elements.

In addition, there are two types of sounds that humans recognize: pure tones and complex tones. A pure tone is a sound that is composed of only one frequency component. In other words, the waveform of a pure tone can be represented as a sine wave.

Complex sounds are sounds that are composed of multiple components with different frequencies. In other words, complex sounds are sounds in which multiple pure tones overlap. The sounds that humans come into contact with on a daily basis often include a mixture of sounds made by humans (e.g., sounds made when moving, voices), sounds made by moving objects (e.g., cars, trains), sounds made by musical instruments, sounds made by nature (e.g., wind, rain), noise, etc. Strictly speaking, pure tones are said to be sounds that do not exist in nature. Therefore, sounds that humans recognize are generally complex sounds. In other words, sounds that humans come into contact with on a daily basis are classified as complex sounds.

Complex sounds can be decomposed into multiple sounds by using frequency analysis (Fourier analysis) or frequency analysis. Frequency analysis is an analysis method that decomposes and analyzes waves such as light and sound, and is an analysis method that applies Fourier analysis. For example, complex sounds can be decomposed by frequency using known acoustic analysis equipment. This allows the complex sounds to be analyzed. Various acoustic analysis techniques, frequency analysis techniques, and measurement analysis techniques can be used to analyze complex sounds.

Here, we will explain musical tones, which mean musical tones (or tones used in music). Musical tones generally refer to sounds that are generated from sound sources such as musical instruments or people, and often refer to sounds that are produced by these sounds. A sound that is composed of only one sine wave is called a pure tone (or a single tone). When a sound generated from a single sound source contains multiple frequencies, the sound is called a complex tone. Note that while in acoustics it is called a complex tone, in music it is sometimes called a chord.

In addition, in this embodiment, as described above, when the vehicle 1 or the agent device 80 is started, a specified sound is output as a startup sound. Based on this specified sound, acoustic characteristics related to the sound processing device of the vehicle 1 are detected, and based on this acoustic characteristics, the sound processing device of the vehicle 1 is calibrated. The sound processing device of the vehicle 1 is, for example, the sound acquisition unit 10, sound output unit 60, and agent device 80 shown in FIG. 3. In addition, in this embodiment, the relationship between the three elements of sound is obtained based on the relationship between the preset specified sound, the specified sound (output value) output from the sound output unit 60, and the specified sound (detection value) obtained by the sound acquisition unit 10. The characteristics of the sound processing device that represent the relationship between the three elements of sound obtained in this manner will be described as the acoustic characteristics of the sound processing device.

[Example of functional configuration of a control device for sound processing devices]
FIG. 3 is a block diagram showing an example of the functional configuration of the control device 100 of the sound processing device.

The control device 100 of the sound processing device includes a sound acquisition unit 10, an image acquisition unit 20, a position information acquisition unit 30, a communication unit 40, a control unit 50, a sound output unit 60, a storage unit 70, and an agent device 80. The control device 100 of the sound processing device can also be called a calibration device because it performs a calibration process to calibrate the sound processing device (e.g., the sound acquisition unit 10, the sound output unit 60).

The sound acquisition unit 10 is provided outside the vehicle 1 and acquires sounds around the vehicle 1 (sounds outside the vehicle) based on the control of the control unit 50, and outputs information about the acquired sounds to the sound analysis unit 51. For example, one or more microphones can be used as the sound acquisition unit 10.

The image acquisition unit 20 captures an image of a subject and generates an image (image data) based on the control of the control unit 50, and outputs information about the generated image to the equipment control unit 53. The image acquisition unit 20 is composed of, for example, one or more camera devices capable of capturing images of subjects around the vehicle 1. In other words, the image acquisition unit 20 can capture images of subjects that exist in the left-right and front-rear directions of the vehicle 1, or in all directions.

The position information acquisition unit 30 acquires position information on the location where the vehicle 1 is located based on the control of the control unit 50, and outputs the acquired position information to the equipment control unit 53. The position information acquisition unit 30 can be realized, for example, by a GNSS receiver that acquires position information using a Global Navigation Satellite System (GNSS). The position information includes data on the position such as latitude, longitude, and altitude at the time of receiving the GNSS signal. The position information may also be acquired by other methods of acquiring position information. For example, the position information may be derived using information from nearby access points or base stations. For example, the position information may be derived using a position estimation technique by a navigation device.

The communication unit 40 exchanges various information with other devices using wireless communication based on the control of the control unit 50. For example, the communication unit 40 acquires various information from various servers via a specific network (e.g., the Internet). Also, for example, the communication unit 40 receives a signal from a key (e.g., a smart key) 5 (see Figures 4 to 6) using short-range wireless communication.

The storage unit 70 is a storage medium that stores various types of information. For example, the storage unit 70 stores various types of information (e.g., control programs, defined sounds, map information) required for the control unit 50 to perform various processes. The storage unit 70 also stores various types of information acquired via the communication unit 40. As the storage unit 70, for example, various storage media such as a ROM (Read Only Memory), a RAM (Random Access Memory), a HDD (Hard Disk Drive), or a SSD (Solid State Drive) can be used.

The control unit 50 controls each part based on various programs stored in the memory unit 70. The control unit 50 is realized by a processing device such as a CPU (Central Processing Unit). The vehicle ECU (Electronic Control Unit) of the vehicle 1 may also be used as the control unit 50, or a processing device different from the vehicle ECU may be provided as the control unit 50.

The control unit 50 has a sound analysis unit 51, an acoustic characteristic detection unit 52, and an equipment control unit 53 as functional components related to device control processing.

The sound analysis unit 51 analyzes the time change of the sound outside the vehicle detected by the sound acquisition unit 10, and based on the analysis results, acquires each piece of information related to the sound acquired by the sound acquisition unit 10, and outputs each piece of information related to the sound to the acoustic characteristic detection unit 52 and the equipment control unit 53.

Specifically, the sound analysis unit 51 performs a predetermined analysis process (e.g., frequency analysis) on the sound (complex sound) acquired by the sound acquisition unit 10, breaks down the complex sound into multiple sounds, and acquires the three elements of each of the multiple sounds that make up the complex sound. In addition, the sound analysis unit 51 extracts a sound that corresponds to a specified sound from among the sounds that make up the complex sound. The method of extracting the specified sound will be described in detail with reference to FIG. 7.

The acoustic characteristic detection unit 52 detects the acoustic characteristics of the sound acquisition unit 10 and the sound output unit 60 based on the analysis results by the sound analysis unit 51, and generates calibration data for calibrating the sound acquisition unit 10 and the sound output unit 60 based on the acoustic characteristics. The acoustic characteristic detection unit 52 then outputs the calibration data to the device control unit 53. The method of detecting the acoustic characteristics and the method of generating the calibration data will be described in detail with reference to FIG. 7.

The device control unit 53 controls each device mounted on the vehicle 1, for example, a sound processing device. For example, the device control unit 53 executes control to output sound from at least one of the agent device 80 and the sound output unit 60. Also, for example, the device control unit 53 executes calibration processing for the sound acquisition unit 10 and the sound output unit 60 based on the calibration data generated by the acoustic characteristic detection unit 52. The calibration processing for the sound acquisition unit 10 and the sound output unit 60 will be described in detail with reference to FIG. 7.

The sound output unit 60 outputs sound to the outside of the vehicle 1 based on the control of the control unit 50. For example, one or more speakers can be used as the sound output unit 60.

[Example of relationship between the environment around the vehicle and the sound output from the sound output unit]
4 to 6 are diagrams showing, in a simplified manner, the relationship between the environment around the vehicle 1 and sounds 91 to 93 outputted from the sound output unit 60. In FIG.

Figure 4 shows an example of a case where the driver D1 uses the key 5 to unlock the door of the vehicle 1 parked in a large area with no buildings or the like in the daytime. It also shows a case where the parent and child U1 and U2 are walking near the vehicle 1. It is assumed that in such an environment, there are no people other than the parent and child U1 and U2, and there is little noise from the surroundings. Therefore, in such an environment, it is preferable to output, as the sound 91, music that is comfortable for the parent and child U1 and U2 walking near the vehicle 1 or a light and familiar song. The key 5 is a remote control device with a wireless communication function, and can exchange various information with the control unit 50 via the communication unit 40 using wireless communication. For example, the key 5 can lock or unlock the door of the vehicle 1 using wireless communication.

Figure 5 shows an example of a case where a driver D1 uses a key 5 to unlock the door of a vehicle 1 parked in a residential area in the middle of the night. In this way, in a quiet environment, it is preferable to output a relaxing sound or a quiet tune as sound 92, taking into account the surrounding environment.

Figure 6 shows an example of a case where driver D1 uses key 5 to unlock the door of vehicle 1 parked in the parking lot of a large shopping mall. In this case, many vehicles 301 to 309 are parked in the parking lot. There are often many shoppers in the parking lot. In such an environment, the area around vehicle 1 is often noisy. Therefore, in such an environment, it is preferable to output a loud sound or lively music as sound 93, taking into consideration the surrounding environment, to inform driver D1 of the presence and position of vehicle 1 and to inform surrounding shoppers that vehicle 1 is moving.

[Example of calibration process]
FIG. 7 is a flow chart showing an example of the calibration process in the control device 100 of the sound processing device. The calibration process is executed by the control unit 50 based on a program stored in the storage unit 70. The calibration process is executed at a predetermined timing. The predetermined timing may be, for example, the timing when the driver D1 of the vehicle 1 uses the key 5 to unlock the door of the vehicle 1, the timing when the driver D1 uses the key 5 to start the vehicle 1 after sitting in the driver's seat, or the timing when it is detected that the driver D1 holding the key 5 has moved close to the vehicle 1. Whether the driver D1 has moved close to the vehicle 1 can be detected based on the radio wave intensity using wireless communication between the key 5 and the communication unit 40. In FIG. 7, the examples shown in FIG. 1 to FIG. 6 are appropriately referred to for explanation.

In step S201, the sound output unit 60 outputs a specified sound for a predetermined time based on the control of the device control unit 53. This predetermined time is a time during which the acoustic characteristics of the sound acquisition unit 10 and the sound output unit 60 can be appropriately detected, and can be set appropriately based on, for example, experimental data. For example, a value of several seconds can be set as the predetermined time.

As for the prescribed sound, for example, a single tone of a predetermined pitch (e.g., frequency: 440 Hz), a predetermined sound volume (e.g., sound pressure: 70 dB), and a predetermined tone (e.g., piano tone) can be output as the prescribed sound. Each piece of information about this prescribed sound can be stored in the memory unit 70 and used. By outputting such a prescribed sound from the sound output unit 60 and detecting the prescribed sound by the sound acquisition unit 10, it becomes possible to detect the acoustic characteristics of the sound output unit 60 or the sound acquisition unit 10 with greater accuracy.

In addition, instead of outputting a single tone as the standard tone, a chord made up of a combination of single tones may be output. For example, a chord with a combination of predetermined pitches (e.g., C frequency: 130 Hz, E frequency: 164 Hz, G frequency: 196 Hz), a predetermined sound volume (e.g., sound pressure: 70 dB), and a predetermined tone color (e.g., piano tone) can be output as the standard tone. This makes it possible to output a sound (song) as the standard tone that makes the driver D1 and people around the vehicle 1 feel comfortable when they hear the standard tone.

In addition, instead of outputting a single tone or chord as the prescribed tone, the single tone and chord may be output while changing over time. For example, a tone that is a tune that is preferred by the driver D1 and people around the vehicle 1 may be set as the prescribed tone. In this way, by outputting prescribed tones from the vehicle 1 that sound like the same tune to the listener, people around the vehicle 1 (including the driver D1) can recognize the tone as coming from the vehicle 1 when they hear the tone emitted from the vehicle 1, and confusion with other tones can be prevented.

However, the standard sound output from the sound output unit 60 may be a sound that sounds completely different each time. Also, the standard sound output from the sound output unit 60 may be a sound that changes only the atmosphere of the standard sound and sounds like the same song to the listener. For example, it is possible to change only the atmosphere of the song by changing the pitch of the sound through transposition. For example, it is possible to change the atmosphere of the sound by keeping the rhythm of the sound the same and changing only the pitch and length of the sound. For example, it is possible to change the atmosphere of the sound by raising all the notes of a C major song by a major second. In this way, it is possible to output a standard sound from the vehicle 1 that sounds like the same song to the listener even if only the atmosphere of the song is changed. In this case, as described above, when people (including the driver D1) around the vehicle 1 hear a sound emitted from the vehicle 1, they can recognize it as a sound emitted from the vehicle 1, and confusion with other sounds can be prevented.

In step S202, the sound acquisition unit 10 acquires sounds outside the vehicle for a predetermined time based on the control of the device control unit 53. In this way, the sound acquisition unit 10 acquires sounds outside the vehicle, and thereby detects the specified sound. This predetermined time can be set to the same value as the predetermined time during which the specified sound is output from the sound output unit 60 in step S201.

In step S203, the sound analysis unit 51 analyzes the time change of the sound outside the vehicle detected by the sound acquisition unit 10, and acquires each piece of information related to the sound acquired by the sound acquisition unit 10 based on the analysis result. Specifically, the sound analysis unit 51 performs a predetermined analysis process on the sound (complex sound) acquired by the sound acquisition unit 10 at a predetermined time, and breaks down the complex sound into multiple sounds. The sound analysis unit 51 also acquires three elements of each of the multiple sounds that constitute the complex sound. The sound analysis unit 51 also acquires the three elements of the specified sound stored in the storage unit 70, and compares the three elements of the specified sound with the three elements of each sound that constitutes the complex sound, thereby extracting a sound that corresponds to the specified sound from among the sounds that constitute the complex sound. For example, the sound that corresponds to the specified sound can be extracted based on the similarity of the three elements of each sound. In the following, the sound that corresponds to the specified sound extracted by the sound analysis unit 51 will be referred to as the specified sound extracted by the sound analysis unit 51.

In step S204, the acoustic characteristic detection unit 52 detects the acoustic characteristics of the sound acquisition unit 10 and the sound output unit 60 based on the analysis results by the sound analysis unit 51, and generates calibration data for calibrating the sound acquisition unit 10 and the sound output unit 60 based on the acoustic characteristics. Specifically, the acoustic characteristic detection unit 52 compares the three elements of the specified sound extracted by the sound analysis unit 51 with the three elements of the specified sound output from the sound output unit 60, and obtains information regarding the relationship between the two three elements.

For example, the acoustic characteristic detection unit 52 acquires the three elements of the specified sound stored in the storage unit 70, compares these three elements of the specified sound with the three elements of the specified sound acquired by the sound analysis unit 51, and calculates the difference value of each element. Note that the difference value of each element over a predetermined time may be calculated and used. In this case, for example, the average value or integrated value of the difference values of each element over a predetermined time may be used. Then, the acoustic characteristic detection unit 52 detects at least one acoustic characteristic of the sound output unit 60 and the sound acquisition unit 10 based on the difference value.

For example, the relationship (acoustic characteristic information) between the output value from the sound output unit 60 and the detection value by the sound acquisition unit 10 regarding the acoustic characteristics is acquired in advance by an experiment or the like, and stored in the storage unit 70. This acoustic characteristic information is information regarding ideal values regarding the acoustic characteristics of the output value from the sound output unit 60 and the detection value by the sound acquisition unit 10. The acoustic characteristic detection unit 52 then acquires the acoustic characteristic information from the storage unit 70, and detects the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 by comparing the difference value described above with the acoustic characteristic information. In other words, it checks the degree of deviation between the ideal value regarding the acoustic characteristics and the actual detection value, and detects the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 based on the confirmation result.

For example, assume that it has been determined through experiments, etc. that when a single-tone standard sound with a frequency of 440 Hz and a sound pressure of 70 dB is output from the sound output unit 60, the detection value of the standard sound by the sound acquisition unit 10 is a frequency of 440 Hz and a sound pressure of 65 dB. In this case, when a single-tone standard sound with a frequency of 440 Hz and a sound pressure of 70 dB is output from the sound output unit 60, if the detection value of the standard sound by the sound acquisition unit 10 is a frequency of 440 Hz and a sound pressure of 65 dB, it is a normal value when compared with the experimental data. Therefore, in such a case, it can be determined that the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 are normal. In this case, there is no need to generate calibration data.

In addition, when a single standard sound with a frequency of 440 Hz and a sound pressure of 70 dB is output from the sound output unit 60, if the detection value of the standard sound by the sound acquisition unit 10 is a frequency of 440 Hz and a sound pressure of 60 dB, the sound pressure will be -5 dB when compared with the experimental data. In such a case, it can be determined that the sound pressure as an acoustic characteristic of the sound output unit 60 has decreased, or that the sensitivity as an acoustic characteristic of the sound acquisition unit 10 has decreased. In this case, calibration data is generated so that the sound pressure level of the sound output unit 60 is +5 dB. Alternatively, calibration data is generated so that the sensitivity level of the sound acquisition unit 10 is increased.

It is also assumed that an abnormal signal is detected by the sound acquisition unit 10. For example, it is also assumed that the detection value of the standard sound by the sound acquisition unit 10 is higher than the output value from the sound output unit 60 by more than the first threshold (i.e., abnormally high) or is lower than the second threshold (i.e., abnormally low) when compared with experimental data. However, the second threshold is less than the first threshold. In this way, if the detection value of the standard sound by the sound acquisition unit 10 is abnormally high or abnormally low, it is also assumed that the sound acquisition unit 10 is not functioning normally. Therefore, in this case, calibration data is generated so that the sound acquisition unit 10 functions normally. For example, calibration data is generated to increase or decrease the sensitivity of the sound acquisition unit 10.

In this way, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 can be detected based on changes in any of the three elements of sound (e.g., changes in frequency or sound pressure), and calibration data can be generated.

In step S205, the device control unit 53 performs a calibration process on the sound acquisition unit 10 and the sound output unit 60 based on the calibration data generated in step S204. For example, if it is determined that the sound pressure is low as the acoustic characteristic of the sound output unit 60, calibration data for increasing the sound pressure level of the sound output unit 60 is generated. In this case, the device control unit 53 calibrates the sound output unit 60 so as to increase the sound pressure level based on the generated calibration data. Also, for example, if it is determined that the sound pressure is high as the acoustic characteristic of the sound output unit 60, calibration data for decreasing the sound pressure level of the sound output unit 60 is generated. In this case, the device control unit 53 calibrates the sound output unit 60 so as to decrease the sound pressure level based on the generated calibration data. Also, for example, if it is determined that the sensitivity is low as the acoustic characteristic of the sound acquisition unit 10, calibration data for increasing the sensitivity level of the sound acquisition unit 10 is generated. In this case, the device control unit 53 calibrates the sound acquisition unit 10 so as to increase the sensitivity level based on the generated calibration data. Also, for example, if it is determined that the acoustic characteristics of the sound acquisition unit 10 have high sensitivity, calibration data is generated to lower the sensitivity level of the sound acquisition unit 10. In this case, the device control unit 53 calibrates the sound acquisition unit 10 based on the generated calibration data so as to lower the sensitivity level.

In this way, a specified sound is output outside the vehicle, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 are detected based on the specified sound, and a calibration process for the sound output unit 60 and the sound acquisition unit 10 is performed based on the acoustic characteristics. As a result, after the calibration, it becomes possible to output the intended sound from the sound output unit 60. In other words, it is possible to check whether the sound output unit 60 and the sound acquisition unit 10 are functioning correctly, and to adjust the acoustic characteristics for the sound output unit 60 and the sound acquisition unit 10 based on the confirmation result.

The calibration process shown in FIG. 7 is an example of execution at a predetermined timing. However, even when the predetermined timing is reached, if a predetermined condition is met, the calibration process shown in FIG. 7 may not be executed. The predetermined condition is met, for example, when there is no certain change in the external environment of the vehicle 1. The external environment of the vehicle 1 is not changed to a certain extent when, for example, the position of the vehicle 1 has hardly changed (for example, when the parking position of the vehicle 1 is changed in the same shopping mall), or when the position of the vehicle 1 has changed but the environment around the vehicle 1 has not changed (for example, when the vehicle 1 is moved to a parking lot of a different shopping mall).

[Example of device control process operation]
8 is a flow chart showing an example of device control processing in the control device 100 of the sound processing device. This device control processing is executed by the control unit 50 based on a program stored in the storage unit 70. This device control processing is executed at a predetermined timing. This predetermined timing may be the same as the predetermined timing shown in FIG.

The device control process shown in FIG. 8 may be executed in parallel with the calibration process shown in FIG. 7 at a predetermined timing, or may be executed after the calibration process shown in FIG. 7 is completed. Also, only the device control process shown in FIG. 8 may be executed at a predetermined timing. In this case, the processes shown in FIG. 7 (steps S201 to S205) may be executed immediately after starting the agent device 80 in step S211, and the calibration process for the sound acquisition unit 10 and the sound output unit 60 may be executed by each of these processes, and then step S212 may be executed. In this case, the specified sound may be, for example, a single sound with a frequency of 440 Hz and a sound pressure of 70 dB. In addition, in FIG. 8, the examples shown in FIG. 1 to FIG. 6 are appropriately referred to for explanation.

In step S211, the device control unit 53 starts up the agent device 80.

In step S212, the device control unit 53 acquires information related to the external environment of the vehicle 1. Information related to the external environment of the vehicle 1 includes, for example, the time of day (e.g., morning, afternoon, night), the location of the vehicle 1, the presence or absence of people around the vehicle 1, the distance between the people around the vehicle 1 and the vehicle 1, the weather and temperature around the vehicle 1, sounds around the vehicle 1, etc.

The time period can be obtained by a clock function built into the control unit 50. The location where the vehicle 1 is located can be obtained based on the location information obtained by the location information obtaining unit 30 and the map information stored in the memory unit 70. The map information may be obtained from an external device via the communication unit 40 and used. The location where the vehicle 1 is located may be obtained based on information obtainable using another device, for example, a car navigation system.

The presence or absence of people around the vehicle 1 and the distance between the people around the vehicle 1 and the vehicle 1 can be detected based on the image acquired by the image acquisition unit 20. In this case, a publicly known person detection technology can be used to detect people in the image. Also, a publicly known measurement technology can be used to measure the distance between the people and the vehicle 1. Note that other sensors, such as LiDAR (Light Detection and Ranging), Sonar (Sound Navigation and Ranging), Radar (Radio Detection and Ranging), etc., may be used to detect the presence or absence of people around the vehicle 1 and the distance between the people around the vehicle 1 and the vehicle 1.

The temperature around the vehicle 1 can be obtained by a temperature sensor mounted on the vehicle 1. In addition, the weather around the vehicle 1 can be obtained from an external device (e.g., a weather data providing server) via the communication unit 40.

For sounds around the vehicle 1, sounds acquired by the sound acquisition unit 10 can be used. For example, the sound analysis unit 51 can perform frequency analysis on sounds outside the vehicle 1 acquired by the sound acquisition unit 10, and use the values obtained by this frequency analysis.

In step S213, the device control unit 53 determines the output sound to be output from the sound output unit 60 or the agent device 80 based on the external environment of the vehicle 1. In this case, the device control unit 53 determines the frequency of the sound so as to avoid sounds with frequencies close to the sounds outside the vehicle 1 acquired by the sound acquisition unit 10. More specifically, sounds in a frequency band different from the frequency band of the sounds outside the vehicle 1 acquired by the sound acquisition unit 10 are set as candidates for the output sound. In this way, for example, even if there is an ambulance or fire engine near the vehicle 1 or people are talking near the vehicle 1, it is possible to output a sound that is not masked by those sounds. In addition, the device control unit 53 determines a sound according to the surrounding environment of the vehicle 1 from among sounds in a frequency band different from the frequency band of the sounds outside the vehicle 1, as shown in Figures 4 to 6.

For example, the frequency band of an ambulance siren is 770 to 960 Hz, the frequency band of a fire engine siren is 300 to 850 Hz, and the frequency band of a human voice is 0.2 to 4 kHz.

Therefore, for example, if it is detected based on information about the external environment of vehicle 1 that vehicle 1 is in an environment where an ambulance siren can be heard, the output sound is determined while avoiding sounds with frequencies close to the frequency band of the ambulance siren (770 to 960 Hz). More specifically, sounds in frequency bands other than the detected frequency band (770 to 960 Hz) are set as candidates for the output sound.

For example, when it is detected based on information on the external environment of the vehicle 1 that the vehicle 1 is in an environment where a fire engine siren can be heard, the output sound is determined while avoiding sounds with frequencies close to the frequency band of the fire engine siren (300 to 850 Hz). More specifically, sounds in frequency bands other than the detected frequency band (300 to 850 Hz) are set as candidates for the output sound.

For example, when it is detected based on information about the external environment of the vehicle 1 that the vehicle 1 is in an environment where human voices can be heard, the output sound is determined while avoiding sounds with frequencies close to the frequency band of human voices (0.2 to 4 kHz). More specifically, sounds with frequency bands other than the detected frequency band (0.2 to 4 kHz) are set as candidates for the output sound. Whether an ambulance, fire engine, or person is present around the vehicle 1 can be detected based on sounds acquired by the sound acquisition unit 10 and images acquired by the image acquisition unit 20.

For example, as shown in FIG. 5, assume that the location of the vehicle 1 is a quiet residential area and that the time of day is night. In this case, since the vehicle 1 is in a quiet environment, it is preferable to output a sound from the sound output unit 60 that is not conspicuous and does not disturb the residents. For example, a sound with a sound pressure of 30 db to 40 db and a frequency equivalent to the song of a bird (for example, about 440 Hz for an owl) is determined. By determining and outputting the sound in this manner, it is possible to allow only the driver D1 to know the location of the vehicle 1 through the sound 92 output from the sound output unit 60, and to prevent people around the vehicle 1 (including the residents of the houses around the vehicle 1) from noticing it.

For example, as shown in FIG. 6, assume that the location where vehicle 1 is located is a parking lot of a shopping mall, and that the time period is daytime. Note that a parking lot of a shopping mall is an example of an environment where people are crowded together. In this case, since vehicle 1 is in a noisy environment, it may be preferable to alert people around vehicle 1 to sound 93 output from sound output unit 60. For example, in a parking lot at night, the presence of a vehicle attempting to leave the parking lot is easily noticed by people in the vicinity due to the vehicle's lights. In contrast, in a parking lot during the day, it is often difficult to notice a vehicle attempting to leave the parking lot. Therefore, in a parking lot during the day, it is important to prevent accidents from occurring due to people not noticing a vehicle attempting to leave the parking lot.

For example, it is preferable to output a sound 93 from the sound output unit 60 that is conspicuous, can be easily heard by people around the vehicle 1, and is noticed by the people around the vehicle 1. For example, a sound with at least one of the frequency and sound pressure set to a large value is determined based on a standard sound (frequency: 440 Hz, sound pressure: 70 dB). In this case, it is preferable to set the frequency to a value that avoids frequencies close to the environmental sound around the vehicle 1, that is, a value in a frequency band different from the frequency band of the environmental sound around the vehicle 1. It is also preferable to change the sound pressure according to the distance to the people around the vehicle 1. For example, by setting the sound pressure so that the person U3 who is closest to the vehicle 1 hears an appropriate sound, it is possible to prevent the person U3 from being surprised by the sound from the vehicle 1. By determining and outputting in this way, it is possible to make the driver D and people around the vehicle 1 aware of the presence of the vehicle 1 by the sound 92 output from the sound output unit 60. In this way, it is possible to inform people around the vehicle 1 that the vehicle 1 will start moving in a crowded parking lot, etc.

For example, as shown in FIG. 4, assume that the environment is one in which parent and child U1 and U2 are walking near the vehicle 1 in a wide area with no buildings or the like in the vicinity, and that the time period is detected to be daytime. In this case, since the vehicle 1 is in a quiet environment, it may be preferable for the sound 91 output from the sound output unit 60 to sound pleasant to the parent and child U1 and U2 around the vehicle 1. For example, it is preferable for the sound output unit 60 to output a light, familiar sound 91 that can be heard by the driver D1 and the parent and child U1 and U2. Note that, when the voices of the parent and child U1 and U2 are detected, it is preferable to output a sound that avoids frequencies close to the voices, i.e., a sound in a frequency band different from the frequency band of the voices of the parent and child U1 and U2.

In addition, it is possible to determine a sound that sounds like the same song to the listener by changing only the atmosphere of the music output depending on the environment around vehicle 1. For example, as described above, it is possible to change only the atmosphere of the music by changing the pitch of the music through transposition. In this way, as described above, when people around vehicle 1 (including driver D1) hear a sound emitted from vehicle 1, they can recognize that the sound is coming from vehicle 1, and confusion with other sounds can be prevented.

In step S214, the device control unit 53 causes the sound output unit 60 to output an output sound determined based on the external environment of the vehicle 1. In this case, as shown in FIG. 4 to FIG. 6, the device control unit 53 preferably changes the state of the agent device 80 so that the face of the agent device 80 faces outside the vehicle, so that people outside the vehicle see that the agent device 80 is speaking. The output sound may be output as the second specified sound, or may be output as a sound to notify people in the vicinity of the presence of the agent device 80. The output sound thus determined may be used as an output sound to be output from the agent device 80 in the vehicle 1 cabin, as necessary. However, it is preferable that the sound to be output from the agent device 80 in the vehicle 1 cabin be output at a lower volume than the sound to be output from the sound output unit 60.

In addition to executing the device control process shown in FIG. 8 at a predetermined timing, a part of the device control process shown in FIG. 8 may be executed based on the external environment of the vehicle 1. For example, when a certain change occurs in the external environment of the vehicle 1, the processes of steps S212 and S213 may be executed to determine the output sound to be output from the sound output unit 60 or the agent device 80. In addition, when a certain change occurs in the external environment of the vehicle 1, for example, when the position of the vehicle 1 moves by more than a threshold value, when the startup time of the vehicle 1 becomes more than a threshold value, when a specific object (e.g., an ambulance, a fire engine) is detected around the vehicle 1, when the weather around the vehicle 1 changes suddenly (e.g., heavy rain, heavy snow), etc.

As described above, it is assumed that each process (steps S201 to S205) shown in FIG. 7 is executed before the process of step S212, and the calibration process for the sound acquisition unit 10 and the sound output unit 60 is executed by each process, and then step S212 is executed. In this case, in step S214, the device control unit 53 causes the sound output unit 60 to output the output sound determined based on the external environment of the vehicle 1 as the second specified sound. Then, each process (steps S202 to S205) shown in FIG. 7 may be executed for the second specified sound, and the calibration process for the sound acquisition unit 10 and the sound output unit 60 may be executed by each process. In this way, the accuracy of the calibration process can be improved by executing the calibration process (steps S201 to S205) without considering the external environment of the vehicle 1, and then executing the calibration process (steps S211 to S214, S202 to S205) taking the external environment of the vehicle 1 into consideration.

An example of determining the standard sound taking into account the external environment of the vehicle 1 will be described in detail with reference to FIG. 9.

In this way, when the agent device 80 is started, a predetermined sound corresponding to the external environment of the vehicle 1 can be output from the vehicle 1. Furthermore, by emitting a predetermined sound from the vehicle 1 when the agent device 80 is started, it is possible to notify those around the vehicle 1 that the vehicle 1 is about to start moving. Furthermore, since this predetermined sound can be a sound of a different frequency from the sound of the external environment of the vehicle 1, it can be a sound that is easy for people around the vehicle 1 to hear. Furthermore, for example, assume that the frequency of the specified sound output from the sound output unit 60 to the outside of the vehicle is frequency A, and the frequency of the sound outside the vehicle used to control the agent device 80 is frequency B. In this case, frequency A may be a frequency corresponding to frequency B.

[Modification of Calibration Process]
Fig. 9 is a flow chart showing an example of a calibration process in the control device 100 of the sound processing device. Also, since this calibration process is a modified example of the calibration process shown in Fig. 7, the following description will focus on the points that differ from Fig. 7.

The processes in steps S221 to S223 shown in FIG. 9 correspond to the processes in steps S211 to S213 shown in FIG. 8. The processes in steps S224 to S228 shown in FIG. 9 correspond to the processes in steps S201 to S205 shown in FIG. 7. For this reason, a description of the processes (steps S221 to S228) shown in FIG. 9 that are common to FIG. 7 and FIG. 8 will be omitted.

In step S223, the device control unit 53 determines the specified sound to be output from the sound output unit 60 based on the external environment of the vehicle 1. In this case, the device control unit 53 determines the frequency of the specified sound so as to avoid sounds with frequencies close to the sounds outside the vehicle 1 acquired by the sound acquisition unit 10. In this way, for example, even if there is an ambulance or fire engine near the vehicle 1 or people are having a conversation near the vehicle 1, it is possible to output the specified sound that is not masked by those sounds.

In step S227, the device control unit 53 may detect an abnormal signal of the sound acquisition unit 10 based on the external environment of the vehicle 1. For example, it is possible to estimate the sound that can be acquired from the surroundings of the vehicle 1 based on the external environment of the vehicle 1. For example, if the sound acquisition unit 10 of the vehicle 1 parked in a residential area acquires a sound of an abnormal volume in the middle of the night, it is also possible to determine that an abnormal signal has been detected by the sound acquisition unit 10. Also, for example, if the sound acquisition unit 10 of the vehicle 1 parked in a parking lot of a large shopping mall in the daytime hardly acquires any surrounding sound, it is also possible to determine that an abnormal signal has been detected by the sound acquisition unit 10. In this way, the device control unit 53 can detect an abnormal signal of the sound acquisition unit 10 based on the analysis result by the sound analysis unit 51 and the external environment of the vehicle 1. Then, if an abnormal signal of the sound acquisition unit 10 is detected, the device control unit 53 generates calibration data so that the function of the sound acquisition unit 10 becomes normal.

In this way, the specified sound can be determined based on the external environment of the vehicle 1, and the specified sound can be output as the startup sound of the agent device 80. This startup sound can be, for example, a sound that plays a similar tune when started up, such as the startup sound of a game device or a personal computer (for example, a futuristic sound). This allows the driver D1 and his family to develop an attachment to the vehicle 1 and the agent device 80. In addition, by playing a similar tune every time the agent device 80 starts up (every time the vehicle 1 starts up), the driver D1 can appeal to those around him that he owns a futuristic vehicle 1, and therefore the need for self-expression that leads to attachment can be satisfied. In addition, for example, it is assumed that a third party who does not own a vehicle equipped with the agent device 80 will be attracted to the vehicle 1 equipped with the agent device 80 that outputs a futuristic sound. This can promote the third party's desire to purchase the agent device 80. In addition, the safety of a third party who purchases the agent device 80 and newly installs the agent device 80 in his vehicle can be improved.

In addition, because the specified sound can be determined based on the external environment of the vehicle 1, the specified sound can be output optimally according to the situation around the vehicle 1. This makes it possible to prevent people around the vehicle 1 from feeling uncomfortable or being a nuisance.

Here, for example, it is known that hearing has a large influence on human memory. For example, when a sound is output from the vehicle 1 equipped with the agent device 80 and the sound is heard by people around the vehicle 1, it is thought that the agent device 80 will be more likely to remain in their memories. In this case, the memory rate of the agent device 80 among the people around the vehicle 1 will improve. This makes it possible to widely publicize the existence of the agent device 80, and to increase the purchase rate of the agent device 80. Furthermore, by installing the agent device 80 in each vehicle, the agent device 80 can provide driving assistance to the driver, thereby improving the safety of each vehicle.

In this way, according to this embodiment, appropriate standard sounds and other sounds can be provided at a moderate volume not only to people inside the vehicle 1, but also to people outside the vehicle. In addition, calibration processing for the sound output unit 60 and the sound acquisition unit 10 can be performed based on the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 detected by the acoustic characteristic detection unit 52. This makes it possible to prevent problems such as the sound acquisition unit 10 being unable to acquire external sounds or the sound output unit 60 outputting abnormally loud sounds due to insufficient adjustment.

In addition, by outputting a specified sound that matches the situation (atmosphere) around the vehicle 1, that is, a specified sound that blends in with the external environment, it is possible to stimulate the emotions of people outside the vehicle.

[Configuration and Effects of the Present Embodiment]
The control method of the sound processing device according to the present embodiment is a control method of the sound processing device of the vehicle 1 including a sound output unit 60 that outputs sound to the outside of the vehicle and a sound acquisition unit 10 that acquires sound around the vehicle 1. This control method of the sound processing device includes a sound analysis step (step S203) of analyzing the sound acquired by the sound acquisition unit 10 when a prescribed sound having a magnitude of a preset type of feature amount (e.g., frequency, sound pressure) of a first value (e.g., frequency: 440 Hz, sound pressure: 70 dB) is output from the sound output unit 60, and acquiring the value of the feature amount of the prescribed sound contained in the sound as a second value, an acoustic characteristic detection step (step S204) of detecting acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 based on the first value and the second value, and a calibration step (step S205) of executing a calibration process for the sound output unit 60 and the sound acquisition unit 10 based on the acoustic characteristics.

According to this configuration, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 mounted on the vehicle 1 are detected using the sound output unit 60 and the sound acquisition unit 10, and are calibrated based on the acoustic characteristics, so that the acoustic characteristics can be appropriately set. In other words, there is no need to newly install a separate configuration for calibrating the sound processing device in the vehicle 1, and the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 (an example of a sound processing device) of the vehicle 1 can be appropriately set.

In addition, in the control method for a sound processing device according to this embodiment, the acoustic characteristic detection step (step S204) generates calibration data for calibrating at least one of the output level (e.g., frequency, sound pressure) of the sound output unit 60 and the sensitivity level of the sound acquisition unit 10 based on the acoustic characteristics, and the calibration step (step S205) calibrates at least one of the sound output unit 60 and the sound acquisition unit 10 based on the calibration data.

According to this configuration, for example, by generating calibration data regarding the output level of the sound output unit 60 and the sensitivity level of the sound acquisition unit 10, the calibration data can be used to appropriately set the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 (an example of a sound processing device) of the vehicle 1.

In addition, in the control method of the sound processing device according to this embodiment, the sound output unit 60 outputs a specified sound when the agent device 80 (a device that provides information related to driving assistance to the driver D1 of the vehicle 1) installed in the vehicle 1 is started up, or when the vehicle 1 is started up.

This configuration makes it possible to avoid outputting the specified sound at irregular times, thereby reducing the sense of anxiety felt by the driver D1. In addition, because the specified sound is output at a predetermined time, it is possible to foster an attachment in the driver D1 to the vehicle 1 and the agent device 80.

The sound processing device control method according to this embodiment further includes an external environment acquisition step (steps S212, S222) for acquiring information related to the external environment of the vehicle 1, and a device control step (steps S213, S214) for controlling an agent device 80 (a device that provides information related to driving assistance to the driver D1 of the vehicle 1) installed in the vehicle 1 based on the information related to the external environment.

With this configuration, the agent device 80 installed in the vehicle 1 can be controlled based on the external environment of the vehicle 1 (e.g., environmental sounds, conversation sounds).

In addition, in the control method for the sound processing device according to this embodiment, the device control steps (steps S213 and S214) determine the sound to be output from the agent device 80 based on information about the external environment of the vehicle 1, and output this sound from the agent device 80.

According to this configuration, it is possible to cause the agent device 80 to output an appropriate sound according to the external environment of the vehicle 1. This makes it possible to provide a comfortable sound to the driver D1 and people around the vehicle 1. In addition, it is also possible to cause the sound output unit 60 to output an appropriate sound according to the external environment of the vehicle 1. This makes it possible to share the sound processing device (sound output unit 60 and sound acquisition unit 10) used to detect the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 with the sound processing device (sound output unit 60 and sound acquisition unit 10) used to control the agent device 80.

The control method for the sound processing device according to this embodiment further includes an external environment acquisition step (step S222) for acquiring information about the external environment of the vehicle 1, and a determination step (step S223) for determining a standard sound based on the information about the external environment, and the sound output unit 60 outputs the standard sound determined in the determination step (step S223) (step S224).

With this configuration, an appropriate standard sound according to the external environment of the vehicle 1 can be output from the sound output unit 60. For example, the standard sound can be determined so as to avoid sounds with frequencies close to the environmental sounds around the vehicle 1, and the standard sound can be output from the sound output unit 60. In this way, it is possible to output a standard sound with a suitable frequency that is easily audible to the driver D1 and people around the vehicle 1, taking into account the external environment of the vehicle 1.

In addition, in the control method for a sound processing device according to this embodiment, the external environment acquisition step (step S222) acquires sounds outside the vehicle acquired by the sound acquisition unit 10 as information relating to the external environment of the vehicle 1, and the determination step (step S223) determines a prescribed sound based on the sounds outside the vehicle acquired by the sound acquisition unit 10.

With this configuration, it is possible to determine the prescribed sound (e.g., the frequency of the prescribed sound) to be output from the sound output unit 60 based on the sound outside the vehicle 1, making it possible to output a suitable prescribed sound in consideration of the sound outside the vehicle 1. In addition, because a sound corresponding to the external environment of the vehicle 1 is output as a prescribed sound for detecting the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10, it is possible to detect the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 with greater accuracy.

In addition, in the control method for a sound processing device according to this embodiment, the specified sound is a sound of a first frequency, the sound analysis step (steps S203, S226) analyzes the sound acquired by the sound acquisition unit 10 and acquires the frequency of the specified sound contained in the sound as a second frequency, and the acoustic characteristic detection step (steps S204, S227) detects the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 based on the first frequency and the second frequency.

With this configuration, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 are detected using frequency and calibrated based on the acoustic characteristics, allowing the acoustic characteristics to be set appropriately.

In addition, in the control method for a sound processing device according to this embodiment, the first frequency is a single frequency.

With this configuration, a single sound of a single frequency that is easy to analyze is used as the standard sound, making it possible to detect the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 with greater accuracy.

In addition, in the control method for a sound processing device according to this embodiment, the first frequency includes multiple frequencies.

This configuration makes it possible to accurately detect the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10, while outputting a chord that is comfortable for the driver D1 and people around the vehicle 1 as the standard sound.

In addition, in the control method for a sound processing device according to this embodiment, the first frequency is set to include frequencies across a preset frequency band.

With this configuration, sounds or songs (e.g., melodic songs) that are preferred by the driver D1 and people around the vehicle 1 can be set as the standard sound, making it possible to output a standard sound that is more comfortable for the driver D1 and people around the vehicle 1.

In addition, in the control method for a sound processing device according to this embodiment, the specified sound is a sound of a first volume, a sound analysis step (steps S203, S226) analyzes the sound acquired by the sound acquisition unit 10 and acquires the volume of the specified sound contained in the sound as a second volume, and an acoustic characteristic detection step (steps S204, S227) detects the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 based on the first volume and the second volume.

According to this configuration, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 are detected using the volume (sound with a predetermined sound pressure value) and are calibrated based on the acoustic characteristics, so that the acoustic characteristics can be set appropriately.

The control device 100 of the sound processing device is a control device of the sound processing device of the vehicle 1, which includes a sound output unit 60 that outputs sound outside the vehicle, and a sound acquisition unit 10 that acquires sounds around the vehicle 1. The control device 100 of the sound processing device includes a sound analysis unit 51 that analyzes the sound acquired by the sound acquisition unit 10 when a specified sound having a magnitude of a feature of a preset type as a first value is output from the sound output unit 60, and acquires the value of the feature of the specified sound contained in the sound as a second value, an acoustic characteristic detection unit 52 that detects the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 based on the first value and the second value, and a device control unit 53 that executes a calibration process for the sound output unit 60 and the sound acquisition unit 10 based on the acoustic characteristics.

According to this configuration, the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 mounted on the vehicle are detected using the sound output unit 60 and the sound acquisition unit 10, and are calibrated based on the acoustic characteristics, so that the acoustic characteristics can be appropriately set. In other words, there is no need to newly install a separate configuration for calibrating the sound processing device in the vehicle 1, and the acoustic characteristics of the sound output unit 60 and the sound acquisition unit 10 (an example of a sound processing device) of the vehicle 1 can be appropriately set.

Note that each process shown in this embodiment is executed based on a program for causing a computer to execute each processing procedure. Therefore, this embodiment can also be understood as an embodiment of a program that realizes the function of executing each of these processes, and a recording medium that stores the program. For example, an update process for adding a new function to the control device of a sound processing device can store the program in the storage device of the control device of the sound processing device. This makes it possible to cause the updated control device of the sound processing device to execute each of the processes shown in this embodiment.

Although the embodiments of the present invention have been described above, the above embodiments merely show some of the application examples of the present invention, and are not intended to limit the technical scope of the present invention to the specific configurations of the above embodiments.

1, 301-309 Vehicle, 2 Dashboard, 3 Steering wheel, 4 Windshield, 5 Keys, 10 Sound acquisition unit, 20 Image acquisition unit, 30 Location information acquisition unit, 40 Communication unit, 50 Control unit, 51 Sound analysis unit, 52 Acoustic characteristic detection unit, 53 Device control unit, 60 Sound output unit, 70 Memory unit, 80 Agent device, 100 Control device for sound processing device

Claims (9)

A method for controlling a sound processing device of a vehicle including a sound output unit that outputs sound to an outside of the vehicle and a sound acquisition unit that acquires sound around the vehicle, comprising:
a sound analysis step of analyzing the sound acquired by the sound acquisition unit when a prescribed sound having a magnitude of a feature of a preset type as a first value is output from the sound output unit, and acquiring a value of the feature of the prescribed sound included in the sound as a second value;
an acoustic characteristic detection step of detecting acoustic characteristics of the sound output unit and the sound acquisition unit based on the first value and the second value;
a calibration step of executing a calibration process for the sound output unit and the sound acquisition unit based on the acoustic characteristics,
the prescribed sound is a sound of a first frequency,
the first frequency includes a plurality of frequencies across a preset frequency band;
The sound analysis step includes analyzing the sound acquired by the sound acquisition unit, and acquiring a frequency of the specified sound included in the sound as a second frequency;
The acoustic characteristic detection step detects the acoustic characteristic based on the first frequency and the second frequency.
A method for controlling sound processing equipment. A method for controlling a sound processing device according to claim 1, comprising:
the acoustic characteristic detection step generates calibration data for calibrating at least one of an output level of the sound output unit and a sensitivity level of the sound acquisition unit based on the acoustic characteristic;
The calibration step calibrates at least one of the sound output unit and the sound acquisition unit based on the calibration data.
A method for controlling sound processing equipment. A method for controlling a sound processing device according to claim 1 or 2, comprising:
The sound output unit outputs the specified sound in response to activation of a device that is installed in the vehicle and provides information regarding driving assistance to a driver of the vehicle, or in response to activation of the vehicle.
A method for controlling sound processing equipment. A method for controlling a sound processing device according to any one of claims 1 to 3, comprising:
An external environment acquisition step of acquiring information regarding an external environment of the vehicle;
and controlling a device installed in the vehicle that provides information related to driving assistance to a driver of the vehicle based on the information related to the external environment.
A method for controlling sound processing equipment. A method for controlling a sound processing device according to claim 4, comprising:
The device control step includes determining a sound to be output from the device based on information about the external environment, and outputting the sound from the device.
A method for controlling sound processing equipment. A method for controlling a sound processing device according to any one of claims 1 to 5, comprising:
An external environment acquisition step of acquiring information regarding an external environment of the vehicle;
determining the reference sound based on information about the external environment;
The sound output unit outputs the specified sound determined in the determining step.
A method for controlling sound processing equipment. A method for controlling a sound processing device according to claim 6, comprising:
the external environment acquisition step acquires the sound outside the vehicle acquired by the sound acquisition unit as information about the external environment of the vehicle;
The determining step determines the specified sound based on a sound outside the vehicle acquired by the sound acquisition unit.
A method for controlling sound processing equipment. A method for controlling a sound processing device according to any one of claims 1 to 7, comprising:
the predetermined sound is a sound of a first volume;
The sound analysis step includes analyzing the sound acquired by the sound acquisition unit, and acquiring a volume of the specified sound included in the sound as a second volume;
The acoustic characteristic detection step detects the acoustic characteristic based on the first volume and the second volume.
A method for controlling sound processing equipment. A control device for a sound processing device of a vehicle, the control device including a sound output unit that outputs sound to an outside of the vehicle and a sound acquisition unit that acquires sound around the vehicle,
a sound analysis unit that, when a prescribed sound having a magnitude of a feature of a preset type as a first value is output from the sound output unit, analyzes the sound acquired by the sound acquisition unit and acquires, as a second value, a value of the feature of the prescribed sound included in the sound;
an acoustic characteristic detection unit that detects acoustic characteristics of the sound output unit and the sound acquisition unit based on the first value and the second value;
an equipment control unit that executes a calibration process for the sound output unit and the sound acquisition unit based on the acoustic characteristics;
the prescribed sound is a sound of a first frequency,
the first frequency includes a plurality of frequencies across a preset frequency band;
The sound analysis unit analyzes the sound acquired by the sound acquisition unit, and acquires a frequency of the specified sound included in the sound as a second frequency;
The acoustic characteristic detection unit detects the acoustic characteristic based on the first frequency and the second frequency.
A control device for sound processing equipment.