JP6171882B2 - Vehicle warning system, in-vehicle device, and program - Google Patents

Description

  The present invention relates to a vehicle warning system, an in-vehicle device, and a program.

  As a means for performing a warning regarding a vehicle, as disclosed in Patent Document 1, a warning display unit that is provided in an instrument device and lights when a warning is performed is known.

JP-A-9-68441

  In recent years, the number of types of warnings required has been increasing (for example, it can be over 40 types). When an alarm display unit corresponding to all of them is provided in an in-vehicle device such as an instrument device, Layout is limited.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a vehicle warning system, an in-vehicle device, and a program capable of various warnings without limiting the layout in the vehicle as much as possible.

In order to achieve the above object, a vehicle warning system according to a first aspect of the present invention includes:
A vehicle warning system comprising an in-vehicle device mounted on a vehicle and a mobile terminal device having an imaging function,
The in-vehicle device includes a light source, and a control unit that turns on the light source with a predetermined lighting pattern when warning about the vehicle is performed,
The portable terminal device
Based on an image obtained by imaging the light source that is lit in the lighting pattern, a specifying unit that specifies warning contents represented by the lighting pattern;
An informing means for informing the warning content specified by the specifying means,
It is characterized by that.

In order to achieve the above object, an in-vehicle device according to the second aspect of the present invention provides:
In-vehicle device provided in the vehicle warning system, the control means to turn on the light source with a lighting pattern changed for each type of warning,
It is characterized by that.

In order to achieve the above object, a program according to the third aspect of the present invention provides:
On the computer,
A warning represented by the lighting pattern based on an image obtained by the mobile terminal device imaging a light source that lights in a predetermined lighting pattern when a warning about the vehicle is performed while the light source is lit in the lighting pattern Processing to identify the content;
A process for notifying the specified warning content;
Is executed.

  According to the present invention, various warnings are possible without limiting the layout in the vehicle as much as possible.

It is a schematic structure figure of a warning system for vehicles concerning one embodiment of the present invention. It is a block diagram for demonstrating the structure of the vehicle-mounted apparatus shown in FIG. It is a block diagram for demonstrating the structure of the portable terminal device shown in FIG. (A)-(c) is a figure for demonstrating the lighting pattern of the 2nd light source part which concerns on one Embodiment of this invention. It is a flowchart of the warning display process which concerns on one Embodiment of this invention. It is a figure which shows an example of a warning image. It is a schematic diagram for demonstrating the table data stored in the memory | storage part of a portable terminal device.

  An embodiment of the present invention will be described with reference to FIGS.

The vehicle warning system 1 according to the present embodiment includes an in-vehicle device 100 and a mobile terminal device 200.
The in-vehicle device 100 is a device mounted on the vehicle 2. In this embodiment, the in-vehicle device 100 is configured as an instrument device of the vehicle 2, specifically, a composite instrument that notifies various information related to the vehicle 2.
The mobile terminal device 200 includes at least a communication function, an imaging function, and a display function. In the vehicle warning system 1, the mobile terminal device 200 is carried by a user who is a driver of the vehicle 2 and used in the vehicle 2. A so-called smartphone is suitable as the mobile terminal device 200, and the mobile terminal device 200 according to the present embodiment is a smartphone as shown in FIG.

(In-vehicle device)
As illustrated in FIG. 1, the in-vehicle device 100 includes a first instrument unit 101, a second instrument unit 102, a display display 103, a first warning unit 104, and a second warning unit 105. As shown in FIG. 2, the in-vehicle device 100 includes a control unit 110, a storage unit 120, a pointer driving unit 130, a first light source unit 140, and a second light source unit 150.

The first instrument unit 101 is a speedometer, and notifies the vehicle speed of the vehicle 2 by causing an index unit (not shown) composed of scales, numerical values, and the like and a pointer 101a indicating the index unit to be read.
The second instrument unit 102 is a tachometer and reports the engine speed. Since the configuration of the second instrument unit 102 is the same as that of the first instrument unit 101, the following description is omitted.

  The display 103 includes a liquid crystal display (LCD), an organic electro-luminescence display (OELD), and the like, and displays, for example, an image indicating various information related to the vehicle 2. As an example, the display 103 functions as an odometer that notifies the travel distance by a display image.

  The first warning unit 104 gives a warning whose display is required by law. There are a plurality of first warning units 104, each of which performs a different type of warning. For example, the plurality of first warning units 104 each give a warning regarding a turn lamp, a seat belt reminder, a side brake, and the like. The first warning unit 104 includes a first light source unit 140, a cover member (not shown) that covers the first light source unit 140, and the like. This cover member is configured so that at least a part thereof is translucent and characters, figures, icons, etc. representing various warning information are displayed by illumination light from the first light source unit 140 (for example, The icon etc. are drawn in the shape of a letter).

  The first light source unit 140 includes a plurality of light emitting diodes (LEDs), and is turned on (including blinking) or turned off under the control of the control unit 110. The plurality of first light source units 140 are provided corresponding to the first warning unit 104 that performs different types of warnings. As an example, the 1st light source part 140 blinks synchronizing with the direction indicator of the vehicle 2, and illuminates the cover member in which the arrow showing the direction (left or right) of a direction indicator was engraved. Thereby, the 1st warning part 104 can alert | report whether the direction indicator of a right or left direction is an ON state.

  The second warning unit 105 performs various warnings whose display is not required by law based on the lighting of the second light source unit 150. Warnings given by the second warning unit 105 being turned on include ABS (Antilock Brake System), traction control, power steering abnormality notification, and the like. The second warning unit 105 includes a second light source unit 150, a cover member (not shown) that covers the second light source unit 150, and the like. At least a part of the cover member is translucent and transmits light from the second light source unit 150.

  Unlike the first warning unit 104, the second warning unit 105 is not provided with an icon or the like that allows the user to grasp the warning content only by visual recognition, and the lighting of the second light source unit 150 is translucent. It is only visually recognized through a cover member, a diffusion member, and the like. Therefore, the user can notice that some warning has been made by turning on the second warning unit 105, but the specific warning content cannot be recognized only by turning on the second warning unit 105. In order to know the specific warning contents, a portable terminal device 200 described later is required.

  The second light source unit 150 includes, for example, one light emitting diode, and is turned on (including blinking) or turned off under the control of the control unit 110. Specifically, the control unit 110 changes the lighting pattern by changing the lighting cycle of the second light source unit 150 according to warning information acquired from an ECU (Electronic Control Unit) 300 of the vehicle 2.

Here, an example of the lighting pattern of the 2nd light source part 150 is shown to Fig.4 (a)-(c). In the figure, an ON period indicates a period in which the second light source unit 150 is turned on, and an OFF period indicates a period in which the second light source unit 150 is turned off. In the figure, the horizontal axis t indicates the elapsed time.
For example, under the control of the control unit 110, the second light source unit 150 performs a light emission operation with the lighting pattern A shown in FIG. Further, the second light source unit 150 performs a light emission operation with the lighting pattern B shown in FIG. 4B when abnormality occurs in the traction control. Further, the second light source unit 150 performs the light emission operation with the lighting pattern C shown in FIG. 4C when an abnormality occurs in the power steering. Thus, under the control of the control unit 110, the second light source unit 150 performs a light emission operation with a lighting pattern changed for each different type of warning. As shown in FIGS. 4A to 4C, the lighting pattern is defined by a combination of a ratio of the lighting period of the second light source unit 150 in a predetermined period, a lighting timing, a lighting cycle, and the like. As will be described in detail later, the vehicular warning system 1 is configured such that the mobile terminal device 200 can specify the warning content represented by each lighting pattern and notify the specified warning content.

  The control unit 110 includes a CPU (Central Processing Unit), a graphic controller, and the like, and executes an operation program stored in the storage unit 120 to control the operation of each unit of the in-vehicle device 100. The control unit 110 acquires various types of information regarding the vehicle 2 from the ECU 300 of the vehicle 2 by a communication method such as CAN (Controller Area Network), LIN (Local Interconnect Network), or hard wired.

  The storage unit 120 includes a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, and the like, and stores an operation program executed by the control unit 110, image data to be displayed on the display display 103, and the like.

  The pointer driving unit 130 includes a stepping motor and the like, and rotates the pointer 101a under the control of the control unit 110. The pointer driving unit 130 rotates the pointer 101a according to the vehicle speed indicated by the vehicle speed data acquired by the control unit 110 from the ECU 300. Thus, the 1st instrument part 101 can alert | report a vehicle speed by instruct | indicating the parameter | index part mentioned above, while the pointer | guide 101a rotates.

(Mobile terminal device)
As illustrated in FIG. 3, the mobile terminal device 200 includes a control unit 210, a storage unit 220, a communication unit 230, an imaging unit 240, and an input / output unit 250.

  The control unit 210 includes a CPU and the like, and executes an operation program stored in the storage unit 220 to control the operation of each unit of the mobile terminal device 200. Note that at least a part of the control unit 210 may be configured by a dedicated circuit such as an ASIC (Application Specific Integrated Circuit). The same applies to the control unit 110 of the in-vehicle device 100.

  The storage unit 220 includes a ROM, a RAM, a flash memory, and the like. The storage unit 220 stores a program executed by the control unit 210, data necessary for each process performed by executing the program, data generated by each process, and the like. Is stored. In particular, in the present embodiment, the storage unit 220 stores a program PG of application software that can execute a warning display process described later. The program PG is prepared in a server by the provider of the in-vehicle device 100 or the vehicle 2 and downloaded in advance via the Internet by the user of the mobile terminal device 200, for example.

  The communication unit 230 is configured to perform Internet communication, and is a communication module that can directly access a WAN (Wide Area Network), an external device (such as a mobile router) that can access the WAN, or a public wireless LAN (Local Area Network) access. It consists of a communication module for communicating with points.

The imaging unit 240 is a configuration for realizing the imaging function of the mobile terminal device 200. The imaging unit 240 is, for example, a video camera module including a plurality of lenses, a solid-state imaging device such as a CCD (Charge Coupled Device) and a CMOS (Complementary Metal-Oxide-Semiconductor), a shutter, and the like. The imaging unit 240 forms an image of a subject on the light receiving surface of the solid-state imaging device using a lens when the shutter is open, converts the intensity of the formed image light into an electrical signal, and the electrical signal Is output to the control unit 210.
In the present embodiment, in the warning display process described later, the imaging unit 240 captures an image of the second warning unit 105 in a lighting state (including blinking) according to a user operation. Then, the control unit 210 identifies the warning content represented by the lighting pattern of the second warning unit 105 based on the image data (moving image data) obtained as a result, and outputs an image for notifying the specified warning content to the input / output unit 250. Display.

  The input / output unit 250 includes a display device that displays and outputs an image captured by the image capturing unit 240 and a warning image to be described later, and an input device that receives an input operation by the user of the mobile terminal device 200. The input / output unit 250 includes, for example, a touch panel (touch screen) that integrally realizes a display function and an input function. The input / output unit 250 also includes a voice input / output device (speaker, microphone, etc.) in a smartphone.

  The vehicle warning system 1 configured as described above enables various warnings without limiting the layout of the interior 2 as much as possible by executing a warning display process described below.

  From here, with reference to FIGS. 5-7, the warning display process which the control part 210 of the portable terminal device 200 performs is demonstrated. For example, the control unit 210 displays a warning when the input device of the input / output unit 250 receives an input operation (user operation on the mobile terminal device 200) for starting application software (so-called application) by the program PG. Start processing. FIG. 5 shows a flowchart of the warning display process.

(Warning display processing)
First, the control unit 210 determines whether or not the input device of the input / output unit 250 has accepted an imaging operation (step S1). When the imaging operation is not received (step S1; No), the control unit 210 stands by.
On the other hand, when the imaging operation is received (step S1; Yes), the control unit 210 controls the operation of the imaging unit 240 and images the subject (step S2). In this vehicle warning system 1, when the user (mainly the driver of the vehicle 2) performs an imaging operation, the second warning unit 105 is lit in a predetermined lighting pattern. When the second warning unit 105 is lit (including blinking), the user guesses that some abnormality has occurred in the vehicle 2, operates the portable terminal device 200 that is carried, activates the application, and the second warning unit 105 is shot with a moving image.

When the subject (here, the second warning unit 105) is imaged (step S2), the control unit 210 executes a lighting pattern recognition process of the second warning unit 105 based on the captured image (step S3).
For example, the control unit 210 acquires image data for one frame from the video signal output from the imaging unit 240, and if the average value of the luminance values of pixels constituting one frame exceeds a predetermined threshold, 2 It is determined that the warning unit 105 is turned on, and when the value is equal to or smaller than the threshold value, the second warning unit 105 is determined to be turned off. Based on the determination result in such processing, the control unit 210 recognizes the lighting pattern of the second warning unit 105 by detecting the ON timing of the second light source unit 150 in a predetermined period. Further, for example, the control unit 210 may be able to recognize the lighting pattern of the second warning unit 105 based on the average value of the luminance values of all the pixels in the image data (image data for several frames) during a certain period. In this case, the lighting pattern of the second warning unit 105 is obtained by changing the ratio of lighting during a certain period (ON time in FIGS. 4A to 4C) for each different type of warning information. In addition, the controller 210 may be configured to recognize the lighting pattern by a method in which known image processing methods and pattern recognition methods are appropriately combined.
In either case, the second warning unit 105 (second light source unit 150) performs a lighting operation with a different lighting pattern for each different type of warning information. Under the control of the control unit 110 of the in-vehicle device 100, the second warning unit 105 is lit with a lighting pattern in which the lighting cycle, the lighting interval, the ratio of the lighting period in a certain period, and the like are different for each type of warning information To do. Note that the second light source unit 150 is adjusted so as to emit light with high brightness that is not affected by the influence of external light.

  When the lighting pattern cannot be recognized (step S4; No), the control unit 210 returns the process to step S1. At this time, the control unit 210 may display an image representing a message such as “The lighting pattern cannot be recognized” on the input / output unit 250 display device.

  When the lighting pattern can be recognized (step S4; Yes), the control unit 210 determines the warning content based on the recognized lighting pattern (step S5). For example, the control unit 210 refers to the table data TA (FIG. 7) included in the above-described program PG and determines the warning content according to the recognized lighting pattern. In this table data TA, the lighting pattern and the warning content are associated with each other. For example, when the control unit 210 recognizes that the lighting pattern of the second warning unit 105 is the pattern A shown in FIG. 4A, the control unit 210 refers to the table data TA and associates the “ABS abnormality associated with the pattern A”. "Is determined as the warning content (step S5).

  That is, by the processing of steps S3 to S5, the control unit 210 specifies the warning content represented by the lighting pattern based on the image obtained by imaging the second light source unit 150 that is lit with the predetermined lighting pattern.

When the warning content is specified (determined) (step S5), the control unit 210 notifies the specified warning content. In the present embodiment, the warning content is notified by displaying a warning image on the display device included in the input / output unit 250 (step S6). Here, since an example in which the lighting pattern of the second warning unit 105 is the pattern A shown in FIG. 4A is described, the control unit 210 warns the ABS image 200a (see FIG. 6). ) Is displayed on the display device of the input / output unit 250 (step S6). As shown in FIG. 6, the warning image 200a is an image representing a sentence and an icon for notifying an ABS abnormality, a sentence for notifying a coping method, and the like.
The above warning display process is terminated when, for example, the input device of the input / output unit 250 receives an application termination operation.

  The vehicle warning system 1 described above includes the in-vehicle device 100 mounted on the vehicle 2 and the mobile terminal device 200 having the imaging unit 240. The in-vehicle device 100 includes a second light source unit 150 (light source) and a control unit 110 that turns on the second light source unit 150 with a predetermined lighting pattern when a warning regarding the vehicle 2 is performed. The controller 210 identifies the warning content represented by the lighting pattern based on the image obtained by imaging the second light source unit 150 that is lit with the lighting pattern, and the display device of the input / output unit 250 The specified warning content is notified (in this embodiment, notification is made by displaying a warning image).

  Moreover, the control part 110 of the vehicle-mounted apparatus 100 makes the 2nd light source part 150 light with the lighting pattern changed for every different kind of warning.

  In addition, the program PG carries the second light source unit 150 that is lit in a predetermined lighting pattern when the warning regarding the vehicle 2 is given to the control unit 210 while the second light source unit 150 is lit in the lighting pattern. Based on the image acquired by the terminal device 200, the process of specifying the warning content represented by the lighting pattern and the process of notifying the specified warning content are executed.

  Thus, since the lighting pattern of the second warning unit 105 (second light source unit 150) is changed for each type of warning in a predetermined warning, the number of warning units provided in the in-vehicle device 100 is reduced. Can do. Therefore, according to the vehicle warning system 1 and the in-vehicle device 100 according to the above embodiment, various warnings are possible without limiting the layout of the interior 2 of the vehicle as much as possible. In addition, it is possible to avoid the display information of the in-vehicle device 100 from being complicated and the visibility and recognizability from being lowered, and to display warning information including a detailed countermeasure on the display device of the mobile terminal device 200. It is user friendly. In addition, as a warning content notified based on the lighting pattern of the 2nd warning part 105, the warning which does not need to stop driving | running | working of the vehicle 2 relatively and does not need to be dealt with comparatively quickly is preferable. Moreover, since the number of warning parts provided in the in-vehicle device 100 can be reduced, the manufacturing cost of the in-vehicle device 100 can be suppressed as much as possible.

  In addition, this invention is not limited by the above embodiment and drawing. Changes (including deletion of constituent elements) can be added to the embodiments and the drawings as appropriate without departing from the scope of the present invention. An example of modification is shown below.

(Modification)
Although the example in which the vehicle-mounted apparatus 100 is comprised as an instrument apparatus was shown above, it is not restricted to this. The in-vehicle device may be a car navigation device or a head-up display device. Moreover, the light source light-emitting device etc. which were provided in the edge part of the rear-view mirror of the vehicle 2 may be sufficient.

  The mobile terminal device 200 is not limited to a smartphone. The mobile terminal device may be a tablet PC, a PDA (Personal Digital Assistant), a digital camera having a communication function, or the like.

  In the above, an example has been shown in which the second light source unit 105 is lit with a lighting pattern in which the lighting cycle, the lighting interval, the ratio of the lighting period in a certain period, and the like differ for each type of warning information. I can't. The second light source unit 150 may be configured by a plurality of LEDs having different emission colors, and may be turned on with different emission colors for different types of warning information. Also in such a case, it can be said that the control part 110 of the vehicle-mounted apparatus 100 changes a lighting pattern for every kind of warning. In this case, the lighting pattern can be recognized by software using a known color identification method.

  Further, the lighting cycle and lighting interval of the second light source unit 105 in the lighting pattern may or may not be recognizable by the user. For example, the second light source unit 105 may be driven by PWM (Pulse Width Modulation) control, and the mobile terminal device 200 may be turned on with a recognizable lighting pattern that is not recognized by the user.

  In the above, an example in which the warning content is notified by an image has been described. However, the warning content may be notified by voice through the speaker of the input / output unit 250.

  In addition, the program PG is stored in the storage unit 220 of the mobile terminal device 200 via download via the Internet, but may be distributed and provided by a removable recording medium. Further, the program PG may be downloaded from another device connected to the mobile terminal device 200. Moreover, the portable terminal device 200 may execute each process according to the program PG by exchanging various data with other devices via a telecommunication network or the like.

  In the above description, in order to facilitate the understanding of the present invention, the description of known unimportant technical matters is appropriately omitted.

DESCRIPTION OF SYMBOLS 1 ... Vehicle warning system 2 ... Vehicle 100 ... In-vehicle apparatus 101 ... 1st instrument part 102 ... 2nd instrument part 103 ... Display display 104 ... 1st warning part 105 ... 2nd warning part 110 ... Control part 120 ... Memory | storage part 130 ... Handle driving unit 140 ... first light source unit 150 ... second light source unit 200 ... mobile terminal device 210 ... control unit 220 ... storage unit 230 ... communication unit 240 ... imaging unit 250 ... input / output unit PG ... program

Claims (3)

A vehicle warning system comprising an in-vehicle device mounted on a vehicle and a mobile terminal device having an imaging function,
The in-vehicle device includes a light source, and a control unit that turns on the light source with a predetermined lighting pattern when warning about the vehicle is performed,
The portable terminal device
Based on an image obtained by imaging the light source that is lit in the lighting pattern, a specifying unit that specifies warning contents represented by the lighting pattern;
An informing means for informing the warning content specified by the specifying means,
A vehicle warning system characterized by that. It is an in-vehicle device with which the warning system for vehicles according to claim 1 is provided, The above-mentioned control means turns on the above-mentioned light source with the lighting pattern changed for every different kind of warning,
In-vehicle device characterized by the above. On the computer,
A warning represented by the lighting pattern based on an image obtained by the mobile terminal device imaging a light source that lights in a predetermined lighting pattern when a warning about the vehicle is performed while the light source is lit in the lighting pattern Processing to identify the content;
A process for notifying the specified warning content;
A program that executes

Images