JP4554569B2 - VEHICLE SERVICE SYNTHESIS DEVICE, COMPUTER PROGRAM, AND VEHICLE SERVICE PROVIDING SYSTEM - Google Patents

Description

  The present invention relates to a vehicle service composition apparatus, a computer program, and a vehicle service providing system for providing a user with a service using a device mounted on a vehicle in accordance with an event such as a user's action on the vehicle.

As a conventional example, the following Patent Document 1 predicts an event that is likely to occur in order to detect and process an event such as a driver's operation or a change in the driving state of a vehicle, and based on the prediction result There is disclosed a technique for changing an event determination order so that an event having a high probability of occurrence is set as a priority. Further, Patent Document 2 below discloses a technique for changing a background color and a foreground color of a display screen by detecting an event such as a change in an illumination state in a vehicle, a change in a parking brake, and time information. Yes.
Japanese Patent Laid-Open No. 5-16703 (abstract) JP 2000-142272 A (paragraph 0020)

By the way, when providing a user with a service using a device mounted on a vehicle according to an event such as an action on the user's vehicle, if a plurality of services can be provided in combination, the user can be more comfortable and / or Or it should be possible to provide a convenient service.

Therefore, the present invention can provide a combination of a plurality of services using each of a plurality of devices mounted on a vehicle in accordance with an event such as a user's action on the vehicle, and thus to the user. It is an object of the present invention to provide a vehicular service composition device, a computer program, and a vehicular service providing system that can provide a more comfortable and / or convenient service.

In order to achieve the above object, the present invention provides a means for estimating an action purpose of a user's vehicle and / or a scene of the user's vehicle,
Based on the behavior object and / or scene of the estimated the user, multiple combinations of each service using each of a plurality of devices mounted on the vehicle, the sense of the relationship between information identifying each service And service flow construction means for constructing a service flow from the strength of the relationship between the information specifying each service ,
A plurality of devices mounted on the vehicle are driven by the constructed service flow.
With this configuration, it is possible to provide a combination of a plurality of services according to an event such as a user's action on the vehicle, and thus provide a more comfortable and / or convenient service for the user.

The vehicle service composition device of the present invention further comprises means for acquiring the current information of the user,
The service flow construction means constructs the service flow based on the acquired current information of the user and the estimated action purpose and / or scene of the user.

The vehicle service composition device of the present invention further comprises means for the user to evaluate the service flow constructed by the service flow construction means,
The service flow construction means modifies the constructed service flow according to the user's evaluation.

Further, the vehicle service providing system according to the present invention is a vehicle service providing system capable of connecting the vehicle service providing device and the vehicle outside service providing device via a network,
The outside service providing apparatus is
Relative scene in the vehicle behavior object and / or the user to the user of the vehicle, several combining the service with each of a plurality of devices mounted on the vehicle, between information specifying each service A service flow construction means for constructing a service flow from the meaning of the relationship and the strength of the relationship between the information specifying each service ;
Means for transmitting the constructed service flow to the in-vehicle service providing apparatus via the network,
The in-vehicle service providing apparatus is
Means for storing a service flow transmitted from the out-of-vehicle service providing device;
Means for estimating the user's behavioral purpose for the vehicle and / or the user's scene in the vehicle;
Means for driving a plurality of devices mounted on the vehicle to obtain a highly adaptable service flow from the stored service flow based on the estimated behavioral purpose and / or scene of the user. It was.

According to the present invention, it is possible to provide a combination of a plurality of services using each of a plurality of devices mounted on a vehicle according to an event such as a user's action on the vehicle. A more comfortable and / or convenient service can be provided.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is an explanatory view showing the definition of a service for a vehicle according to the present invention. The vehicle is provided with an existing tangible device D such as a door 1a that can be opened and closed for a user to get on and off and a window 2a that can be opened and closed for ventilation or the like. Therefore, the service in the present invention is an intangible service that drives the device D, such as an automatic door opening / closing service 1b that automatically opens and closes the door 1a and an automatic window opening / closing service 2b that automatically opens and closes the window 2a. Say s.

  FIG. 2 shows some examples of the device D provided in the vehicle and the service s using the device D. Examples of the device D include a driver's seat (D seat) door, a passenger seat (P seat) door, a passenger seat lift up / down device, indoor / outdoor illumination, and the like. In addition to the automatic door opening / closing service 1b and the automatic window opening / closing service 2b, the services s using these devices D include an automatic light-up service and a music / audio reproduction service. Therefore, in the present invention, a behavior purpose for the user's vehicle and a scene in the user's vehicle are estimated, and a plurality of services s using each of the plurality of devices D based on the estimated user's behavior purpose and scene are provided. Build a combined service flow.

  FIG. 3 is a block diagram showing an embodiment of the vehicular service composition apparatus according to the present invention. In FIG. 3, the sensor 11 is an in-vehicle camera, a sensor (such as a thermometer, a sweat meter, or a sphygmomanometer) that detects a user's living body, a thermometer, a hygrometer, a GPS sensor that detects a current position, or the like. The estimation engine 12 includes at least a purpose estimation unit 12a and a scene estimation unit 12b. The purpose estimation unit 12a estimates the action purpose a for the user's vehicle, such as whether the user wants to get on, get off, or enjoy, based on the detection signal of the sensor 11, and the scene estimation unit 12b The actual scene b in the user's vehicle, such as getting off, is estimated. The estimation engine 12 is provided with a state estimation unit 12c if possible, and the state estimation unit 12c allows the user to feel tired, excited, depressed, etc. Or a personality estimation unit 12d, and the personality estimation unit 12d may estimate the personality d of the user, such as the user likes to be bright, likes to have fun, likes to be calm, etc. Good.

  The synthesis engine 13 is based on the current information A of the user environment detected by the sensor 11, the user's action purpose a estimated by the purpose estimation unit 12a, the user's actual scene b estimated by the scene estimation unit 12b, and the like. Then, a service flow combining a plurality of services is generated. The execution engine 14 activates the existing device D of the vehicle based on the service flow generated by the synthesis engine 13. The estimation engine 12, the synthesis engine 13, and the execution engine 14 are configured by an ECU (Electronic Control Unit).

FIG. 4 shows an example actually applied to a vehicle. The device D originally mounted on the vehicle includes an AV device (AV) 21, an AV ECU 22 that controls the AV device 21, a car navigation device (car navigation) 23, a car navigation ECU 24 that controls the car navigation 23, a window 25, and a window 25. Window ECU 26, door 27, door ECU 28 for controlling door 27, brake 29, brake ECU 30 for controlling brake 29, engine 31, engine ECU 32 for controlling engine 31, and the like. The AV ECU 22 and the car navigation ECU 24 are connected to a multimedia LAN 33, the window ECU 26 and the door ECU 28 are connected to a body LAN 34, and the brake ECU 30 and the engine ECU 32 are connected to a power train LAN 35. Therefore, by connecting the service synthesis ECU 36 including the estimation engine 12 and the synthesis engine 13 shown in FIG. 3 to the LANs 33, 34, and 35, several services s using the device D originally mounted on the vehicle are provided. It can be provided to the user in combination. Here, services using body devices such as windows 25 and doors 27 can be referred to as convenience services, and services using multimedia devices such as AV equipment 21 and car navigation system 23 are comfort services. I can say that. Therefore, if a convenience service and a comfort service are combined, a more comfortable and / or convenient composite service can be provided to the user.

FIG. 5 shows a vehicular service providing system in which the configuration shown in FIG. 4 is developed. The multimedia system service composition ECU 37 is connected to the multimedia system LAN 33 and combines several services s using the AV device 21 and the car navigation system 23. The body system service synthesis ECU 38 is connected to the body system LAN 34 and combines several services using the windows 25 and doors 27. The power train system service synthesis ECU 39 is connected to the power train system LAN 35 to connect the brake 29, Several services s using the engine 31 are combined. Then, by connecting the in-vehicle integrated service composition ECU 40 to these service composition ECUs 37, 38, and 39 via a network such as the Internet, a service using each system device D originally mounted on the vehicle. Several combinations of s can be provided to the user.
The in-vehicle integrated service composition ECU 40 constitutes an out-of-vehicle service providing apparatus, and blocks other than the in-vehicle integrated service composition ECU 40 constitute an in-vehicle service providing apparatus. The in-vehicle integrated service composition ECU 40 constructs a service flow in which a plurality of services using each of a plurality of devices mounted on the vehicle are combined with respect to a behavior purpose for the user's vehicle and a scene in the user's vehicle, The constructed service flow is transmitted through the network. The in-vehicle service providing apparatus stores the service flow transmitted from the in-vehicle integrated service synthesis ECU 40, estimates an action purpose for the user's vehicle and a scene in the user's vehicle, and is stored based on the estimated action purpose and scene. A plurality of devices mounted on the vehicle are driven by the service flow.

  Next, the service synthesis algorithm will be described with reference to FIG. In FIG. 6, first, it is checked whether or not there is a service graph obtained by linking and combining services of the entire vehicle (step S1), and if not, a service graph is generated (step S3). If the service graph exists, it is checked whether or not the service graph has been updated (step S2). If the service graph has been updated, a service graph corresponding to the update is generated (step S3). FIG. 7 shows a service graph of the entire vehicle generated by linking the services s1, s2 to s7 as an example of the service graph. Services s1, s2 to s7 may be programs or agents. An arrow linking the services s1, s2 to s7 indicates a relationship (purpose a, individuality d, state c, scene b) and strength (described later).

  Each of the services s1, s2 to s7 has information on the ID of each service and the relationship between other services related to the service, as shown in FIG. The information on the relationship of other services includes information indicating the ID of the other service and the meaning of the relationship. Information indicating the meaning of the relationship includes information on the meaning of purpose a, individuality d, state c, and scene b described with reference to FIG. 3, and information on the strength among a plurality of services to be combined.

  Next, if the service is not updated in step S2, three ontologies of domain ontology, service ontology, and personal ontology are acquired (step S4), and then the concept that matches the purpose, individuality, state, and scene from the acquired ontology. (Step S5), and then, as shown in FIG. 9B, a service graph related to the extracted concept is constructed (step S6). Here, FIG. 9A shows a service graph of the entire vehicle generated by linking services s1, s2 to s7 as shown in FIG. 7, and FIG. 9B relates to the concept extracted in step S6. As an example of the service graph constructed as described above, the link L13 from the service s1 to the service s3, the link L36 from the service s3 to the service s6, the link L46 from the service s4 to the service s6 in FIG. A service graph constructed by removing the link L64 from s6 to service s4, the link L67 from service s6 to service s7, and the link L73 from service s7 to service s3 is shown.

  Next, as shown in FIG. 10, one or more service flows up to purpose a are searched from the constructed service graph (step S7). Here, A1, A2, and A3, which are the starting points of the service flow, are a plurality of current information that can be considered by the user. Next, one or more service flows from the user's actual current information A1 to the purpose a are searched from the one or more service flows as shown in FIG. 11 (step S8). Here, the example shown in FIG. 11 indicates that the current information A1 → service s2 → service s3 → purpose a service flow and the current information A1 → service s3 → purpose a service flow are searched. Next, as shown in FIG. 12, the strengths of these two service flows are calculated (step S9). In FIG. 12, the strength of the service flow of the current information A1 → the service s2 → the service s3 → the purpose a is set to the total score = 6 = 2 + 2 + 2, and the strength of the service flow of the current information A1 → the service s3 → the purpose a is the total score = 5 = 3 + 2. Next, as shown in FIGS. 13A and 13B, the service flows are listed in descending order of strength (total score) to determine the fitness of each service flow (step S10), and then the fitness is the highest. The service flow is formatted into an executable format and output (step S11). Here, the higher strength (total score) is the higher fitness.

  FIG. 14 shows another processing example for constructing a service relationship. In FIG. 14, first, it is checked whether or not there is initial data of the service graph (step S21), and if there is, the initial data is acquired (step S22). Moreover, it is checked whether there is a user's usage history (step S23), and if there is, the usage history is acquired (step S24). Next, an ontology is acquired (step S25), and then a service relationship is constructed (step S26). When an ontology is acquired in step S25 and step S26 to build a service relationship, the mediation type as shown in FIG. 15A and the broadcast type as shown in FIG. 15B are used. Can do.

  FIG. 16 shows a service management database in the composition engine 13 in FIG. 3, and this database includes a service name, a service ID, a service outline, etc. as management information of each service. Note that this database may be in another synthesis engine instead of in the synthesis engine 13.

  FIG. 17 is a flowchart illustrating an example of a service graph learning process. 17, in step S31, a service flow is created by synthesizing a plurality of services in steps S1 to S11 shown in FIG. 6, and then individual services are executed based on the created service flow in step S32. . Then, it is checked whether or not there is a user's evaluation (step S33), and if there is, the strength of the meaning of the service relationship described in FIG. 12 is changed based on the evaluation (step S34). For example, the executed service flow is stored in the usage history as it is (step S35).

  FIG. 18 is a flowchart illustrating an example of a concept learning process. 18, in step S41, a service flow is created by synthesizing a plurality of services in steps S1 to S11 shown in FIG. 6, and then individual services are executed based on the created service flow in step S42. . Then, it is checked whether or not there is a user's evaluation (step S43). If there is, the semantic structure of the ontology is changed based on the evaluation (step S45). (Step S44).

  FIG. 19 is a flowchart showing an example of processing for acquiring a concept from the outside. In FIG. 19, when a concept is acquired from the outside (step S51), it is checked whether or not the acquired concept already exists (step S52). If it does not exist, it is stored (step S54). In that case, it is stored as a backup (step S53).

  FIG. 20 is a flowchart illustrating an example of processing in which the user changes the concept. In FIG. 20, when a concept is acquired (step S61), it is checked whether or not the acquired concept already exists (step S62). If it already exists, it is stored as a backup (step S63), and does not exist. In this case, the user corrects and saves (steps S64 and S65).

By the way, as described with reference to FIG. 3, the user's physical / mental state c, such as tired, excited, or depressed, is estimated, or a personality estimation unit 12d is provided. When the personality estimation unit 12d estimates the user's personality d such as that he likes to be bright, likes to have fun, likes to be calm, etc., a more organic service flow can be constructed. FIG. 21 shows some examples of such cases. In the case of the personality d = showy like 1 shown in FIG. 1, state c = depression, and purpose b = get on the driver's seat, a service flow combining the following 12 services can be generated.
1. 1. Light up lights (headlight, tail lamp, door illumination) 2. Play music (rock) outside the car. Open the window. Play back “Please come back” 5. Play "Open the driver's seat door" 6. 6. Close the window. Open the driver's seat door 8. (After sitting) Play “Close the door” 9. 9. Close the driver's seat door. 10. Turn off the light. 11. Stop music outside the car. Play “Let ’s keep going”

The present invention can provide a combination of a plurality of services in accordance with an event such as a user's behavior with respect to a vehicle, and thus can provide a more comfortable and / or convenient service for the user. It can be used for various vehicles.

It is explanatory drawing which shows the definition of the service for vehicles which concerns on this invention. It is explanatory drawing which shows the example of the device mounted in the vehicle, and its service. It is a block diagram which shows one Embodiment of the service composition apparatus for vehicles which concerns on this invention. It is a block diagram which shows an example of the whole structure which applied the service composition apparatus for vehicles of FIG. 3 to the vehicle. It is a block diagram which shows the service provision system for vehicles which concerns on this invention. 3 is a flowchart showing a service composition algorithm according to the present invention. It is explanatory drawing which shows the service graph of the whole vehicle. It is explanatory drawing which shows the management information of the service graph of FIG. In FIG. 6, it is explanatory drawing which shows the process which extracts the service graph relevant to the extracted concept. It is explanatory drawing which shows the process which extracts the service flow which matches the objective from the service graph extracted in FIG. It is explanatory drawing which shows the process which extracts the service flow which matches a user's present information from the service graph in which the objective matched in FIG. It is explanatory drawing which shows the process which calculates the strength from the present information of the service flow matched in FIG. 11 to the objective. It is explanatory drawing which shows the process which lists up the service flow calculated in FIG. 12 in order with a high total score. It is a flowchart which shows the other service graph production | generation process. FIG. 15 is an explanatory diagram showing in detail a process of building a service relationship in FIG. 14. It is explanatory drawing which shows the service management database in a synthetic | combination engine. It is a flowchart which shows an example of the learning process of a service graph. It is a flowchart which shows an example of the learning process of a concept. It is a flowchart which shows an example of the process which acquires a concept from the outside. It is a flowchart which shows an example of the process in which a user changes a concept. It is explanatory drawing which shows the example of a service flow.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Sensor 12 Estimation engine 12a Purpose estimation part 12b Scene estimation part 12c State estimation part 12d Individuality estimation part 13 Composition engine 14 Execution engine D Device s Service

Claims (9)

Means for estimating a behavioral purpose of the user's vehicle and / or a scene in the vehicle of the user;
Based on the behavior object and / or scene of the estimated the user, multiple combinations of each service using each of a plurality of devices mounted on the vehicle, the sense of the relationship between information identifying each service And service flow construction means for constructing a service flow from the strength of the relationship between the information specifying each service ,
A vehicular service combining apparatus configured to drive a plurality of devices mounted on the vehicle by the constructed service flow. Means for obtaining current information of the user;
2. The service flow constructing unit constructs the service flow based on the acquired current information of the user and the estimated action purpose and / or scene of the user. Vehicle service composition device. Means for allowing the user to evaluate the service flow constructed by the service flow construction means;
The vehicle service composition apparatus according to claim 1, wherein the service flow construction unit modifies the constructed service flow according to the evaluation of the user. A means for obtaining the fitness of the service flow constructed by the service flow construction means;
The in-vehicle service composition apparatus according to any one of claims 1 to 3, wherein a service flow having a high fitness can be executed. Estimating a behavioral purpose for the user's vehicle and / or a scene in the user's vehicle;
Based on the behavior object and / or scene of the estimated the user, multiple combinations of each service using each of a plurality of devices mounted on the vehicle, the sense of the relationship between information identifying each service And a service flow construction step of constructing a service flow from the strength of the relationship between the information specifying each service ,
A computer program that is executed by a computer. Further comprising obtaining the current information of the user;
Wherein the service flow construction steps, according to claim 5, characterized in that to construct the current information of the obtained the user, the service flow based on the action objects and / or scenes of the estimated the user Computer program. The user further comprises the step of evaluating the service flow constructed by the service flow construction step,
Wherein the service flow construction step, a computer program according to the constructed service flow to claim 5 or 6, characterized in that to modify in accordance with the evaluation of the user. Further comprising the step of obtaining the fitness of the service flow constructed by the service flow construction means,
The computer program according to any one of claims 5 to 7, wherein a service flow having a high fitness can be executed. A vehicle service providing system capable of connecting an in-vehicle service providing apparatus and an outside service providing apparatus via a network,
The outside service providing apparatus is
Relative scene in the vehicle behavior object and / or the user to the user of the vehicle, several combining the service with each of a plurality of devices mounted on the vehicle, between information specifying each service A service flow construction means for constructing a service flow from the meaning of the relationship and the strength of the relationship between the information specifying each service ;
Means for transmitting the constructed service flow to the in-vehicle service providing apparatus via the network,
The in-vehicle service providing apparatus is
Means for storing a service flow transmitted from the out-of-vehicle service providing device;
Means for estimating the user's behavioral purpose for the vehicle and / or the user's scene in the vehicle;
Means for driving a plurality of devices mounted on the vehicle to obtain a highly adaptable service flow from the stored service flow based on the estimated behavioral purpose and / or scene of the user. Vehicle service provision system.

Images