JP5035178B2 - Evaluation item generation apparatus and program - Google Patents

Description

  The present invention relates to an evaluation item generation device and a program, and more particularly to an evaluation item generation device and a program for generating an evaluation item for evaluating the usability (ease of use) of a device.

  Conventionally, in order to evaluate the usability of a developed device or a device under development, an evaluator actually uses the device and performs evaluation by scoring for each evaluation item (question).

  For example, for the evaluation items, “guideline items” used to specifically check the components of the evaluation target, “view items” used for the purpose of overlooking the evaluation target from a comprehensive viewpoint, etc. It has been proposed to evaluate an evaluation object by multiplying an evaluation score by a weighting factor obtained by associating these items (see Patent Document 1).

  In addition, it has been proposed to evaluate and evaluate usability of AV navigation products by categorizing and hierarchically evaluating evaluation items and taking into account the importance of the evaluation items (Non-patent Document 1).

In addition, it has been proposed to create a checklist that complements the problems of users who have special considerations on the three elements of usability: operability, cognition, and comfort, and aims for versatility of evaluation. (Non-patent document 2).
JP 2003-263526 A “Fundamental research on the construction of usability evaluation system (1)”, Symposium “Usability and ergonomics of mobile phones and car navigation systems”, March 10, 2005, p. 39-42 “Introduction to User Engineering” written by Masaaki Kurosu, Kyoritsu Shuppan, 2000, p. 171-186

  However, the usability evaluation described in Patent Document 1, Non-Patent Document 1 and Non-Patent Document 2 is intended to generalize the structure and evaluation method of evaluation items, and the extraction of evaluation items is based on know-how such as brainstorming. Since the method that has been relied upon is used, there is a problem in that it is not considered what evaluation items are set to extract or generate the evaluation items necessary for the target device without omission.

  The present invention has been made to solve the above-described problems, and can be used to generate evaluation items necessary for an evaluation target device without omission when evaluating the ease of use of the device. An object is to provide a generation device and a program.

  In order to achieve the above object, the evaluation item generating apparatus of the present invention includes a plurality of predetermined general-purpose evaluation items for evaluating the ease of use of the device, and a plurality of items depending on the function and design requirements of the evaluation target device. Display means for displaying the device-dependent evaluation items, a value indicating the importance of the evaluation target device for each of the plurality of general-purpose evaluation items displayed on the display means, and for each of the plurality of device-dependent evaluation items Each of the plurality of general-purpose evaluation items for each combination of input means for inputting a value indicating the importance of the evaluation target device, each of the plurality of general-purpose evaluation items and each of the plurality of device-dependent evaluation items, and A value indicating the degree of association with each of the plurality of device-dependent evaluation items, a value indicating the importance of the general-purpose evaluation item input from the input unit, and a device-dependent evaluation item input from the input unit A calculation means for calculating a score that increases as any one of the values indicating importance increases, and a general-purpose evaluation item and device-dependent evaluation of the combination based on the score for each combination calculated by the calculation means Generating means for generating a question for evaluating the ease of use of the evaluation target device using the item.

  In addition, the evaluation item generation program of the present invention provides a computer with a plurality of predetermined general-purpose evaluation items for evaluating the ease of use of the device, and a plurality of device-dependencies depending on the functions and design requirements of the evaluation target device. Each of the plurality of general-purpose evaluation items and the plurality of the plurality of general-purpose evaluation items and each of the plurality of device-dependent evaluation items are combined for each of the plurality of general-purpose evaluation items and the plurality of device-dependent evaluation items. A value indicating the degree of association with each of the device-dependent evaluation items, a value indicating the importance of the evaluation target device for each of the plurality of general-purpose evaluation items displayed on the display unit, and the plurality of device-dependent evaluation items A value indicating the importance of the general-purpose evaluation item input from the input means for inputting the value indicating the importance of the device to be evaluated for each, and the device-dependent evaluation term input from the input means A calculation means for calculating a score that increases as any of the values indicating importance of the combination increases, and based on the score for each combination calculated by the calculation means, the general-purpose evaluation items of the combination and the device dependence It is a program for functioning as a generating means for generating a question for evaluating ease of use of the evaluation target device using an evaluation item.

  According to the evaluation item generation device and the evaluation item generation program of the present invention, the display means depends on a plurality of predetermined general-purpose evaluation items for evaluating the ease of use of the device and the functions and design requirements of the evaluation target device. Display a plurality of device-dependent evaluation items, a value indicating the importance of the evaluation target device for each of the plurality of general-purpose evaluation items displayed on the display means, and the evaluation target device of each of the plurality of device-dependent evaluation items A value indicating the importance is input from the input means. The computing means indicates the degree of association between each of the plurality of general-purpose evaluation items and each of the plurality of device-dependent evaluation items for each combination of each of the plurality of general-purpose evaluation items and each of the plurality of device-dependent evaluation items. A score that increases as any of the value, the value indicating the importance of the general-purpose evaluation item input from the input unit, and the value indicating the importance of the device-dependent evaluation item input from the input unit increases. Then, the generation unit generates a question for evaluating ease of use of the evaluation target device using the general-purpose evaluation item of the combination and the device-dependent evaluation item based on the score for each combination calculated by the calculation unit. .

  In this way, since a question that combines the general-purpose evaluation item and the device-dependent evaluation item is generated based on the score calculated from the importance and relevance of the general-purpose evaluation item and the device-dependent evaluation item, the ease of use of the device is increased. When the evaluation is performed, evaluation items necessary for the evaluation target device can be generated without omission.

  In addition, the value indicating the degree of association may be input from the input unit in a state where the plurality of general-purpose evaluation items and the plurality of device-dependent evaluation items are displayed on the display unit. Based on a plurality of predetermined general-purpose evaluation items, it can be determined in advance for each of the plurality of device-dependent evaluation items.

  As described above, according to the evaluation item generating device and the program according to the present invention, when evaluating the ease of use of the device, the evaluation items necessary for the evaluation target device can be generated without omission. The effect of being able to be obtained is obtained.

  Hereinafter, an embodiment of an evaluation item generating device of the present invention will be described in detail with reference to the drawings.

  As shown in FIG. 1, the evaluation item generation device 10 according to the first exemplary embodiment is generated by an input device 12 configured with a keyboard and a mouse or a touch panel for inputting various settings and conditions. A display device 14 including a display for displaying evaluation items and a computer 16 for executing evaluation item generation processing are provided.

  The computer 16 includes a CPU 24 that controls the entire evaluation item generation apparatus 10, a ROM 26 that stores various programs such as an evaluation item generation program described later, a RAM 28 that temporarily stores data as a work area, and various types of information stored therein. HDD (hard disk) 30 serving as a storage means, a network I / F (interface) unit 32 for connecting to a network, an I / O (input / output) port 34, and a bus for connecting them. Yes. The input device 12 and the display device 14 are connected to the I / O port 34.

  Here, the evaluation structure in the first embodiment will be described. As shown in FIG. 2, the usability evaluation structure in the present embodiment has a general evaluation item that does not depend on a specific device and an evaluation target for each specific device in evaluating “ease of use” of the device. It consists of equipment-dependent evaluation items for evaluating functions and design requirements. The general-purpose evaluation item and the device-dependent evaluation item have a many-to-many relationship, and the degree of the relationship varies depending on each item. The importance of general-purpose evaluation items varies depending on which function and design requirements of the target device are evaluated. Further, the functions and design requirements of the target device have different degrees of importance depending on the important points in the development of the target device and the appeal points that are so-called “sell”.

  It is necessary for the target device by generating evaluation items comprehensively considering the degree of association between these general-purpose evaluation items and device-dependent evaluation items, the importance of general-purpose evaluation items, and the importance of device-dependent evaluation items. Evaluation items can be generated without omission while making both versatility and device dependency compatible.

  Next, a processing routine of the evaluation item generation program in the first embodiment will be described with reference to FIG. Here, a case where an evaluation item for performing usability evaluation of a car navigation system (hereinafter referred to as “car navigation”) is generated using the evaluation item generation device 10 will be described.

  In step 100, general-purpose evaluation items stored in advance in a predetermined storage area are acquired. Here, so that it becomes a highly versatile evaluation item that is not specialized for a specific device, “easy to see”, “easy to hear”, “easy to understand”, which are used as general evaluation items in conventional usability evaluation, “Easy to operate” and “Familiar” are preset as general-purpose evaluation items.

  Next, in step 102, device-dependent evaluation items of the evaluation target device are acquired. This is acquired from development data in which the functions and design requirements of the target device are described in the development stage. In such development data, the functions and design requirements of the target device are described without omission. The development data may be input from the input device 12, stored in a storage device externally connected via a network, or stored in the HDD 30 of the computer 16.

  Here, the functions and setting requirements of the target device have an upper, middle, and lower hierarchical structure. As the upper hierarchy, “map display” that displays a map around the current position and destination, and input from the user An “operation screen” for displaying a screen for receiving and a “voice output” for outputting guidance to the user by voice are set.

  “Road”, “icon”, and “character” are set as the middle level of “map display”. For each of “road”, “icon”, and “character”, “size” and “ “Color scheme” is set. “Upper-middle-lower” (for example, “map-road-size”), which is a combination of these layers, becomes one device-dependent evaluation item. In addition, “button” and “character” are set as the middle level of “operation screen”, and “size”, “color scheme”, “quantity” and “placement” are set as “text” as the lower level of “button”. "Size", "Color scheme", and "Content" are set as the lower hierarchy. In addition, “message” is set as the middle level of “voice output”, and “volume”, “sound quality”, “length”, and “content” are set as the lower level of “message”.

  Next, in step 104, as shown in FIG. 4, the variable evaluation input in which the general evaluation items acquired in step 100 are arranged as row headings and the device-dependent evaluation items acquired in step 102 are arranged as column headings. The table 40 is displayed on the display device 14. A general-purpose evaluation item number i is assigned to the general-purpose evaluation items in order from the top, and a device-dependent evaluation item number j is assigned to the device-dependent evaluation items in order from the left.

  The variable input table 40 includes an importance input area 42 for inputting the importance of the general-purpose evaluation item, an appeal input area 44 for inputting the appeal of the device-dependent evaluation item, and the general-purpose evaluation item and the device-dependent evaluation. A relevance level input area 46 for inputting a relevance level with an item is provided. The importance level input area 42 includes a field A (i) corresponding to the general-purpose evaluation item i (i = 1, 2,..., N: n is the number of general-purpose evaluation items). The appeal input area 44 includes a field B (j) (j = 1, 2,..., M: m is the number of device-dependent evaluation items) corresponding to the device-dependent evaluation item j. The relevance input area 46 includes fields C (i, j) corresponding to general-purpose evaluation items i and device-dependent evaluation items j.

  Next, in step 106, it is determined whether or not the importance value for each general-purpose evaluation item has been input to all the fields A (i) in the importance input area 42 via the input device 12. The importance value input here is set to a value that increases as it is determined that the evaluation item is important for the evaluation target device. For example, the importance value is set in the range of 0 to 1, and a questionnaire such as “Is it easy to see for car navigation? Is it important?” The value to be obtained. When 10 out of 10 replies that “easy to operate” of general evaluation item number 4 is important, “1” is entered in field A (4).

  In addition, although the case where car navigation is evaluated is described here, for example, in the case of a mobile phone or the like, fashionability is often considered in usability, and the importance value of “friendly” increases. Conceivable. As described above, the importance of the general-purpose evaluation item varies depending on the evaluation target device.

  If all the importance levels have been input, the process proceeds to step 108. If not, the determination in this step is repeated.

  In step 108, it is determined whether or not the appeal value for each device-dependent evaluation item has been input to all the fields B (j) in the appeal degree input area 44 via the input device 12. The appeal value input here is set to a value that becomes higher as the function and design requirements of the so-called “sell” in the evaluation target device. For example, the value of the appeal degree is set in a range of 0 to 1, and “1” is set for the device-dependent evaluation item related to the function and design requirement “sell”, and “0. 5 ”. If the “operation screen-button-quantity” of the device-dependent evaluation item number 9 is not a device-dependent evaluation item related to the function and design requirements that are “sell” for the target device, “0.5” is set in the field B (9). Enter.

  Here, the degree of appeal is used, but any value that can weight the device-dependent evaluation item according to the function of the target device and the importance of the design requirement may be used. If all the appeal degrees are input, the process proceeds to step 110. If not, the determination in this step is repeated.

  In step 110, it is determined whether or not all the relevance values of the general-purpose evaluation item and the device-dependent evaluation item have been input to the field C (i, j) of the relevance level input area 46 via the input device 12. In the field C (i, j), the degree of association between the general-purpose evaluation item i and the device-dependent evaluation item j is input. The value of the degree of relevance input here is set to a value that increases as it is determined that the relationship between the general-purpose evaluation item and the device-dependent evaluation item is deep. For example, set the value of relevance in the range of 0 to 1 and conduct a questionnaire such as "Is" Easy to see "and" Map-Road-Size "related?" The value is obtained by “/” number of questionnaire subjects ”. When 5 out of 10 replies are related to the degree of association between “easy to operate” of general-purpose evaluation item number 4 and “operation screen-button-quantity” of device-dependent evaluation item number 9 Enter “0.5” in C (4, 9).

  If all the relevance levels have been input, the process proceeds to step 112. If not, the determination in this step is repeated. FIG. 5 shows an example in which the importance of the general-purpose evaluation item, the appeal degree of the device-dependent evaluation item, and the relevance between the general-purpose evaluation item and the device-dependent evaluation item are all input.

In step 112, the score S (i, j) corresponding to the general-purpose evaluation item i and the device-dependent evaluation item j is calculated according to the following equation (1) based on the values input in the fields.
S (i, j) = A (i) × B (j) × C (i, j) (1)

  FIG. 6 shows an example of the calculation result of the score S (i, j). For example, the score S (4,9) corresponding to “easy to operate” of the general-purpose evaluation item 4 and “operation screen-button-quantity” of the device-dependent evaluation item 9 is S (4,9) = 1.0. * 0.5 * 0.5 = 0.25 is calculated.

  Next, in step 114, “1” is set to i and j. Next, in step 116, it is determined whether or not the score S (i, j) is larger than a predetermined value Vs. As the predetermined value Vs, for example, a value such as Vs = 0.037 can be set with a case where the importance, the appeal, and the relevance are each 1/3. If the score S (i, j) is greater than the predetermined value Vs, the process proceeds to step 118. If the score S (i, j) is less than the predetermined value Vs, the process proceeds to step 120. Here, assuming that Vs = 0.037 is used as a predetermined value, S (1,1) is “1.00”, so that the determination is affirmed and the routine proceeds to step 118.

  In step 118, a question that is an evaluation item is generated by combining the general-purpose evaluation item i and the device-dependent evaluation item j. For example, “upper hierarchy of device-dependent evaluation item j” + “no” + “middle hierarchy of device-dependent evaluation item j” + “ha” + “general-purpose evaluation item i” + “lower hierarchy of device-dependent evaluation item j” Generate such a question. In the case of the combination of the general-purpose evaluation item 1 and the device-dependent evaluation item 1, the question “Is the map road easy to see?” Is generated. The generated question is temporarily stored in a predetermined storage area.

  Next, in step 120, it is determined whether j has reached m which is the number of device-dependent evaluation items. If j = m is not satisfied, the process proceeds to step 122, j is incremented by 1, and the process returns to step 116. If j = m, the process proceeds to step 124, where it is determined whether i is n, which is the number of general-purpose evaluation items. If i = n is not true, the process proceeds to step 126, i is incremented by 1, and the process returns to step 116. As described above, when the comparison with the predetermined value Vs and the question generation are completed for all the scores S (i, j) by repeating the processing of step 116 to step 126, the determination in step 124 is affirmed. Proceed to 128. In FIG. 6, the field indicated by shading indicates that the score is equal to or lower than a predetermined value, and the other fields indicate that the score is greater than the predetermined value. Questions are generated for combinations with evaluation items.

  In step 128, the question generated in step 118 and stored in the predetermined area is displayed on the display device 14. FIG. 7 shows an example of a question generation result. A portion marked with “◯” represents a combination of a general-purpose evaluation item having a score greater than a predetermined value and a device-dependent evaluation item (corresponding to a field other than half-tone in FIG. 6). The questions generated for the combination of general-purpose evaluation items marked with “◯” and device-dependent evaluation items are shown on the right side of the table.

  As described above, according to the evaluation item generation device in the first embodiment, the importance of the evaluation target device with respect to the general-purpose evaluation item and the appeal degree of the evaluation target device with respect to the device-dependent evaluation item are used. Evaluation items important to the device are extracted, and since the degree of association between the general-purpose evaluation item and the device-dependent evaluation item is used, the versatility for evaluating the usability of the device for the user and the device developer It is possible to generate the evaluation items necessary for the evaluation target device without omission, while at the same time achieving the device dependency that is directly linked to product development or improvement.

  In the first embodiment, it is determined whether or not the importance of the general-purpose evaluation item, the appeal of the device-dependent evaluation item, and the relevance between the general-purpose evaluation item and the device-dependent evaluation item have been input in that order. Although described, any decision may be made first. In the first embodiment, the case where the score is calculated when all the fields have been input has been described. For example, a signal instructing score calculation is input by the input device, and the instruction signal is input. The score may be calculated by receiving. In this case, for a field that has not been input when the instruction signal is received, the score may be calculated assuming that 0 is input.

  In the first embodiment, the case where the score is calculated by multiplying the importance of the general-purpose evaluation item, the appeal degree of the device-dependent evaluation item, and the relevance between the general-purpose evaluation item and the device-dependent evaluation item has been described. However, the score may be calculated by adding these. Further, it may be calculated by an expression combining addition and multiplication, such as “(importance + appeal degree) × relevance”.

  Next, a second embodiment will be described. In the first embodiment, a case has been described in which the degree of association between the general-purpose evaluation item and the device-dependent evaluation item is input by the input device. However, in the second embodiment, the degree of association is determined with respect to the device-dependent evaluation item. Are different from each other. Note that the configuration of the evaluation item generation device according to the second embodiment is the same as the configuration of the evaluation item generation device 10 of the first embodiment, and a description thereof will be omitted.

  With reference to FIG. 8, the processing routine of the evaluation item generation program in the second embodiment will be described. In addition, about the process same as the process routine of the evaluation item generation program in 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  In step 200, the device-dependent evaluation item of the target device and the value of the degree of association between the general-purpose evaluation item and the device-dependent evaluation item are acquired. In this embodiment, since general-purpose evaluation items are determined in advance, corresponding to the device-dependent evaluation items described in the development data in the device development stage, the value of the degree of relevance with the general-purpose evaluation items is determined in advance in the development data. Can be described in For example, for the device-dependent evaluation item “map display-road-size”, a relevance level of “easy to see” is 1; a relevance level of “easy to hear” is 0; a relevance level of “easy to understand” is 0; The degree of association with “easy” is 0, the degree of association with “friendly” is 0, and so on. Therefore, when the device-dependent evaluation item is acquired from the development data, the relevance value can be acquired together.

  Next, in step 202, the variable input table 40 is displayed on the display device 14. As in the first embodiment, the variable input table 40 has general evaluation items arranged as row headers and device-dependent evaluation items arranged as column headers, as shown in FIG. In the relevance level input area 46 in the first embodiment, the value of the relevance level acquired in step 200 is displayed.

  Next, the process from step 106 to step 128 is executed to generate a question. Note that, since the degree of association has already been acquired by the process of step 202, the process of determining whether all the degrees of association of step 110 in the first embodiment have been input is omitted.

  As described above, according to the evaluation item generating device in the second embodiment, the relevance level is determined in advance corresponding to the device-dependent evaluation item, so that the first relevance level is not input. The same effect as the embodiment can be obtained.

  In the second embodiment, the case where the relevance level is not input has been described. However, when the device dependency evaluation items for which the relevance level is determined and the device dependency evaluation items for which the relevance level is not defined are mixed. When displaying the variable input table, it is possible to display the value of the relevance obtained in the relevance degree input area and to allow the input device to input the field for which the relevance is not determined.

It is the schematic which shows the structure of the evaluation item production | generation apparatus 10 which concerns on 1st Embodiment. It is a figure for demonstrating a usability evaluation structure. It is a flowchart which shows the processing routine of the evaluation item generation program in 1st Embodiment. 5 is a table showing an example of a variable input table 40. 5 is a table showing an example when each value is input to a variable input table 40. It is a table | surface which shows an example of the calculation result of score S (i, j). It is a table | surface which shows an example of the production | generation result of a question. It is a flowchart which shows the processing routine of the evaluation item production | generation program in 2nd Embodiment.

Explanation of symbols

10 Evaluation Item Generation Device 12 Input Device 14 Display Device 16 Computer 40 Variable Input Table 42 Importance Level Input Area 44 Appeal Level Input Area 46 Relevance Level Input Area

Claims (5)

Display means for displaying a plurality of predetermined general-purpose evaluation items for evaluating the ease of use of the device, and a plurality of device-dependent evaluation items depending on the function and design requirements of the evaluation target device;
Input a value indicating the importance of the evaluation target device for each of the plurality of general-purpose evaluation items displayed on the display means, and a value indicating the importance of the evaluation target device for each of the plurality of device-dependent evaluation items Input means to
A value indicating the degree of association between each of the plurality of general-purpose evaluation items and each of the plurality of device-dependent evaluation items, for each combination of each of the plurality of general-purpose evaluation items and each of the plurality of device-dependent evaluation items, A score that increases as any of the value indicating the importance of the general-purpose evaluation item input from the input unit and the value indicating the importance of the device-dependent evaluation item input from the input unit increases. Computing means;
Generating means for generating a question for evaluating ease of use of the evaluation target device using the general-purpose evaluation item and the device-dependent evaluation item of the combination based on the score for each combination calculated by the calculating unit When,
An evaluation item generating device including:   The evaluation item generating device according to claim 1, wherein a value indicating the degree of association is input from the input unit in a state where the plurality of general-purpose evaluation items and the plurality of device-dependent evaluation items are displayed on the display unit.   The evaluation item generating device according to claim 1, wherein a value indicating the degree of association is predetermined for each of the plurality of device-dependent evaluation items based on the plurality of predetermined general-purpose evaluation items. Computer
Means for controlling the display means to display a plurality of predetermined general-purpose evaluation items for evaluating the ease of use of the device and a plurality of device-dependent evaluation items depending on the function and design requirements of the evaluation target device; ,
A value indicating the degree of association between each of the plurality of general-purpose evaluation items and each of the plurality of device-dependent evaluation items, for each combination of each of the plurality of general-purpose evaluation items and each of the plurality of device-dependent evaluation items, A value indicating the importance of the evaluation target device for each of the plurality of general-purpose evaluation items displayed on the display means and a value indicating the importance of the evaluation target device for each of the plurality of device-dependent evaluation items are input. An arithmetic operation for calculating a score that increases as any of the value indicating the importance of the general-purpose evaluation item input from the input unit and the value indicating the importance of the device-dependent evaluation item input from the input unit increases. Means,
Generating means for generating a question for evaluating ease of use of the evaluation target device using the general-purpose evaluation item and the device-dependent evaluation item of the combination based on the score for each combination calculated by the calculating unit When,
Evaluation item generation program to make it function.   An evaluation item generation program for causing a computer to function as each means constituting the evaluation item generation device according to claim 2.

Images