JP7595809B2 - Information presentation device, program, and information presentation method - Google Patents

Description

The present disclosure relates to an information presentation device, a program, and an information presentation method.

Patent Document 1 discloses a plant monitoring device that presents the operating status of a plant to an operator. The plant monitoring device has a section that measures the operator's biological information and a section that analyzes the operator's psychological state, and controls the content of the presentation according to the operator's condition.

Patent No. 291237

The conventional technology is not only applicable to plant monitoring devices for plant monitoring. For example, it can also be applied to an information presentation device that, for the purpose of discovering or confirming monitored objects moving within a specific space, arranges sensors to capture monitored objects moving within the space and presents the results of detection by the sensors to monitoring workers.

However, when the space in which the monitored object moves is outdoors, the ability to process sensor data and detect the monitored object (hereinafter referred to as the sensor information processing resources of the information presentation device) and the ability to estimate associated information (hereinafter referred to as device performance) vary depending on the weather.

If the information presented is controlled based solely on the work performance of the monitoring worker, when the monitoring worker's work performance is high, the visual information processing resources of the monitoring worker may be consumed excessively, even though the device performance is maintained at a high level. In such cases, the monitoring worker's fatigue level increases, and his or her performance deteriorates more quickly than necessary. As a result, when device performance deteriorates due to weather changes, a situation may arise in which the sensor information processing resources of the information presentation device and the visual information processing resources of the monitoring worker are insufficient.

Therefore, one or more aspects of the present disclosure aim to reduce the rate at which fatigue accumulates in monitoring workers by appropriately allocating resources between the device and the monitoring workers.

an information presentation device according to one aspect of the present disclosure, comprising: a data receiving unit that receives sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data; a data analysis unit that analyzes the sensor data to analyze the object to be monitored; an equipment performance estimation unit that estimates equipment performance indicating a reliability of a result of the analysis; a task amount determination unit that determines the task amount such that the higher the equipment performance, the lower the task amount of a monitoring worker monitoring the object to be monitored; a display content determination unit that determines content to be displayed using the sensor data so that the content differs depending on the task amount; a display data generation unit that generates display data for displaying the determined content; a work sensor that detects data related to the monitoring worker as work data; and a work performance estimation unit that uses the work data to estimate work performance indicating the efficiency of the work of the monitoring worker , wherein the task amount determination unit determines the task amount such that the higher the equipment performance and the higher the work performance .

A program according to one aspect of the present disclosure causes a computer to function as a data receiving unit that receives sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data, a data analysis unit that analyzes the sensor data to analyze the object to be monitored, an equipment performance estimation unit that estimates equipment performance indicating reliability of the analysis results, a task amount determination unit that determines the task amount such that the higher the equipment performance, the lower the task amount of a monitoring worker monitoring the object to be monitored , a display content determination unit that determines content to be displayed using the sensor data so that it varies depending on the task amount, a display data generation unit that generates display data for displaying the determined content , a work sensor that detects data related to the monitoring worker as work data, and a work performance estimation unit that uses the work data to estimate work performance indicating the efficiency of the work of the monitoring worker , wherein the task amount determination unit determines the task amount such that the higher the equipment performance and the higher the work performance .

An information presentation method according to one aspect of the present disclosure includes receiving sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data, analyzing the sensor data to analyze the object to be monitored, estimating equipment performance indicating a reliability of a result of the analysis, determining a task amount such that the higher the equipment performance, the lower the task amount of a monitoring worker monitoring the object to be monitored, determining content to be displayed using the sensor data such that the content differs depending on the task amount, generating display data for displaying the determined content, detecting data related to the monitoring worker as work data, and using the work data to estimate work performance indicating the efficiency of the work of the monitoring worker, wherein the task amount is determined such that the higher the equipment performance and the higher the work performance .

According to one or more aspects of the present disclosure, the rate at which fatigue accumulates in the monitoring worker can be reduced by appropriately allocating resources between the device and the monitoring worker.

1 is a block diagram illustrating a schematic configuration of an air traffic control system as an information presentation system according to first and fourth embodiments. FIG. 1 is a schematic diagram showing a monitoring operation in a control room. 1 is a block diagram illustrating a schematic configuration of an information display device according to first and fourth embodiments. 1 is a schematic diagram of an image included in a video captured by a camera. 13 is an example of an image included in a video that is displayed on a display when the device performance is evaluated as "high" and the task amount is determined to be "low." 13 is an example of an image included in a video that is displayed on a display when the device performance is evaluated as "medium" and the task amount is determined to be "normal." 13 is an example of an image included in a video that is displayed on a display when the device performance is evaluated as "low" and the task amount is determined to be "high." 1A and 1B are block diagrams showing an example of a hardware configuration. A block diagram showing a schematic configuration of an air traffic control system as an information presentation system according to a second embodiment. FIG. 11 is a block diagram illustrating a schematic configuration of an information display device according to second and third embodiments. FIG. 1 is a first schematic diagram for explaining resources. FIG. 11 is a schematic diagram for explaining resource evaluation. FIG. 2 is a schematic diagram illustrating a first example display for assisting a first observer task of searching for newly arrived aircraft; 1 is a schematic diagram showing a first example of an image included in a video displayed on a display; 11 is a schematic diagram showing a second example of an image included in a video displayed on the display. FIG. FIG. 11 is a schematic diagram showing a third example of an image included in a video displayed on the display.

Embodiment 1.
The first embodiment will be described using an air traffic control system as an example.
FIG. 1 is a block diagram showing a schematic configuration of an air traffic control system 100 serving as an information presentation system according to the first embodiment.
The air traffic control system 100 includes a sensor 110 and an information presentation device 120 .

Sensor 110 is installed in control tower 102 provided at airport 101. Sensor 110 is provided to monitor the nearby space. In other words, sensor 110 detects data for monitoring the monitored object as sensor data. In this case, sensor 110 is a camera for capturing aircraft 103#1, which is the monitored object.

The sensor data collected by the sensor 110 is transmitted to the control room 105 via the sensor data communication path 104 .
The control room 105 is equipped with facilities for performing control work, and monitors are present in the control room 105. For example, the control room 105 is equipped with an information display device 120 that displays information to the monitors. The control room 105 may be located in the control tower 102, or may be located in a remote location. The monitors give control instructions to aircraft, and the instructions are transmitted to the control tower 102 via the control instruction communication path 106, and then transmitted from the control tower 102 to the aircraft 103#1.

FIG. 2 is a schematic diagram showing the monitoring operation in the control room 105. As shown in FIG.
The control room 105 is equipped with an information presentation device 120 and a display 107 that functions as a display unit.

The information presentation device 120 displays the sensor data transmitted from the sensor 110 or the results of processing the sensor data on the display 107. The monitoring worker pays attention to the display 107 and performs the following monitoring tasks.
The first monitor task is to search for and find aircraft appearing in the vicinity of the airport 101 .
The second monitoring task is to confirm the individual information of the discovered aircraft, such as the aircraft type, airline, or flight number.
The third task of the monitor is to check the status of the discovered aircraft, such as its speed, flight position, or aircraft health.

After completing these monitoring tasks, the monitoring personnel decide what control instructions to give to the aircraft.

The information presentation device 120 presents sensor data or the results of processed sensor data to the monitoring worker in order to assist the monitoring worker in his/her work. For example, the information presentation device 120 processes the sensor data by performing image processing to improve visibility or by superimposing information obtained from the results of data analysis. In the first embodiment, the sensor data is assumed to be video data that is video data of the surroundings of the airport 101 captured by the camera, which is the sensor 110, in other words, the space through which aircraft travel.

FIG. 3 is a block diagram illustrating a schematic configuration of the information presentation device 120 according to the first embodiment.
The information presentation device 120 includes a data receiving unit 121 , a data analyzing unit 122 , an apparatus performance estimating unit 123 , a task amount determining unit 124 , a display content determining unit 125 , and a data processing unit 126 .

The data receiving unit 121 receives sensor data sent from the sensor 110.

The data analysis unit 122 analyzes the received sensor data. For example, the data analysis unit 122 analyzes the sensor data to analyze the monitored object. Here, the data analysis unit 122 performs the following tasks as presentation-side tasks, which are tasks on the information presentation device 120 side.
The first proposed task is to detect aircraft in the video, which are objects that are likely to be aircraft.
The second presenter task is the estimation of individual information of the detected aircraft.
The third posed task is the estimation of the detected aircraft states.
These results are used as display content to assist the surveillance worker in his work.

The equipment performance estimation unit 123 calculates the equipment performance that indicates the reliability of the results of the analysis performed by the data analysis unit 122 .
The device performance estimation unit 123 can calculate the device performance by using an estimated likelihood when detecting an aircraft from a video as an index. Furthermore, the device performance estimation unit 123 can also calculate the device performance by using an estimated likelihood of a position, a moving speed, or individual identification information as an index. For example, the device performance estimation unit 123 can calculate the device performance such that the higher the estimated likelihood, the higher the device performance.
Furthermore, the device performance estimation unit 123 may also use as an index an overall or partial statistical quantity of an image included in a video, such as contrast or brightness distribution, etc. For example, the device performance estimation unit 123 may calculate the device performance such that the higher the contrast or brightness, the higher the device performance.

The equipment performance estimation unit 123 may select a representative one from these multiple indicators to represent the equipment performance. Alternatively, the equipment performance estimation unit 123 may calculate a linear sum using these indicators and a predetermined coefficient, and represent the calculated value as the equipment performance.
The apparatus performance estimating section 123 provides the calculated apparatus performance to the task amount determining section 124 .

The task amount determination unit 124 evaluates the equipment performance calculated by the equipment performance estimation unit 123, and determines the task amount of the monitoring worker from the evaluation result. For example, the task amount determination unit 124 determines the task amount such that the higher the equipment performance, the smaller the task amount of the monitoring worker who monitors the monitored object.

Specifically, the task amount determination unit 124 evaluates the device performance calculated by the device performance estimation unit 123 in three stages: high, medium, or low. For example, by setting two thresholds for the estimated likelihood of detecting an aircraft from the image described above, the task amount determination unit 124 can evaluate the device performance in three stages.

The task amount determination unit 124 then determines the task amount of the monitoring worker from the identified evaluation results. For example, if the device performance is rated "high," the analysis results from the data analysis unit 122 can be highly trusted, and the task amount determination unit 124 determines the task amount of the monitoring worker to be "low." If the device performance is rated "medium," the analysis results from the data analysis unit 122 cannot be highly trusted, and the task amount determination unit 124 determines the task amount of the monitoring worker to be "normal." If the device performance is rated "low," the analysis results from the data analysis unit 122 cannot be highly trusted, and the task amount determination unit 124 determines the task amount of the monitoring worker to be "high."

The display content determination unit 125 receives the analysis results of the data analysis unit 122 and the task amount of the monitoring worker determined by the task amount determination unit 124, and determines the display content using the sensor data so that it differs depending on the task amount of the monitoring worker. For example, the display content determination unit 125 can determine whether or not to display a button for the monitoring worker to perform work depending on the task amount. The display content determined here is displayed on the display 107.

The data processing unit 126 functions as a display data generation unit that generates display data for displaying the content determined by the display content determination unit 125. For example, the data processing unit 126 processes the sensor data transferred from the data receiving unit 121 based on the determination of the display content determination unit 125. The processed result is then transmitted to the display 107 for display.

4 to 7 are schematic diagrams for explaining the relationship between the task amount determined by the task amount determination unit 124 and the images included in the video displayed on the display 107. FIG.
FIG. 4 is a schematic diagram of an image included in a video captured by a camera, which is a sensor 110 installed in the control tower 102.
4, two aircraft 103#2 and 103#3 are shown in an image 160#1 captured by a camera. One of the aircraft, 103#2, is an aircraft that has just recently appeared in the vicinity of the airport 101, and the other aircraft, 103#3, is an aircraft that has been around for some time since its appearance.

FIG. 5 is an example of an image included in the video displayed on the display 107 when the device performance is evaluated as "high" and the task amount is determined to be "low."
Similarly to FIG. 4, image 160#2 shown in FIG. 5 also shows aircraft 103#2 that has just appeared and aircraft 103#3 that has appeared for some time.
The data analysis unit 122 has already detected the aircraft 103#2 and the aircraft 103#3 as newly appeared aircraft when they appeared in space, and has also completed estimation of the individual information of the aircraft 103#3.

Here, since the analysis results from the data analysis unit 122 can be trusted, the data analysis unit 122 performs the first presentation side task and the second presentation side task, and the first monitoring side task and the second monitoring side task of the monitoring work worker are omitted, thereby reducing the amount of tasks for the monitoring work worker.

Therefore, the aircraft status input pop-up 161 displays the estimated results of the individual information estimated by the data analysis unit 122, such as the speed, approach distance, and whether or not there is an abnormality of aircraft 103#3.

The task assigned to the monitoring worker here is to check the content displayed in the aircraft status input pop-up 161, and if it is correct, to use an input unit not shown to press an approval button not shown, or if there is an item that needs to be corrected, to use an input unit not shown to input the correction for that item and press an approval button not shown. The accuracy of the displayed information can be determined by visually checking signals from other sensors such as radar, and by the content of communications with the pilot. This corresponds to the third monitoring task of the monitoring tasks mentioned above.

FIG. 6 is an example of an image included in the video displayed on the display 107 when the device performance is evaluated as "medium" and the task amount is determined to be "normal."
Similarly to FIG. 4, image 160#3 shown in FIG. 6 also shows aircraft 103#2 that has just appeared and aircraft 103#3 that has been appearing for some time.
The data analysis unit 122 has already detected the aircraft 103#2 and the aircraft 103#3 as newly appeared aircraft when they appeared in space, and has also completed estimation of the individual information of the aircraft 103#3.

Here, the data analysis unit 122 performs the first presenting task, and the first monitoring task of the monitoring worker can be omitted, but the reliability of the analysis results by the data analysis unit 122 is not very high, so the second monitoring task of the monitoring worker cannot be omitted. For this reason, the model selection button area 162 is displayed, and the model estimation result of aircraft 103#3 performed by the data analysis unit 122 is displayed, with multiple buttons corresponding to models with high probability lined up as candidates. Also, the aircraft status input pop-up 161 displays the estimated results of the aircraft's speed, proximity distance, and the presence or absence of abnormalities, as in FIG. 5.

The monitoring worker uses an input unit (not shown) to select the button corresponding to the correct model from the buttons displayed in the model selection button area 162. The monitoring worker also checks the contents displayed in the aircraft status input pop-up 161, judges whether they are correct as explained in FIG. 5, makes corrections as necessary, and presses the approve button. These correspond to the second and third monitoring tasks mentioned above.

FIG. 7 is an example of an image included in the video displayed on the display 107 when the device performance is evaluated as "low" and the task amount is determined to be "high."
Similarly to FIG. 4, image 160#4 shown in FIG. 7 also shows aircraft 103#2 that has just appeared and aircraft 103#3 that has been appearing for some time.

The data analysis unit 122 has already detected the aircraft 103#2 and the aircraft 103#3 as newly appeared aircraft when they appeared in space, and has also completed estimation of the individual information of the aircraft 103#3.
However, if the evaluation of the equipment performance is low, the tasks assigned to the monitoring operator cannot be omitted.
Therefore, similarly to the case where the device performance is rated as "medium" as shown in FIG. 6, the image 160#4 displays the machine state input pop-up 161 and the model selection button area 162.

The data analysis unit 122 detects objects in the image that are likely to be aircraft. A discovery confirmation button area 163 is displayed near objects detected as candidates. The surveillance worker determines whether the detected object is an aircraft or not, and inputs whether the detection was correct or incorrect by selecting a displayed button via an input unit (not shown).

Here, it is assumed that some time has passed since aircraft 103#3 was detected, and that the detection result has already been determined to be correct by a monitoring worker.

As described above, when device performance is poor, the monitoring worker performs all of the first monitoring task, the second monitoring task, and the third monitoring task described above.

A part or all of the data analysis unit 122, device performance estimation unit 123, task amount determination unit 124, display content determination unit 125 and data processing unit 126 described above can be configured, for example, as shown in FIG. 8 (A), by a memory 10 and a processor 11 such as a CPU (Central Processing Unit) that executes a program stored in the memory 10. In other words, the information presentation device 120 can be realized by a so-called computer. Such a program may be provided through a network, or may be provided by recording it on a recording medium. That is, such a program may be provided, for example, as a program product.

In addition, some or all of the data analysis unit 122, the device performance estimation unit 123, the task amount determination unit 124, the display content determination unit 125 and the data processing unit 126 can be configured as a processing circuit 12 such as a single circuit, a composite circuit, a processor operated by a program, a parallel processor operated by a program, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array), as shown in FIG. 8(B).
As described above, the data analysis section 122, the device performance estimation section 123, the task amount determination section 124, the display content determination section 125 and the data processing section 126 can be realized by a processing circuit network.

The data receiving unit 121 can be realized by a communication interface such as a NIC (Network Interface Card).
The information presentation device 120 may also include an input interface (not shown) such as a keyboard or a mouse that functions as an input unit.

As described above, according to the first embodiment, the amount of tasks assigned to the monitoring worker can be adjusted according to the device performance. In other words, the sensor information processing resources of the information presentation device 120 and the visual information processing resources of the monitoring worker can be appropriately allocated. This makes it possible to minimize the rate at which the monitoring worker accumulates fatigue.

In addition, in embodiment 1, the operations performed by the monitoring worker are button operations or keyboard input, but embodiment 1 is not limited to such examples.

In addition, in the embodiment described above, the first presenting side task, the second presenting side task, and the third presenting side task are set as the presenting side task, but the first embodiment is not limited to such an example. For example, the task amount determination unit 124 may define performance indicators and thresholds corresponding to the check items corresponding to each of the first presenting side task, the second presenting side task, and the third presenting side task, and determine whether or not to omit each check item. In addition, the task amount determination unit 124 may adjust the task amount by setting multiple thresholds for each check item and making the check method more detailed or simple.

In addition, when detecting aircraft, the data analysis unit 122 can learn in advance the relationship between previously obtained images of aircraft and individual information such as model, and can detect the appearance of an aircraft from images obtained during operation and estimate individual information.

In the first embodiment described above, aircraft information (e.g., size, speed of movement, etc.) obtained from a radar sensor that detects aircraft flying around the airport 101 may be added as sensor data. In addition, data obtained from a sensor for detecting weather conditions around the airport 101 may be added to the sensor data. Adding these data is expected to improve the reliability of the analysis results by the data analysis unit 122 as well as the reliability of the output results of the device performance estimation unit 123.

Embodiment 2.
The second embodiment will also be described using an air traffic control system as an example.
FIG. 9 is a block diagram showing a schematic configuration of an air traffic control system 200 serving as an information presentation system according to the second embodiment.
The air traffic control system 200 includes a sensor 110, an information presentation device 220, and an operation sensor 240.

The sensor 110 of the air traffic control system 200 of embodiment 2 is similar to the sensor 110 of the air traffic control system 100 of embodiment 1.

The work sensor 240 detects data related to the monitoring worker as work data. For example, the work sensor 240 is a sensor for measuring the performance of the monitoring worker. Specifically, the work sensor 240 collects the monitoring worker's gaze, movements such as button operation or keyboard operation, facial expressions, heart rate, breathing, and other biological data as work data. The work sensor 240 may be attached directly to the monitoring worker's body to directly collect the biological data, or may be collected non-contact using a camera or radio waves, etc.

FIG. 10 is a block diagram illustrating a schematic configuration of an information presentation device 220 according to the second embodiment.
The information presentation device 220 includes a data receiving unit 221 , a data analysis unit 122 , an equipment performance estimation unit 123 , a task amount determination unit 224 , a display content determination unit 125 , a data processing unit 126 , and a task performance estimation unit 227 .

The data analysis unit 122, device performance estimation unit 123, display content determination unit 125 and data processing unit 126 of the information presentation device 220 in embodiment 2 are similar to the data analysis unit 122, device performance estimation unit 123, display content determination unit 125 and data processing unit 126 of the information presentation device 120 in embodiment 1.

The data receiving unit 221 receives the sensor data sent from the sensor 110 .
Furthermore, the data receiving unit 221 receives biological data sent from the work sensor 240 .
The received sensor data is provided to the data analysis unit 122 and the data processing unit 126 , and the received biological data is provided to the task performance estimation unit 227 .

The work performance estimation unit 227 receives biometric data such as the movements, facial expressions, gaze, and heart rate variability of the supervisory worker, and estimates work performance indicating the efficiency of the supervisory worker's work from the biometric data.

For example, the work performance estimation unit 227 can determine the work performance as the eye movement speed, button operation speed, or character input speed of the monitoring worker. The work performance estimation unit 227 can also determine the total of a combination of a number of speeds selected from these.
Here, the line of sight movement speed can be calculated as the reciprocal of the time from when the information presentation device 220 detects an object presumed to be an aircraft until when the monitoring worker moves his/her line of sight to the detected position of the object.
The button operation speed can be calculated as the reciprocal of the time from when the confirmation button appears on the screen to when the monitoring worker finishes operating the button.
The character input speed can be calculated as the reciprocal of the time from when the status confirmation pop-up is displayed until the supervisor finishes inputting characters and presses the approval button. The character input speed can also be calculated as the keyboard key operation speed, which is the number of key operations by the supervisor divided by the time required for those operations.

In addition, if the work performance estimation unit 227 detects a negative psychological state from the facial expression of the monitoring worker, or detects an abnormal physiological state from the heart rate or breathing, it may determine the work performance by multiplying the value calculated as described above by a value of 1 or less, or may set the work performance value to zero.
Then, the task performance estimating section 227 provides the calculated task performance to the task amount determining section 224 .

The task amount determination unit 224 determines the task amount so that the higher the equipment performance and the higher the work performance, the smaller the task amount of the monitoring worker. Here, the task amount determination unit 224 evaluates the equipment performance calculated by the equipment performance estimation unit 123 and the work performance estimated by the work performance estimation unit 227, and determines the task amount of the monitoring worker from the evaluation results.

For example, the task amount determination unit 224 expresses the total resources, including the devices and monitoring workers that can be allocated to task processing, as a linear sum of the device performance and the work performance. The coefficients associated with each are predefined, and the product of the coefficients is the device resource and the work resource, respectively.

The "total resources" shown in Figure 11 is the sum of the device resources and the work resources. The dotted lines in Figure 11 represent the required resources, which are the resources required to complete the first monitor task, the second monitor task, and the third monitor task.

The "resource allocation" shown in Figure 11 represents the result of adjusting the equipment resources and the work resources. The adjustment amount of the equipment resources is zero, but the adjusted work resources are the work resources minus the surplus of the total resources over the required resources.

The task amount determination unit 224 determines the amount of tasks to be assigned to the monitoring worker by evaluating the total resources as shown in Figure 12. For example, the task amount determination unit 224 determines the amount of tasks in three levels, "high," "normal," and "low," by using two thresholds for the adjusted work resources.

If the task amount is judged to be "small", the same contents as those in Fig. 5 are displayed on the display 107. The processing contents and monitoring tasks are the same as those explained in Fig. 5.
If the task amount is determined to be "normal", the same contents as those in Fig. 6 are displayed on the display 107. The processing contents and monitoring tasks are the same as those explained in Fig. 6.
If the task amount is determined to be "large", the same contents as those in Fig. 7 are displayed on the display 107. The processing contents and monitoring tasks are the same as those explained in Fig. 7.

A part or all of the work performance estimation unit 227 described above can be configured, for example, as shown in FIG. 8(A), by a memory 10 and a processor 11 such as a CPU that executes a program stored in the memory 10.
In addition, a part or the whole of the task performance estimation unit 227 can be configured by the processing circuitry 12, for example, as shown in FIG. 8(B).
As described above, the task performance estimating unit 227 can be realized by a processing circuit network.

As described above, according to the second embodiment, the amount of tasks assigned to the monitoring worker can be adjusted according to the device performance and the work performance. In other words, the sensor information processing resources of the information presentation device 220 and the visual information processing resources of the monitoring worker can be appropriately allocated. This makes it possible to minimize the rate at which the monitoring worker accumulates fatigue, while also maintaining the quality of the monitoring task.

External information such as weather forecasts for the area around the airport 101, predetermined aircraft operation plans, and personnel deployment plans related to air traffic control operations may be added as input information to the task amount determination unit 224. By adding this information to the input, the task amount determination unit 224 can predict fluctuations in required resources, fluctuations in equipment performance, and fluctuations in work performance due to fatigue accumulation or personnel changes among monitoring workers, and can also flexibly determine resource allocation. For example, by changing the threshold for evaluating total resources, decisions can be made such as allowing a temporary increase in task amount or encouraging early personnel changes.

Specifically, the task amount determination unit 224 can predict the deterioration and recovery of equipment performance over time by receiving weather forecasts for the area around the airport. This allows the task amount determination unit 224 to evaluate the amount of tasks that should be handled by the monitoring worker and estimate the resources required for each monitoring task. For example, when equipment performance deteriorates, the task amount determination unit 224 may increase the task amount of the monitoring worker by reducing the threshold for total resources.

Furthermore, by receiving the aircraft operation plan as input, the task amount determination unit 224 can predict an increase in the task amount due to an increase in the number of aircraft subject to control per period. This allows the task amount determination unit 224 to determine whether the increase in the task amount will continue from the aircraft operation plan. If the increase in the task amount continues, it can be predicted that work performance will decrease, and therefore the task amount determination unit 224 may reduce the task amount of the monitoring worker by increasing the threshold value for evaluating the total resources.

Furthermore, by receiving an input of a personnel allocation plan related to air traffic control operations, the task amount determination unit 224 can predict time series fluctuations in the amount of task to be assigned to each person from the personnel allocation plan. As a result, since each person's work performance declines over time depending on the amount of task assigned, the task amount determination unit 224 can predict time series fluctuations in each person's work performance taking this into account. When the work performance of a monitoring worker declines, the task amount determination unit 224 may reduce the task amount of the monitoring worker by increasing the threshold for evaluating the total resources.

As described above, the task amount determination unit 224 may increase the task amount of the monitoring worker when it is predicted that the device performance will decline, and may decrease the task amount when it is predicted that the work performance will decline.

There may be cases where the total resources are less than the required resources, or where the prediction of equipment performance and work performance as described above results in a prediction that the total resources are less than the required resources. In such cases, the information presentation device 220 may warn the supervisor of the need for assistant personnel or substitute personnel.

In addition, the work performance estimation unit 227 may pre-learn the relationship between the biometric data obtained from the work sensor 240 and the work performance of the monitoring worker, and estimate the work performance from the biometric data obtained during operation.

Embodiment 3.
If the amount of work assigned to the monitoring worker continues to be small, the monitoring worker's senses may become dull and his/her work performance may decline. In this case, it is effective to intentionally vary the amount of work assigned to the monitoring worker.

The third embodiment will also be described using an air traffic control system as an example.
As shown in FIG. 9 , an air traffic control system 300 serving as an information presentation system according to the third embodiment includes a sensor 110 , an information presentation device 320 , and a work sensor 240 .

The sensor 110 of the air traffic control system 300 according to the third embodiment is similar to the sensor 110 of the air traffic control system 100 according to the first embodiment.
The working sensor 240 of the air traffic control system 300 according to the third embodiment is similar to the working sensor 240 of the air traffic control system 200 according to the second embodiment.

As shown in FIG. 10, the information presentation device 320 in embodiment 3 includes a data receiving unit 221, a data analysis unit 122, an apparatus performance estimation unit 123, a task amount determination unit 224, a display content determination unit 325, a data processing unit 126, and a work performance estimation unit 227.

The data analysis unit 122, the device performance estimation unit 123 and the data processing unit 126 of the information presentation device 320 in the third embodiment are similar to the data analysis unit 122, the device performance estimation unit 123 and the data processing unit 126 of the information presentation device 120 in the first embodiment.
In addition, the data receiving unit 221, task amount determination unit 224, and work performance estimation unit 227 of the information presentation device 320 in embodiment 3 are similar to the data receiving unit 221, task amount determination unit 224, and work performance estimation unit 227 of the information presentation device 220 in embodiment 2.

The display content determination unit 325 receives the analysis results from the data analysis unit 122 and the task amount of the monitoring worker determined by the task amount determination unit 224, and determines the display content of the display 107 according to the task amount of the monitoring worker.
In the third embodiment, the display content determination unit 325 switches between display content corresponding to a certain task amount and display content corresponding to another task amount. In other words, the display content determination unit 325 changes the content to be displayed in accordance with the task amount according to time.

For example, if the task amount is judged to be "small," the same content as in FIG. 5 is displayed on the display 107. The processing content and monitoring tasks are the same as those explained in FIG. 5. The same content as in FIG. 6 is also displayed. The processing content and monitoring tasks are the same as those explained in FIG. 6. The display of FIG. 5 and the display of FIG. 6 may be determined regularly, such as alternating, or may be set randomly so that the display ratio over a certain period of time is constant.

If the task amount is judged to be "normal", the same contents as in FIG. 6 are displayed on the display 107. The processing contents and monitoring tasks are the same as those explained in FIG. 6. The same contents as in FIG. 7 are also displayed. The processing contents and monitoring tasks are the same as those explained in FIG. 7. The display of FIG. 6 and the display of FIG. 7 may be determined regularly, such as alternating, or may be set randomly so that the display ratio over a certain period of time is constant.

If the task volume is determined to be "high," the same content as in FIG. 7 is displayed on the display 107. The processing content and monitoring tasks are the same as those described in FIG. 7.

In this way, it is possible to intentionally vary the amount of tasks assigned to monitoring workers, thereby preventing the monitoring workers' senses from becoming dulled in relation to the monitoring work and maintaining the quality of the monitoring tasks.

Embodiment 4.
As a method of using the aircraft detection results by the data analysis unit 122 to assist the first monitoring task, it is also effective to perform control to guide the line of sight of the monitoring worker, making it possible to finely adjust the amount of work.

As shown in FIG. 1, an air traffic control system 400 as an information presentation system relating to embodiment 4 includes a sensor 110 and an information presentation device 420.

The sensor 110 of the air traffic control system 400 of embodiment 4 is similar to the sensor 110 of the air traffic control system 100 of embodiment 1.

As shown in FIG. 3, the information presentation device 420 in embodiment 4 includes a data receiving unit 121, a data analysis unit 122, an apparatus performance estimation unit 123, a task amount determination unit 124, a display content determination unit 425, and a data processing unit 126.

The data receiving unit 121, data analysis unit 122, device performance estimation unit 123, task amount determination unit 124 and data processing unit 126 of the information presentation device 420 in embodiment 4 are similar to the data receiving unit 121, data analysis unit 122, device performance estimation unit 123, task amount determination unit 124 and data processing unit 126 of the information presentation device 120 in embodiment 1.

The display content determining unit 425 determines the display content of the display 107 in accordance with the task amount of the monitoring worker determined by the task amount determining unit 124, as in the first embodiment.
Furthermore, for example, when a monitoring worker gives an instruction via an input unit (not shown), the display content determination unit 425 determines to display content to assist the monitoring worker in his or her tasks.

For example, the display content determination unit 425 can decide to display content indicating the position of a monitored object detected by analysis by the data analysis unit 122. For example, the display content determination unit 425 decides the display content for displaying a screen such as the one below, based on the aircraft detection results by the data analysis unit 122, to assist the monitoring worker in the first monitoring task. Figures 13 to 16 below show images included in video based on data processed by the data processing unit 126 in accordance with the display content determined by the display content determination unit 425.

For example, FIG. 13 is a diagram illustrating a first example display to assist a first observer task of searching for newly arrived aircraft.
In the image 160#5 shown in FIG. 13, an indicator display window 164 is provided at a specific position of the image indicated by the sensor data.

An arrow 164a is displayed as an indicator in the indicator display window 164. When the data analysis unit 122 detects an object in the image that is estimated to be an aircraft, the arrow 164a indicates the position where the object was detected. In other words, the arrow 164a is displayed so as to guide the line of sight in a specific direction as viewed from a certain point on the display 107 as the origin. Note that the method of guidance may be a different symbol, such as a symbol resembling a human eye, pointing in the direction of the object, instead of the arrow 164a.

In this case, the monitoring worker uses an input unit (not shown) to operate the cursor on image 160#5, align it with the object's location, and click to confirm that the new aircraft has been detected. This corresponds to pressing the button described in Figure 7.

If the first monitoring task is to be omitted in order to adjust the amount of tasks, this can be achieved by closing the window displaying the indicator.

In addition, by adjusting the difficulty of the first monitoring task, rather than imposing the first monitoring task, the prevention of sensory dulling as shown in embodiment 3 can be achieved. For example, the display content determination unit 425 may encourage the monitoring worker to search for the aircraft by scanning his/her line of sight by opening the indicator display window 164 but not displaying the indicator, as in image 160#6 shown in FIG. 14. In addition, the display content determination unit 425 may encourage the monitoring worker to use more visual information resources for the first monitoring task without relying on the information presentation device 420, for example, by delaying the time between opening the indicator display window and displaying the indicator.

As another control to guide the gaze of the monitoring worker, the display content determination unit 425 may use a method such as changing the contrast for each part on the display 107.

An image 160#7 shown in FIG. 15 is an example in which the contrast of an image portion including a detected object is changed and edges are emphasized.
Also, as in image 160#8 shown in FIG. 16, the detected object may be enlarged to guide the gaze of the monitoring worker.

In the above-described embodiments 1 to 4, the information presentation devices 120 to 420 do not include a display 107, but the information presentation devices 120 to 420 may include a display 107.

100, 200, 300, 400 Air traffic control system, 107 Display, 110 Sensor, 120, 220, 320, 420 Information presentation device, 121, 221 Data receiving unit, 122 Data analysis unit, 123 Device performance estimation unit, 124, 224 Task amount determination unit, 125, 325 Display content determination unit, 126 Data processing unit, 227 Work performance estimation unit.

Claims (11)

a data receiving unit that receives sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data;
a data analysis unit that analyzes the sensor data to analyze the monitored object;
an apparatus performance estimation unit for estimating an apparatus performance indicating a reliability of a result of the analysis;
a task amount determination unit that determines the task amount so that the higher the device performance is, the smaller the task amount of the monitoring worker who monitors the monitoring object is;
a display content determination unit that determines a content to be displayed using the sensor data so as to vary depending on the task amount;
a display data generating unit that generates display data for displaying the determined content;
a work sensor that detects data related to the monitoring worker as work data;
a work performance estimation unit that estimates a work performance that represents the efficiency of the work of the monitoring worker using the work data ,
The task amount determination unit determines the task amount such that the higher the device performance and the higher the work performance, the smaller the task amount becomes.
An information presentation device comprising: The information presentation device according to claim 1 , wherein the task amount determination unit increases the task amount when it is predicted that the device performance will decrease. The information presentation device according to claim 1 , wherein the task amount determination unit reduces the task amount when it is predicted that the work performance will decrease. a data receiving unit that receives sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data;
a data analysis unit that analyzes the sensor data to analyze the monitored object;
an apparatus performance estimation unit for estimating an apparatus performance indicating a reliability of a result of the analysis;
a task amount determination unit that determines the task amount so that the higher the device performance is, the smaller the task amount of the monitoring worker who monitors the monitoring object is;
a display content determination unit that determines a content to be displayed using the sensor data so as to vary depending on the task amount;
a display data generating unit that generates display data for displaying the determined content ,
The task amount determination unit increases the task amount when it is predicted that the device performance will be degraded.
An information presentation device comprising: a data receiving unit that receives sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data;
a data analysis unit that analyzes the sensor data to analyze the monitored object;
an apparatus performance estimation unit for estimating an apparatus performance indicating a reliability of a result of the analysis;
a task amount determination unit that determines the task amount so that the higher the device performance is, the smaller the task amount of the monitoring worker who monitors the monitoring object is;
a display content determination unit that determines a content to be displayed using the sensor data so as to vary depending on the task amount;
a display data generating unit that generates display data for displaying the determined content ,
The display content determining unit determines whether or not to display a button for the monitoring worker to perform a task according to the task amount.
An information presentation device comprising: The information presentation device according to claim 1 , wherein the display content determination unit changes the content to be displayed in accordance with the task amount according to time. 5. The information presentation device according to claim 1 , wherein the display content determining unit determines whether or not to display a button for the monitor worker to perform a task, depending on the task amount. 6. The information presentation device according to claim 1 , wherein the display content determination unit determines to display content for assisting the monitoring worker in performing a task using a result of the analysis. The information presentation device according to claim 8 , wherein the display content determination unit displays content indicating a position of the monitored object detected by the analysis. Computer,
a data receiving unit that receives sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data;
a data analysis unit that analyzes the sensor data to analyze the monitored object;
an apparatus performance estimation unit for estimating an apparatus performance representative of the reliability of the result of the analysis;
a task amount determination unit that determines the task amount such that the higher the device performance is, the smaller the task amount of the monitoring worker monitoring the monitoring object is;
a display content determination unit that determines content to be displayed using the sensor data so as to vary depending on the task amount ;
a display data generating unit that generates display data for displaying the determined content;
A work sensor that detects data related to the monitoring worker as work data; and
a work performance estimation unit that estimates work performance representing the efficiency of the work of the monitoring worker using the work data ;
The task amount determination unit determines the task amount such that the higher the device performance and the higher the work performance, the smaller the task amount becomes.
A program characterized by. receiving sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data;
Analyzing the sensor data to perform an analysis of the monitored object;
estimating an apparatus performance representative of a degree of confidence in the results of said analysis;
determining the amount of work to be performed by a monitoring worker for monitoring the object to be monitored such that the higher the performance of the device is, the smaller the amount of work to be performed by the monitoring worker for monitoring the object to be monitored is;
determining content to be displayed using the sensor data so as to vary depending on the task amount;
generating display data for displaying the determined content ;
Detecting data relating to the monitoring worker as work data;
An information presentation method for estimating a work performance representing an efficiency of a work of the monitoring worker by using the work data, comprising:
The task amount is determined so that the higher the device performance and the higher the work performance, the smaller the task amount is.
An information presentation method comprising:

Images