JP7741542B2 - Surveillance support system, surveillance support method and program - Google Patents

Description

The present invention relates to a monitoring support system, a monitoring support method, and a program.

Patent document 1 discloses a system for monitoring the flight of UAVs (unmanned aerial vehicles).

Japanese Patent Application Laid-Open No. 2021-099846

However, the system described in Patent Document 1 does not allow on-site monitors to be instructed on the items they should check.

The present invention was made in light of this background, and aims to provide technology that can specify inspection items on-site.

The primary invention of the present invention for solving the above problems is a monitoring support system comprising an item setting unit that accepts the specification of check items to be checked by an observer, a sending unit that sends the check items to the observer's terminal, a receiving unit that receives from the terminal the check status of the check items checked by the observer, and a status display unit that displays the check status.

Other problems and solutions disclosed in this application will be made clear in the detailed description of the invention and drawings.

This invention allows for on-site inspection items to be specified.

1 is a diagram illustrating an example of the overall configuration of a monitoring support system according to an embodiment of the present invention. FIG. 2 illustrates an example of a hardware configuration of a management server 2. FIG. 2 illustrates an example of the software configuration of a management server 2. FIG. 10 is a diagram showing an example of a screen 4 displayed to a center staff member. FIG. 2 is a diagram illustrating the operation of the monitoring support system of the present embodiment. FIG. 10 is a diagram showing an example of a screen related to sending a check request. FIG. 10 is a diagram showing an example of a screen on the monitor terminal 1 for accepting a check request. FIG. 10 is a diagram showing an example of a display screen of the management server 2 in which the check state has changed. FIG. 7 is a diagram showing an example of a screen 70 that displays a check state.

<Summary of the Invention>
The present invention will be described by listing the contents of the embodiments. For example, the present invention has the following configuration.
[Item 1]
an item setting unit that accepts designation of check items that should be checked by an observer;
a transmission unit that transmits the check items to the monitor's terminal;
a receiving unit that receives from the terminal the check status of the check items checked by the monitor;
a status display unit that displays the check status;
A monitoring support system comprising:
[Item 2]
Item 1, a monitoring support system comprising:
a location information acquisition unit that acquires the location of the terminal from the terminal;
a map display unit that displays a map and displays the location of the terminal on the map;
A monitoring support system further comprising:
[Item 3]
Item 1, a monitoring support system comprising:
the location information acquisition unit acquires the location of the monitored object,
the map display unit displays the position of the monitored object;
A monitoring support system characterized by the above.
[Item 4]
Item 3. The monitoring support system according to item 3,
the status display unit displays the check status on the map;
A monitoring support system characterized by the above.
[Item 5]
5. The monitoring support system according to any one of items 1 to 4,
an item storage unit that stores the items;
an item setting unit that receives input of the items and registers them in the item storage unit;
A monitoring support system further comprising:
[Item 6]
6. The monitoring support system according to any one of items 1 to 5,
the transmitting unit transmits the check items together with the designation of the monitoring target;
the receiving unit receives the check status together with the designation of the monitoring target;
A monitoring support system characterized by the above.
[Item 7]
A step of accepting designation of check items to be checked by an observer;
transmitting the check items to a terminal of the monitor;
receiving from the terminal the check status of the check items checked by the monitor;
displaying the checked state;
A monitoring support method characterized by being executed by a computer.
[Item 8]
A step of accepting designation of check items to be checked by an observer;
transmitting the check items to a terminal of the monitor;
receiving from the terminal the check status of the check items checked by the monitor;
displaying the checked state;
A program that causes a computer to execute the following.

<System Overview>
A monitoring support system according to one embodiment of the present invention will be described below. The monitoring support system of this embodiment supports checking the inspection target and the conditions surrounding the inspection target. In this embodiment, the inspection target is a drone. Personnel (hereinafter referred to as monitors) stationed within the drone's flight area check the drone's aircraft and the conditions within the flight area. The results of the monitors' checks (hereinafter referred to as check results) are aggregated on a server at the center. The center can display a list of the check results by each monitor to check whether there are any problems with the aircraft or flight environment, making it easy to understand the drone's flight status. Employees at the center (hereinafter referred to as center staff) can request monitors to check the drone when it is in operation. The center can be, for example, a drone control room.

<System Configuration>
1 is a diagram showing an example of the overall configuration of a monitoring support system according to this embodiment. The monitoring support system according to this embodiment includes a management server 2. The management server 2 is communicably connected to an observer terminal 1 via a communication network 3. The communication network 3 is, for example, the Internet, and is constructed using a public telephone line network, a mobile phone line network, a wireless communication path, Ethernet (registered trademark), or the like.

The monitor terminal 1 is a computer operated by a monitor. The monitor terminal 1 can be realized, for example, as a smartphone, tablet computer, or personal computer. Multiple monitors may be stationed in the drone flight area, and therefore multiple monitor terminals 1 may also exist.

Management server 2 is a computer that manages the results of checks performed by monitors. In this embodiment, it is assumed that management server 2 is operated by a center staff member, but center staff may also access management server 2 using a terminal. Management server 2 may be a general-purpose computer such as a workstation or personal computer, or may be logically realized using cloud computing.

<Management Server>
FIG. 2 is a diagram illustrating an example of the hardware configuration of the management server 2. Note that the illustrated configuration is an example, and other configurations may also be used. The management server 2 includes a CPU 201, memory 202, storage device 203, communication interface 204, input device 205, and output device 206. The storage device 203 stores various data and programs, and is, for example, a hard disk drive, solid state drive, or flash memory. The communication interface 204 is an interface for connecting to the communication network 3, and is, for example, an adapter for connecting to Ethernet (registered trademark), a modem for connecting to a public telephone network, a wireless communication device for wireless communication, a USB (Universal Serial Bus) connector or an RS232C connector for serial communication, etc. The input device 205 is used to input data, and is, for example, a keyboard, mouse, touch panel, button, microphone, etc. The output device 206 is used to output data, and is, for example, a display, printer, speaker, etc. Each functional unit of the management server device 2 described below is realized by the CPU 201 reading a program stored in the storage device 203 into the memory 202 and executing it, and each storage unit of the management server 2 is realized as part of the storage area provided by the memory 202 and the storage device 203.

<Software configuration>
3 is a diagram showing an example of the software configuration of the management server 2. The management server 2 includes an observer information update unit 211, an aircraft information update unit 212, an item setting unit 213, a check request sending unit 214, a check status receiving unit 215, a map display unit 216, a status display unit 217, an observer information storage unit 231, an aircraft information storage unit 232, a check item storage unit 233, and a check status storage unit 234.

<Storage section of management server>
The monitor information storage unit 231 stores information about monitors (hereinafter referred to as monitor information). The monitor information may include an monitor ID that identifies the monitor, the monitor's name, the monitor's current location, and the date and time when the current location was acquired. The monitor information storage unit 231 can, for example, periodically receive the monitor's current location (the current location of the monitor terminal 1 identified by the monitor terminal 1 using GPS or the like) from the monitor terminal 1 and update the current location and date and time. The monitor information storage unit 231 can also store a history of the monitor's current location (i.e., multiple pieces of monitor information).

The air vehicle information storage unit 232 stores information about the drone being monitored (hereinafter referred to as air vehicle information). The air vehicle information may include an air vehicle ID that identifies the drone, the air vehicle's current position, altitude, and the date and time the current position was acquired. The air vehicle information may also include information about the air vehicle's flight path. The air vehicle information storage unit 232 can also store a history of the drone's current position (i.e., multiple pieces of air vehicle information).

The check item memory unit 233 stores information (hereinafter referred to as check item information) including items (check items) to be checked by the monitor. Check item information may include a set ID that identifies a group of one or more check items, an item ID that identifies the check item, an icon, and check content. The set ID may be a condition for identifying a specific monitoring target, such as a specific drone model, or a condition for identifying a specific monitor, or a combination of these (having a specific monitor check specific check items for a specific type of drone). The icon specifies the icon image that is displayed when displaying the check items on the monitor terminal 1. The icon may be set to an icon image, or information that identifies the icon image may be set. The check content is an explanation of the item to be checked.

The check status memory unit 234 stores information (hereinafter referred to as check status information) including the check status of check items by an observer. The check status information can include the check status of each check item in association with an observer ID that identifies the observer, an aircraft ID that indicates the drone being monitored by the observer, and the date and time when the check status was obtained from the observer terminal 1. The check status can be, for example, checked or unchecked. Note that it may be possible to set multiple statuses for the check status.

<Functional part of the management server>
The observer information update unit 211 updates the observer information. For example, the observer information update unit 211 can periodically receive the current location of the observer from the observer terminal 1, create observer information including the received current location and current date and time, and register this in the observer information storage unit 231. The observer information update unit 211 can also accept input from a center staff member and update the observer information.

The air vehicle information update unit 212 updates air vehicle information. For example, the air vehicle information update unit 212 can periodically receive information such as the current position and altitude from the drone, create air vehicle information including the received current position and altitude as well as the current date and time, and register this in the air vehicle information storage unit 232. The air vehicle information update unit 212 can also accept input from center staff and update the air vehicle information.

The item setting unit 213 sets check items. The item setting unit 213 can accept, for example, from a center staff member, the specification of check items that should be checked by monitors. In other words, check items are customizable. The item setting unit 213 can create check item information and register it in the check item storage unit 233. The item setting unit 213 can accept input for multiple check items belonging to the same group, issue a new set ID, and create check item information that includes the set ID.

The check request sending unit 214 sends a request for a check (hereinafter referred to as a check request) to the monitor terminal 1. Check items are set in the check request. For example, the check request sending unit 214 can receive a destination monitor designation from a center staff member and send the check items to the monitor terminal 1 of the designated monitor. This allows the center staff member to request the monitor to check the aircraft and surrounding conditions via a tablet or the like. The check request sending unit 214 can also set information (aircraft ID) indicating the monitor target (drone) in the check request. This allows the monitor to check multiple monitor targets.

The check request sending unit 214 can also read check item information corresponding to a specific set ID (which may be specified by a center staff member or a default set ID may be used) from the check item storage unit 233 and send an input form for checking each check item to the monitor terminal 1. This input form can include, for example, icons that can be tapped.

The check request sending unit 214 can also send the current location of the drone to the monitor terminal 1 that sent the check request. The check request sending unit 214 can periodically read the current location (altitude may also be added) from the aircraft information storage unit 232 for the aircraft ID set in the check request sent to the monitor terminal 1, and send it together with the aircraft ID to the monitor terminal 1.

The check status receiving unit 215 can receive the check status of check items from the monitor terminal 1. When any check item is checked (or unchecked), the monitor terminal 1 sends the check status of all check items to the management server 2. The check status receiving unit 215 receives this information, creates check status information that sets the status of the received check items, the monitor ID indicating the monitor associated with the monitor terminal 1 that received the information, and the current date and time, and registers this information in the check status memory unit 234.

The map display unit 216 displays map information. For example, the map display unit 216 can accept a specific location specification from a center staff member, access a map server, etc., and retrieve and display a tile image corresponding to the accepted location and surrounding tile images.

The map display unit 216 can also display the location of the monitor terminal 1 on a map. The map display unit 216 can obtain the current location of each monitor terminal 1 from the monitor information storage unit 231 and display a marker indicating the monitor at that location. This allows center staff to check the location of the monitor on the map.

The map display unit 216 can also display the location of the monitored object (drone) on a map. The map display unit 216 can obtain the current location of each drone from the aircraft information storage unit 232 and display a marker indicating the drone at that location. This allows center staff to check the location of the drone on the map.

The map display unit 216 can also display a map on the monitor terminal 1. For example, the map display unit 216 may transmit map data to the monitor terminal 1, or may transmit the center position and scale of the map to the monitor terminal 1, and the monitor terminal 1 may access, for example, a map server to obtain and display the map data.

The status display unit 217 can display the check status received from the monitor terminal 1. The status display unit 217 can display the check status on a map. The status display unit 217 can display the check status above the drone's position on the map. As the drone's position is updated periodically as described above, the drone's check status will be displayed above the drone's flight route.

<Screen example>
4 is a diagram showing an example of screen 4 displayed to a center staff member. Screen 4 may be displayed on a display of management server 2 or on a terminal operated by a center staff member connected to management server 2.

A map 40 is displayed on screen 4. Icons 41 indicating the location of observers and icons 42 indicating the location of drones are displayed on map 40. The number of icons 41 displayed is equal to the number of observers deployed on map 40. The number of icons 42 displayed is equal to the number of drones flying within the area shown on map 40. At the flight location of a drone, an object 43 indicating the check status of the check item for that drone is displayed. The object 43 displays check boxes (icons in the example of Figure 4) equal to the number of check items checked for that drone. In the example of Figure 4, an icon 431 is displayed to check that the observer has sighted the drone, an icon 432 is displayed to check that there are no obstacles to flight around the drone, an icon 433 is displayed to check that the drone's airframe is in good condition, and an icon 434 is displayed to check that the drone has passed. When the observer checks each check item, the display mode of these icons changes. For example, the color of the icon may change.

<Operation>
FIG. 5 is a diagram illustrating the operation of the monitoring support system of this embodiment.

The management server 2 accepts the designation of an observer from the center staff (S301), and also accepts the designation of the drone to be monitored (S302), and sends a check request containing the aircraft ID indicating the designated drone and check items to the observer terminal 1 of the designated observer (S303).

Figure 6 shows an example screen for sending a check request. When a center staff member selects the icon 41 corresponding to monitor A on screen 4 using a mouse 51 or the like, the management server 2 can accept the designation of monitor A. The management server 2 displays a dialog 52, displaying a list of drones that the selected monitor (monitor A) can check, and allows the user to select a drone. For example, a button 521 can be displayed for each drone that can be monitored, and when button 521 is selected, the target drone can be accepted.

Figure 7 is a diagram showing an example of a screen on the monitor terminal 1 for accepting a check request. When the monitor terminal 1 receives a check request, it displays a dialog 611 on the screen 61 of the monitor terminal 1, notifying the monitor that a check request has been received. After the check request is received, the screen 62 of the monitor terminal 1 displays check boxes (icons in the example of Figure 7) for each check item for each drone for which a check has been requested. When a check box (icon) is tapped on the monitor terminal 1, the check status of the corresponding check item changes, and the display mode of the icon also changes depending on the check status. In the example of Figure 7, a graphic 622 indicating a checked state is displayed on the icon. When the check status changes, the check status is sent from the monitor terminal 1 to the management server 2.

Returning to Figure 5, when the management server 2 receives the check status from the monitor terminal 1 (S304: YES), it registers the received check status in the check status storage unit 234 (S305) and displays the check status on the screen (S306).

Figure 8 is a diagram showing an example of the display screen of the management server 2 where the check status has changed. On screen 4 shown in Figure 8, the icon 431 of the object 43 related to the drone of the aircraft 1 has changed to a checked state (filled in shape). Note that if the management server 2 has multiple observer terminals 1 checking the same drone, i.e., if data for different observer IDs for the same aircraft ID is registered in the check status memory unit 234, the management server 2 may display a shape indicating that the drone has been checked by any observer.

The management server 2 can also display the check status for a combination of observer and drone, rather than on a map. Figure 9 is a diagram showing an example of a screen 70 that displays the check status. Screen 70 displays the check status for each observer and each drone that the observer is checking. By visually checking screen 70, center staff can easily understand which observer is checking which drone and what kind of check they are performing.

Returning to Figure 5, the management server 2 repeats the process from step S304 until the monitor's check is completed (S307: NO).

As described above, the monitoring support system of this embodiment allows aircraft monitoring to be carried out through collaboration between the flight (aircraft) manager (center staff) at the center and the observer in the field. Furthermore, the monitoring support system of this embodiment allows the center staff to request an observer to check the aircraft and surrounding conditions via a tablet or other device, and the observer can easily perform the check by simply tapping the appropriate check box (icon) on the observer terminal 1, such as a tablet. Check items can be customized. Furthermore, multiple observers can check multiple aircraft (and surrounding conditions), allowing the center staff managing the aircraft to easily see the check status. Furthermore, once the observer has completed their check, the check status can be displayed on a map on the drone's flight route.

The present embodiment has been described above, but the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention may be modified or improved without departing from its spirit, and equivalents thereof are also included within the present invention.

For example, while this embodiment is intended to be used for flight verification of aircraft, it can also be widely applied to collaboration between centers and ground operators (such as center staff requesting checks from field monitors).

1 Monitor terminal 2 Management server

Claims (8)

A monitoring support system for supporting monitoring of a monitoring target that is a moving body,
an item setting unit that accepts designation of one or more check items that should be checked by an observer for the monitoring target;
a transmission unit that transmits the one or more check items to the monitor's terminal;
a receiving unit that receives from the terminal the check status of the checked check item in response to the monitor changing the check status of at least one of the at least one or more check items for the moving monitor target ;
a status display unit that displays the one or more check items in association with the monitoring target in a display format corresponding to the check status received by the receiving unit ;
Equipped with
The monitoring support system further comprises a status display unit that, when a single monitoring object is being monitored by multiple monitors while it is moving , identifiably displays the check status of the check items that each of the multiple monitors should check for that single monitoring object. The monitoring support system according to claim 1,
a location information acquisition unit that acquires the location of the terminal from the terminal;
a map display unit that displays a map and displays the location of the terminal on the map;
A monitoring support system further comprising: The monitoring support system according to claim 2,
the location information acquisition unit acquires the location of the monitoring target,
the map display unit displays the location of the monitoring target;
A monitoring support system characterized by the above. The monitoring support system according to claim 3,
the status display unit displays the check status on the map;
A monitoring support system characterized by the above. 5. The monitoring support system according to claim 1,
an item storage unit that stores the one or more check items;
an item setting unit that receives input of the one or more check items and registers the input in the item storage unit;
A monitoring support system further comprising: The monitoring support system according to any one of claims 1 to 5,
the transmitting unit transmits the one or more check items for a designated monitoring target;
the receiving unit receives the check status of the one or more check items for the designated monitoring target;
A monitoring support system characterized by the above. A surveillance support method for supporting surveillance of a surveillance target that is a moving body, comprising:
a step of receiving designation of one or more check items to be checked by an observer for the monitoring target;
transmitting the one or more check items to a terminal of the monitor;
receiving, from the terminal, the check status of the checked check item in response to the monitor changing the check status of at least one of the at least one or more check items for the moving monitor target ;
a step of displaying the one or more check items in association with the monitoring target in a display format corresponding to the received check status;
When a single moving monitoring target is monitored by a plurality of monitors, a step of identifiably displaying the check status of the check items to be checked by each of the plurality of monitors for the single monitoring target;
A monitoring support method characterized by being executed by a computer. a step of accepting designation of one or more check items to be checked by an observer for a monitoring target which is a moving object;
transmitting the one or more check items to a terminal of the monitor;
receiving, from the terminal, the check status of the checked check item in response to the monitor changing the check status of at least one of the at least one or more check items for the moving monitor target ;
a step of displaying the one or more check items in association with the monitoring target in a display format corresponding to the received check status;
When a single moving monitoring target is monitored by a plurality of monitors, a step of identifiably displaying the check status of the check items to be checked by each of the plurality of monitors for the single monitoring target;
A program that causes a computer to execute the following.