JP7689716B2 - Aircraft operation support system and aircraft operation support method - Google Patents

Description

The present invention relates to an aircraft operation support system and an aircraft operation support method.

Unmanned aerial vehicles such as drones fly autonomously using a positioning system such as the Global Positioning System (GPS) or manually operated by a remote operator. Manned aerial vehicles are controlled by autonomous navigation or manually operated by an on-board operator.

In recent years, systems have been proposed to control the operation of multiple aircraft from the ground, both unmanned and manned.

For example, Patent Document 1 states the following about route management control of flying objects: "The route management control server is communicatively connected to a plurality of first flying objects via a network. The server includes a storage means for storing location data including at least one of map information, topographical information, and building information, and route data based on three-dimensional coordinates, a control means for reading out the location data and route data, and a transmission means for transmitting the read location data and route data to each of the first flying objects."

JP 2019-35772 A

In the air above which aircraft fly, there are no physically laid "roads" like roads or railroads on the ground. Therefore, when trying to control the traffic of manually piloted aircraft, one possible method would be to somehow indicate the location and direction of flight, as on the ground. On the other hand, when trying to control the traffic of automatically piloted aircraft, one possible method would be to fly the aircraft according to route information that takes into account the aircraft's position, flight route, etc.

As such, it is expected that the methods for controlling the traffic of aircraft will differ between manual and automatic piloting. Therefore, when controlling traffic in an airspace where manually and automatically piloted aircraft coexist, different types of information will be required depending on the piloting method, raising concerns that the system for managing operations will become complicated. For this reason, there is a need to provide a simpler operation system.

Although Patent Document 1 discloses technology for displaying flight routes and traffic information on the display unit of an aircraft, it does not consider simplifying the system.

The present invention aims to provide a simplified system for operational management and support of aircraft.

The present application includes multiple means for solving at least part of the above problems, examples of which are as follows: An aircraft operation support system according to one aspect of the present invention for solving the above problems comprises an aircraft operation control device including a guidance information generation unit that generates guidance information indicating a flight route for each spatial block partitioned by subdividing a flight space, and a communication unit that transmits the guidance information, and a flight support device including a guidance information output unit that outputs the guidance information to a specified device of the aircraft.

The guidance information generating unit may generate image information for visualizing the flight route as the guidance information, and the guidance information output unit may display the guidance information by superimposing it on a landscape viewed from the sky.

The guidance information generating unit may generate audio information indicating the flight route as the guidance information, and the guidance information output unit may output the guidance information to an output device mounted on the aircraft.

The flight support device may further include a guidance information analysis unit that, when the aircraft is controlled by autopilot, analyzes the guidance information and outputs a control instruction signal to fly the aircraft along the flight route indicated by the guidance information according to the analysis result.

The device may further include a guidance information analysis unit that compares different types of guidance information and detects discrepancies in the flight route, the guidance information generation unit generates image information for visualizing the flight route and audio information indicating the flight route as the guidance information, the guidance information output unit outputs the guidance information to a specified device of the aircraft, and the guidance information analysis unit detects discrepancies in the flight route indicated by the image information and the audio information.

The guidance information generating unit may generate guidance information that includes at least one of the following information: flight speed, altitude range, advertisements, and warnings.

In addition, an air vehicle operation support method according to one embodiment of the present invention is an air vehicle operation support method executed by an air vehicle operation control device and a flight support device, in which the air vehicle operation control device performs a guidance information generation step of generating guidance information indicating a flight route for each spatial block partitioned by subdividing a flight space, and a communication step of transmitting the guidance information, and the flight support device performs a guidance information output step of outputting the guidance information to a specified device of the air vehicle.

The present invention provides a simplified system for managing and supporting aircraft operations.

Problems, configurations, effects, etc. other than those mentioned above will become clear from the description of the embodiments below.

FIG. 1 is a diagram showing an example of an overview of an aircraft operation support system. FIG. 2 is a block diagram showing an example of the functional configuration of an aircraft traffic control device and a flight support device. FIG. 11 is a diagram showing an example of spatial information. FIG. 2 is a diagram showing an example of altitude bands of a space block. FIG. 1 is a conceptual diagram showing an example of a space block. FIG. 2 is a diagram showing an example of traffic management information. FIG. 11 is a diagram showing an example of AR image information that is guidance information. FIG. 11 is a flow chart showing an example of flight support processing. FIG. 13 is a diagram showing an example of a screen displayed on a display device of the aircraft. FIG. 2 is a diagram illustrating an example of a hardware configuration of an aircraft operation control device. FIG. 2 is a diagram illustrating an example of a hardware configuration of a flight support device.

The following describes an embodiment of the present invention with reference to the drawings.

First Embodiment
1 is a diagram showing an example of an outline of an aircraft flight support system 1000 according to the present embodiment. The aircraft flight support system 1000 is a system that manages and supports the flight of an aircraft AM. The aircraft AM is a manned or unmanned aircraft, such as air mobility such as a helicopter or an airplane.

As shown in the figure, the aircraft operation support system 1000 divides the flight space in the sky into mesh-like spatial blocks and transmits information for visualizing the flight route according to the spatial block in which the aircraft is located, thereby managing and supporting the operation of the aircraft AM that receives such information.

Such an aircraft operation support system 1000 has an aircraft operation management device 100 and a flight support device 200 (see FIG. 2). The aircraft operation management device 100 is a device that manages the operation of the aircraft AM, and constantly determines which spatial block the aircraft AM is located in, and generates guidance information for visualizing the flight route according to the spatial block in which the aircraft AM is located.

The flight support device 200 is a device that supports the operation of the flying object AM and is mounted on the flying object AM. The flight support device 200 receives guidance information transmitted from the flying object operation management device 100 and performs various processes such as visualizing and displaying the flight route.

Figure 2 is a block diagram showing an example of the functional configuration of the aircraft traffic management device 100 and the flight support device 200. As shown in the figure, the aircraft traffic management device 100 has a memory unit 110, a processing unit 120, and a communication unit 130.

The memory unit 110 is a functional unit that stores various information used in the processing of the aircraft traffic management device 100. Specifically, the memory unit 110 has spatial information 111, traffic management information 112, and guidance information 113.

Figure 3 is a diagram showing an example of spatial information 111. As shown in the figure, spatial information 111 is information about each spatial block that is partitioned by subdividing the flight space in the sky into a mesh. Specifically, spatial information 111 has a record that associates a spatial block ID 111a, an altitude band 111b, and a coordinate range 111c indicating latitude, longitude, and altitude.

The spatial block ID 111a is information for identifying each spatial block. The altitude band 111b is information for identifying the altitude band to which the spatial block belongs, as shown in FIG. 4 (a diagram showing an example of the altitude bands of a spatial block). The altitude band 111b includes a number of altitude bands, such as altitude band A, altitude band B, and altitude band C, arranged in order of proximity to the ground (lowest altitude). The coordinate range 111c is information indicating the coordinate range of latitude, longitude, and altitude that indicates the division range of each spatial block.

Figure 5 is a conceptual diagram showing an example of a space block. As shown in the figure, a space block is a rectangular parallelepiped space defined by a space block ID 111a, an altitude band 111b, and a coordinate range 111c registered in the space information 111. A space block is set so that each side has a predetermined length (for example, tens of meters to hundreds of meters) according to the coordinate range of latitude, longitude, and altitude.

The aircraft traffic management device 100 manages the operation of the aircraft AM on a space block basis. That is, the aircraft traffic management device 100 constantly grasps (manages) the space block in which the aircraft AM is located, and generates guidance information 113 according to the space block in which the aircraft AM is located.

In other words, conceptually, each spatial block can be considered as being linked to spatial information 111, information identifying the aircraft AM on the flight route that includes that spatial block, and guidance information 113 (image information and audio information) such as the course direction and traffic lanes that indicate the flight route as seen from that spatial block.

In this way, by managing the flight space in spatial block units, the current position and flight route of the flying object AM can be conceptualized and managed, which simplifies the system for operating and supporting the flying object AM compared to, for example, managing the position and flight route of the flying object AM based on coordinate positions.

Figure 6 shows an example of flight management information 112. Flight management information 112 is information for managing the flight of the flying object AM. Specifically, flight management information 112 has a record that associates an flying object ID 112a, a flight route 112b, and a current position 112c of the flying object AM indicated by a coordinate position and a spatial block ID.

The flying object ID 112a is information for identifying the flying object AM. The flight route 112b is information indicating the flight route by transitioning the spatial block ID through which the flying object AM flies. The current position 112c is information indicating the current position of the flying object AM by a coordinate position and a spatial block ID. The coordinate position is a coordinate position indicated by latitude, longitude, and altitude, and position information obtained periodically (e.g., every second) from the flight support device 200 is registered. The spatial block ID is the spatial block ID in which the flying object AM is located, and the spatial block ID identified based on the coordinate position is registered.

Such flight management information 112 is updated by the flight position management unit each time position information of the flying object AM is obtained from the flight support device 200.

The guidance information 113 is information showing guidance to support flight, and is AR (Augmented Reality) image information showing the course direction and traffic lanes of the flight route. Specifically, the guidance information 113 is AR image information for visualizing the course direction and traffic lanes of the flight route as seen from the flying object AM flying in a certain spatial block, and is displayed by the flight support device 200 superimposed on the image captured by the camera of the flying object AM. The guidance information 113 is generated by the guidance information generation unit 124.

Figure 7 is a diagram showing an example of AR image information, which is guidance information 113. As shown in the figure, the AR image information is image information that shows the course direction 300 and traffic lane 310 for each spatial block included in the flight route. In addition, the AR image information corresponding to the spatial blocks that are the departure point and destination point includes image information or text information indicating that the spatial block is the departure point or destination point (not shown). Note that, as shown in the figure, the AR image information may also include a boundary line 320 between the spatial block in which the flying object AM is located and other spatial blocks in order to assist manual piloting.

The processing unit 120 is a functional unit that performs various calculation processes executed by the aircraft traffic control device 100. Specifically, the processing unit 120 has an information acquisition unit 121, a flight position management unit 122, a flight route calculation unit 123, and a guidance information generation unit 124.

The information acquisition unit 121 is a functional unit that acquires information from a specific external device. Specifically, the information acquisition unit 121 acquires position information of the flying object AM and instructions to execute a specific process (for example, the flight support process described below) from the flight support device 200 via the communication unit 130.

The flight position management unit 122 is a functional unit that manages the flight position of the flying object AM. Specifically, the flight position management unit 122 periodically (e.g., every second) identifies the current position of the flying object AM using position information acquired from the flight support device 200. In addition, the flight position management unit 122 registers information related to the identified current position in the operation management information 112.

More specifically, the flight position management unit 122 identifies a spatial block ID corresponding to the current position of the flying object based on the coordinate position indicating the latitude, longitude, and altitude contained in the position information acquired from the flight support device 200. The flight position management unit also updates the flight management information 112 by registering the coordinate position contained in the position information and the identified spatial block ID in the flight management information 112 in association with the identification information (flying object ID) of the flying object AM whose position information was acquired.

The flight route calculation unit 123 is a functional unit that calculates the flight route of the flying object AM. Specifically, when the flight route calculation unit 123 acquires information on the departure point and destination point of the flying object AM (for example, coordinate information of latitude and longitude indicating the departure point and destination point, or information on spots where takeoff and landing are possible), it calculates a flight route connecting the departure point and destination point. Note that the flight route calculation unit 123 calculates the flight route using a known route calculation method, such as a flight route that minimizes the number of spatial blocks passed through and the number of right and left turns. In addition, the flight route calculation unit 123 may calculate the flight route of the target flying object AM by taking into account the flight routes of other flying objects AM and the altitude range in which they fly.

The guidance information generating unit 124 is a functional unit that generates guidance information 113 to support the flight of the flying object AM. Specifically, as shown in FIG. 7, the guidance information generating unit generates guidance information 113, which is AR image information for visualizing the course direction and traffic lanes for each spatial block included in the flight route, and which can be displayed by the flight support device 200 by superimposing it on the video information captured by the camera of the flying object AM.

In addition, when the guidance information generating unit 124 generates guidance information 113 corresponding to spatial blocks that are the starting point and destination, it generates AR image information that includes image information or text information indicating that the spatial blocks are the starting point or destination.

The guidance information generating unit 124 may generate AR image information that includes a boundary line 320 between the spatial block in which the flying object AM is located and other spatial blocks.

The guidance information generation unit 124 also generates a set of AR image information for a predetermined number of spatial blocks (e.g., 3 to 10 blocks) ahead in each direction, starting from the spatial block in which the flying object AM is currently located, and transmits guidance information 113 to the flight support device 200 via the communication unit 130, in which the AR image information is associated with the flying object ID of the destination flying object AM.

The communication unit 130 is a functional unit that communicates information with external devices. Specifically, the communication unit 130 acquires location information indicating the current location of the flying object AM from the flight support device 200. The communication unit 130 also acquires an instruction to execute flight support processing from the flight support device 200. The communication unit 130 also transmits guidance information 113 to the flight support device 200.

The communication unit 130 may perform direct wireless communication with the communication unit 130 of the flight support device 200, or may perform wireless communication with the flight support device 200 via a ground relay base station (radio tower) connected via a predetermined network N such as the Internet.

Next, an example of the functional configuration of the flight support device 200 will be described. As shown in FIG. 2, the flight support device 200 has a memory unit 210, a processing unit 220, and a communication unit 230.

The memory unit 210 is a functional unit that stores various information used in the processing of the flight support device 200. Specifically, the memory unit 210 stores the guidance information 113 obtained from the aircraft operation control device 100 via the communication unit 230.

The processing unit 220 is a functional unit that performs various processes executed by the flying object AM. Specifically, the processing unit 220 has an input receiving unit 221, a position identification unit 222, a guidance information output unit 223, and a guidance information analysis unit 224.

The input reception unit 221 is a functional unit that receives instructions or information input from a user, who is a crew member of the aircraft, via an input device possessed by the aircraft AM. Specifically, the input reception unit 221 receives input of information indicating a departure point and a destination point via the input device. The departure point may be coordinate information indicating the current position of the aircraft, or may be the name of the nearest spot from which takeoff is possible. Similarly, the destination point may be coordinate information or the name of the nearest spot near the destination from which landing is possible.

The input reception unit 221 also receives an instruction to execute flight support processing from the user via the input device. The input reception unit 221 also associates its own aircraft ID with the instruction to execute flight support processing, including the information on the departure point and destination point that was received as input, and transmits the instruction to the aircraft traffic management device 100 via the communication unit 230.

The position identification unit 222 is a functional unit that identifies the current position of the flying object AM. Specifically, the position identification unit 222 periodically (e.g., every second) identifies the coordinate position of latitude, longitude, and altitude indicating the current position of the flying object AM using output information from a GPS receiver and an altimeter mounted on the flying object AM. In addition, the position identification unit 222 transmits position information including the flying object ID of its own flying object AM and the identified coordinate position to the flying object operation control device 100 via the communication unit 230.

The guidance information output unit 223 is a functional unit that outputs the guidance information 113. Specifically, when the guidance information output unit 223 acquires the guidance information 113 via the communication unit 230, the guidance information output unit 223 determines whether or not the guidance information 113 is for the user's own flying object based on the flying object ID included in the guidance information 113. Furthermore, when the guidance information output unit 223 determines that the guidance information 113 is for the user's own flying object, it displays the guidance information 113 (AR image information) on the display device of the flying object AM by superimposing it on the image captured by the camera mounted on the flying object AM.

After displaying the guidance information 113, the guidance information output unit 223 transmits, via the communication unit 230, a request to obtain the guidance information 113 to be displayed when moving to the next spatial block on the flight route, in association with the aircraft's own aircraft ID, to the aircraft traffic management device 100.

The guidance information analysis unit 224 is a functional unit that analyzes the contents of the guidance information 113 and performs processing according to the analysis results. Specifically, the guidance information analysis unit 224 performs image analysis of the AR image information, which is the guidance information 113, and determines whether or not image information or text information indicating the destination is included.

In addition, when the flying object AM is flying under autopilot (for example, when autopilot mode is set on the flying object AM), the guidance information analysis unit 224 outputs an instruction signal to a control device (not shown) that controls flight so that the flying object AM flies inside the traffic lane and is automatically steered according to the course direction based on the image analysis results of the AR image information.

The communication unit 230 is a functional unit that communicates information with external devices. Specifically, the communication unit 230 transmits to the aircraft traffic management device 100 an instruction to execute flight support processing, position information of the aircraft AM, and a request to acquire guidance information 113. The communication unit 230 also acquires the guidance information 113 from the aircraft traffic management device 100.

The communication unit 230 may perform direct wireless communication with the communication unit 130 of the aircraft traffic control device 100, or may perform wireless communication with the aircraft traffic control device 100 via a ground relay base station (radio tower) connected via a specified network N such as the Internet.

The above describes an example of the functional configuration of the aircraft operation management device 100 and the flight support device 200.

[Operation Description]
8 is a flow diagram showing an example of a flight support process. This process is started when the flying object operation control device 100 acquires an execution instruction for the flight support process from the flight support device 200.

When the process starts, the flight route calculation unit 123 calculates a flight route (step S001). Specifically, the flight route calculation unit 123 calculates a flight route connecting the departure point and destination point included in the execution instruction for the flight support process. The flight route calculation unit 123 also identifies a record in the traffic management information 112 to which the aircraft ID included in the acquired execution instruction is associated, and registers a spatial block ID indicating the calculated flight route in the traffic management information 112.

Next, the guidance information generation unit 124 determines whether the flying object AM has reached the flight start point (step S002). Specifically, the guidance information generation unit 124 refers to the flight management information 112 and identifies the spatial block ID corresponding to the current position of the flying object AM. The guidance information generation unit 124 also determines whether the identified spatial block ID matches the first spatial block ID registered in the flight route. If it is determined that they do not match (No in step S002), the guidance information generation unit 124 executes the process of step S002 again. On the other hand, if it is determined that they match (Yes in step S002), the guidance information generation unit 124 transitions to the process of step S003.

In step S003, the guidance information generation unit 124 generates the guidance information 113. Specifically, the guidance information generation unit 124 generates AR image information for visualizing the course direction and traffic lanes for each spatial block included in the flight route.

Next, the guidance information generating unit 124 transmits the guidance information 113 (step S004). Specifically, the guidance information generating unit 124 generates AR image information for visualizing the course direction and traffic lanes up to a predetermined number of spatial blocks ahead, starting from the spatial block in which the flying object AM is currently located on the flight route, as the guidance information 113, and transmits this information in association with the flying object ID of the transmission destination.

Next, the communication unit 230 of the flight support device 200 acquires the guidance information 113 transmitted from the flying object operation management device 100 (step S005). The guidance information output unit 223 outputs the guidance information 113 (step S006). Specifically, the guidance information output unit 223 of the flight support device 200 determines whether the guidance information 113 is for its own flying object based on the flying object ID included in the guidance information 113. If the guidance information output unit 223 determines that the guidance information 113 is for its own flying object, it acquires an image captured by a camera mounted on the flying object, and displays the image on the display device of the flying object AM by superimposing AR image information showing the course direction and traffic lane indicating the flight route on the image.

Figure 9 shows an example of a screen displayed on the display device of the flying object AM. As shown in the figure, the display device displays an image of a landscape seen from above, such as a building 330, captured by a camera, overlaid with AR image information that visualizes the course direction 300 and traffic lane 310 indicating the flight route.

In this way, the flight support device 200 visualizes the course direction and traffic lanes that indicate the flight route, and displays them superimposed on an image showing the scenery as seen from above. This allows the crew member (user) performing manual control to control the flying object AM by referring to the image including the displayed guidance information 113.

Next, the guidance information analysis unit 224 determines whether the flight is being manually piloted (step S007). For example, the guidance information analysis unit 224 determines whether the flight is being manually piloted based on the mode setting of manual piloting or automatic piloting. If it is determined that the flight is being manually piloted (Yes in step S007), the guidance information analysis unit 224 transitions the process to step S008. On the other hand, if it is determined that the flight is not being manually piloted (No in step S007), the guidance information analysis unit 224 transitions the process to step S011.

If it is determined that the flight is being manually piloted (Yes in step S007), the guidance information analysis unit 224 proceeds to step S008, where it determines whether the flying object AM has reached the destination point. Specifically, the guidance information analysis unit 224 performs image analysis of the output guidance information 113, and determines that the flying object AM has reached the destination point if the spatial block in which the flying object AM is currently located contains image information or text information indicating the destination point.

If it is determined that the flying object AM has reached the destination point (Yes in step S008), the guidance information analysis unit 224 ends the processing of this flow. On the other hand, if it is determined that the flying object AM has not reached the destination point (No in step S008), the guidance information analysis unit 224 transitions the processing to step S009.

In step S009, the guidance information output unit 223 transmits a request to acquire guidance information 113. Specifically, the guidance information output unit 223 transmits, via the communication unit 230, to the aircraft traffic control device 100 a request to acquire guidance information 113 to be displayed when moving to the next spatial block on the flight route.

When the guidance information generating unit 124 of the flying object operation control device 100 receives a request to obtain guidance information 113 via the communication unit 130, it determines whether the flying object AM is near the next spatial block (step S010). Specifically, the guidance information generating unit 124 calculates the distance to the next spatial block on the flying object AM's flight route based on the coordinate position indicating the current position registered in the operation control information 112, and determines whether the distance is within a predetermined distance (e.g., within several tens of meters).

If it is determined that the distance is not within the predetermined distance (No in step S010), the guidance information generation unit 124 executes the process of step S010 again. On the other hand, if it is determined that the distance is within the predetermined distance (Yes in step S010), the guidance information generation unit 124 transitions to the process of step S003 and generates guidance information 113 to be output when the flying object AM moves to the next spatial block.

In the process of step S011, which is performed when it is determined that the flight is not manually controlled (No in step S007), the guidance information analysis unit 224 performs image analysis of the output guidance information 113 and identifies the course direction and the position of the traffic lane in the spatial block in which the flying object AM is located. The guidance information analysis unit 224 also outputs an instruction signal for controlling flight based on the analysis result of the guidance information 113 (step S012). Specifically, the guidance information analysis unit 224 outputs an instruction signal based on the analysis result to a control device (not shown) that controls flight so that the flying object AM flies inside the traffic lane and is automatically controlled according to the course direction. In addition, when the instruction signal for automatic control is output, the guidance information analysis unit 224 transitions the process to step S008.

The above describes the flight support processing by the aircraft operation support system. With such an aircraft operation management device and flight support device, it is possible to provide a more simplified system for operation management and support of the aircraft AM. In particular, since the flight space can be managed in spatial block units and information for flight support can be shared regardless of whether the aircraft is being piloted manually or automatically, it is possible to provide a more simplified aircraft operation support system.

Second Embodiment
In the first embodiment, AR image information indicating the course direction and traffic lanes of the flight route is generated as the guidance information 113, and flight is supported using the guidance information 113, but the present invention is not limited to this. The aircraft operation support system 1000 of the second embodiment generates audio information indicating the course direction and traffic lanes of the flight route as the guidance information 113. In addition, the flight support device 200 outputs the acquired audio information as the guidance information 113.

The characteristic processing of each functional unit according to this embodiment will be described in detail with reference to FIG. 8. Note that the description of the processing similar to that of the first embodiment will be omitted.

In step S003, the guidance information generating unit 124 generates, as the guidance information 113, voice information indicating the course direction and traffic lane in the spatial block in which the flying object AM is currently located on the flight route. Specifically, the guidance information generating unit 124 generates voice information indicating the course direction, such as "Please go straight" or "Please turn right (left)". The guidance information generating unit 124 also generates voice information indicating the traffic lane, such as "Please fly a little further to the right (left)".

When the aircraft reaches a spatial block that is the departure point or destination point, the guidance information generating unit 124 generates guidance information 113 that includes audio information indicating that the spatial block is the departure point or destination point, respectively (e.g., "You have reached the departure point (destination point)").

In addition, in step S006, the guidance information output unit 223 outputs audio information, which is the guidance information 113 acquired from the aircraft operation management device 100, to an output device such as a speaker possessed by the aircraft AM. Since the course direction and traffic lanes indicating the flight route can be recognized based on such audio information, the crew member (user) performing manual control can control the aircraft AM by referring to the output guidance information 113.

In step S011, the guidance information analysis unit 224 analyzes the output voice information by voice recognition. In step S012, the guidance information analysis unit 224 outputs an instruction signal for controlling the automatic pilot of the flying object AM according to the analysis result of the guidance information 113, i.e., the result of the voice recognition.

In addition, in step S008, the guidance information analysis unit 224 performs voice recognition using the output guidance information 113, and determines that the destination point has been reached if the voice information includes voice information indicating that the spatial block in which the aircraft AM is currently located is the destination point.

In addition, in step S003, which is reached via step S010, the guidance information generation unit 124 generates, as guidance information 113, audio information to be output when the flying object AM moves to the next spatial block.

In this way, the aircraft operation support system according to this embodiment can also manage the flight space in spatial block units and standardize information for flight support regardless of whether the aircraft is being piloted manually or automatically, thereby providing a simplified system for the operation management and support of aircraft.

The aircraft operation support system 1000 may generate guidance information 113 that includes both AR image information and audio information, and the flight support device 200 may output both the AR image information and the audio information.

In addition, in a form in which both AR image information and audio information are output as guidance information 113, the guidance information analysis unit 224 may perform an error check to determine whether the course direction indicated by the image analysis result of the AR image information and the voice recognition result of the audio information match. Such an error check makes it possible to detect an error in which the course direction indicated by the AR image information does not match the course direction indicated by the audio information, making it possible to control the flying object AM, such as stopping the flying object AM, when an error is detected, thereby enabling safer operation of the flying object AM.

In addition, in a form in which both AR image information and audio information are output as guidance information 113, the audio information may be a beep sound with a specific meaning defined. The guidance information analysis unit 224 outputs an instruction signal for controlling the flying object AM based on the definition of each type of beep sound.

In addition, in the above-described embodiment, AR image information was generated that indicates the flight route direction and traffic lanes, but AR image information may also be generated that includes at least one of the following: flight speed, altitude range, advertisements, or warnings (e.g., speed limits, etc.).

In the first embodiment described above, an example was described in which AR image information, which is the guidance information 113, is displayed on a display device possessed by the flying object AM, but the present invention is not limited to this, and the guidance information 113 may be displayed on goggles worn by the occupant (user) of the flying object AM, or may be projected onto the windshield. In either case, the guidance information 113 is displayed superimposed on the scenery seen through the goggles or windshield.

Specifically, the flight support device 200 and the goggles are connected so as to be able to communicate with each other, and the guidance information output unit 223 outputs AR image information, which is the guidance information 113, to the goggles. Furthermore, when the guidance information 113 is to be projected and displayed on the windshield, the guidance information output unit 223 outputs the guidance information 113 to a specified device for realizing, for example, a head-up display.

In addition, the guidance information 113 may be displayed on the display device of the flying object AM by superimposing it on image (video) information that is an augmented reality (AR) image of a building or other scenery seen from the sky captured by a camera of the flying object AM and processed by a functional unit (not shown) of the flight support device 200.

The present invention can also be applied to flight support for small unmanned aerial vehicles such as drones. For example, when operating a drone using a control terminal such as a smartphone, tablet terminal, or dedicated controller, the same effect as the above-mentioned aerial vehicle operation support system 1000 can be achieved by outputting AR image information to the display unit of these terminals or outputting audio information to the speakers equipped in the terminals. Note that the control terminal only needs to realize processing similar to that of each functional unit of the flight support device 200 using dedicated application software pre-installed.

Next, we will explain the hardware configuration of the aircraft operation management device 100 and the flight support device 200.

Figure 10 shows an example of the hardware configuration of the aircraft traffic management device 100. The aircraft traffic management device 100 is realized by a high-performance information processing device.

As shown in the figure, the aircraft operation control device 100 has a processing device 410, a main memory device 420, an auxiliary memory device 430, a communication device 440, and a bus 450 that electrically interconnects each of these devices.

The processing device 410 is, for example, a CPU (Central Processing Unit). The main memory device 420 is a memory device such as a RAM (Random Access Memory) or a ROM (Read Only Memory).

The auxiliary storage device 430 is a non-volatile storage device capable of storing digital information, such as a hard disk drive, a solid state drive (SSD), or a flash memory.

The communication device 440 is a communication unit that performs wireless communication with an external device.

Figure 11 is a diagram showing an example of the hardware configuration of the flight support device 200. The flight support device 200 is realized by a high-performance information processing device. The flight support device 200 may be incorporated into a control device (not shown) that controls the flight of the flying object AM, or may be mounted on the flying object AM as a separate device separate from the control device.

As shown in the figure, the flight support device 200 has an input device 510, an output device 520, a processing device 530, a main memory device 540, an auxiliary memory device 550, a communication device 560, and a bus 570 that electrically interconnects each of these devices.

The input device 510 is an input device such as a touch panel or a hard switch key. The output device 520 is a display device such as a display or an audio output device such as a speaker.

The processing device 530 is, for example, a CPU. The main storage device 540 is a memory device such as a RAM or a ROM. The auxiliary storage device 550 is a non-volatile storage device such as a hard disk, SSD, or flash memory that can store digital information.

The communication device 560 is a communication unit that performs wireless communication with an external device.

The above describes the hardware configuration of the aircraft operation management device 100 and the flight support device 200.

The processing unit 120 of such an aircraft operation control device 100 is realized by a program that causes the processing device 410 to perform processing. This program is stored in the main memory device 420 or the auxiliary memory device 430, and is loaded onto the main memory device 420 when the program is executed, and is executed by the processing device 410. The memory unit 110 is realized by the main memory device 420 or the auxiliary memory device 430, or a combination of these. The communication unit 130 is realized by the communication device 440.

Similarly, the processing unit 220 of the flight support device 200 is realized by a program that causes the processing device 530 to perform processing. This program is stored in the main memory device 540 or the auxiliary memory device 550, and is loaded onto the main memory device 540 when the program is executed, and is executed by the processing device 530. The memory unit 210 is realized by the main memory device 540 or the auxiliary memory device 550, or a combination of these. The communication unit 230 is realized by the communication device 560.

The above-mentioned configurations, functions, processing units, and processing means of the aircraft traffic management device 100 and the flight support device 200 may be realized in part or in whole in hardware, for example by designing them as integrated circuits. The above-mentioned configurations and functions may also be realized in software by a processor interpreting and executing a program that realizes each function. Information on the programs, tables, files, etc. that realize each function can be stored in a storage device such as a memory, hard disk, or SSD, or in a recording medium such as an IC card, SD card, or DVD.

Furthermore, each functional block of the aircraft traffic management device 100 and the flight support device 200 is classified according to the main processing content in order to facilitate understanding of each function realized in this embodiment. Therefore, the present invention is not limited by the way in which each function is classified or its name. Furthermore, each configuration of the aircraft traffic management device 100 and the flight support device 200 can be further classified into more components according to the processing content. Furthermore, it is also possible to classify each component so that it performs even more processing.

Furthermore, all or part of each functional unit may be constructed by hardware (such as an integrated circuit such as an ASIC) implemented in a computer. Furthermore, the processing of each functional unit may be executed by a single piece of hardware, or may be executed by multiple pieces of hardware.

The present invention is not limited to the above-mentioned embodiments and modifications, but includes various other embodiments and modifications. For example, the above-mentioned embodiments have been described in detail to clearly explain the present invention, and are not necessarily limited to those having all of the configurations described. It is also possible to replace part of the configuration of one embodiment with the configuration of another embodiment or modification, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. It is also possible to add, delete, or replace part of the configuration of each embodiment with other configurations.

1000: Aircraft operation support system, 100: Aircraft operation management device, 110: Memory unit, 111: Spatial information, 112: Operation management information, 113: Guidance information, 120: Processing unit, 121: Information acquisition unit, 122: Flight position management unit, 123: Flight route calculation unit, 124: Guidance information generation unit, 130: Communication unit, 200: Flight support device, 210: Memory unit, 220: Processing unit, 221: Input reception unit, 22 2: Position identification unit, 223: Guidance information output unit, 224: Guidance information analysis unit, 230: Communication unit, 410: Processing device, 420: Main memory device, 430: Auxiliary memory device, 440: Communication device, 450: Bus, 510: Input device, 520: Output device, 530: Processing device, 540: Main memory device, 550: Auxiliary memory device, 560: Communication device, 570: Bus, AM: Air vehicle, N: Network

Claims (7)

a guidance information generating unit that generates guidance information indicating a flight route of the aircraft for each space block partitioned by subdividing the flight space;
A communication unit that transmits the guidance information; and
A flight support device mounted on the aircraft,
a guidance information output unit that outputs the guidance information to a predetermined device for outputting the guidance information as information viewable by a pilot of the flying object;
and a guidance information analysis unit that, when the aircraft is controlled by autopilot, analyzes the guidance information output to the specified device and outputs a control instruction signal so that the aircraft flies along the flight route indicated by the guidance information in accordance with the analysis result. 2. The aircraft flight support system according to claim 1,
The guidance information generating unit
generating image information for visualizing the flight route as the guidance information;
The guidance information output unit
An aircraft navigation support system characterized in that the image information is displayed superimposed on a landscape seen from above. 3. The aircraft flight support system according to claim 2,
The image information output to the predetermined device of the aircraft is
Image information showing the course direction and traffic lane for each of the spatial blocks included in the flight route from the pilot's first-person viewpoint.
An aircraft operation support system comprising: 2. The aircraft flight support system according to claim 1,
The guidance information generating unit
Generate voice information indicating the flight route as the guidance information;
The guidance information output unit
An aircraft operation support system, characterized in that the voice information is output to the specified device of the aircraft. 2. The aircraft flight support system according to claim 1,
The guidance information analysis unit
comparing different types of the guidance information and performing an analysis to detect discrepancies in the flight route;
the guidance information generation unit generates, as the guidance information, image information for visualizing the flight route and audio information indicating the flight route;
The guidance information output unit outputs the guidance information to the predetermined device of the aircraft,
The guidance information analysis unit
An aircraft operation support system characterized by detecting any discrepancies in the flight route indicated by the image information and the audio information. 2. The aircraft flight support system according to claim 1,
The guidance information generating unit
An aircraft operation support system, characterized in that it generates guidance information by adding at least one of the following information to the guidance information: flight speed, altitude range, advertisements, and warnings. A flying object operation support method executed in an flying object operation support system having an flying object operation control device and a flight support device,
The aircraft traffic control device includes :
A guidance information generating step of generating guidance information indicating a flight route of the aircraft for each space block partitioned by subdividing the flight space;
A communication step of transmitting the guidance information;
The flight support device mounted on the aircraft is
a guidance information output step of outputting the guidance information to a predetermined device for outputting the guidance information as information viewable by a pilot of the flying object ;
and a guidance information analysis step of, if the aircraft is controlled by autopilot, analyzing the guidance information output to the specified device and outputting a control instruction signal so that the aircraft flies along the flight route indicated by the guidance information based on the analysis result .

Images