JP7619653B2 - Method, system and program - Google Patents

Description

The present disclosure relates to methods, systems and programs.

There is a growing need for inspections, photography, and the like using unmanned aerial vehicles such as drones. For this reason, technology to easily operate unmanned aerial vehicles is being developed. For example, Patent Document 1 discloses technology for operating unmanned aerial vehicles using a touch panel.

JP 2019-85041 A

At inspection and photography sites, work may be carried out to restrict the area in which aircraft can fly as much as possible. The location and size of the flight restriction area varies depending on the site, so it is necessary to set it each time.

This disclosure has been made in light of this background, and its purpose is to provide a method, system, and program that can easily set flight restriction zones for aircraft on-site.

According to the present disclosure, a method is provided that includes displaying a map on a display unit, acquiring information related to a designated area on the map that is input based on an operation on the map displayed on the display unit, and outputting information related to a flight restriction zone of an aircraft in real space based on the designated area on the map.

In addition, according to the present disclosure, a system is provided that includes a display control unit that causes a map to be displayed on a display unit, an input information acquisition unit that acquires information related to a designated area on the map that is input based on an operation on the map displayed on the display unit, and an output control unit that outputs information related to a flight restriction zone of an aircraft in real space based on the designated area on the map.

In addition, according to the present disclosure, a program is provided that causes a computer to function as a display control unit that causes a map to be displayed on a display unit, an input information acquisition unit that acquires information relating to a designated area on the map that is input based on an operation performed on the map displayed on the display unit, and an output control unit that outputs information relating to a flight restriction zone of an aircraft in real space based on the designated area on the map.

According to the present invention, it is possible to easily set flight restriction areas for aircraft on-site.

FIG. 1 is a diagram illustrating an overview of a system 1 according to an embodiment of the present disclosure. 2 is a block diagram showing a configuration of an information processing terminal 10 according to the embodiment. FIG. A block diagram showing an example of the functional configuration of the unmanned aerial vehicle 20 according to the same embodiment. 2 is a block diagram showing a functional configuration of a control unit 11 according to the embodiment. FIG. FIG. 4 is a flowchart illustrating a series of controls in the system 1 according to the embodiment. 13 is a diagram showing a first example screen of the touch panel 12 relating to a method for setting a flight restricted area by the system 1 according to the embodiment. FIG. 13 is a diagram showing a second example screen of the touch panel 12 relating to the method of setting a flight restricted area by the system 1 according to the embodiment. FIG. 11 is a flowchart showing a series of controls in a method for outputting information related to flight restricted areas using the system 1 according to the embodiment. FIG. 13 is a diagram showing a first example screen of the touch panel 12 relating to a method of outputting information related to flight restricted areas by the system 1 according to the embodiment. FIG. 13 is a diagram showing a second example screen of the touch panel 12 relating to a method of outputting information related to flight restricted areas by the system 1 according to the embodiment. FIG. 13 is a diagram showing a third example screen of the touch panel 12 relating to a method of outputting information related to flight restricted areas by the system 1 according to the embodiment. FIG.

A preferred embodiment of the present disclosure will be described in detail below with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configuration are designated by the same reference numerals to avoid redundant description.

<System Overview>
FIG. 1 is a diagram showing an outline of a system 1 according to an embodiment of the present disclosure. As shown in the figure, the system 1 includes an information processing terminal 10 and an unmanned aerial vehicle 20. The system 1 according to this embodiment can be used, for example, to photograph an area FRA1 including a building S1 or the like. In this system 1, a user U using the information processing terminal 10 performs an operation to control the flight of the unmanned aerial vehicle 20 on the touch panel of the information processing terminal 10. At that time, an image including the above-mentioned area photographed by a camera 28 mounted on the unmanned aerial vehicle 20 is displayed on the touch panel. In this embodiment, for example, information on the flight restriction area of the unmanned aerial vehicle 20 can be displayed superimposed on the image displayed on the touch panel. With such a display, the user U can grasp the area in which the unmanned aerial vehicle 20 can fly/cannot fly by looking at the touch panel.

The information processing terminal 10 according to this embodiment is implemented by a so-called tablet-shaped small computer. In other embodiments, the information processing terminal 10 may be realized by a portable information processing terminal such as a smartphone or a game console, or may be realized by a stationary information processing terminal such as a personal computer. The information processing terminal 10 may also be realized by multiple pieces of hardware, with functions distributed among them.

Figure 2 is a block diagram showing the configuration of the information processing terminal 10 according to this embodiment. As shown in the figure, the information processing terminal 10 includes a control unit 11 and a touch panel 12, which is an example of a display unit.

The processor 11a is a computing device that controls the operation of the control unit 11, controls the transmission and reception of data between each element, and performs processes necessary for executing programs. In this embodiment, the processor 11a is, for example, a CPU (Central Processing Unit), and executes programs stored in the storage 11c (described later) and deployed in the memory 11b to perform each process.

The memory 11b includes a main memory device consisting of a volatile memory device such as a dynamic random access memory (DRAM), and an auxiliary memory device consisting of a non-volatile memory device such as a flash memory or a hard disk drive (HDD). This memory 11b is used as a working area for the processor 11a, and also stores the BIOS (Basic Input/Output System) that is executed when the control unit 11 is started, various setting information, etc.

Storage 11c stores programs and information used for various processes. For example, when a user operates an aircraft for capturing images of an area including a structure S1, etc., via information processing terminal 10, storage 11c may store a program for controlling the flight of the aircraft.

The transceiver unit 11d connects the control unit 11 to a network such as the Internet, and may be equipped with a short-range communication interface such as Bluetooth (registered trademark) or BLE (Bluetooth Low Energy).

The input/output unit 11e is an interface to which input/output devices are connected, and in this embodiment, a touch panel 12 is connected.

The bus 11f transmits, for example, address signals, data signals and various control signals between the connected processor 11a, memory 11b, storage 11c, transmission/reception unit 11d and input/output unit 11e.

The touch panel 12 is an example of a display unit, and has a display surface on which acquired videos and images are displayed. In this embodiment, this display surface accepts information input by touching the display surface, and is implemented using various technologies such as a resistive film method or a capacitive method.

For example, an image captured by the unmanned aerial vehicle 20 may be displayed on the display surface of the touch panel 12. Information regarding the flight restriction zone of the unmanned aerial vehicle 20 may be displayed on the display surface superimposed on the image captured by the unmanned aerial vehicle 20. Buttons, objects, etc. for controlling the flight of the unmanned aerial vehicle 20 and controlling the imaging device may also be displayed on the display surface. A user may input information via the touch panel 12 to the images, buttons, etc. displayed on the display surface.

In this embodiment, the touch panel 12 is given as an example of the display unit, but the present technology is not limited to this example. For example, the display unit may be realized by a display device such as another display, monitor, or smartphone. In addition, the input device for acquiring input information may be realized by a method other than the touch panel 12. For example, the input device may be realized by various input devices such as a mouse, a keyboard, a voice recognition device, and a gaze recognition device instead of the touch panel 12. In addition, the information processing device 10 may be realized independently of at least one of the display device such as the touch panel 12 and the input device. In this case, for example, the information processing device 10 may be realized by one or more servers such as a cloud server, and may be provided so as to be able to communicate with the touch panel 12.

Figure 3 is a block diagram showing an example of the functional configuration of the unmanned aerial vehicle 20 according to this embodiment. As shown in Figure 3, the unmanned aerial vehicle 20 according to one embodiment includes a main body 21, a transceiver unit 22, a flight controller 23, a battery 24, an ESC 25, a motor 26, a propeller 27, and a camera 28. Note that the unmanned aerial vehicle 20 is an example of an aerial vehicle. The type of the aerial vehicle is not particularly limited, and may be, for example, a so-called multi-rotor drone as shown in Figure 3.

The flight controller 23 may have one or more processors 23A, such as a programmable processor (e.g., a central processing unit (CPU)).

Flight controller 23 has and has access to memory 23B. Memory 23B stores logic, code, and/or program instructions that are executable by the flight controller to perform one or more steps.

Memory 23B may include, for example, a separable medium such as an SD card or a random access memory (RAM) or an external storage device. Data acquired from sensors 23C may be directly transmitted to and stored in memory 23B. For example, still image and video data captured by camera 28 is recorded in the built-in memory or an external memory.

The flight controller 23 includes a control module configured to control the state of the air vehicle. For example, the control module controls the propulsion mechanism (motor 26, etc.) of the air vehicle via an ESC (Electric Speed Controller) 25 to adjust the spatial arrangement, speed, and/or acceleration of the air vehicle having six degrees of freedom (translational motion _x , y, and z, and rotational motion θ x , _{θ y} , and θ _z ). The control module can control one or more of the camera 28, sensors 23C, etc.

The flight controller 23 can communicate with a transceiver 22 configured to transmit and/or receive data from one or more external devices (e.g., a terminal such as the information processing terminal 10, a display device, or other remote controller). For example, the transceiver 22 can utilize one or more of a local area network (LAN), a wide area network (WAN), infrared, radio, WiFi, a point-to-point (P2P) network, a telecommunications network, cloud communications, and the like.

The transmitter/receiver unit 22 can transmit and/or receive one or more of the following: data acquired by the camera 28 or sensors 23C, processing results generated by the flight controller 23, specified control data, user commands from the information processing terminal 10 or a remote controller, etc.

The sensors 23C in this embodiment may include inertial sensors (accelerometers, gyro sensors), GPS sensors, proximity sensors (e.g., lidar), or vision/image sensors (e.g., cameras).

The battery 24 may be a known battery, such as a lithium polymer battery. The power that drives the unmanned aerial vehicle 20 is not limited to the electricity supplied from the battery 24, but may be powered by an internal combustion engine, for example.

The camera 28 is an example of an imaging device. The type of the camera 28 is not particularly limited, and may be, for example, a normal digital camera, a spherical camera, an infrared camera, a thermography image sensor, or the like. The camera 28 may be connected to the main body 21 by a gimbal (not shown) or the like so as to be independently displaceable.

Figure 4 is a block diagram showing the functional configuration of the control unit 11 according to this embodiment. As shown in Figure 4, the control unit 11 includes a map acquisition unit 111, an image acquisition unit 112, a display control unit 113, an input information acquisition unit 114, a flight restriction area determination unit 115, a coordinate conversion unit 116, and an output control unit 117. Each of these functional units can be realized by the processor 11a reading a program stored in the storage 11c into the memory 11b and executing it. Furthermore, the map information 118 can be stored, for example, in the storage 11c, an external storage, a cloud server, etc.

The map acquisition unit 111 has a function of acquiring map information 118. The map information 118 has information related to the map. The information related to the map is, for example, information in which location information (including at least one of longitude information, latitude information, and altitude information) is associated with a map or an aerial photograph (which may include one captured by the unmanned flying object 20). Such map information 118 may include not only geographical information but also information on the type of structure or area (house, park, public facility, commercial facility, industrial facility, river, etc.). The map information 118 may be acquired using, for example, an API (Application Programming Interface) provided by a service related to the map. In this case, for example, the user may perform an operation to search for a place where a flight restriction area should be set by inputting to the touch panel 12 on which the map is displayed, so that the map information 118 may be appropriately updated. The acquired map information 118 is output to the display control unit 113.

The image acquisition unit 112 has a function of acquiring information on images captured by the unmanned aerial vehicle 20. The image acquisition unit 112 appropriately acquires images captured by the camera 28 mounted on the unmanned aerial vehicle 20. The acquired images may be moving images obtained in real time, or still images captured at any timing. Information on the acquired images is output to the display control unit 113.

The display control unit 113 has a function to display the acquired image and information on the touch panel 12. The display control unit 113 also has a function to display information such as buttons, objects, text, etc., included in the image for providing information to a user using the present system 1 and for acquiring input information based on user operations. The display control unit 113 may also have a function to display on the touch panel 12 an image based on input information acquired by the input information acquisition unit 114 described below.

For example, the display control unit 113 may have a function to display a map related to the acquired map information 118. This causes the map to be displayed on the touch panel 12. The display control unit 113 may also have a function to display the captured image acquired by the image acquisition unit 112.

The input information acquisition unit 114 has a function of acquiring input information generated based on an operation on an image displayed on the touch panel 12. The input information here includes, for example, information about a position on the image displayed on the touch panel 12. The position on the image is, for example, the position of a pixel that constitutes the image. In other words, the input information includes information indicating at which position on the image the user performed an operation. Such operations include, for example, tapping, touching, swiping, sliding, and the like.

Such input information may include, for example, input information relating to the setting of a flight restricted area. As will be described in detail later, input information relating to the setting of a flight restricted area is, for example, information (designated area information) generated by an operation of setting a designated area corresponding to the flight restricted area of the unmanned aerial vehicle 20 on a map when the area in which the unmanned aerial vehicle 20 may fly is displayed on the touch panel 12. Such input information may include, for example, information relating to the registration, change, or deletion of a flight restricted area.

The input information may also include input information for controlling the flight of the unmanned aerial vehicle 20. For example, when buttons, objects, etc. for controlling the flight of the unmanned aerial vehicle 20 are displayed on the touch panel 12 by the display control unit 113, the input information for controlling the flight of the unmanned aerial vehicle 20 is information generated by operating the buttons or objects. Such input information may include, for example, information for control of the takeoff, landing, ascent, descent, translation, rotation, speed, etc. of the unmanned aerial vehicle 20, as well as information for control of the imaging process, zoom, and imaging direction of the camera 28.

The flight restricted area determination unit 115 has a function of determining a flight restricted area in real space based on input information related to the setting of the flight restricted area. For example, the flight restricted area determination unit 115 determines a flight restricted area in real space based on the designated area information included in the above input information. The flight restricted area can be identified, for example, by the position information (latitude information and longitude information) of the designated area on a map.

The coordinate conversion unit 116 has a function of converting the flight restricted area into position coordinates in an image captured by the unmanned aerial vehicle 20. For example, the coordinate conversion unit 116 obtains the coordinates of the flight restricted area on the captured image based on the latitude information and longitude information of the flight restricted area determined by the flight restricted area determination unit 115. This makes it possible to recognize, for example, which part of the captured image is the flight restricted area on the captured image displayed on the touch panel 12 described below.

The output control unit 117 has a function of outputting information related to the flight restriction zone in real space. The manner in which the output control unit 117 outputs the information is not particularly limited. For example, the output control unit 117 may output the information to the touch panel 12. The information may be displayed, for example, superimposed on an image captured by the unmanned aerial vehicle 20. More specifically, the output control unit 117 may display the information on the touch panel 12 as an AR (augmented reality) display showing a position (e.g., an area) corresponding to at least either the inside or the outside of the flight restriction zone, superimposed on the captured image.

In addition, the output control unit 117 may control the display of an object for moving the unmanned aerial vehicle 20 when the object is displayed superimposed on the captured image captured by the unmanned aerial vehicle 20. Specifically, the output control unit 117 may control the display of the object in a manner corresponding to the object being unable to be set as a movement target position when the object is located in a position corresponding to the outside of the flight restriction area in the captured image (i.e., a no-fly area). The manner corresponding to the object being unable to be set may include, for example, a change in the color or shape of the object, or a manner in which an object for completing the setting of a movement target cannot be selected. In addition, the output control unit 117 may control the display of the object so that the object for setting the movement target position can be moved based on an operation on the touch panel 12 only to a position inside the flight restriction area in the captured image.

The output control unit 117 may also output information relating to the flight restricted area in real space to the unmanned aerial vehicle 20. For example, the output control unit 117 may control the unmanned aerial vehicle 20 to fly only in the area inside the flight restricted area. This allows, for example, the unmanned aerial vehicle 20 to fly only in the area corresponding to the flight restricted area.

Next, an example of a method for setting a flight restricted area using the system 1 according to this embodiment will be described with reference to a flowchart. Figure 5 is a flowchart showing a series of controls in the method for setting a flight restricted area using the system 1 according to this embodiment.

First, the map acquisition unit 111 acquires the map information 118 (step SQ101). The acquired map is then displayed on the touch panel 12 by the display control unit 113 (step SQ103).

Figure 6 is a diagram showing a first example screen of the touch panel 12 relating to a method for setting a flight restriction zone by the system 1 according to this embodiment. As shown in Figure 6, a map M1 is displayed on the screen V1 of the touch panel 12. Also, a button 101 for modifying the designated area is displayed on the screen V1. The user can operate the touch panel 12 to set a designated area for the map M1. Also, by performing input such as sliding or pinching on the map M1, it is possible to change or enlarge or reduce the area displayed on the map M1.

Next, the input information acquisition unit 114 acquires information related to the designated area by input to the touch panel 12 (step SQ105). FIG. 7 is a diagram showing a second example screen of the touch panel 12 relating to the method of setting a flight restriction area by the system 1 according to this embodiment. As shown in FIG. 7, a plurality of pins 201 can be set on the map M1 by the user's operation on the touch panel 12. Then, the designated area 202 can be set with each pin 201 as a vertex. The method of setting the designated area 202 is not particularly limited, and the designated area may be set, for example, by freehand. In addition, if a similar area has been set in the past, the designated area may be set by recalling information set in the past. The designated area 202 may be confirmed, for example, when the designation of the pins 201 is completed and an enclosed area is generated.

Next, the flight restriction area determination unit 115 determines a flight restriction area in real space based on the determined designated area 202 (step SQ107). Information related to such flight restriction area may be temporarily stored in the storage 13, for example .

Next, an example of a method for outputting information related to flight restricted areas using the system 1 according to this embodiment will be described with reference to a flowchart. Figure 8 is a flowchart showing a series of controls in a method for outputting information related to flight restricted areas using the system 1 according to this embodiment.

First, the unmanned aerial vehicle 20 captures an image of the flight restriction zone and the surrounding area using the on-board camera 28 (step SQ201). The captured image obtained by this imaging process is acquired by the image acquisition unit 112 (step SQ203). At that time, the position of the unmanned aerial vehicle 20 etc. at the time the captured image was captured is also acquired. The information relating to the position can be used in the conversion process between coordinates on the captured image and coordinates in real space, which will be described later.

Next, the display control unit 113 displays the captured image on the touch panel 12 (step SQ205). Note that the captured image may be a moving image received in real time from the unmanned aerial vehicle 20, or a still image.

Next, the coordinate conversion unit 116 associates the coordinates on the captured image with real space coordinates (step SQ207). This process is for displaying an area corresponding to the flight restriction zone on the captured image, which will be described later. The association between the coordinates on the captured image (local coordinates) and real space coordinates (global coordinates) can be performed using known techniques such as mapping transformation.

Next, the coordinate conversion unit 116 converts the flight restriction zone into coordinates on the captured image based on the above correspondence (step SQ209). Through this process, an area on the captured image corresponding to the flight restriction zone is uniquely determined.

Next, the output control unit 117 displays the area outside the flight restriction zone on the touch panel 12, superimposed on the captured image (step SQ211).

9 is a diagram showing a first example screen of the touch panel 12 relating to a method for outputting information related to the flight restricted zone by the system 1 according to this embodiment. As shown in FIG. 9, a captured image P1 captured by the unmanned aerial vehicle 20 is displayed on the screen V1 of the touch panel 12. The captured image P1 is obtained by capturing an image with the camera 28 of the unmanned aerial vehicle 20 set to a shooting direction directly below. An area FRA10 inside the flight restricted zone and an area FRA11 outside the flight restricted zone are displayed on either side of the boundary line 203 of the flight restricted zone, superimposed on the captured image P1. Also displayed on screen V1 are a button 103 for landing the unmanned aerial vehicle 20, a button 104 for moving the unmanned aerial vehicle 20 in the vertical direction, a button 105 for rotating the unmanned aerial vehicle 20 around the yaw axis, an object 106 for adjusting the shooting direction of the camera 28 mounted on the unmanned aerial vehicle 20, an object 107 for adjusting the wide-angle/telephoto degree of the camera 28, an object 108 for positioning the target movement position of the unmanned aerial vehicle 20, and a button 109 for starting movement of the unmanned aerial vehicle 20.

As shown in FIG. 9, the area FRA10 inside the flight restricted area and the area FRA11 outside the flight restricted area may be displayed in other manners. In the example shown in FIG. 9, no image processing is performed on the area FRA10 inside the flight restricted area, whereas an object may be displayed on the area FRA10 outside the flight restricted area. In this way, it is possible to visually recognize the inside and outside of the flight restricted area from the viewpoint of the unmanned aerial vehicle 20 on the touch panel 12. That is, it is possible to visually recognize the position in real space corresponding to the flight restricted area set by the user himself on the interface of the touch panel 12 during the flight of the unmanned aerial vehicle 20. In addition, the display position of the area inside and outside the flight restricted area may also be changed according to the movement of the unmanned aerial vehicle 20.

Figure 10 is a diagram showing a second example of the screen of the touch panel 12 relating to the output method of information related to the flight restricted area by the system 1 according to this embodiment. In the example shown in Figure 10, the captured image P2 is obtained by capturing an image with the imaging direction of the camera 28 of the unmanned flying object 20 not directly below but diagonally. In this way, even when the imaging direction is diagonal, it is possible to display the area FRA10 inside the flight restricted area and the area FRA11 outside the flight restricted area as information related to the flight restricted area on the captured image P2 in a distinguished manner. In this case, for example, information related to the imaging angle of the camera 28 may be included as position information included in the captured image. Based on the information related to the imaging angle, the coordinate conversion unit 116 associates the coordinates of the flight restricted area with the coordinates of the captured image, thereby making it possible to display the relevant area on the captured image P2. At this time, the position information of the flight restricted area may include predetermined altitude information. This makes it possible to uniquely determine the position of the flight restricted area to be superimposed on the captured image P2.

Figure 11 is a diagram showing a third example of a screen of the touch panel 12 relating to the method of outputting information related to the flight restricted area by the system 1 according to this embodiment. The captured image P1 shown in Figure 11 is the same as the captured image P1 shown in Figure 9. Here, a case where an operation is performed to move the object 108 for positioning the movement target position of the unmanned aerial vehicle 20 onto the area FRA11 outside the flight restricted area will be described. As shown in Figure 11, when an attempt is made to move the object 108 onto the area FRA11 outside the flight restricted area, the state of the object 108 changes and a display such as object 108a appears on the screen V1. In particular, the object 108a may be displayed in a state in which it cannot be set at this position. This allows the user to intuitively understand that the unmanned aerial vehicle 20 cannot be moved to such an area. In addition, as another example, when the object 108 is located at a position included in the area FRA11 outside the flight restricted area, the button 109 for starting the movement of the unmanned aerial vehicle 20 may be changed and displayed in a state in which it cannot be selected. This prevents the user from moving the unmanned aerial vehicle 20 outside the flight restriction area.

Above, an example of a method for controlling the unmanned aerial vehicle 20 by the system 1 according to this embodiment has been described. In the above embodiment, an example of a control method for the actual flight of the unmanned aerial vehicle 20 has been described, but the present technology is not limited to such an example. For example, the present technology can be used for a simulation in which a virtual drone is flown in a VR (Virtual Reality) or AR (Augmented Reality) space. By performing a simulation of the flight behavior of the unmanned aerial vehicle 20 by flight control using VR or AR, the imaging direction of the camera 28 when the unmanned aerial vehicle 20 is actually flown can be confirmed in advance. Note that a known technology can be used for the simulation using a VR space or an AR space.

As described above, according to the system 1 of this embodiment, a flight restricted area can be set on the touch panel 12, and information about the flight restricted area can be obtained via the touch panel 12. For example, the flight restricted area can be superimposed on an image captured by the unmanned aerial vehicle 20 and displayed in an AR-like manner. This allows the user operating the touch panel 12 to set the flight restricted area within which the unmanned aerial vehicle 20 can fly, and intuitively grasp its position. For example, even if the shooting angle of the camera 28 of the unmanned aerial vehicle 20 changes, such a display can be displayed by superimposing an object indicating the flight restricted area at an appropriate position on the captured image.

In the above embodiment, the inside and outside of the flight restricted area are displayed in an AR-like manner using objects or the like, but the present technology is not limited to such an example. For example, when the unmanned aerial vehicle 20 is approaching the boundary of the flight restricted area, an alert indicating that the unmanned aerial vehicle is approaching the boundary may be output by the touch panel 12. In addition, when it is determined that the unmanned aerial vehicle 20 flies outside the flight restricted area or that flight control is being performed such that the unmanned aerial vehicle 20 will exceed the boundary of the flight restricted area within a predetermined time, the unmanned aerial vehicle 20 may be controlled to automatically head toward the inside of the flight restricted area.

Although the preferred embodiment of the present disclosure has been described in detail above with reference to the attached drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person with ordinary knowledge in the technical field of the present disclosure can conceive of various modified or revised examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

The devices described in this specification may be realized as a single device, or may be realized by multiple devices, some or all of which are connected via a network. For example, the control unit and storage of the information processing terminal 10 may be realized by different servers connected to each other via a network.

The series of processes performed by the device described in this specification may be realized using software, hardware, or a combination of software and hardware. A computer program for realizing each function of the information processing terminal 10 according to this embodiment may be created and implemented in a PC or the like. A computer-readable recording medium on which such a computer program is stored may also be provided. Examples of the recording medium include a magnetic disk, an optical disk, a magneto-optical disk, and a flash memory. The above computer program may also be distributed, for example, via a network, without using a recording medium.

In addition, the processes described in this specification using flow chart diagrams do not necessarily have to be performed in the order shown. Some processing steps may be performed in parallel. Also, additional processing steps may be employed, and some processing steps may be omitted.

In addition, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology disclosed herein may provide other effects that are apparent to a person skilled in the art from the description of this specification, in addition to or in place of the above effects.

Note that the following configurations also fall within the technical scope of the present disclosure.
(Item 1)
Displaying a map on a display unit;
acquiring information related to a designated area on the map input based on an operation on the map displayed on the display unit;
outputting information related to a flight restriction zone of an aircraft in real space based on the designated area on the map;
The method includes:
(Item 2)
The method according to item 1,
A method for outputting information related to a flight restricted area in the real space to the display unit.
(Item 3)
The method according to item 2,
Displaying on the display unit a captured image carried on the aircraft flying within the flight restriction area;
and displaying information related to the flight restricted zone on the display unit by superimposing the information on the captured image.
(Item 4)
Item 3. The method according to item 3,
A method for displaying, on the display unit, a display indicating a position in the captured image that corresponds to at least either an inside or an outside of the flight restricted zone, superimposed on the captured image.
(Item 5)
Item 5. The method according to item 4,
A method for displaying an area corresponding to at least either an inside or an outside of the flight restriction zone by superimposing it on the captured image based on information relating to a position in the real space at the time the captured image was captured.
(Item 6)
The method according to any one of items 2 to 5,
displaying on the display unit an image captured by the aircraft flying within the flight restricted area;
an object for setting a movement target position of the flying object is displayed on a display unit that displays the captured image;
When the position of the object is a position corresponding to outside the flight restriction zone in the captured image, the object is displayed on the display unit in a manner corresponding to the object not being set as the movement target position.
(Item 7)
The method according to any one of items 2 to 6,
displaying on the display unit an image captured by the aircraft flying within the flight restricted area;
an object for setting a movement target position of the flying object is displayed on a display unit that displays the captured image;
A method in which display of the object is controlled so that the object can be moved based on an operation on the display unit only to a position inside the flight restriction zone in the captured image.
(Item 8)
The method according to any one of items 1 to 7,
A method for outputting information relating to flight restricted areas in real space to the flying object.
(Item 9)
Item 8. The method according to item 8,
The method, wherein the flying object is controlled to fly only within an area inside a flight restricted area in the real space.
(Item 10)
The method according to any one of items 1 to 9,
A method according to claim 1, wherein the information relating to a flight restricted zone in the real space includes information relating to a no-fly zone that is outside the flight restricted zone.
(Item 11)
A system for flight control of an aircraft, comprising:
a display control unit that displays a map on a display unit;
an input information acquisition unit that acquires information related to a designated area on the map that is input based on an operation on the map displayed on the display unit;
an output control unit that outputs information related to a flight restriction area in a real space based on the designated area on the map;
A system comprising:
(Item 12)
Computer,
a display control unit that displays a map on a display unit;
an input information acquisition unit that acquires information related to a designated area on the map that is input based on an operation on the map displayed on the display unit;
an output control unit that outputs information related to a flight restriction zone of an aircraft in real space based on the designated area on the map;
A program that functions as a

REFERENCE SIGNS LIST 1 System 10 Information processing terminal 11 Control unit 12 Touch panel 20 Unmanned aerial vehicle 28 Camera 111 Map acquisition unit 112 Image acquisition unit 113 Display control unit 114 Input information acquisition unit 115 Flight restriction area determination unit 116 Coordinate conversion unit 117 Output control unit 118 Map information

Claims (10)

Displaying a map on a display unit;
acquiring information related to a designated area on the map input based on an operation on the map displayed on the display unit;
outputting information related to a flight restricted area , which is an area in which an aircraft in real space can fly based on the designated area on the map, the information including altitude information;
displaying information related to a target position of the aircraft and a flight restriction area in the real space on the display unit ;
Moving the set movement target position, the movement target position being unable to move outside the flight restriction area;
Displaying an image captured by the aircraft flying within the flight restriction area on the display unit;
Including,
an object for setting the movement target position of the flying object is displayed on the display unit that displays the captured image;
When the position of the object is a position corresponding to outside the flight restriction zone in the captured image, the object is displayed on the display unit in a manner corresponding to the object not being set as the movement target position . 2. The method of claim 1 ,
Displaying on the display unit a captured image carried on the aircraft flying within the flight restriction area;
and displaying information related to the flight restricted zone on the display unit by superimposing the information on the captured image. 3. The method of claim 2 ,
A method for displaying, on the display unit, a display indicating a position in the captured image that corresponds to at least either an inside or an outside of the flight restricted zone, superimposed on the captured image. 4. The method of claim 3 ,
A method for displaying an area corresponding to at least either an inside or an outside of the flight restriction zone by superimposing it on the captured image based on information relating to a position in the real space at the time the captured image was captured. The method according to any one of claims 1 to 4 ,
displaying on the display unit an image captured by the aircraft flying within the flight restricted area;
an object for setting a movement target position of the flying object is displayed on a display unit that displays the captured image;
A method in which display of the object is controlled so that the object can be moved based on an operation on the display unit only to a position inside the flight restriction zone in the captured image. The method according to any one of claims 1 to 5 ,
A method for outputting information relating to flight restricted areas in real space to the flying object. 7. The method of claim 6 ,
The method, wherein the flying object is controlled to fly only within an area inside a flight restricted area in the real space. The method according to any one of claims 1 to 7 ,
A method according to claim 1, wherein the information relating to a flight restricted zone in the real space includes information relating to a no-fly zone that is outside the flight restricted zone. A system for flight control of an aircraft, comprising:
a display control unit that displays a map on a display unit;
an input information acquisition unit that acquires information related to a designated area on the map that is input based on an operation on the map displayed on the display unit;
an output control unit that outputs information related to a flight restricted area , which is an area in real space where the aircraft can fly based on the designated area on the map, the information including altitude information; and
Equipped with
The output control unit is
displaying information related to a target position of the aircraft and a flight restriction area in the real space on the display unit ;
When the set movement target position is moved , the movement target position cannot be moved outside the flight restriction area,
A captured image captured by the aircraft flying within the flight restricted area is displayed on the display unit;
displaying an object for setting the movement target position of the flying object on the display unit that displays the captured image;
When the position of the object is a position corresponding to outside the flight restriction zone in the captured image, the system displays the object on the display unit in a manner corresponding to the object not being set as the movement target position. Computer,
a display control unit that displays a map on a display unit;
an input information acquisition unit that acquires information related to a designated area on the map that is input based on an operation on the map displayed on the display unit;
an output control unit that outputs information related to a flight restricted area, which is an area in which an aircraft in real space can fly based on the designated area on the map, the information including altitude information; and
A program that functions as
The output control unit is
displaying information related to a target position of the aircraft and a flight restriction area in the real space on the display unit ;
When the set movement target position is moved , the movement target position cannot be moved outside the flight restriction area,
A captured image captured by the aircraft flying within the flight restricted area is displayed on the display unit;
displaying an object for setting the movement target position of the flying object on the display unit that displays the captured image;
and a program for displaying the object on the display unit in a manner corresponding to the object being incapable of being set as the movement target position when the object's position corresponds to a position outside the flight restriction zone in the captured image .

Images