System, method, and program for controlling drone

The present invention relates to a system, a method, and a program for controlling a drone that takes an image with a camera.

Recently, drones have been widely used, for example, taking images from the sky. The images are analyzed and used for measurement, etc. For example, the sensor system of a drone that is provided with a photodetection and ranging system and a camera system to check the diameters of any number of trees in a group is proposed (Patent Document 1).

Patent Literature

Patent Document 1; JP 2014-122019A

However, the system of Patent Document 1 has a problem in which the resolution of an image to be taken has to be always high to fly with checking the diameters of any number of trees in a group. In other words, such a system only has to provide a resolution to determine the diameters of trees but actually a higher resolution to take an image regardless of the imaging point.

In view of the above-mentioned problems, an objective of the present invention is to provide a system, a method, and a program for controlling a drone to take an image at high resolution if a predetermined condition is satisfied.

The first aspect of the present invention provides a system for controlling a drone, including:

an image acquisition unit that acquires an image taken by a drone;

an image analysis unit that analyzes the acquired image;

an extraction unit that extracts a point that satisfies a predetermined condition based on the result of the image analysis;

a position coordinate acquisition unit that acquires the position coordinate of the extracted point; and

a control unit that controls the drone to fly to the acquired position coordinate and take an image at a higher resolution than that of the analyzed image.

According to the first aspect of the present invention, the system acquires an image taken by a drone, analyzes the acquired image, extracts a point that satisfies a predetermined condition based on the result of the image analysis, acquires the position coordinate of the extracted point, and controls the drone to fly to the acquired position coordinate and take an image at a higher resolution than that of the analyzed image.

The first aspect of the present invention is the category of a system, but the categories of a method, a program, etc., have similar functions and effects.

The present invention is capable to take an image with high resolution at a point where a predetermined condition is satisfied, so as to avoid useless data from being generated by imaging an unnecessary part at high resolution.

FIG. 1 shows a schematic diagram of the system for controlling a drone.

FIG. 2 shows a flow chart of the method for controlling a drone.

FIG. 3 shows one example illustrating the points where the edge variation is a predetermined value or more.

FIG. 4 shows one example illustrating the points where image analysis cannot be performed due to low resolution.

Embodiments of the present invention will be described below with reference to the attached drawings. However, these are illustrative only, and the technological scope of the present invention is not limited thereto.

The system for controlling a drone 1 that is shown in FIG. 1 includes an image acquisition module 11 , an image analysis module 12 , an extraction module 13 , a position coordinate acquisition module 14 , a control module 15 , and a setting module 16 that the control unit achieves by reading a predetermined program. The drone 100 may be an uninhabited airborne vehicle or a multicopter.

The image acquisition unit 11 acquires the image taken by the camera 101 of a drone 100 connected through a network. The network may be wired or wireless, may be a public line network such as the Internet or a dedicated line network, and may be connected with a cloud or through Peer to Peer (hereinafter referred to as “P2P”).

The image analysis module 12 analyzes the acquired image. For example, the image analysis module 12 performs edge detection that is a feature detection. The extraction module 13 extracts a point that satisfies a predetermined condition based on the result of the image analysis. For example, the extraction module 13 extracts a point where the edge variation is a predetermined value or more and a point where the image analysis cannot be performed clue to low resolution.

The position coordinate acquisition module 14 acquires the position coordinate of the extracted point. For example, the drone 100 is provided with a global positioning system (hereinafter referred to as “GPS”) 102 to determine the position coordinate of an imaging location. Thus, the position coordinate of the point extracted from the image is also determined. Furthermore, if the drone 100 is provided with an altimeter 103 , the altitude is determined.

The control module 15 controls the drone 100 to fly to the position coordinate of the extracted point and take an image at a higher resolution or more than that of the above-mentioned image. To take an image at a higher resolution or more than that of the above-mentioned image, for example, the control module 15 controls the drone 100 to approach or to increase the magnification of the camera 101 .

The setting module 16 sets the flight route to fly to all the points if there are two or more points, for example.

The setting module 16 sets the flight route to fly in order of closer position coordinates of the points if there are two or more points, for example. The setting module 16 sets the flight route to fly in order of increasing the edge variations of the points if there are two or more points, for example.

Process Behavior

The drone control process will be described below with reference to FIG. 2 . The image acquisition step S 11 acquires the image taken by the camera 101 of a drone 100 connected through a network. The image analysis step S 12 analyzes the acquired image. For example, the image analysis step S 12 performs edge detection. The edge detection is to detect a discontinuously changed part.

The extraction step S 13 extracts a point that satisfies a predetermined condition based on the result of the image analysis. Examples of the point that satisfies a predetermined condition include a point where the edge variation is a predetermined value or more, which is circled in FIG. 3 , and a point where the image analysis cannot be performed due to low resolution, which is circled in FIG. 4 .

The position coordinate acquisition step S 14 acquires the position coordinate of the extracted point. For example, the drone 100 is provided with a GPS 102 to determine the position coordinate of an imaging location, as described above. Thus, the position coordinate of the point extracted from the image is also determined. Furthermore, if the drone 100 is provided with an altimeter 103 , the altitude is determined.

The control step S 15 controls the drone 100 to fly to the position coordinate of the extracted point and take an image at a higher resolution or more than that of the above-mentioned image. To take an image at a higher resolution or more than that of the above-mentioned image, for example, the control module 15 controls the drone 100 to approach or to increase the magnification of the camera 101 .

The setting step S 16 sets the flight route to fly all the points based on their respective position coordinates if there are two or more points, for example. The setting step S 16 sets the flight route to fly in order of closer position coordinates of the points if there are two or more points, for example. The setting step S 16 sets the flight route to fly in order of increasing the edge variations of the points if there are two or more points, for example.

To achieve the means and the functions that are described above, a computer (including a CPU, an information processor, and various terminals) reads and executes a predetermined program. For example, the program may be provided through Software as a Service (SaaS), specifically, from a computer through a network or may be provided in the form recorded in a computer-readable medium such as a flexible disk, CD (e.g., CD-ROM), or DVD (e.g., DVD-ROM, DVD-RAM). In this case, a computer reads a program from the record medium, forwards and stores the program to and in an internal or an external storage, and executes it. The program may be previously recorded in, for example, a storage (record medium) such as a magnetic disk, an optical disk, or a magnetic optical disk and provided from the storage to a computer through a communication line.

The embodiments of the present invention are described above. However, the present invention is not limited to the above-mentioned embodiments. The effect described in the embodiments of the present invention is only the most preferable effect produced from the present invention. The effects of the present invention are not limited to those described in the embodiments of the present invention.

1 System for controlling a drone

11 Image acquisition module

12 Image analysis module

13 Extraction module

14 Position coordinate acquisition module

15 Control module

16 Setting module

100 Drone

101 Camera

102 GPS

103 Altimeter