USPatent applicationPatented

Virtual track design system for mobile devices and implementation method thereof

Granted 25 Oct 2022 · no office action yet

Life of the application

7 dated events
⤢ drag to zoom20182020202220242026202820302032203420362038ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

A virtual track design system for mobile devices and implementation method thereof are disclosed. The virtual track design system includes communication module: which is mainly used for relevant map information, virtual track information, positioning information, and task information transmission, and acts as a bridge; interaction module: which sets fixed track with arbitrary shape and length through graphical editing environment, and supports segmental modification, deletion of tracks and other functions. After editing, sends the virtual track information to the intelligent cruise algorithm processing module; acquisition module: which gets the virtual track information provided by the interaction module, stores relevant data, and sends the information to the key point of track extraction module. The invention does not require additional cost to deploy auxiliary equipment, and is more convenient, flexible and fast to use.

Description

8 parts
›CROSS REFERENCE TO RELATED APPLICATIONS

This application is the national phase entry of International Application No. PCT/CN2018/080272, filed on Mar. 23, 2018, which is based upon and claims priority to Chinese Patent Application No. 201710181094.0 filed on Mar. 24, 2017, the entire contents of which are incorporated herein by reference.

›TECHNICAL FIELD

The present invention relates to a virtual track design system and implementation method thereof, particularly to a virtual track design system for mobile devices and implementation method thereof.

›BACKGROUND

At present, the existing setpoint cruise systems based on the preset trajectory are mainly implemented as follows:

First, laying track. Magnetic conductivity physical traction systems such as urban trams and some food-delivery robots are used for laying track to realize setpoint cruise according to a preset track. This scheme uses track technology and auxiliary sensors (infrared sensor, ultrasonic sensor and other sensors) to achieve obstacle avoidance behavior. Laying tracks has the following disadvantages: 1. additional deployment of tracks is required, which results in high cost, complicated operation and inflexible usage; 2. high operating noise and greatly change the environment.

Second, the visible light camera, infrared thermal imager and other detection instruments are used to patrol the line to achieve the setpoint cruise according to the preset trajectory. This scheme also requires the deployment of auxiliary equipment in the working environment. Similarly, the operation is complex, the cost is high and the operation is inflexible. In addition, there is no guarantee of environmental invariability and cleanliness.

Based on the deficiencies of the existing cruise system at setpoint according to the preset trajectory, the present invention provides a new virtual track design and a method for realizing the navigation system.

›SUMMARY · 1 of 2

The technical problem to be solved by the present invention is to provide a virtual track design system for mobile devices and an implementation method thereof, which does not need to deploy additional auxiliary equipment and is more convenient, flexible and fast to use. In addition, there is no impact on the environment, and it is more convenient to add and remove the virtual track, and the system is more intelligent.

The invention solves the above technical problems through the following technical solutions: a virtual track design system for mobile devices, wherein its core modules and functions are as follows:

communication module: the communication module is mainly used for relevant map information, virtual track information, positioning information, and task information transmission, and acts as a bridge;

interaction module: the interaction module sets fixed track with arbitrary shape and length through graphical editing environment, and supports segmental modification, deletion of tracks and other functions. After editing, the interaction module sends the virtual track information to the intelligent cruise algorithm processing module;

acquisition module: the acquisition module gets the virtual track information provided by the interaction module, stores relevant data, and sends the virtual track information to the orbital key point extraction module;

orbital key point extraction module: the key point information of the virtual track can be extracted by the orbital key point extraction module according to the virtual track information, and a point where the derivative of the first order is 0 by piecewise fitting according to the limiting conditions such as the slope of the curve, etc., etc. is the key point of the virtual track;

sensor data acquisition and filtering module: the data of the sensor configured on the intelligent device is collected, and relevant filtering algorithm is adopted to remove the noise point of measurement data;

odometer module: the odometer obtains the mileage data of intelligent devices and provides prior knowledge for the autonomous positioning module;

map module: the map module mainly uses SLAM related algorithm to build environment map. The map can be used for global path planning and autonomous positioning module, which is the core module of intelligent mobile algorithm;

autonomous positioning module: based on the current sensor information, the autonomous positioning module constructs the storage module by combining the map, and the relevant matching algorithm is used to obtain the current position information and posture information, so that the intelligent device can know its position and posture in the environment in real time;

graph structure construction module of the orbital key point: the graph structure construction module uses the key point information in the orbital key point extraction module and map information of sensor data acquisition and filtering module, combines the accessibility between key points, constructs vertex and edge information of the graph structure, and provides data support for the search of key track of virtual track;

task scheduling management module: this module is mainly used to manage navigation tasks issued by users, including setting task sequence, task distribution, task execution logic, invoking path planning service and other parts. It is the control center of the whole system;

global key point path search module: according to tasks issued by the task scheduling management module and information of the autonomous positioning module, combining with the heuristic search algorithm, the global key point path search module searches the optimal path along the virtual track from the starting point to the end point by using graph structure of the track key point, and guides the intelligent device to complete the cruise task;

local trajectory planning module: the local trajectory planning module generates a smooth collision-free control decision by using observation data fused by multi-sensors, the current virtual track node information and autonomous positioning information, and combining with the current speed information. So that the intelligent device can complete the specified cruise task without collision.

motion control module: motion control module generates motion control decisions by using the collision free control decisions generated by the local trajectory planning module, and combining with the intelligent devices motion model, to control the smooth and collision-free movement of intelligent devices at a certain speed.

intelligent movement module: intelligent movement module receives the instruction of motion control module to control the collision-free movement of the device.

Preferably, the communication module includes a client communication module and a communication module of system algorithm processing layer.

The invention also provides an implementation method of a virtual track design system for mobile devices, including the following steps:

Step 1: setting, adding, deleting and editing the virtual track information by users through the interaction module sending the virtual track information to the algorithm processing part by the communication module.

Step 2: receiving the corresponding virtual track information sent by the interaction module by the communication module of the algorithm processes part, and going to step 3.

Step 3: after receiving the relevant information of the virtual track, extracting by the acquisition module, the key point information of virtual track based on the virtual track information, and a point where the derivative of the first order is 0 by piecewise fitting according to the limiting conditions such as the slope of the curve, etc., etc. is the key point of the virtual track, and going to step 4.

Step 4: combining with map information of map module, key points information of track, and accessibility between key points to construct vertex and edge information of graph structure.

Step 5: after receiving the navigation task by the communication module, according to the information of the autonomous positioning module and the search algorithm, searching the optimal key points path along the virtual track from the starting point to the end point by using the graph structure of the key points along the track in step 4, and going to step 6.

›SUMMARY · 2 of 2

Step 6: according to the key point path generated in step 5, combining with the current fusion observation information and autonomous positioning information of the mobile device, and according to the motion speed and model of the mobile device, to generate the control decision. If the control decision is generated, then going to step 7, otherwise, exiting and ending the task.

Step 7: smoothening the speed according to the control decision of step 6, and issuing control instructions to the mobile device, and controlling the movement of the mobile device.

The advantages of the invention are: the invention can set fixed track with arbitrary shape and length on the interactive interface by the user through interactive mode, and supports functions such as segmenting modification and track deletion, making it convenient and flexible in operation. According to the virtual track given by the user, key points of the track (intersections, inflection points and other characteristic points representing the track characteristics) are extracted to construct the graph of the virtual track. According to the starting point of the mobile device and the end point set by the user, the key points of the virtual track closest to the starting point and the end point were searched respectively, and graph is used to search the shortest virtual track to the destination point. By using the trajectory planning strategy and combining with the sensing sensor of mobile devices, the mobile device can move to the designated position smoothly, avoiding any collision, and realize the set-point cruise function. The invention does not require additional cost to deploy auxiliary equipment, and is more convenient, flexible and fast to use. In addition, it does not need to change the environment, and it is more convenient to add and remove the vritual track and the present invention is more intelligent.

›BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is the schematic diagram of the present invention.

›DETAILED DESCRIPTION OF THE EMBODIMENTS · 1 of 2

In order to specifically explain the technical solution of the present invention, FIGURE is used to represent the preferred embodiment of the invention as below.

As shown in FIG. 1 , virtual track design system for mobile devices of the present invention includes:

communication module: which contains two parts, client communication module and system algorithm processing layer communication module. It is mainly used for relevant map information, virtual track information, positioning information, and task information transmission, and acts as a bridge;

interaction module: which sets fixed track with arbitrary shape and length through graphical editing environment, and supports segmental modification, deletion of tracks and other functions. After editing, sends the virtual track information to the intelligent cruise algorithm processing module;

acquisition module: which gets the virtual track information provided by the interaction module, stores relevant data, and sends the virtual track information to the key point of track extraction module;

orbital key point extraction module: by which according to virtual track information, the key points information of the virtual track can be extracted, and a point where the derivative of the first order is 0 by piecewise fitting according to the limiting conditions such as the slope of the curve, etc. is the key point of the virtual track;

sensor data acquisition and filtering module: by which the data of the sensor configured on the intelligent device is collected, and relevant filtering algorithm is adopted to remove the noise of measurement data;

odometer module: which obtains the mileage data of intelligent devices and provide prior knowledge for the autonomous positioning module;

map module: which mainly uses SLAM related algorithm to build environment map. The map can be used for global path planning and autonomous positioning module, which is the core module of intelligent mobile algorithm;

autonomous positioning module: which is based on the current sensor information, the storage module is constructed by combining with the map, and the relevant matching algorithm is used to obtain the current position information and posture information, so that the intelligent device can know its position and posture in the environment in real time;

graph structure construction module of the orbital key point: which uses the key point information in the orbital key point extraction module and map information of sensor data acquisition and filtering module. Combines the accessibility between key points, constructs vertex and edge information of the graph structure, and provides data support for the search of key track of virtual track;

task scheduling management module: this module is mainly used to manage navigation tasks issued by users, including setting task sequence, task distribution, task execution logic, invoking path planning service and other parts. It is the control center of the whole system;

global key point path search module: which is according to the tasks issued by the task scheduling management module and autonomously positions module information, combining with the heuristic search algorithm, searches the optimal path along the virtual track from the starting point to the end point by using the graph structure of the orbital key point of track, and guides the intelligent device to complete the cruise task;

local trajectory planning module: which uses the observation data fused by multi-sensor, current virtual track node information and autonomous positioning information, and combines with the current speed information to generate a smooth collision-free control decision so that the intelligent device can complete the specified cruise task without collision.

motion control module: which uses collision free control decisions generated by the local trajectory planning module, combines with the intelligent device's motion model, generates motion control decisions, to control the smooth and collision-free movement of intelligent devices at a certain speed.

intelligent movement module: which receives the instruction of motion control module to control the collision-free movement of the device.

Communication module and interaction module constitute the interaction part.

The acquisition module, the orbital key point extraction module, the sensor data acquisition and filtering module, the odometer module, the map module, the graph structure construction module of orbital key point, the task scheduling management module, the global key point path search module, the local trajectory planning module, the autonomous positioning module, the motion control module, and the intelligent movement module constitute the algorithm processing part.

An implementation method of a virtual track design system for mobile devices provided by the invention includes:

Step 1: setting, adding, deleting and editing the virtual track information by users through the interaction module sending the virtual track information to the algorithm processing part by the communication module.

Step 2: receiving the corresponding virtual track information sent by the interaction module by the communication module of the algorithm processes part, and going to step 3.

Step 3: after receiving the relevant information of the virtual track, extracting by the acquisition module, the key information of virtual track based on the virtual track information, and a point where the derivative of the first order is 0 by piecewise fitting according to limiting conditions such as slope of the curve, etc. is the key point of the virtual track, and going to step 4.

Step 4: combining with map information of map module, key points information of track, and accessibility between key points to construct vertex and edge information of graph structure.

Step 5: after receiving the navigation task by the communication module, according to the information of the autonomous positioning module and the search algorithm, searching the optimal key points path along the virtual track from the starting point to the end point by using the graph structure of the key points along the track in step 4, and going to step 6.

›DETAILED DESCRIPTION OF THE EMBODIMENTS · 2 of 2

Step 6: according to the key point path generated in step 5, combining with the current fusion observation information and autonomous positioning information of the mobile device, and according to the motion speed and model of the mobile device, to generate the control decision. If the control decision is generated, then going to step 7, otherwise, exiting and ending the task.

Step 7: smoothening the speed according to the control decision of step 6, and issuing control instructions to the mobile device, and controlling the movement of the mobile device.

The detailed embodiment above further specifically explains the technical problems, the technical solution and beneficial effects of the present invention. It should be understood that the above is only a specific embodiment of the present invention, which should not be used to limit the invention. Any modification, equivalent replacement and improvement made within the spirit and principles of the invention shall be included in the protection scope of the invention.

Claims as granted

3 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

4 codes
IPC · International Patent Classification
Section G — Physics
  • G06N5/02
  • G06F30/15
  • G05D1/02
  • G06F9/48

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJan 2018Jul 2018Jan 2019Jul 2019Jan 2020Jul 2020Jan 2021Jul 2021Jan 2022Jul 2022Jan 2023USPTOApplicantNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
4.6 y
1,677 days filing → grant
Office actions
0
none on record
Examiner
Richard M Camby
art unit 3661 · TC 3600
Citations: 10 back · 0 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom2020202220242026202820302032203420362038Owner 1
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock