USPatent applicationPatented

Image-sensing system

Granted 5 May 2020 · no office action yet

Assignee: FANUC

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Kouhei Kuribara, Kazuo Sato · Examiner: Talha M Nawaz · AU 2483 · TC 2400

Life of the application

7 dated events
⤢ drag to zoom20202022202420262028203020322034203620382040ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

An object is to provide an image-sensing system which can acquire uniform images with a line sensor camera. An image-sensing system includes: a line sensor camera that shoots a workpiece in which a plurality of circumferential surfaces whose radii differ from each other are aligned in a direction of an axis and which is being machined while being rotated about the axis from a direction orthogonal to the axis so as to cover the entire workpiece in the direction of the axis; and a scan rate change unit which changes a scan rate of the line sensor camera to values that respectively correspond to the radii of the circumferential surfaces, and the line sensor camera shoots the workpiece at the scan rates which are changed to the values corresponding to the radii of the circumferential surfaces so as to respectively correspond to the circumferential surfaces.

Description

10 parts
›This application is based on and claims the…

This application is based on and claims the benefit of priority from Japanese Patent Application No. 2018-065533, filed on 29 Mar. 2018, the content of which is incorporated herein by reference.

BACKGROUND OF THE INVENTION
›Field of the Invention

The present invention relates to an image-sensing system which senses an image of a workpiece.

›Related Art

Conventionally, a line sensor camera (also referred to as a line scan camera) is known which shoots a workplace after being machined in a state where the workpiece is attached to a machine tool (see, for example, patent document 1). The line sensor camera is characterized in that as compared with an area sensor camera, the line sensor camera can easily shoot continuous images and can shoot high-resolution images with low distortion. Images shot with the line sensor camera as described above are utilized in inspections for defects such as a foreign material, a scratch, a hole and a stain.

Patent Document 1: Japanese Unexamined Patent Application, Publication No. H07-001294

›SUMMARY OF THE INVENTION

Since the resolution of the line sensor camera is affected by a scan rate and the speed of a subject, in order to acquire uniform images, a certain level of preparation such as synchronization with an encoder is needed. When a workpiece having circumferential surfaces whose radii differ in a stepwise manner is shot, the distance from the line sensor camera differs in a stepwise manner, and thus the resolution of images shot differs in a stepwise manner, with the result that uniform images cannot be acquired.

The present invention is made in view of the foregoing problem, and an object thereof is to provide an image-sensing system which can acquire uniform images with a line sensor camera.

(1) An image-sensing system (for example, an image-sensing system 1 which will be described later) according to the present invention includes: a line sensor camera (for example, a line sensor camera 4 which will be described later) that shoots a workpiece (for example, a workpiece W which will be described later) in which a plurality of circumferential surfaces (for example, circumferential surfaces W 1 , W 2 which will be described later) whose radii differ from each other are aligned in the direction of an axis (for example, the direction D 1 of an axis which will be described later) and which is being machined while being rotated about the axis from a direction orthogonal to the axis (for example, an orthogonal direction D 2 which will be described later) so as to cover the entire workpiece in the direction of the axis; and a scan rate change unit (for example, a scan rate change unit 20 which will be described later) which changes a scan rate (for example, a scan rate S which will be described later) of the line sensor camera to values that respectively correspond to the radii of the circumferential surfaces, and the line sensor camera shoots the workpiece at the scan rates which are changed to the values corresponding to the radii of the circumferential surfaces so as to respectively correspond to the circumferential surfaces.

(2) Preferably, the image-sensing system of (1) includes: an image processing unit (for example, an image processing unit 21 which will be described later) which extracts, from a plurality of images that are shot so as to respectively correspond to the circumferential surfaces, parts of the circumferential surfaces whose radii correspond to the values of the scan rates of the line sensor camera at which the images are shot, and which combines the extracted parts of the circumferential surfaces.

According to the present invention, it is possible to provide an image-sensing system which can acquire uniform images with a line sensor camera.

›BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing a schematic configuration of an image-sensing system according to an embodiment of the present invention;

FIG. 2 is a function block diagram showing the configuration of a numerical controller in the embodiment of the present invention;

FIG. 3 is a diagram for illustrating the function of an image processing unit in the embodiment of the present invention; and

FIG. 4 is a flowchart showing the flow of the operation of the image-sensing system according to the embodiment of the present invention.

›DETAILED DESCRIPTION OF THE INVENTION · 1 of 3

An embodiment of the present invention will be described in detail below with reference to drawings.

The configuration of an image-sensing system 1 according to the present embodiment will first be described with reference to FIGS. 1, 2 and 3 . FIG. 1 is a diagram showing a schematic configuration of the image-sensing system 1 according to the present embodiment. FIG. 2 is a function block diagram showing the configuration of a numerical controller 3 in the present embodiment. FIG. 3 is a diagram for illustrating the function of an image processing unit 21 in the present embodiment.

Here, a plurality of uniform true circular patterns which are arranged at regular intervals on circumferential surfaces W 1 and W 2 in a workpiece W of FIG. 1 whose radii differ from each other are provided for convenience of description. Likewise, a plurality of uniform true circular patterns which are arranged at regular intervals in the images P 1 , P 2 and P 3 of FIG. 3 are also provided for convenience of description.

The image-sensing system 1 shown in FIG. 1 is a system which shoots the workpiece W that is being machined in a machine tool 2 . In the workpiece W which is a target to be shot by the image-sensing system 1 , the circumferential surfaces W 1 and W 2 whose radii differ from each other are aligned in the direction D 1 of an axis of a spindle (which is not shown in the figure) in the machine tool 2 , and the workpiece W is rotated about the spindle. In other words, with the machine tool 2 which will be described later, a cylindrical portion whose radius is large and a cylindrical portion whose radius is small are machined so as to be aligned in the direction D 1 of the axis, and the image-sensing system 1 shoots the shape of the machined workpiece W as described above.

As shown in FIG. 1 , the image-sensing system 1 according to the present embodiment includes the machine tool 2 , the numerical controller (CNC device) 3 , a line sensor camera 4 and a camera control unit 5 . Here, the line sensor camera is also referred to as a line scan camera.

Under control of the numerical controller 3 , the machine tool 2 rotates the workpiece W which is attached to the spindle (which is not shown in the figure), and presses a cutting tool (which is not shown in the figure) attached to a tool post (which is not shown in the figure) onto the workpiece W so as to perform cutting (turning).

As shown in FIG. 2 , the numerical controller 3 includes a CPU 10 , a memory 11 , a display unit 12 , an input unit 13 , an interface 14 and a bus 15 .

The CPU 10 is a processor which comprehensively controls the image-sensing system 1 (see FIG. 1 ). The CPU 10 is connected through the bus 15 to the memory 11 , the display unit 12 , the input unit 13 and the interface 14 . The memory 11 is formed with a ROM 16 , a RAM 17 , a nonvolatile memory 18 and the like. The display unit 12 displays information necessary for an operator. The input unit 13 is a keyboard or the like for inputting various types of commands and data. The interface 14 is connected to an external storage medium, a host computer and the like so as to exchange various types of commands and data.

The CPU 10 functions as a scan rate change unit 20 , an image processing unit 21 , a determination unit 22 , a spindle speed change unit 23 and the like.

The scan rate change unit 20 changes the scan rate [μ sec.] of the line sensor camera 4 (see FIG. 1 ) to values which respectively correspond to the radii of the circumferential surfaces W 1 and W 2 of the workplace W (see FIG. 1 .). Specifically, the scan rate change unit 20 acquires, from programs stored in the memory 11 , the radii (radii r [mm]) of the circumferential surfaces W 1 and W 2 (see FIG. 1 ) and the speed n [rpm] of the spindle in the machine tool 2 (see FIG. 1 ). Then, the scan rate change unit 20 calculates the surface speeds V [mm/sec.]=2πr×n/60 of the circumferential surfaces W 1 and W 2 , and uses the preset resolution R [mm/pix] of the line sensor camera 4 (see FIG. 1 ) so as to calculate the scan rates S [μ sec.]=R× 10 6 /V.

More specifically, the scan rate change unit 20 calculates, according to surface speeds V of the circumferential surfaces W 1 and W 2 which are calculated, the scan rates S at which desired high resolutions can be obtained. In this way, a scan rate S 1 at which a desired high resolution corresponding to the circumferential surface W 1 can be obtained and a scan rate S 2 at which a desired high resolution corresponding to the circumferential surface W 2 can be obtained are calculated.

Then, the scan rate change unit 20 changes, based on the result of the calculation, the scan rates S [μ sec.] of the line sensor camera 4 (see FIG. 1 ) according to each of the circumferential surfaces W 1 and W 2 . The scan rate change unit 20 may acquire the radii (radii r [mm]) of the circumferential surfaces W 1 and W 2 (see FIG. 1 ) from the result of analysis of data of images shot with the line sensor camera 4 (see FIG. 1 ) instead of the machining programs stored in the memory 11 . Specifically, based on a known relationship between the camera coordinates of the line sensor camera 4 and the machine coordinates of the machine tool 2 , distances between the line sensor camera 4 and the circumferential surfaces W 1 and W 2 of the workpiece W and the spindle may be calculated from image data shot, and based on the calculated distances, the radii of the circumferential surfaces W 1 and W 2 may be calculated and acquired.

The image processing unit 21 extracts, from the images P 1 and P 2 (see FIG. 3 ) which are shot by the line sensor camera 1 (see FIG. 1 ) so as to respectively correspond to the circumferential surfaces W 1 and W 2 , parts of the circumferential surfaces whose radii correspond to the values of the scan rates S of the line sensor camera 4 (see FIG. 1 ) at which the images P 1 and P 2 (see FIG. 3 ) are shot, and combines the extracted parts of the circumferential surfaces W 1 and W 2 so as to produce the new image P 3 (see FIG. 3 ).

›DETAILED DESCRIPTION OF THE INVENTION · 2 of 3

In other words, as shown in FIG. 3 , the image processing unit 21 (see FIG. 2 ) extracts the part P 11 of the circumferential surface W 1 from the image P 1 shot at the scan rate S [μ sec.] corresponding to the circumferential surface W 1 (see FIG. 1 ), and extracts the part P 22 of the circumferential surface W 2 from the image P 2 shot at the scan rate S [μ sec.] corresponding to the circumferential surface W 2 . Then, the image processing unit 21 (see FIG. 2 ) combines the extracted part P 11 of the circumferential surface W 1 and the extracted part P 22 of the circumferential surface W 2 , and thereby produces the new image P 3 . In this way, the image P 3 is a combination of the image P 11 and the image P 22 in which the desired high resolutions respectively corresponding to the radii of the circumferential surfaces W 1 and P 2 can be obtained, with the result that the image P 3 is a uniform image.

With reference back to FIG. 2 , the determination unit 22 compares the scan rates S [μ sec.] calculated by the scan rate change unit 20 and the minimum value S min [μ sec.] of the scan rate which can be set by the line sensor camera 4 (see FIG. 1 ). Then, the determination unit 22 determines whether or not the scan rates S [μ sec.] calculated by the scan rate change unit 20 are equal to or more than the minimum value S min [μ sec.] of the scan rate which can be set by the line sensor camera 4 (see FIG. 1 ).

When the determination unit 22 determines that the scan rates S [μ sec.] calculated by the scan rate change unit 20 are not equal to or more than the minimum value S min [μ sec.] of the scan rate which can be set by the line sensor camera 4 (see FIG. 1 ), the determination unit 22 further determines whether or not the parts corresponding to the scan rates are being machined. Even when the determination unit 22 determines that the parts corresponding to the scan rates are “not being machined”, the parts which do not correspond to the scan rates are being machined, and thus the workpiece W as a whole is being machined.

When the determination unit 22 determines that the workpiece W is not being machined, the spindle speed change unit 23 sets the speed n [rpm] of the spindle in the machine tool 2 (see FIG. 1 ) such that the calculated scan rates S [μ sec.] of the line sensor camera 4 (see FIG. 1 ) are the minimum value S min [μ sec.] which can be set.

With reference back to FIG. 1 , the line sensor camera 4 shoots the workpiece W from a direction D 2 orthogonal to the spindle (which is not shown in the figure) of the machine tool 2 so as to cover the entire workpiece W in the direction D 1 of the axis. Specifically, the line sensor camera 4 shoots the workpiece W at the scan rates S [μ sec.] which are changed to the values corresponding to the radii of the circumferential surfaces W 1 and W 2 so as to respectively correspond to the circumferential surfaces W 1 and W 2 . The data of the images shot with the line sensor camera 4 is fed through the camera control unit 5 to the numerical controller 3 .

The operation of the image-sensing system 1 will then be described with reference to FIG. 4 . FIG. 4 is a flowchart showing the flow of the operation of the image-sensing system 1 .

As shown in FIG. 4 , in step S 11 , the cutting of the workpiece W with the machine tool 2 is first started. Then, the process proceeds to step S 12 , and the scan rate change unit 20 acquires the radii (radii r [mm]) of parts of the workpiece W which are being cut and the speed n [rpm] of the spindle in the machine tool 2 . As described previously, the radii of the workpiece W may be acquired from the machining programs of the numerical controller 3 or may be acquired by calculation from images shot with the line sensor camera 4 .

Then, the process proceeds to step S 13 , and the scan rate change unit 20 calculates the surface speeds V [mm/sec.] of the parts of the workpiece W which are being cut. After the calculation, the process proceeds to step S 14 , and the scan rates S [μ sec.] which respectively correspond to the circumferential surfaces W 1 and W 2 of the workpiece W are calculated from the desired resolutions R [mm/pix] of the line sensor camera 4 .

Then, the process proceeds to step S 15 , and the determination unit 22 determines whether or not the scan rates S [μ sec.] calculated by the scan rate change unit 20 are equal to or more than the minimum value S min [μ sec.] of the scan rate which can be set by the line sensor camera 4 . The minimum value S min of the scan rate is previously set according to the performance of the line sensor camera 4 .

When the determination of step S 15 is yes, that is, when the scan rates S [μ sec.] calculated by the scan rate change unit 20 are equal to or more than the minimum value S min [μ sec.] of the scan rate which can be set by the line sensor camera 4 , the process proceeds to step S 16 , and the scan rate change unit 20 changes the scan rate S [μ sec.] of the line sensor camera 4 to the calculated values. After the change, the process proceeds to step S 20 .

When the determination of step S 15 is no, that is, when the scan rates S [μ sec.] calculated by the scan rate change unit 20 are not equal to or more than the minimum value S min [μ sec.] of the scan rate which can be set by the line sensor camera 4 , the process proceeds to step S 17 , and the determination unit 22 determines whether or not the parts corresponding to the scan rates are being machined.

When the determination of step S 17 is yes, that is, when the parts corresponding to the scan rates S are being machined, the process proceeds to step S 18 , and the scan rate change unit 20 changes the scan rate S [μ sec.] of the line sensor camera 4 to the minimum value S min [μ sec.] which can be set. After the change, the process proceeds to step S 20 .

When the determination of step S 17 is no, that is, when the parts corresponding to the scan rates S are not being machined, the process proceeds to step S 19 , and the spindle speed change unit 23 sets the speed n [rpm] of the spindle in the machine tool 2 such that the calculated scan rates S [μ sec.] of the line sensor camera 4 are the minimum value S min [μ sec.] which can be set. After the setting, the process proceeds to step S 18 , and the scan rate change unit 20 changes the scan rate S [μ sec.] of the line sensor camera 4 to the minimum value S min [μ sec.] which can be set. After the change, the process proceeds to step S 20 .

›DETAILED DESCRIPTION OF THE INVENTION · 3 of 3

In step S 20 , the workpiece W is shot with the line sensor camera 4 at the scan rates S [μ sec.] of the line sensor camera 4 which are changed in the individual steps described above. After the shooting, the process proceeds to step S 21 , and the image processing unit 21 extracts the machined parts from the images shot. Specifically, as described previously, the part P 11 of the circumferential surface W 1 is extracted from the image P 1 shot at the scan rate S corresponding to the circumferential surface W 1 , and the part P 22 of the circumferential surface W 2 is extracted from the image P 2 shot at the scan rate corresponding to the circumferential surface W 2 . After the extraction, the present process is completed.

The present process is repeatedly performed. The image processing unit 21 combines the extracted parts so as to produce the new image. As necessary, the produced image is displayed on the display unit 12 or the like and is output.

As described above, in the image-sensing system 1 according to the present embodiment, even when the workpiece W is being machined, with the line sensor camera, it is possible to acquire a uniform high-resolution image. Hence, even when the workpiece W is being machined, the inspection of the workpiece W can be performed. Even when the workpiece W has the circumferential surfaces W 1 and W 2 whose radii differ from each other, it is possible to acquire the images of the surfaces at constant desired resolutions, with the result that it is possible to compare a plurality of parts whose radii differ from each other.

Although the embodiment of the present invention is described above, the present invention is not limited to the embodiment described above. The effects described in the present embodiment are simply a list of the most preferred effects produced from the present invention, and the effects of the present invention are not limited to the effects described in the present embodiment.

For example, although in the embodiment described above, the machined workpiece W is shaped such that the two circumferential surfaces W 1 and W 2 whose radii differ from each other are aligned in the direction D 1 of the axis of the spindle, there is no limitation to this shape. The machined workpiece W may be shaped such that three or more circumferential surfaces whose radii differ from each other are aligned in the direction D 1 of the axis as long as they fall within the range of shooting of the line sensor camera 4 .

Although in the embodiment described above, the CPU 10 of the image-sensing system 1 which functions as the scan rate change unit 20 , the image processing unit 21 , the determination unit 22 and the spindle speed change unit 23 is incorporated in the numerical controller 3 , there is no limitation to this configuration. The CPU 10 may be incorporated in a higher controller other than the numerical controller 3 , a separate PC or the like.

›EXPLANATION OF REFERENCE NUMERALS

1 image-sensing system

2 machine tool

3 numerical controller

4 line sensor camera

5 camera control unit

10 CPU

11 memory

12 display unit

13 input unit

14 interface

15 bus

16 ROM

17 RAM

18 nonvolatile memory

20 scan rate change unit

21 image processing unit

22 determination unit

23 spindle speed change unit

W workpiece

W 1 , W 2 circumferential surface

D 1 direction of axis

D 2 orthogonal direction

S scan rate

R radius

n speed

V surface speed

R resolution

P 1 , P 2 image

1 of 10 part labels are ours — the grant heads the rest

Claims as granted

2 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

2 codes
IPC · International Patent Classification
Section G — Physics
  • G06T7/55
Section H — Electricity
  • H04N5/232

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomApr 2019Jul 2019Oct 2019Jan 2020Apr 2020Jul 2020USPTOApplicantNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
1.1 y
406 days filing → grant
Office actions
0
none on record
Examiner
Talha M Nawaz
art unit 2483 · TC 2400
Citations: 7 back · 1 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20202022202420262028203020322034203620382040Owner 1
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock