Performing image process and size measurement upon a three-dimensional ultrasound image in an ultrasound system
Granted 2 Dec 2014 · 4 office actions
Current assignee: Samsung Medison Co., Ltd. · originally Samsung Electronics
Law firm: Law firm · Log in to unlock
Attorney: Attorney · Log in to unlock
Inventors: Jae Heung Yoo, Eun Ho Yang · Examiner: Joel Lamprecht · AU 3737 · TC 3700
Life of the application
18 dated eventsAbstract
Embodiments for performing an image process and a size measurement upon a three-dimensional ultrasound image are disclosed. In one embodiment, by way of non-limiting example, an ultrasound system comprises: a user input unit configured to receive input information for setting at least one seed point on a two-dimensional ultrasound image from a user; an ultrasound data acquisition unit configured to transmit and receive ultrasound signals to and from a target object including a plurality of objects of interest and output ultrasound data; and a processing unit configured to form volume data based on the ultrasound data, form the two-dimensional ultrasound image and a three-dimensional ultrasound image based on volume data, detect at least one object of interest corresponding to the input information from the three-dimensional ultrasound image, and perform an image process and a size measurement of the detected object of interest upon the three-dimensional ultrasound image.
Description
8 parts›CROSS-REFERENCE TO RELATED APPLICATIONS
The present application claims priority from Korean Patent Application No. 10-2010-0006722 filed on Jan. 26, 2010, the entire subject matter of which is incorporated herein by reference.
›TECHNICAL FIELD
The present disclosure generally relates to ultrasound systems, and more particularly to performing an image process and size measurement upon a three-dimensional (3D) ultrasound image in an ultrasound system.
›BACKGROUND
An ultrasound system has become an important and popular diagnostic tool since it has a wide range of applications. Specifically, due to its non-invasive and non-destructive nature, the ultrasound system has been extensively used in the medical profession. Modern high-performance ultrasound systems and techniques are commonly used to produce two-dimensional (2D) or three-dimensional (3D) ultrasound images of internal features of an object (e.g., human organs).
The ultrasound system may provide the 3D ultrasound image including clinical information such as spatial information and anatomical figures of the target object, which cannot be provided by the 2D ultrasound image. The ultrasound system may transmit ultrasound signals into a target object and receive ultrasound echo signals reflected from the target object. The ultrasound system may further form volume data based on the ultrasound echo signals. The ultrasound system may further render the volume data to thereby form the 3D ultrasound image.
The ultrasound system may provide the 3D ultrasound image and the 2D ultrasound image corresponding to an A plane, a B plane and a C plane, which may be mutually orthogonal. However, there is a problem in that it is difficult to estimate how the objects of interest shown in the 2D ultrasound image are three-dimensionally indicated and what sizes the objects of interest have in the 3D ultrasound image.
›SUMMARY
Embodiments for providing a plurality of slice images in an ultrasound system are disclosed herein. In one embodiment, by way of non-limiting example, an ultrasound system comprises: a user input unit configured to receive input information for setting at least one seed point on a two-dimensional ultrasound image from a user; an ultrasound data acquisition unit configured to transmit and receive ultrasound signals to and from a target object including a plurality of objects of interest and output ultrasound data; and a processing unit in communication with the user input unit and the ultrasound data acquisition unit, the processing unit being configured to form volume data based on the ultrasound data, form the two-dimensional ultrasound image and a three-dimensional ultrasound image based on volume data, detect at least one object of interest corresponding to the input information from the three-dimensional ultrasound image, and perform an image process and a size measurement of the detected object of interest upon the three-dimensional ultrasound image.
In another embodiment, there is provided a method of performing an image process and a size measurement upon a three-dimensional ultrasound image, comprising: a) transmitting and receiving ultrasound signals to and from a target object including a plurality of objects of interest and output ultrasound data; b) forming volume data based on the ultrasound data; c) forming a two-dimensional ultrasound image and a three-dimensional ultrasound image based on the volume data; d) receiving input information for setting at least one seed point on the two-dimensional ultrasound image; e) detecting at least one object of interest corresponding to the input information from the three-dimensional ultrasound image; and f) performing an image process and a size measurement of the detected object of interest upon the three-dimensional ultrasound image.
In yet another embodiment, there is provided a computer readable medium comprising computer executable instructions configured to perform the following acts: a) acquiring ultrasound data for a target object including a plurality of objects of interest; b) forming volume data based on the ultrasound data; c) forming a two-dimensional ultrasound image and a three-dimensional ultrasound image based on the volume data; d) receiving input information for setting at least one seed point on the two-dimensional ultrasound image; e) detecting at least one object of interest corresponding to the input information from the three-dimensional ultrasound image; and f) performing an image process and a size measurement of the detected object of interest upon the three-dimensional ultrasound image.
The Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used in determining the scope of the claimed subject matter.
›BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram showing an illustrative embodiment of an ultrasound system.
FIG. 2 is a block diagram showing an illustrative embodiment of an ultrasound data acquisition unit.
FIG. 3 is a schematic diagram showing an example of acquiring ultrasound data corresponding to a plurality of frames.
FIG. 4 is a flow chart showing a process of performing an image process and a size measurement upon a three-dimensional (3D) ultrasound image.
FIG. 5 is a schematic diagram showing an example of volume data.
FIG. 6 is a schematic diagram showing an example of the 3D ultrasound image, a plurality of objects of interest and indexes.
FIG. 7 is a schematic diagram showing an example of a plurality of slices and an object of interest (blood vessel).
FIG. 8 is a schematic diagram showing an example of location difference between edges of the object of interest (blood vessel) on adjacent slices.
FIG. 9 is a schematic diagram showing an example of performing a segmentation of the object of interest (blood vessel).
FIG. 10 is a schematic diagram showing an example of the object of interest (blood vessel) and indexes.
FIG. 11 is a schematic diagram showing an example of performing the image process upon the 3D ultrasound image.
›DETAILED DESCRIPTION · 1 of 3
A detailed description may be provided with reference to the accompanying drawings. One of ordinary skill in the art may realize that the following description is illustrative only and is not in any way limiting. Other embodiments of the present invention may readily suggest themselves to such skilled persons having the benefit of this disclosure.
Referring to FIG. 1 , an ultrasound system 100 in accordance with an illustrative embodiment is shown. As depicted therein, the ultrasound system 100 may include a user input unit 110 . The user input unit 110 may be configured to receive input information for setting at least one seed point on a two-dimensional (2D) ultrasound image. The user input unit 110 may include a control panel, a mouse or a keyboard. However, it should be noted herein that the user input unit 110 may not be limited thereto.
The ultrasound system 100 may further include an ultrasound data acquisition unit 120 . The ultrasound data acquisition unit 120 may be configured to transmit and receive ultrasound signals to and from a target object and output ultrasound data. The target object may include a plurality of objects of interest (e.g., blood vessels, a heart, etc.).
FIG. 2 is a block diagram showing an illustrative embodiment of the ultrasound data acquisition unit 120 . Referring to FIG. 2 , the ultrasound data acquisition unit 120 may include a transmit (Tx) signal generating section 210 , an ultrasound probe 220 , a beam former 230 and an ultrasound data forming section 240 .
The Tx signal generating section 210 may be configured to generate Tx signals. In one embodiment, the Tx signal generating section 210 may generate Tx signals for obtaining a plurality of frames F i (1≦i≦N) corresponding to a three-dimensional (3D) ultrasound image at every predetermined time, as shown in FIG. 3 .
FIG. 3 is a schematic diagram showing an example of acquiring ultrasound data corresponding to the plurality of frames F i (1≦i≦N). The plurality of frames F i (1≦i≦N) may represent sectional planes of the target object (not shown).
Referring back to FIG. 2 , the ultrasound probe 220 may include a plurality of elements (not shown) for reciprocally converting between ultrasound signals and electrical signals. The ultrasound probe 220 may be configured to transmit ultrasound signals to the target object in response to the Tx signals provided from the Tx signal generating section 210 . The ultrasound probe 220 may further receive ultrasound signals (i.e., ultrasound echo signals) from the target object and output the received signals. The received signals may be analog signals. The ultrasound probe 220 may include a three-dimensional (3D) mechanical probe or a two-dimensional (2D) array probe. However, it should be noted herein that the ultrasound probe 220 may not be limited thereto.
The beam former 230 may be configured to convert the received signals provided from the ultrasound probe 220 into digital signals. The beam former 230 may further apply delays to the digital signals in consideration of the elements and focal points to output digital receive-focused signals.
The ultrasound data forming section 240 may be configured to form ultrasound data corresponding to the frames F i (1≦i≦N) based on the digital receive-focused signals provided from the beam former 230 . The ultrasound data forming section 240 may further perform various signal processing (e.g., gain adjustment) upon the digital receive-focused signals.
Referring back to FIG. 1 , the ultrasound system 100 may further include a processing unit 130 in communication with the user input unit 110 and the ultrasound data acquisition unit 120 . The processing unit 130 may include a central processing unit, a microprocessor or a graphic processing unit. However, it should be noted herein that the processing unit 130 may not be limited thereto.
FIG. 4 is a flow chart showing a process of performing an image process and a size measurement upon the 3D ultrasound image. The processing unit 130 may be configured to synthesize the ultrasound data corresponding to the plurality of frames F i (1≦i≦N) to form volume data 510 as shown in FIG. 5 , at step S 402 in FIG. 4 .
FIG. 5 is a schematic diagram showing an example of the volume data 510 . The volume data 510 may include a plurality of voxels (not shown) having brightness values. In FIG. 5 , reference numerals 521 , 522 and 523 represent an A plane, a B plane and a C plane, respectively. The A plane 521 , the B plane 522 and the C plane 523 may be mutually orthogonal. Also, in FIG. 5 , the axial direction may be a Tx direction of the ultrasound signals, the lateral direction may be a longitudinal direction of the elements, and the elevation direction may be a swing direction of the elements, i.e., a depth direction of the 3D ultrasound image.
The processing unit 130 may be configured to form the 2D ultrasound image based on the volume data 510 , at step S 404 in FIG. 4 . The 2D ultrasound image may be displayed on a display unit 150 in FIG. 1 . Thus, the user may set the at least one seed point on the 2D ultrasound image displayed on the display unit 150 by using the user input unit 110 . In one embodiment, the 2D ultrasound image may be an ultrasound image corresponding to the A plane 521 , the B plane 522 or the C plane 523 . However, it should be noted herein that the 2D ultrasound image may not be limited thereto.
The processing unit 130 may be configured to render the volume data 510 to form the 3D ultrasound image, at step S 406 in FIG. 4 . The methods of rendering the volume data 510 are well known in the art. Thus, they have not been described in detail so as not to unnecessarily obscure the present invention.
The processing unit 130 may be configured to perform an edge detection of the objects of interest upon the 3D ultrasound image, at step S 408 in FIG. 4 . In one embodiment, the processing unit 130 may perform the edge detection by using an edge mask such as Sobel, Prewitt, Robert, Canny and the like. In another embodiment, the processing unit 130 may perform the edge detection based on a difference of eigenvalues using a structure tensor.
›DETAILED DESCRIPTION · 2 of 3
The processing unit 130 may be configured to perform segmentation of the objects of interest upon the 3D ultrasound image based on the detected edges, at step S 410 in FIG. 5 . Optionally, the processing unit 130 may further set indexes on the segmented objects of interest. The index may include a text, a figure, etc.
In one embodiment, the processing unit 130 may perform the segmentation of the objects of interest IO 1 , IO 2 and IO 3 upon the 3D ultrasound image UI based on the detected edges, as shown in FIG. 6 . The processing unit 130 may further set indexes OSG 1 , OSG 2 and OSG 3 on the segmented objects of interest IO 1 , IO 2 and IO 3 .
In another embodiment, the processing unit 130 may set a plurality of slices S 1 to S n on the 3D ultrasound image, as shown in FIG. 7 . The slices may correspond to the frames F i (1≦i≦N). However, it should be noted herein that the slices may not be limited thereto. The processing unit 130 may further analyze a first slice S 1 to detect edges VE 11 , VE 12 of the object of interest (i.e., a blood vessel) from the first slice S 1 . The processing unit 130 may further analyze a second slice S 2 to detect edges VE 21 , VE 22 of the object of interest from the second slice S 2 . The processing unit 130 may further compare the edge VE 21 of the second slice S 2 with the edge VE 11 of the first slice S 1 to calculate location difference between the edges VE 21 and VE 11 , as shown in FIG. 8 . The processing unit 130 may further compare the edge VE 22 of the second slice S 2 with the edge VE 12 of the first slice S 1 to calculate location difference between the edges VE 22 and VE 12 , as shown in FIG. 8 . The processing unit 130 may further compare the edge VE 22 of the second slice S 2 with the edge VE 11 of the first slice S 1 to calculate location difference between the edges VE 22 and VE 11 , as shown in FIG. 8 . The processing unit 130 may further compare the edge VE 21 of the second slice S 2 with the edge VE 12 of the first slice S 1 to calculate location difference between the edges VE 21 and VE 12 , as shown in FIG. 8 . The processing unit 130 may further compare each of the calculated location differences with a predetermined threshold value. If it is determined that the location difference between the edges VE 21 and VE 11 and the location difference between the edges VE 22 and VE 12 are equal to or less than the threshold value, and the location difference between the edges VE 22 and VE 11 and the location difference between the edges VE 21 and VE 12 are more than the threshold value, then the processing unit 130 may further connect the edge VE 21 to the edge VE 11 , and connect the edge VE 22 to the edge VE 12 , as shown in FIG. 9 . The processing unit 130 may perform the segmentation upon a third slice S 3 and a fourth slice S 4 as mentioned above. The processing unit 130 may further analyze a fifth slice S 5 to detect an edge VE 5 from the fifth slice S 5 . The processing unit 130 may further compare the edge VE 5 of the fifth slice S 5 with an edge VE 41 of the fourth slice S 4 to calculate location difference between the edges VE 5 and VE 41 . The processing unit 130 may further compare the edge VE 5 with an edge VE 42 of the fourth slice S 4 to calculate location difference between the edges VE 5 and VE 42 . The processing unit 130 may further compare the calculated location differences with the threshold value. If it is determined that the location difference between the edges VE 5 and VE 41 and the location difference between the edges VE 5 and VE 42 are equal to or less than the threshold value, then the processing unit 130 may further connect the edge VE 5 to the edges VE 41 and VE 42 . The processing unit 130 may further analyze a sixth slice S 6 to detect edge VE 6 from the sixth slice S 6 . The processing unit 130 may further compare the edge VE 6 of the fifth slice S 6 with the edge VE 5 of the fifth slice S 5 to calculate location difference between the edges VE 6 and VE 5 . The processing unit 130 may further compare the calculated location difference with the threshold value. If it is determined that the location difference between the edges VE 6 and VE 5 is equal to or less than the threshold value, then the processing unit 130 may further connect the edge VE 6 to the edge VE 5 . The processing unit 130 may further perform the segmentation of the object of interest upon a seventh slice S 7 to an n th slice S n as mentioned above. The processing unit 130 may further analyze the plurality of slices S 1 to S n to detect a vascular bifurcation VB of the object of interest as shown in FIG. 10 . The processing unit 130 may further set indexes VSG 1 , VSG 2 and VSG 3 on the segmented object of interest based on the vascular bifurcation VB.
The processing unit 130 may be configured to set the at least one seed point corresponding to the input information on the 3D ultrasound image, at step S 412 in FIG. 4 . In one embodiment, the processing unit 130 may set the at least one seed point based on geometrical information of the 2D ultrasound image for the 3D ultrasound image.
The processing unit 130 may be configured to detect at least one object of interest corresponding to the at least one seed point set on the 3D ultrasound image, at step S 414 in FIG. 4 .
The processing unit 130 may be configured to perform the image process of the detected object of upon the 3D ultrasound image, at step S 416 in FIG. 4 . In one embodiment, the processing unit 130 may perform the image process for applying different colors to the detected object of interest upon the 3D ultrasound image. For example, the processing unit 130 may perform the image process for applying different colors to the detected objects of interest IO 1 and IO 3 corresponding to seed points SP 1 and SP 2 , respectively, upon the 3D ultrasound image UI, as shown in FIG. 11 .
The processing unit 130 may be configured to perform the size measurement of the detected object of interest upon the 3D ultrasound image to form measurement information, at step S 418 in FIG. 4 . The methods of the size measurement are well known in the art. Thus, they have not been described in detail so as not to unnecessarily obscure the present invention.
›DETAILED DESCRIPTION · 3 of 3
Referring back to FIG. 1 , the ultrasound system 100 may further include a storage unit 140 . The storage unit 140 may store the ultrasound data acquired by the ultrasound data acquisition unit 120 . The storage unit 140 may further store the volume data 510 formed by the processing unit 130 .
The ultrasound system 100 may further include the display unit 150 . The display unit 150 may display the 2D ultrasound image and the 3D ultrasound image formed by the processing unit 130 . The display unit 150 may further display the measurement information formed by the processing unit 130 .
In another embodiment, the present invention may provide a computer readable medium comprising computer executable instructions configured to perform the following acts: a) acquiring ultrasound data for a target object including a plurality of objects of interest; b) forming volume data based on the ultrasound data; c) form a two-dimensional ultrasound image and a three-dimensional ultrasound image based on the volume data; d) receiving input information for setting at least one seed point on the two-dimensional ultrasound image; e) detecting at least one object of interest corresponding to the input information from the three-dimensional ultrasound image; and f) performing an image process and a size measurement of the detected object of interest upon the three-dimensional ultrasound image. The computer readable medium may comprise a floppy disk, a hard disk, a memory, a compact disk, a digital video disk, etc.
Although embodiments have been described with reference to a number of illustrative embodiments thereof, it should be understood that numerous other modifications and embodiments can be devised by those skilled in the art that will fall within the spirit and scope of the principles of this disclosure. More particularly, numerous variations and modifications are possible in the component parts and/or arrangements of the subject combination arrangement within the scope of the disclosure, the drawings and the appended claims. In addition to variations and modifications in the component parts and/or arrangements, alternative uses will also be apparent to those skilled in the art.
Claims as granted
7 claimsLog in to read the claims of this application.
Log in to unlockClassifications
8 codes- A61B8/08
- A61B8/00
- G06T7/00
- G01S15/89
Claim changes
SoonSee which claims were amended, added or cancelled during examination, with every added and removed word marked.
The published claims of this application are not paired with the granted ones in what we hold.
File wrapper
See the full prosecution history — every USPTO and applicant action on this file, in order.
Log in to unlockDocuments
Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.
Log in to unlockChain of title
See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.
Log in to unlock