USPatent applicationPatented

Noise estimation method and apparatus for noise adaptive ultrasonic image processing

Granted 9 Mar 2004 · 3 office actions

Current assignee: Siemens Medical Solutions USA, Inc. · originally Acuson Corporation

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Kutay Ustuner, Anming He · Examiner: Jayanti K. Patel · AU 2625 · TC 2600

Application· this page
9431304
filed 29 Oct 1999
Publication
Not published
not published
Patent
US 6,704,437
granted 9 Mar 2004

Life of the application

15 dated events
⤢ drag to zoom20002002200420062008201020122014201620182020ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

A noise-adaptive method for processing an ultrasonic image set forms a filtered image set having a selectively enhanced noise component as compared to the original image set. A noise parameter is generated as a function of the image set and the filtered image set, and then the noise parameter is used in ultrasonic image processing. A background noise image is generated from the noise parameter and the original image and is used in ultrasonic image processing.

Description

6 parts
›BACKGROUND

The present invention relates to medical diagnostic ultrasonic imaging, and in particular to noise-adaptive image processing techniques for use with ultrasonic images.

Denison U.S. Pat. No. 4,761,819 discloses an adaptive noise reduction filter for use with MRI or other scanners. In the disclosed system a weighting function is used based on the variance of the diagnostic data noise and the variance of the pixel value. Noise variance is estimated by the smallest data value difference between each data value and its neighbors.

The present invention is directed to a noise-adaptive method and apparatus for processing a medical diagnostic ultrasonic image which employs a new method and apparatus for assessing local noise level of the image.

›SUMMARY

The preferred embodiment described below applies a highpass filter to an ultrasonic image set to form a filtered image set. This filtered image set has a selectively enhanced noise component (and a selectively reduced signal component) as compared with the original image set. A pixelwise noise parameter is generated as a function of the image set and the filtered image set, and this noise parameter is then used in ultrasonic image processing.

The foregoing discussion has been provided merely by way of introduction, and is not intended to limit the scope of the following claims.

›BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an ultrasonic imaging system that incorporates a preferred embodiment of this invention.

FIG. 2 is a block diagram of a method performed by the system of FIG. 1 .

FIG. 3 is a more detailed block diagram of the noise estimator and the SNR adaptive processor of FIG. 1 .

FIG. 4 is a flow chart of a method performed by the system of FIG. 3 .

FIG. 5 is a graph of a map function.

›DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS · 1 of 3

The preferred embodiments described below estimate electronic noise level at each image pixel, and then employ the estimated electronic noise level for electronic noise reduction and electronic noise level adaptive image processing. These embodiments estimate electronic noise level from the image itself and then use this estimated electronic noise level to reduce noise in the processed image while retaining the desired acoustic signal.

The present inventors have recognized that one important difference between electronic noise and the desired acoustic signal is that the correlation lengths among neighboring data points are greater for the desired acoustic signal than for electronic noise. The technique described below is based on the premise that electronic noise is less correlated than the desired acoustic signal in at least one of the following dimensions: azimuth, range, elevation, and time. This premise is valid if the object being imaged is not moving too fast and the sampling rates in time and space are adequate. The electronic noise level can be estimated by comparing the variance of the neighborhood of each pixel for the original image and for a highpass-filtered version of the original image. The ratio between the variances can then be used to generate a noise parameter ranging from 0 to 1, where 0 is indicative to a 0 noise level and 1 is indicative to a 100% noise level. This noise parameter is then used in image processing, as for example by removing the noise from the original image.

FIG. 1 shows a block diagram of a medical diagnostic ultrasonic imaging system 10 that incorporates a preferred embodiment of this invention. The imaging system 10 includes a transmitter 12 such as a transmit beamformer that applies ultrasonic transmit waveforms via a multiplexer 14 to a phased array ultrasonic transducer 16 . The transducer 16 forms ultrasonic waves that are transmitted into a region being imaged in a conventional manner.

Returning ultrasonic echoes from the region being imaged are converted into receive signals by the transducer 16 . These receive signals are conducted via the multiplexer 14 to a receiver 18 that typically includes a receive beamformer. Beamformed signals from the receiver 18 are applied as an input to a B-mode processor 20 that generates B-mode detected images at its output. These images are applied to a noise parameter estimator 22 and to an SNR (signal to noise ratio) adaptive processor 24 . As explained in greater detail below, the noise parameter estimator 22 estimates a noise parameter indicative of the level of local noise based on the statistics of an image at multiple regions of the image. The SNR adaptive processor 24 uses the noise parameter from the noise parameter estimator 22 to enhance the image, which is then applied to an image processor (not shown). In an alternative embodiment, the noise parameter estimator 22 can be placed after the receive beamformer of the receiver 18 and before the detector of the B-mode processor 20 .

All of the elements 12 through 20 of the system 10 can be implemented in any suitable form, using either analog or digital technology. These elements of the system 10 have been provided by way of example in order to provide a framework to allow the preferred embodiments of this invention to be described clearly. It is not intended to limit this invention to any specific form of the elements 12 through 20 , and many variations are possible. For example, the transmitter 12 and the receiver 18 may be coupled to separate ultrasonic transducers, eliminating the need for a multiplexer 14 . A wide variety of transmitters and receivers can be used. The transducer 16 can be 1, 1.5 or 2 dimensional, and mechanical ultrasonic focusing techniques can be used in combination with or in substitution for conventional phased array focusing techniques.

FIG. 2 provides a high level flow chart of a method practiced by the system 10 of FIG. 1 . At 40 a set of one or more images is acquired. For example, the images can be acquired using the elements 12 through 20 of FIG. 1 . Alternately, ultrasonic images can be acquired from a storage system. The term “acquiring” is intended broadly to encompass any method for measuring or retrieving ultrasonic images, whether in analog or digital form. The term “image” is intended broadly to encompass a part of an image such as a single scan line or a series of scan lines. The acquired ultrasonic images are not restricted to any specific imaging mode, and can take the form for example of B-mode, color Doppler energy, color Doppler velocity, or color Doppler variance, whether in fundamental or harmonic imaging mode, including both contrast harmonic and tissue harmonic imaging. The ultrasonic image set acquired at 40 may be at any suitable stage in image processing, and is not limited to post-detection, log-compressed images. At 42 a noise parameter is generated as a function of local variance or correlation length (spatial or temporal) of the ultrasonic image set. The term “variance” is intended broadly to encompass any statistical measure of disorder along the selected axis or axes (dimension(s)). This noise parameter is preferably generated at multiple points within the image. For example, a separate noise parameter can be generated for each pixel of the image, as described below. At 44 the noise parameter developed at 42 is used for SNR adaptive ultrasonic image processing.

FIG. 3 shows a more detailed block diagram of one embodiment of the noise parameter estimator 22 and the SNR adaptive processor 24 of FIG. 1 . As shown in FIG. 3, the B-mode processor provides an image l(r,x,n), where r indicates range, x indicates scan line number, and n indicates frame number. The image l(r,x,n) can correspond to an image at any stage in signal processing after analog to digital conversion of the received signal. The image l(r,x,n) is applied in parallel to a signal suppression filter 50 and to a local statistical parameter estimator 52 . The image l(r,x,n) in this example includes both the desired signal and the electronic noise generated by the system, and the image l(r,x,n) can be a full-frame image or a partial-frame image.

›DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS · 2 of 3

The signal suppression filter 50 is preferably a highpass filter or a band stop filter, depending upon where the image is in the receive signal processing path and the dimension or axis selected for the filter 50 . The filter 50 can be a filter with one or more dimensions selected from the axial, azimuthal, elevational, and time dimensions. When the filter 50 is positioned to operate on baseband signals, the filter 50 can be referred to as having a low frequency stopband, because it preferentially filters out low frequency components of the image, thereby enhancing noise components of the image. The output of the filter 50 is designated as I H (r,x,n). Electronic noise has a white spatial and temporal spectrum, which extends to half the sampling frequency in each dimension. In contrast, acoustic signals have more limited bandwidths. Pre and post-detection processing, which may include filtering and interpolation, may limit the spectral bandwidth of electronic noise in certain dimensions. For this reason, it is preferred to use a signal suppression filter 50 that operates on a dimension having little or minimum noise bandwidth limitation. When the image l(r,x,n) is least filtered along the x dimension, a suitable filter for the filter 50 is [−1 2−1]/{square root over (6)} in the x dimension.

The local statistical parameter estimator 52 estimates the noise content of the image I to generate the parameter S and the noise content of the filtered image I H to generate the parameter S H . The statistical parameter estimator 52 calculates statistical parameters such as mean and variance in the neighborhood of each image pixel for both the image I and the filtered image I H . Typically, the neighborhood size used to calculate the mean and variance includes several resolution cells. For example, the statistical parameter estimator 52 can calculate the variances of I H and I for each image pixel and then apply a low-pass filter to the variances to generate S H and S, respectively.

The noise estimates S H , S are applied as inputs to a noise parameter map 54 . The output of the map 54 is a noise parameter N(r,x,f) that takes values within the range of [0,1]. The noise parameter map 54 maps the ratio S H /S to the noise parameter N. Preferably, the noise parameter map 54 includes multiple maps that are selected in accordance with beamformer parameters such as point spread function and sampling rate. One suitable function that can be used in the map 54 is shown in FIG. 5 .

The noise parameter N generated by the map 54 can be used to reduce the electronic noise level of the original image, or it can be used as an input for other noise-adaptive image processing. In one example the noise parameter N is multiplied by the image I at 56 , and the result is smoothed by a low-pass filter 60 and subtracted from the image I at 58 to provide a noise-reduced image.

Once generated from one image, the noise parameter N can be used to process additional images, because the background noise remains relatively unchanged until operating conditions for the imaging system are changed. For this reason, it may be preferred to calculate the noise parameter N only once for each set of operating conditions. The background noise image BNI generated by the multiplier 56 or filter 60 of FIG. 3 can be taken as an example of a background noise image. The image BNI depends on the signal level of the current image, and is therefore different from image to image.

It should be understood that the noise parameter developed above can be used in a wide variety of ultrasonic imaging processing, and the example of FIG. 3 is not intended to be limiting. For example, the noise parameter can be used to select a response function that can include a compounding function, a synthesis function, a compression function, a gain function, a spatial filtering function, or a temporal filtering function. U.S. patent application Ser. No. 09/430,156, filed on the same day as the present appation and assigned to the assignee of the present invention, provides a fuller description of a variety of noise-adaptive image processing methods that can be used. The entirety of this copending application is hereby incorporated by reference.

FIG. 4 shows a block diagram of a method implemented with the elements of FIG. 3 . At 70 an ultrasonic image I is acquired. At 72 the image I is filtered to enhance the noise component and to reduce the signal component of the filtered image I H . At 74 a noise parameter is generated as a function of I and I H , and at 76 the noise parameter is used for SNR adaptive image processing. The noise parameter can be used in any of the ways described above. For example, the noise parameter can be used to generate a measure of electronic noise or SNR.

The method and apparatus described above provide the advantage that noise is estimated simply and reliably using only the image itself. No separate noise measurements are required as in certain prior art approaches.

Of course, it should be understood that many changes and modifications can be made to the preferred embodiments described above. For example, any suitable filters can be used, whether implemented with analog or digital techniques. The noise measurements described above can be made at many points on the receive signal processing path, and these measurements can be made using a wide variety of system hardware.

As used herein the term “noise parameter” is intended broadly and is not to be limited to the foregoing examples. For example, a noise parameter may be indicative of noise or signal to noise ratio of a portion of an image.

The term “function of” is intended broadly to encompass both direct and indirect functions. Thus, a parameter is said to be a function of a first variable whether or not it is also a function of a second variable. Functions can be linear, nonlinear, reciprocal or the like, and can be implemented in any desired computational, lookup table, or selection approach.

The term “generate” is intended broadly to encompass a wide variety of techniques, including lookup table techniques, selection techniques, and calculation techniques, whether analog or digital.

›DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS · 3 of 3

The term “correlation length” is intended broadly to encompass any statistical measure of the degree of correlation among image signals within a neighborhood along any desired dimension or axis.

The term “set” is intended broadly to encompass one or more.

The term “image” is intended broadly to encompass one dimensional, two dimensional or greater dimensional images including one or more than one frame of image data.

The term “circuit” is intended to encompass both analog and digital circuits, including programmed computers. First and second circuits may be implemented by the same hardware at different times when a computer is executing different program sequences.

The foregoing detailed description has described only a few of the many forms that this invention can take. For this reason, it is only the following claims, including all equivalents, that are intended to define the scope of this invention.

Claims as granted

13 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

5 codes
IPC · International Patent Classification
Section G — Physics
  • G06T5/00
  • G06T5/20
USPC · US Patent Classification
382/128382/261600/437

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJan 2000Jul 2000Jan 2001Jul 2001Jan 2002Jul 2002Jan 2003Jul 2003Jan 2004USPTOApplicantNon-final rejectionFinal rejectionNon-final rejectionNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
4.4 y
1,593 days filing → grant
Office actions
3
non-final + final
Responses
3
1 RCE
Interviews
1
examiner interview summaries
Examiner
Jayanti K. Patel
art unit 2625 · TC 2600
Citations: 17 back · 13 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20002002200420062008201020122014201620182020Owner 1Owner 3
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock