Method and apparatus for real-time 3D image rendering on a picture archival and communications system (PACS) workstation

This invention relates to image management systems, and more particularly to image reconstruction on an image workstation coupled to an image manager.

Medical scanners and medical imaging machines are an integral part of modern medical practice. These scanners and medical imaging devices utilize both electromagnetic radiation and sonic wave to produce images which are viewed by doctors for the diagnosis and care of patients. For example, ultrasound machines are useful for viewing fetuses during prenatal care in a pregnancy or blood flow patterns in arteries. Magnetic resonance imaging (MRI) machines are useful for producing images of a wide range of soft tissues.

In a large hospital, medical scanners and medical imaging devices are preferably networked with a central image management system, such as a picture archival and communications system (PACS). The PACS is designed to provide a central storage for archive for medical images. Further, PACS is configured so that stored images may be retrieved. Typically, a hospital will have a single PACS that is networked with a plurality of medical scanners and medical imaging devices located throughout the hospital. Further, the PACS will be networked with a plurality of image workstations, such as a PACS workstation. Images generated by medical scanners and medical imaging devices are transferred to the PACS for storage and later retrieval and review by doctors located throughout the hospital at any of the plurality of image workstations.

Conventionally, doctors or users of image workstations (e.g., PACS workstations) were able to view only two dimensional image renderings of the images retrieved from the PACS. Three dimensional image rendering was restricted to three dimensional rendering on stand alone workstations dedicated for three dimensional graphics processing. Further, because of the restriction to stand alone workstations, conventional three dimensional graphics processing was not carried out on PACS workstation therefore image information and data could not be simply received from the PACS server. Further, because the 3D processing is conventionally carried out on stand alone workstations, the PACS has not been used to store 3D image information.

Therefore, there is a need for an image workstation that is in communication with the PACS and is configured to carry out 3D processing thereon. Further, there is a need for an image workstation that is capable of receiving image information from the PACS and constructing a 3D image rendering while the information is being retrieved.

An embodiment of the invention relates to an image management system. The image management system includes an image manager having a plurality of inputs and outputs. The inputs are configured to receive image information signals and the outputs are configured to provide image output signals. The image manager is configured to store information representative of a plurality of two dimensional image slices. The output signals are representative of the stored two dimensional image slices. The image management system also includes an imaging device having an output coupled to at least one of the inputs of the image manager, and configured to provide an image signal. The image management system further includes an image workstation having an input coupled to at least one of the outputs of the image manager. The image workstation is configured to receive output signals from the image manager representative of selected two dimensional image slices stored by the image manager. The image workstation is configured to construct three dimensional image renderings while the output signals are being received by the image workstation.

Another embodiment of the invention relates to a method of producing a rendering of a three dimensional object from a plurality of two dimensional image information files. The method includes receiving, by an image manager, a plurality of two dimensional image information files from an imaging device. The method also includes storing a plurality of two dimensional image files on the image manager and communicating selected two dimensional image information files to an image workstation. The method further includes receiving a two dimensional image information file by the image workstation and building a portion of the rendering of the three dimensional object based on the two dimensional information file and any other two dimensional information files previously received by the image workstation.

Still another embodiment of the invention relates to a medical imaging system. The medical imaging system includes a medical scanner. The medical imaging system also includes an image manager coupled to the medical scanner and configured to receive and store signals representative of two dimensional image slices from the medical scanner. The medical imaging system also includes an image workstation configured to receive selected signals representative of two dimensional image slices and is configured to construct a three dimensional rendering from the signals representative of the two dimensional image slices substantially while the two dimensional image slices are being received. A partial rendering of the three dimensional rendering may be manipulated while the image workstation is receiving the two dimensional image slices.

The invention will become more fully understood from the following detailed description, taken in conjunction with the accompanying drawings, wherein like reference numerals refer to like parts, in which:

FIG. 1 is a block diagram of an image handling system; and

FIG. 2 is a block diagram of data flow from a scanning or imaging device to an imaging workstation.

Referring now to FIG. 1, a block diagram of an image handling system 10 is depicted. Image handling system 10 includes an image manager 20 which, in a preferred embodiment, is a picture archival and communication system (PACS) server, however image manager 20 is not limited to a PACS server, but may be any picture archiving apparatus. In a preferred embodiment, image manager 20 includes an information storage unit (ISU) for short-term storage and retrieval and an archival storage unit (e.g., an optical disc storage and optical disc reader system) for long-term storage and retrieval.

Image manager 20 is coupled to a plurality of imaging devices 30 which are configured to create digitized image information based on an image subject such as, but not limited to, portions of the human anatomy. In a preferred embodiment, imaging devices 30 include, but are not limited to magnetic resonance imaging (MRI) devices, ultrasound imaging devices, computed tomography (CT) devices, nuclear imaging devices, X-ray imaging devices and any other types of imaging devices, not limited to the medical field. In a preferred embodiment, imaging devices 30 produce image files in the DICOM 3 or DEFF formats however, other image file formats are equally applicable. The image files are communicated from imaging devices 30 to image manager 20 as two dimensional slices or image information representative of two dimensional slices through the object being imaged. Therefore, from a single image file stored on image manager 20 , a two dimensional image rendering may be reconstructed. Such two dimensional renderings are often presented to a user on any of a number of workstations 40 that are coupled to communications network 22 (such as an ethernet or other applicable communications network connection) that is in communication with image manager 20 . Workstation 40 may be, in a preferred embodiment, a PACS workstation.

In a preferred embodiment, it is preferable to have the option of viewing the imaged object in a three dimensional rendering on workstation 40 instead of a two dimensional rendering. Three dimensional renderings may be accomplished by a number of pertinent algorithms including surface rendering algorithms, maximum intensity projections (MIP) and other applicable three dimensional rendering processes. Referring now to FIG. 2, a block diagram, showing a portion of system 10 , depicts the flow of information in system 10 . In operation, scanner 30 scans an object, such as a patient. Scanner 30 generates an electrical signal representative of the configuration of the object. The analog signal is communicated to a digital analog converter 35 . Digital analog converter 35 produces a digital signal that is communicated to PACS server or image manager 20 . In an alternative embodiment, scanner 30 may directly generate a digital signal, thus digital to analog converter 35 would not be required. Further, alternatively scanner 30 may include the digital analog converter 35 therein. Image manager 20 stores the image signals in a file format such as DICOM 3 or DEFF. The image files may be stored on any of a variety of storage devices, such as magnetic storage devices or optical storage devices. Image information from image manager 20 may be selectively retrieved by any of a number of workstations or other information retrieval devices coupled to communications network 22 . Workstation 40 includes a display device 45 .

To display a three dimensional image on display 45 , workstation 40 must retrieve a plurality of two dimensional image files from image manager 20 . Often, however because of the delay required in retrieving a plurality of two dimensional image slices or two dimensional image files, manipulation of a three dimensional image on workstation 40 is delayed until all of the two dimensional image slices are retrieved. However, in a preferred embodiment, workstation 40 includes programmed logic or software that allows display 45 to show a three dimensional image rendering that is being built or compiled substantially while the two dimensional image slices are being retrieved (such as incremental volume rendering). Therefore, a three dimensional image rendering is built based on the two dimensional image file being retrieved and any two dimensional image files that have already been retrieved by image workstation 40 .

Therefore, a user utilizing workstation 40 may manipulate the image and view the image before it is completed. Therefore, for example if a physician is looking at an MRI scan of a human head, and the scan was done from the top of the head to the bottom, the physician who is interested in an area near the forehead does not have to wait until all of the two dimensional image slices, to the bottom of the head, near the neck of the patient have been received. The physician may manipulate (rotate, scale, colorize, measure, etc.) and view a partial three dimensional rendering while the two dimensional image slices are being communicated to the image manager.

While the preferred embodiment refers to imaging devices used in the medical area, the reference to imaging devices may be interpreted broadly. The embodiment can encompass those situations in which any imaging device is coupled to and in communication with a communications network and an image manager.

Further, those who have skill in the art will recognize that the present invention is applicable with many different hardware configurations, software architectures, communications protocols and organizations or processes.

While the detailed drawings, specific examples, and particular formulations given describe preferred embodiments, they serve the purpose of illustration only. The materials and configurations shown and described may differ depending on the chosen performance characteristics and physical characteristics of the communications networks. For example, the type of communications network or communications protocols used may differ. The systems shown and described are not limited to the precise details and conditions disclosed. Furthermore, other substitutions, modifications, changes, and omissions may be made in the design, operating conditions, and arrangements of the preferred embodiments without departing from the spirit of the invention as expressed in the appended claims.