USPatent applicationPatented

Image diagnosis apparatus

Granted 2 Dec 2014 · 1 office action

Current assignee: Toshiba Medical Systems Corporation · originally Toshiba

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Satoshi Wakai · Examiner: Ali Bayat · AU 2666 · TC 2600

Life of the application

9 dated events
⤢ drag to zoom20122014201620182020202220242026202820302032ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

According to one embodiment, an image diagnosis apparatus includes a line shape information generating unit and a comparing unit. The line shape information generating unit is configured to generate first line shape information corresponding to a first medical image and second line shape information corresponding to a second medical image, respectively. The comparing unit is configured to compare the generated first line shape information with the second line shape information.

Description

9 parts
›This application is based upon and claims the…

This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2010-254148, filed on Nov. 12, 2010;

The entire contents of which are incorporated herein by reference.

›BACKGROUND OF THE INVENTION

1. Field of the Invention

An embodiment of the present invention relates to an image diagnosis apparatus.

2. Description of the Related Art

An MRI (Magnetic Resonance Imaging) apparatus is one of image diagnosis apparatuses used in a medical field, and a related imaging method is diffusion imaging. The diffusion imaging is a method for taking a diffusion weighted image (DWI) which emphasizes a diffusion effect such that particles such as water molecules diffuse owing to thermodynamic Brownian motion. The diffusion imaging draws attention as being useful for early diagnosis of cerebral infarction.

Further, the diffusion imaging develops as diffusion tensor imaging (DTI) in a cerebral nerve area in which anisotropy of nerve fibers is detected or nerve fibers are depicted with the use of anisotropy. While diffusion imaging produces a two-dimensional monochrome image as usual, DTI produces a two-dimensional color image.

Further, an imaging method called “diffusion tensor tractography (DTT)” draws attention as well in recent years. According to DTT, a maximum diffusion direction is tracked, e.g., on a voxel basis or on a slightly expanded voxel basis on the basis of a diffusion tensor image (called a DTI image hereafter) obtained owing to DTI, a trajectory of the tracking is depicted three-dimensionally, and a diffusion tensor tractography image (called a DTT image hereafter) is generated.

Incidentally, technologies including volume rendering, DTT described above and vector flow imaging are known as a method for indicating three-dimensionally linear (line shape) information obtained by the aforementioned MRI apparatus and X ray CT apparatus such as a cerebral blood vessel, a bundle of nerve fibers or blood flow velocity.

Further, as to images of three-dimensionally indicated line shape information, such images of a same patient's same part in time of the onset of a disease and of a study after a medical treatment are arranged side by side, so that a user visually observes the images so as to check an effect of the medical treatment.

A related art is disclosed in Japanese Unexamined Patent Publication No. 2009-148314.

As information density of the line shape information is so high that its indication is complicated, though, it is difficult to visually observe in the case of a tiny change. Thus, in conventional technique, an index indicating a degree of the disease (called an abnormality degree, hereafter) cannot be observed in perspective from a difference between the images in time of the onset of the diseased part and the images in normal condition. Further, there used to be no objective index which indicates to what extent the condition has recovered (called a recovery degree, hereafter) between the images in time of the onset of the diseased part and the images in time of a study while or after being treated.

›BRIEF DESCRIPTION OF THE DRAWINGS

In the accompanying drawings:

FIG. 1 is a block diagram which schematically illustrates a constitution of an image processing apparatus of an embodiment of the invention;

FIG. 2 is a block diagram which schematically illustrates a constitution of a controlling unit of the image processing apparatus;

FIG. 3 is a flowchart which illustrates an operation to cancel a shape difference between left and right brains;

FIG. 4 illustrates changes and relationships of an abnormality degree and a recovery degree in each of studies indicated in chronological order;

FIG. 5 is a flowchart which illustrates an operation to make a DTT image of nerve fibers and calculate an abnormality degree;

FIG. 6 illustrates an example of a DTT image of cerebral nerve fibers;

FIGS. 7A-C illustrate how to calculate an abnormality degree;

FIG. 8 is a flowchart which illustrates an operation to calculate a recovery degree;

FIGS. 9A-C provide a first diagram which illustrates how to calculate a recovery degree;

FIG. 10 is a second diagram which illustrates how to calculate a recovery degree;

FIG. 11 illustrates how to calculate a recovery degree of nerve fibers three-dimensionally;

FIG. 12 illustrates an example of an indication of a recovery degree of nerve fibers;

FIG. 13 is a flowchart which illustrates an operation to estimate nerve fibers in a case where the nerve is damaged on a diseased side;

FIGS. 14A-D provide a conceptual diagram of an operation to estimate nerve fibers in a case where the nerve is damaged on a diseased side;

FIG. 15 illustrates an example of an indication of a recovery degree of a blood vessel system; and

FIG. 16 illustrates an example of an indication of a recovery degree of a blood flow.

›DETAILED DESCRIPTION · 1 of 6

An embodiment of the present invention has been made in view of the aforementioned problems, and a purpose of the embodiment is to provide an image diagnosis apparatus which can calculate and indicate an abnormality degree and a recovery degree by using line shape information such as a blood vessel, nerve fibers, information on a blood flow, etc.

An image diagnosis apparatus of an embodiment includes a line shape information generating unit and a comparing unit. The line shape information generating unit generates first line shape information corresponding to a first medical image and second line shape information corresponding to a second medical image, respectively. The comparing unit compares the generated first line shape information with the second line shape information.

An embodiment of the present invention will be explained below with reference to the drawings.

FIG. 1 is a block diagram which schematically illustrates a constitution of an image processing apparatus 1 (image diagnosis apparatus) of an embodiment of the present invention. The image processing apparatus 1 includes a controlling unit 10 , a display unit 12 , an operation unit 13 , a communication unit 15 , a storage unit 16 , a data storage medium 17 and an image database 21 , and these components are connected with each other through a bus.

The display unit 12 is a monitor, etc. which displays text data, image data, etc. as controlled by the controlling unit 10 . The operation unit 13 is an input device such as an operation key, etc. The communication unit 15 is connected to a LAN inside the hospital and performs communication with various kinds of modalities.

The image database 21 stores “a medical image obtained by an image obtaining unit 101 in the controlling unit 10 described later”, “a medical image to which three-dimensional line shape information generated by a line shape information generating unit 106 is added”, “a diffusion direction vector”, etc.

The storage unit 16 provides the controlling unit 10 and the communication unit 15 with a work area. The storage unit 16 can be implemented by a RAM (Random Access Memory), etc.

The data storage medium 17 (computer-readable medium) stores a program, data, etc. The data storage medium 17 can be implemented by a hard disk, a memory (Flash Memory, ROM: Read Only Memory), etc. Programs which make the computer work as each of portions of the embodiment (programs which make the computer run processes of each of the portions), a plurality of application programs, etc. are stored in the data storage medium 17 .

The controlling unit 10 is an arithmetic operation device which supervises and controls the image processing apparatus 1 and runs other various arithmetic operation processes, control processes, etc. Functions of the controlling unit 10 can be implemented by hardware components such as various kinds of processors (CPU, DSP, etc.), an ASIC (gate array, etc.) or a program. The controlling unit 10 runs various processes of the embodiment on the basis of the programs (data) stored in the data storage medium 17 .

FIG. 2 is a block diagram which illustrates the controlling unit 10 in detail. The controlling unit 10 includes an image obtaining unit 101 , a diseased part detecting unit 102 , a region dividing unit 103 , a displacement calculating unit 104 , an estimation unit 105 , a line shape information generating unit 106 , a comparing unit 107 and a shape conversion unit 108 .

The image obtaining unit 101 obtains an image such as a cerebral image out of DWI images obtained by an external MRI apparatus, via the communication unit 15 . Further, the image obtaining unit 101 obtains a DTT image and a diffusion direction vector stored in the image database 21 . The diseased part detecting unit 102 detects an abnormal part such as a cerebral infarction part from the medical image of the brain obtained by the image obtaining unit 101 , which will be described later in detail. The region dividing unit 103 divides the medical image of the brain obtained by the image obtaining unit 101 into left and right brains along a cerebral mid-spinal line. The displacement calculating unit 104 calculates a “warp field” which indicates displacements of shapes of the left and right brains into which the brain image was divided by the region dividing unit 103 . The shape conversion unit 108 converts a shape of an abnormal side or a normal side on the basis of the “warp field” calculated by the displacement calculating unit 104 .

The line shape information generating unit 106 carries out a diffusion tensor analysis of a DWI image so as to generate a diffusion tensor image (DTI). Moreover, the line shape information generating unit 106 tracks the maximum diffusion direction on the generated DTI image, and carries out a tractography analysis to three-dimensionally depict a trajectory of the tracking, extracts line shape information of nerve fibers, and thereby generates a diffusion tensor tractography image (called a DTT image, hereafter). Further, the line shape information generating unit 106 calculates a diffusion direction vector which is a vector in a local region of linear fibers from the generated DTT image.

The estimation unit 105 has a function to copy a part of the DTI image on the normal side into the abnormal side and to estimate nerve fibers on the abnormal side. If part of nerve fibers is damaged or significantly deformed in the abnormal side region as being affected by the infarction part, etc., it is so difficult to track the maximum diffusion direction on the DTI image that a DTT image can be hardly generated for nerve fibers located beyond the damaged part or the deformed part in some cases. If that is the case, the estimation unit 105 can replace the damaged part or the deformed part on the abnormal side with a DTI image copied from the normal side so as to make it possible to generate a DTT image for the nerve fibers located beyond the damaged part or the deformed part. The comparing unit 107 compares “nerve fibers in time of the onset of the abnormal part” with “nerve fibers in time of being normal”, from the DTT image generated by the line shape information generating unit 106 . The comparing unit 107 further compares “nerve fibers in time of the onset of the abnormal part” with “nerve fibers in time of a study while or after being treated”.

›DETAILED DESCRIPTION · 2 of 6

Then, an operation of the image diagnosis apparatus 1 of the constitution described above will be explained. Suppose, at first, that either one of the left and right brains includes an abnormal part. An operation to cancel a left-to-right shape difference will be explained with reference to FIG. 3 .

<Adjustment of Left-to-Right Difference>

The image obtaining unit 101 obtains the entire region of the brain from a medical image taken by the external MRI apparatus and received by the communication unit 15 , i.e., T 1 W (T 1 (longitudinal relaxation time)-weighted), T 2 W (T 2 (transverse relaxation time)-weighted) or DWI image, etc (step S 101 ). Then, the abnormal part detecting unit 102 detects an abnormal part such as a cerebral infarction part, etc. from the medical image of the brain obtained by the image obtaining unit 101 by using, e.g., a DWI/PWI (Perfusion Weighted Imaging) mismatch method, etc (step S 103 ).

Then, the region dividing unit 103 divides the medical image of the brain obtained by the image obtaining unit 101 into a left region and a right region along a cerebral mid-spinal line (step S 105 ). At this time, the region on the side including the abnormal part is called an “abnormal side” region, and the region on the side including no abnormal part is called a “normal side” region.

Then, the displacement calculating unit 104 flips the normal side region line-symmetrically with respect to the cerebral mid-spinal line and renders its shape similar to the shape of the abnormal side (step S 107 ). Then, the displacement calculating unit 104 calculates a “warp field” from three-dimensional images of the flipped normal side region and the abnormal side region (step S 109 ). Morphological images, e.g., T 1 W images or T 2 W images can be used as the three-dimensional images to be used for calculation of the “warp field”. What is the “warp field” mentioned here is as follows. If one of two three-dimensional medical images corresponding to each other is warped, expanded, reduced or rotated with respect to the other, a positional difference between anatomically identical points on the both images is expressed as a vector, and such vectors of respective equivalent points between the two images are gathered into a set expressed as a vector field (warp field). The warp field on the three-dimensional medical image is, e.g., a three-dimensional vector field having resolution on a voxel basis. Once the warp field is calculated, the three-dimensional images of the flipped normal side region and the abnormal side region can be converted so that positions of anatomically identical points can agree with each other. For example, the abnormal side image can be converted by applying the “warp field” to the three-dimensional image in the abnormal side region, so as to make the positions of the anatomically identical points on the abnormal side image and on the flipped normal side image agree with each other. On the other hand, the normal side image can be converted by applying the “warp field” to the three-dimensional image in the flipped normal side region, so as to make the positions of the anatomically identical points on the abnormal side image and on the flipped normal side image agree with each other. Incidentally, the process for calculating the “warp field” may employ a method for either linear position adjustment (rigid registration) or nonlinear position adjustment (non-rigid registration), or a combination of those methods. Further, the displacement calculating unit 104 may use detailed information on anatomical regions such as the central sulcus, the grey matter, etc. so as to calculate a “warp field” for every small region.

Further, the anatomically identical parts may be captured on different positions in images obtained in studies carried out at different times in some cases, even if both images are of the same abnormal side. If that is the case, the warp field between the images taken at different times can be calculated, and the warp field can be applied to either one of the images so as to align the anatomically identical parts with each other.

The “warp field” is useful to correct not only left-to-right asymmetry of a T 1 W image used for calculation of the warp field, etc. but also left-to-right asymmetry of a DWI image taken in the same study that the T 1 W image is taken in, and of a DTI or DTT image generated from the DWI image.

According to the present embodiment, the warp field calculated at the step S 109 in FIG. 3 is applied to either one of the abnormal and normal sides, and the entire shape difference between nerve fibers on the normal and abnormal sides is absorbed. On top of that, a local displacement of the nerve fibers affected by the cerebral infarction part, etc. on the abnormal side is compared with the nerve fibers on the normal side, so as to calculate an “abnormality degree (disease degree)”.

Further, “a ‘recovery degree’ which relatively indicates to what extent an amount of deformation of nerve fibers on the abnormal side has recovered (or worsened) with respect to the nerve fibers on the normal side” is calculated each time as treatment continues. In order to calculate the recovery degree, the respective DTT images are aligned with each other by using “a warp field for aligning the abnormal side and the normal side with each other” and “a warp field between the images taken at different times”.

Incidentally, both or either one of the “abnormality degree” and the “recovery degree” may be calculated.

FIG. 4 illustrates an idea of the “abnormality degree” and the “recovery degree” in connection with the studies. A study carried out in time of the onset of the disease (before a treatment) is defined as a study 1 , and studies carried out after the treatment are defined as a study 2 and a study 3 in chronological order. The “abnormality degree” A is an index which indicates how far a local shape of nerve fibers on the abnormal side has deviated from a shape of nerve fibers on the normal side. Meanwhile, the “recovery degree” B is an index which relatively indicates to what extent the local shape of the nerve fibers on the abnormal side has recovered with respect to the shape of the nerve fibers on the normal side between the study 1 before the treatment and the study 2 after the treatment, or between the study 1 before the treatment and the study 3 after the treatment. Another index, i.e. “difference on the normal side” C indicates a degree of a change on the normal side, if any, between the study 1 before the treatment and the study 2 after the treatment, or between the study 1 before the treatment and the study 3 after the treatment. That is because a difference having been caused on the normal side between the study 1 and the study 2 or between the study 1 and the study 3 , if any, needs to be absorbed before the “recovery degree” B is calculated, as the difference is affected by the “recovery degree” B on the abnormal side. How to calculate the “abnormality degree” A and the “recovery degree” B will be explained more specifically below.

›DETAILED DESCRIPTION · 3 of 6

<Calculate Abnormality Degree A>

To begin with, an operation to make a DTT image of nerve fibers and to calculate an abnormality degree A by comparing the abnormal side with the normal side will be explained with reference to FIG. 5 .

The line shape information generating unit 106 tracks a maximum diffusion direction on a DTI image on each of the normal and abnormal sides, carries out a tractography analysis for three-dimensionally depicting a trajectory of the tracking, and extracts line shape information of nerve fibers so as to make a DTT image of the nerve fibers (step S 201 ). FIG. 6 illustrates an exemplary DTT image of nerve fibers of a brain. In FIG. 6 , e.g., a two-dimensional DWI image of the brain is combined with a three-dimensional DTT image and displayed. The nerve fibers extended from a particular portion of the brain can be three-dimensionally observed according to the combined image.

Then, the shape conversion unit 108 flips the DTT image on the normal side (step S 202 ). The shape conversion unit 108 further applies the warp field calculated by the displacement calculating unit 104 at the step S 109 in FIG. 3 to the flipped DTT image on the normal side so as to align the flipped DTT image on the normal side with the DTT image on the abnormal side (step S 203 ).

Then, the line shape information generating unit 106 calculates a diffusion direction vector on a voxel basis for each of the flipped DTT image on the normal side and the DTT image on the abnormal side which have been aligned with each other at the step S 203 (step S 205 ). The diffusion direction vectors calculated from the DTT image on the abnormal side and from the flipped DTT image on the normal side are called the abnormal side vector and the normal side vector, respectively, for convenience below.

Then, the comparing unit 107 calculates an abnormality degree from a difference between a vertex of the normal side vector and a vertex of the abnormal side vector which anatomically correspond to each other. The comparing unit 107 calculates values of the abnormality degree for each of portions of the nerve fibers (step S 207 ).

Then, the controlling unit 10 files the DTT image made at the step S 201 , the normal side vector and the abnormal side vector calculated on each of positions at the step S 205 , and the abnormality degree calculated at the step S 207 in the image database 21 (step S 209 ).

FIG. 7 (A), FIG. 7 (B) and FIG. 7 (C) illustrate an idea of calculating the abnormality degree described above. FIG. 7 (A) is a conceptual diagram of the nerve fibers at particular positions X, Y and Z on the normal side, and illustrates examples of diffusion direction vectors calculated from the nerve fibers at the respective positions, i.e., normal side vectors [Xa], [Ya] and [Za]. Meanwhile, FIG. 7 (B) is a conceptual diagram of the nerve fibers at positions anatomically corresponding to the positions in FIG. 7 (A) on the abnormal side before a treatment, and illustrates examples of diffusion direction vectors calculated from the nerve fibers at the respective positions, i.e., abnormal side vectors [Xb], [Yb] and [Zb]. The nerve fibers on the abnormal side are locally deformed with respect to the normal side as being pressed by the infarction part, etc. FIG. 7 (C) illustrates an idea of calculating an abnormality degree from the normal side vectors [Xe], [Ya] and [Za] and the abnormal side vectors [Xb], [Yb] and [Zb]. As illustrated in FIG. 7 (C), the abnormality degree is represented by an absolute value of a displacement vector connecting the vertices of the normal side and abnormal side vectors anatomically corresponding to each other. As to the position X, e.g. vertices ax and bx of the normal side and abnormal side vectors [Xa] and [Xb], respectively, anatomically correspond to each other, and an absolute value of a vector [bx, ax] going from the vertex ax to the vertex bx is calculated as an abnormality degree at the position X. Similarly, an abnormality degree at the position Y is calculated as an absolute values of a vector [by, ay] going from the vertex ay to the vertex by, and an abnormality degree at the position Z is calculated as an absolute value of a vector [bz, az] going from the vertex az to the vertex bz, respectively. The abnormality degree may be calculated on a voxel basis from a diffusion direction vector in every voxel, and may be calculated on an over-voxel basis upon a plurality of diffusion direction vectors being linked.

The abnormality degree calculated at each of the positions is filed in the image database 21 together with the DTT image.

<Calculate Recovery Degree B>

Then, an operation to compare the abnormal side in the study 1 before being treated with the abnormal side in the study 2 or 3 after being treated so as to calculate the recovery degree B will be explained with reference to FIG. 8 . Incidentally, suppose that there is no difference on the normal side between the study 1 and the study 2 .

The line shape information generating unit 106 makes DTT images of the normal side and the abnormal side in the study 2 , and calculate a diffusion direction vector (step S 301 ). The diffusion direction vector at this time is called an abnormal side vector in the study 2 . Meanwhile, the image obtaining unit 101 obtains a diffusion direction vector on the abnormal side calculated from the DTT image in the study 1 before the treatment (called an abnormal side vector in the study 1 ) from the image database 21 (step S 303 ).

The comparing unit 107 compares the abnormal side vector in the study 2 calculated at the step S 301 with the abnormal side vector in the study 1 obtained by the image obtaining unit 101 at the step S 303 , so as to calculate a recovery degree in an interval between the studies 1 and 2 (step S 305 ).

FIGS. 9A-C and FIG. 10 illustrate an example of a method for specifically calculating a recovery degree. FIG. 9 (A) is a conceptual diagram of nerve fibers on particular positions X, Y and Z on the normal side, in the way similar to FIG. 7A , and illustrates examples of diffusion direction vectors calculated from the nerve fibers at the respective positions, i.e., normal side vectors [Xa], [Ya] and [Za] FIG. 9 (B) is a conceptual diagram of the nerve fibers at positions anatomically corresponding to the positions in FIG. 9 (A) on the abnormal side before a treatment, and illustrates examples of diffusion direction vectors calculated from the nerve fibers at the respective positions, i.e., abnormal side vectors [Xb], [Yb] and [Zb]. The nerve fibers on the abnormal side are locally deformed with respect to the normal side as being pressed by the infarction part, etc. similarly as in FIG. 7 (B). FIG. 9 (C) illustrates abnormal side vectors [Xd], [Yd] and [Zd] calculated from the nerve fibers on the abnormal side, in the way similar to FIG, 9 B. While FIG. 9 (B) illustrates the abnormal side vectors calculated from data in the study 1 before the treatment, though, FIG. 9 (C) illustrates the abnormal side vectors calculated from data in the study 2 (or study 3 ) after the treatment. These drawings illustrate that the infarction part is reduced owing to the treatment and the pressure from the infarction part decreases, and that the local deformation of the nerve fibers resultantly is coming close to normal condition.

›DETAILED DESCRIPTION · 4 of 6

FIG. 10 illustrates a method for calculating the recovery degree by using the normal side vector [Ya], the abnormal side vector [Yb] in the study 1 and the abnormal side vector [Yc] in the study 2 at the position Y as examples. According to the embodiment, the recovery degree is defined as a relative value (ratio), with respect to the diffusion direction vector on the normal side (i.e., normal side vector), as follows. The ratio of “a difference of the abnormal side vectors between before and after the treatment” to “a difference between the abnormal and normal side vectors before the treatment” is defined as the relative value. Specifically, the recovery degree is an index defined (in percent) according to a following equation.

Recovery degree(in percent)=100*cos θ*|[ C]|/|[C 0 ]|

In the above equation, the term |[C 0 ]| is an absolute value of a vector going from the vertex of the abnormal side vector [Yb] before the treatment to the vertex of the normal side vector [Ya] (called a complete recovery vector [C 0 ]) according to a following equation.

[ C 0 ]=[Ya]−[Yb]

Further, the term |[C]| is an absolute value of a vector going from the vertex of the abnormal side vector [Yb] before the treatment (study 1 ) to the vertex of the abnormal side vector [Yd] after the treatment (the study 2 or the study 3 ) (called a recovery vector [C]).

Further, the term θ is an angle formed between the complete recovery vector [C 0 ] and the recovery vector [C], and is usually given a value θ=0° on a way of recovery (when the abnormal side vector comes close to the normal side vector) and a value θ=180° on a way of turning worse (when the abnormal side vector goes away from the normal side vector). Incidentally, a recovery degree having a negative value may be multiplied by (−1) to be made positive and defined as a worsening degree.

Incidentally, the recovery degree is 0 percent with respect to the abnormal side vector before the treatment according to the equation which defines the recovery degree. The recovery degree grows in the positive direction as the abnormal side vector after the treatment comes close to the normal side vector, and is 100 percent when the abnormal side vector exactly agrees with the normal side vector. Further, the recovery degree grows in the negative direction as the abnormal side vector after the treatment goes away from the normal side vector, and the worsening degree grows in the positive direction.

The recovery (or worsening) degree may be calculated from the diffusion direction vector (the normal side vector or the abnormal side vector) in every voxel on a voxel basis, and may be calculated on an over-voxel basis upon a plurality of diffusion direction vectors being linked. The recovery (or worsening) degree calculated in this way at each of the positions is stored in the image database 21 together with the DTT image in the study 2 (or the study 3 ).

FIG. 10 illustrates an exemplary case in which the vertex of the abnormal side vector after the treatment (in the study 2 ) comes onto a straight line L connecting the vertex of the normal side vector and the vertex of the abnormal side vector before the treatment (in the study 1 ). Depending upon a magnitude (absolute value) of the abnormal side vector [Yd] after the treatment (in the study 2 ), though, the vertex of the abnormal side vector [Yd] may stay off the straight line L in some cases. If that is the case, the absolute value of the abnormal side vector [Yd] may be suitably changed while maintaining the direction of the abnormal side vector [Yd], in such a manner that the terminal point of the abnormal side vector [Yd] comes onto the straight line L.

Further, as a diffusion direction vector is three-dimensional, the abnormal side vector in the study 2 is not always on a plane in which the abnormal side vector in the study 1 and the normal side vector are included. If that is the case, the terminal points of the respective three-dimensional vectors are projected onto a two-dimensional plane so as to calculate the recovery degree from concentric circles centered at the terminal point of the projected normal side vector as illustrated in FIG. 11 . Specifically, the terminal point of the projected normal side vector is defined as “O”, the terminal point of the projected abnormal side vector in the study 1 is defined as “P”, and the terminal point of the projected abnormal side vector in the study 2 “Q”. Then, a vector PO is a recovery vector of a recovery degree of 100 percent. By drawing a circle centered at the point O passing the point Q, an intersection point X between this circle and the vector PO is calculated. A recovery degree is calculated according to a ratio in magnitude of the vector PX to the vector PO. As the ratio in magnitude of the vector PX to the vector PO is 20 percent, e.g., a recovery degree of 20 percent is calculated in the case of FIG. 11 .

If a DTT image of nerve fibers taken in the study 2 is displayed, the recovery degree calculated as described above may be indicated separately by color according to the level of the recovery degree. FIG. 12 illustrates a displayed example. In FIG. 12 , the color of the nerve fibers grows dark as the recovery degree grows high. Further, as to the display of the recovery degree, only nerve fibers of recovery degrees lower than a particular value may be indicated on the DTT image. Further, a threshold value which determines the recovery degree to be indicated may be made selectable. An efficient analysis can thereby be enabled such that only parts not having recovered enough or even worsening are extracted from an image of nerve fibers having a complicated shape and high density of information.

Further, in order to indicate the abnormality degree described above, the nerve fibers may be indicated separately by color according to the level of the abnormality degree on the DTT images in the respective studies, in the way similar to the case of FIG. 12 . In this case, extract and indicate only parts of a high abnormality degree from an image of nerve fibers having complicated shapes and high density of information so as to visually and easily check where and to what extent abnormal parts are, as well.

›DETAILED DESCRIPTION · 5 of 6

<Calculate the Difference C on the Normal Side>

The operation to compare “the normal side in the study 1 before the treatment” with “the normal side in the study 2 after the treatment” so as to calculate “the difference on the normal side” is the same as the comparison on the abnormal side in the operation to calculate the recovery degree, and its explanation is omitted. Incidentally, the difference on the normal side is calculated after calculating the worsening degree and before calculating the recovery degree in each of the studies. Then, the result of calculating the difference on the normal side is included into the calculation of the recovery degree. Exact values of the recovery degree can thereby be obtained on the abnormal side, even if there is any change, e.g. with time on the normal side between pre- and post-treatment conditions.

<In Case of Damaged Nerve Fibers>

When a DTT image of the nerve fibers is made from the DTI image at the step S 201 illustrated in FIG. 5 , the nerve may have been affected by the abnormal part and thus damaged resulting in that the maximum diffusion direction can be hardly tracked on the DTI image and that the DTT image can be made only halfway in some cases. An operation to estimate the nerve fibers in such a case will be explained with reference to a conceptual diagram in FIG. 14 and a flowchart in FIG. 13 .

Suppose that the nerve is damaged and cut off between positions l 1 and l 2 on the abnormal side as illustrated in FIG. 14 (A). FIG. 14 (B) illustrates DTT images of the normal side and the abnormal side in this case. The DTT image is made in condition that the diffusion direction of the nerve fibers is not known beyond the position l 1 as the nerve is damaged at the position l 1 on the abnormal side. Thus, though the nerve is present beyond the position l 2 , the maximum diffusion direction cannot be tracked. Thus, the shape conversion unit 108 uses the warp field calculated at the step S 109 and converts the DTT image on the abnormal side in such a manner that an anatomical position of the nerve fibers up to the damaged portion agrees with an anatomical position of the nerve fibers on the normal side (step S 401 ).

Then, the shape conversion unit 108 flips the nerve fibers on the normal side and copies the flipped nerve fibers onto the abnormal side (step S 403 ). The nerve fibers copied from the normal side onto the abnormal side is indicated by dotted lines in FIG. 14 (C).

The nerve is damaged only between the positions l 1 and l 2 , and is extended from the position l 2 again, as shown in FIG. 14 (A). Thus, if a trajectory between the positions l 1 and l 2 is known on the DTT image on the abnormal side in FIG. 14C , the tracking operation can be continually performed, as the diffusion direction is known beyond the position l 2 . As the nerve fibers on the normal side are copied at the step S 403 , the estimation unit 105 can estimate the trajectory between the positions l 1 and l 2 where the nerve is damaged on the abnormal side and can estimate a trajectory beyond the position l 2 (step S 405 ). The position l 2 on the DTT image is set as an ROI (Region Of Interest) for restarting tracking.

Then, the line shape information generating unit 106 deletes the nerve fibers between the positions l 1 and l 2 having been copied from the normal side at the step S 403 (step S 407 ), so as to return to the damaged condition.

Because the nerve fibers on the abnormal side found at the step S 407 have been deformed, these nerve fibers do not have an intrinsic shape on the abnormal side. Thus, the shape conversion unit 108 converts “the shape of the nerve fibers on the abnormal side having been deleted at the step S 407 ” into “the original shape” on the basis of the warp field (step S 409 ).

As a result, even if the nerve is damaged in the middle, the nerve fibers can be estimated from the normal side by the use of the warp field. The nerve fibers beyond the damaged portion which used to be incapable of being tracked can thereby be tracked so as to make a DTT image.

<Other Examples>

Incidentally, the recovery degree is calculated and displayed with regard to the nerve fibers according to the embodiment described above. The recovery degree can be similarly calculated and displayed separately by color with regard to other line shape information except for the nerve fibers, such as a blood vessel system or blood flows. FIG. 15 and FIG. 16 illustrate examples of recovery degrees in a cerebral blood system and in a blood flow, respectively. As the blood vessel system has lots of diverging points differently from the nerve fibers, the recovery degree can be calculated and indicated for every extracted blood vessel into which the blood vessel system is divided at the diverging points. Further, a blood vessel or a diverging point of an object to be observed, e.g. around a cerebral infarction part can be specified, as well. Further, if a blood vessel, e.g. coronary artery chronologically changes its shape, a chronological recovery degree and a side effect on another part can be indicated as the shape of the coronary artery is tracked for every phase of an R-R period in an ECG (Electrocardiogram).

A recovery degree for a blood flow is calculated by obtaining a blood flow vector by means of an analytical process. As to a part such as a part around the heart in which blood flow significantly changes its velocity, a chronological blood flow vector for every phase of an R-R period in an ECG (Electrocardiogram) is calculated so that an instantaneous abnormal blood flow can be expressed.

According to the embodiment described above, as to line shape information having high information density such as nerve fibers, a blood vessel system or a blood flow, a worsening degree is calculated after absorbing a shape difference between a normal side and an abnormal side, by taking a difference between an abnormal side vector before a treatment and a normal side vector calculated from a DTT image. A worsening degree in a study before the treatment is defined as a recovery vector of a 100 percent recovery degree. Then, a ratio of the recovery degree is calculated on the basis of a position where an abnormal side vector after the treatment is tangential onto a line segment of the recovery vector, and the calculated ratio is displayed according to the recovery degree. An efficient analysis can thereby be enabled such that only parts not having recovered enough or even worsening are extracted from an image of nerve fibers having a complicated shape and high density of information and that a treatment effect is checked, etc.

›DETAILED DESCRIPTION · 6 of 6

Although the embodiment of the present invention have been described above in detail with reference to the drawings, the embodiment can be modified, within the scope of the invention, in designing a specific constitution without being limited to what is described above.

1 of 9 part labels are ours — the grant heads the rest

Claims as granted

22 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

9 codes
IPC · International Patent Classification
Section G — Physics
  • G01R33/56
  • G01R33/563
  • G06K9/68
USPC · US Patent Classification
382/128382/131382/132382/203382/130382/190

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJul 2012Jan 2013Jul 2013Jan 2014Jul 2014Jan 2015USPTOApplicantNon-final rejectionResponse after non-finalNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
2.7 y
981 days filing → grant
Office actions
1
non-final + final
Responses
1
no RCE
Examiner
Ali Bayat
art unit 2666 · TC 2600
Citations: 16 back · 0 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20122014201620182020202220242026202820302032Owner 1Owner 2
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock