performed by: ron amit supervisor: tanya chernyakova in cooperation with: prof. yonina eldar

47
Performed by: Ron Amit Supervisor: Tanya Chernyakova In cooperation with: Prof. Yonina Eldar 1 Sub-Nyquist Sampling in Ultrasound Imaging Part A Final Presentation Semester: Spring 2012

Upload: kieu

Post on 07-Feb-2016

54 views

Category:

Documents


0 download

DESCRIPTION

Sub- Nyquist Sampling in Ultrasound Imaging. Performed by: Ron Amit Supervisor: Tanya Chernyakova In cooperation with: Prof. Yonina Eldar. Part A Final Presentation Semester: Spring 2012. Agenda. Introduction Project Goals Background Recovery Method Image Construction Summary - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

1

Performed by: Ron AmitSupervisor: Tanya Chernyakova

In cooperation with: Prof. Yonina Eldar

Sub-Nyquist Sampling in Ultrasound Imaging

Part A Final PresentationSemester: Spring 2012

Page 2: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

2

Agenda• Introduction• Project Goals• Background• Recovery Method• Image Construction• Summary• Future Goals

Page 3: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

3

Introduction

Page 4: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Introduction 4

Ultrasound Imaging

Page 5: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Introduction 5

Beamforming

Page 6: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Introduction 6

Problem

• Typical Nyquist rate is 20 MHz * Number of transducers * Number of image lines

• Large amount of data must be collected and processed in real time

Page 7: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Introduction 7

Solution

• Develop a low rate sampling scheme based on knowledge about the signal structure

Page 8: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

8

Main goal: Prove the preferability of the Xampling method for Ultrasound imaging

Part A:• Improve recovery method• Improve image construction runtime

Project Goals

Project Goals

Page 9: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

9

Background

Page 10: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Background 10

FRI Model

• Theoretical lower bound of sample rate:

Page 11: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Background 11

Unknown Phase

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5

x 10-6

-1

-0.8

-0.6

-0.4

-0.2

0

0.2

0.4

0.6

0.8

1h(t), Known Pulse Shape

t [sec]

Am

plitu

de0 0.5 1 1.5 2 2.5 3 3.5 4 4.5

x 10-6

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1h(t), Known Pulse Shape

t [sec]

Am

plit

ud

e

• Define:

Page 12: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

12

Sampling Scheme

Receiver Elements

Low Rate Samples

RecoveryImage

Construction

Background

Block Diagram

𝒄𝑡 𝑙 ,𝑏𝑙

Page 13: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

13

Single Receiver Xample Scheme

• Unknown parameters are extracted from low rate samples.

Background

Page 14: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

14

• Combines Beamforming and sampling process.

• Samples are a group of Beamformed signal’s Fourier coefficients.

• Sampling at Sub-Nyquist rate is possible.

• Digital processing extracts the Beamformed signal parameters.

Compressed Beamforming

Background

Page 15: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Background 15

Using analog kernels and integrators

First Sampling Scheme :

Problem : Analog kernels are complicated for hardware implementation

Compressed Beamforming

Page 16: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Background 16

Simplified Sampling Scheme :

• Based on approximation• One simple analog filter per receiver• Linear transformation applied on samples

Compressed Beamforming

Page 17: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

17

Recovery Method

Page 18: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

18

Sampling Scheme

Receiver Elements

Low Rate Samples

Recovery𝑡 𝑙 ,𝑏𝑙

Image Constructio

n

Block Diagram

𝒄

Page 19: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

19Recovery Method

Parameter Recovery• Problem : Recover and from samples

• Time delay : • Amplitude and phase:

• Complex samples: - Partial group of the Beamformed signal’s Fourier Coefficients

• The relation shown in [1]:

Page 20: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Compressed Sensing Formulation

Time quantization:

𝑁=⌊𝜏∆𝑠

⌋Number of times samples:

Equation Set:

, j=1,..,K

Recovery Method 20

Page 21: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

21Recovery Method

(~𝑐1

⋮~𝑐𝐾

)=( e− 𝑖

2𝜋𝑇∆𝑠𝑘1 1

⋯ ⋯ ⋯ e− 𝑖

2𝜋𝑇∆𝑠𝑘1 𝑁

⋮ ⋯ ⋯ ⋯ ⋮

e− 𝑖 2𝜋

𝑇∆ 𝑠𝑘𝐾 1

⋯ ⋯ ⋯ e−𝑖 2𝜋

𝑇∆ 𝑠𝑘𝐾 𝑁 )(

𝑥1

⋮⋮⋮𝑥𝑁

)

Define :1≤n≤𝑁

Matrix Form:

[KxN] – Partial DFT MatrixProblem: = V , unknown

Compressed Sensing Formulation

Equation Set:

K << N

Page 22: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

22Recovery Method

Problem: = V , unknown

OMP Algorithm

OMP Solves : , such that

Sparsity assumption:

Number of Real samples:1662 (per image line per transducer)

Standard Image

Standard Image:OMP with L=25:Number of Real samples:200 (per image line per transducer)Recovery Method : OMP-NoamRecovery Runtime : 2.4111 [Sec]

Alternative Imaging - Using PhasePSNR: 10.9991 [dB]Imaging Runtime: 0.49933 [Sec]

Page 23: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

23Recovery Method

• The signal is reconstructed by incorporating the pulse shape

• Namely, passing trough a band-pass filter: • Conceptual Change: The signal of interest is and not .

• need to be reconstructed correctly only in the pulse pass-band bandwidth .

New Approach

Page 24: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

24Recovery Method

• Assume includes all the Fourier coefficients in the pulse bandwidth:

o Any for which the Fourier coefficients in the pulse bandwidth are equal to will yield perfect reconstruction.

o Equivalent condition: = V exactly.

New Approach

-8 -6 -4 -2 0 2 4 6 80

1

2

3

4

5

6

7

8x 10

-7 H(f), Fourier Transform of Known Pulse

f [MHz]

Am

plitu

de

Page 25: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Proposed Solution Solve: = V

�̂�= 1N

V𝑯

~𝒄Possible Solution:

=Proof:

• Simple solution - easy to calculate

• Equivalent to building using only the sampled frequencies

Recovery Method

Page 26: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

26

Using all the 361 Fourier coefficients in the pulse bandwidth:

-8 -6 -4 -2 0 2 4 6 80

1

2

3

4

5

6

7

8x 10

-7 H(f), Fourier Transform of Known Pulse

f [MHz]

Am

plitu

de

Number of Real samples:722 (per image line per transducer)Recovery Method : Min L2 NormRecovery Runtime : 0.30741 [Sec]

Alternative Imaging - Using PhasePSNR: 14.5923 [dB]Imaging Runtime: 0.65576 [Sec]

Proposed Solution - Result

Recovery Method

Page 27: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

27

Proposed Solution - Result

Number of Real samples:722 (per image line per transducer)Recovery Method : Min L2 NormRecovery Runtime : 0.30741 [Sec]

Alternative Imaging - Using PhasePSNR: 14.5923 [dB]Imaging Runtime: 0.65576 [Sec]

Proposed Solution (using 722 real samples):

Number of Real samples:1662 (per image line per transducer)

Standard Image

Standard Image (using 1662 real samples ):

Recovery Method

Page 28: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

28

Sub - Sample

• Using 100 out of 361 coefficients:

Can a smaller number of samples be used?

-8 -6 -4 -2 0 2 4 6 80

1

2

3

4

5

6

7

8x 10

-7 H(f), Fourier Transform of Known Pulse

f [MHz]

Am

plitu

de

Number of Real samples:200 (per image line per transducer)Recovery Method : ProjectionsRecovery Runtime : 0.060768 [Sec]

Alternative Imaging - Using PhasePSNR: 13.8379 [dB]Imaging Runtime: 0.61273 [Sec]

Recovery Method

Page 29: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

29

Artifact• Using 100 out of 361 coefficients:

Number of Real samples:200 (per image line per transducer)Recovery Method : ProjectionsRecovery Runtime : 0.060768 [Sec]

Alternative Imaging - Using PhasePSNR: 13.8379 [dB]Imaging Runtime: 0.61273 [Sec]

Recovery Method

Page 30: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

30

Artifact: Solution

0 20 40 60 80 1000.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1Weight Vector

Fourier Coeff Index

We

ight

Non-Ideal Band Pass:

Number of Real samples:200 (per image line per transducer)Recovery Method : Min L2 NormRecovery Runtime : 0.06322 [Sec]

Alternative Imaging - Using PhasePSNR: 13.5536 [dB]Imaging Runtime: 0.59366 [Sec]

• Using 100 weighted coefficients:

Recovery Method

Page 31: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

31

Number of Real samples:200 (per image line per transducer)Recovery Method : Min L2 NormRecovery Runtime : 0.06322 [Sec]

Alternative Imaging - Using PhasePSNR: 13.5536 [dB]Imaging Runtime: 0.59366 [Sec]

Proposed Solution , with weights (using 200 real samples):

OMP (using 200 real samples):

Number of Real samples:200 (per image line per transducer)Recovery Method : OMP-NoamRecovery Runtime : 2.4111 [Sec]

Alternative Imaging - Using PhasePSNR: 10.9991 [dB]Imaging Runtime: 0.49933 [Sec]

Proposed Solution - Result

Recovery Method

Page 32: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

32

Number of Real samples:200 (per image line per transducer)Recovery Method : Min L2 NormRecovery Runtime : 0.06322 [Sec]

Alternative Imaging - Using PhasePSNR: 13.5536 [dB]Imaging Runtime: 0.59366 [Sec]

Proposed Solution , with weights (using 200 real samples):

Proposed Solution - Result

Number of Real samples:1662 (per image line per transducer)

Standard Image

Standard Image (using 1662 real samples ):

Recovery Method

Page 33: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

33

ImageConstruction

Page 34: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

34

Sampling Scheme

Receiver Elements

Low Rate Samples

RecoveryImage

Construction

Block Diagram

𝒄𝑡 𝑙 ,𝑏𝑙

Page 35: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

35Image Construction

Image Construction1. Signal Creation: For each image line (angle), create

signal from estimated parameters2. Interpolation: Interpolate Polar data to full Cartesian grid

Page 36: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Image Construction 36

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5

x 10-6

-1

-0.8

-0.6

-0.4

-0.2

0

0.2

0.4

0.6

0.8

1h(t), Known Pulse Shape

t [sec]

Am

plitu

de

Signal Creation

• Standard method – Use Hilbert transform to cancel modulation

• In signal creation, pulse envelope can be used beforehand

0 0.5 1 1.5 2 2.5 3 3.5 4 4.5

x 10-6

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1h(t), Known Pulse Shape

t [sec]

Am

plit

ud

e

Page 37: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

37Image Construction

Signal Creation

• Convolution with pulse envelope• Problem: Image is blurred• Estimated Phase is needed for a clear image

𝑠 [𝑛 ]=¿ �̂� [𝑛 ]∨∗h [𝑛 ]

Number of Real samples:440 (per image line per transducer)Recovery Method : Min L2 NormRecovery Runtime : 0.19118 [Sec]

Alternative Imaging - Using PhasePSNR: 14.5382 [dB]Imaging Runtime: 0.66487 [Sec]

Number of Real samples:440 (per image line per transducer)Recovery Method : Min L2 NormRecovery Runtime : 0.18607 [Sec]

Alternative Imaging - Not Using PhasePSNR: 12.9517 [dB]Imaging Runtime: 0.70984 [Sec]

Page 38: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Image Construction 38

𝑠 [𝒏 ]=𝑹𝒆 {�̂� [𝒏 ]∗ (𝒈 [𝒏 ]𝒆𝒊 (𝒏∆𝑠𝝎𝟎− 𝜷))}

Signal Creation

𝑠 [𝑛 ]=∑𝑙=1

𝐿

|𝑏𝑙|𝑔 [𝑛−¿ql ]cos (𝜔0∆𝑠 (𝑛−𝑞𝑙 )+𝛽𝑙− 𝛽)¿Signal Model:

}

Using:

Convolution Form:

Page 39: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

39Image Construction

Image Construction1. Signal Creation: For each image line (angle), create

signal from estimated parameters2. Interpolation: Interpolate Polar data to full Cartesian grid

Page 40: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Image Construction 40

2D Interpolation

Number of Real samples:440 (per image line per transducer)Recovery Method : ProjectionsRecovery Runtime : 0.1852 [Sec]Filter: : None

Standard ImagingImaging Runtime: 8.4127 [Sec]PSNR: 14.3835 [dB]

• 2D Linear interpolation• High quality image, but very slow

Page 41: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Image Construction 41

Nearest Neighbor Interpolation

Number of Real samples:440 (per image line per transducer)Recovery Method : ProjectionsRecovery Runtime : 0.19201 [Sec]Filter: : None

Standard ImagingImaging Runtime: 4.314 [Sec]PSNR: 13.4968 [dB]

• Each Cartesian gets the value of the nearest polar data point

• Lower quality image, but fast

Page 42: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Image Construction 42

My method

• Interpolate only in the angle axis (1D interpolation)• Place each polar data point in the nearest point on the

Cartesian grid

Number of Real samples:440 (per image line per transducer)Recovery Method : ProjectionsRecovery Runtime : 0.17816 [Sec]

Alternative Imaging - Using PhaseImaging Runtime: 0.66153 [Sec]PSNR: 13.9718 [dB]

Page 43: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

Image Construction 43

Image Construction - Results

• Almost identical images• Significant runtime reduction

Number of Real samples:440 (per image line per transducer)Recovery Method : Min L2 NormRecovery Runtime : 0.19118 [Sec]

Alternative Imaging - Using PhasePSNR: 14.5382 [dB]Imaging Runtime: 0.66487 [Sec]

Number of Real samples:440 (per image line per transducer)Recovery Method : Min L2 NormRecovery Runtime : 0.18752 [Sec]

Standard ImagingPSNR: 14.3814 [dB]Imaging Runtime: 8.4543 [Sec]

My method: Standard Imaging:

Page 44: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

44

Summary

Page 45: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

45

• New recovery method• Significantly faster recovery runtime• Very simple hardware implementation• Much better image quality• Significantly faster image construction runtime

Achievements:

Summary

Page 46: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

46

Future Goals

• Improve the simplified sampling scheme

• Cooperation with GE Healthcare

• Build a demo which shows the efficiency of the

Sub- Nyquist method

Page 47: Performed by: Ron  Amit Supervisor: Tanya  Chernyakova In cooperation with: Prof.  Yonina Eldar

47

References:[1] N. Wagner, Y. C. Eldar and Z. Friedman, "Compressed Beamforming in Ultrasound Imaging", IEEE Transactions on Signal Processing, vol. 60, issue 9, pp.4643-4657, Sept. 2012.

[2] Ronen Tur, Y.C. Eldar and Zvi Friedman, “Innovation Rate Sampling of Pulse Streams With Application to Ultrasound Imaging”, IEEE Trans. Signal Process., vol. 59, no. 4, pp. 1827-1842, 2011

[3] K. Gedalyahu, R. Tur and Y.C. Eldar, “Multichannel Sampling of Pulse Streams at the Rate of Innovation”, IEEE Trans. Signal Process., vol. 59, no. 4, pp. 1491-1504, 2011