Michael B. Wakin - Research
Low-Dimensional Models for
Signal and Data ProcessingHome
Research
Publications
Activities & Interests
Curriculum Vitae (pdf)
Research Interests
- Signal and image processing using sparse, low-dimensional, and manifold-based signal models
- Multiscale geometric analysis for image processing, compression, estimation, and computer vision
- Low-rate signal sensing and acquisition; signal recovery from partial information; compressed sensing
- Multiple signal processing, compression, acquisition, and recovery; light field imaging; sensor networks
- Approximation theory and computational harmonic analysis; wavelets, curvelets, and wedgelets
Motivation
Effective techniques for processing and understanding data and information often rely on some sort of model that characterizes the expected behavior of the information. In many cases, the model conveys a notion of constrained structure or conciseness to the information; one may believe, for example, that a length-N data vector (or signal) has few degrees of freedom relative to its size N. Examples include: bandlimited signals, images containing low-dimensional geometric features, or collections of signals observed from multiple viewpoints in a camera or sensor network.
The notion of conciseness is a very powerful assumption, and it suggests the potential for developing highly accurate and efficient data processing algorithms that capture and exploit the inherent structure of the model. In some cases, for example, the signals of interest can be expressed as sparse linear combinations of elements from some dictionary the sparsity of the representation directly reflects the conciseness of the model and permits efficient algorithms for signal processing. Sparsity also forms the core of the emerging theory of Compressed Sensing, which states that a sparse signal can be recovered from a small number of random linear measurements.
In other cases, however, sparse representations may not suffice to truly capture the underlying structure of a signal. Instead, the conciseness of the signal model may impose a low-dimensional geometric (often manifold-like) structure to the signal class as a subset of the high-dimensional ambient signal space. To date, the importance and utility of manifolds for signal processing has been acknowledged largely through a research effort into learning manifold structure from a collection of data points. While these methods have proved effective for certain tasks (such as classification and recognition), they also tend to be quite generic and fail to consider the geometric nuances of specific signal classes.
Projects and Contributions
The purpose of my research is to develop new methods and understanding for signal and data processing based on low-dimensional signal models, with a particular focus on the role of geometry. Below is a list of key topics (with links to selected publications):
Compressed Sensing and Dimensionality Reduction
Introduction
Manifold-based Compressed Sensing and Manifold Learning
- E. J. Candès and M. B. Wakin, An introduction to compressive sampling, in IEEE Signal Processing Magazine, vol. 25, no. 2, pp. 2130, March 2008.
Distributed (Multi-signal) Compressed Sensing
- M. B. Wakin, Manifold-Based Signal Recovery and Parameter Estimation from Compressive Measurements, Preprint, 2008.
- R. G. Baraniuk and M. B. Wakin, Random Projections of Smooth Manifolds, Foundations of Computational Mathematics, vol. 9, no. 1, pp. 51-77, February 2009.
- C. Hegde, M. Wakin, and R. Baraniuk, Random Projections for Manifold Learning, in Neural Information Processing Systems -- NIPS, Vancouver, Canada, December 2007.
Algorithms for Sparse Signal Recovery
- D. Baron, M. F. Duarte, M. B. Wakin, S. Sarvotham, and R. G. Baraniuk, Distributed Compressive Sensing, Preprint, 2009. [Revised from an earlier 2005 submission.]
- M.B. Wakin, A Manifold Lifting Algorithm for Multi-View Compressive Imaging, in Picture Coding Symposium (PCS 2009), Chicago, Illinois, May 2009.
- J.Y. Park and M.B. Wakin, A Multiscale Framework for Compressive Sensing of Video, in Picture Coding Symposium (PCS 2009), Chicago, Illinois, May 2009.
Theoretical Foundations
- M. A. Davenport and M. B. Wakin, Analysis of Orthogonal Matching Pursuit using the Restricted Isometry Property, Preprint, 2009.
- E. J. Candès, M. B. Wakin, and S. P. Boyd, Enhancing Sparsity by Reweighted L1 Minimization, Journal of Fourier Analysis and Applications, vol. 14, no. 5, pp. 877--905, December 2008.
Information Scalability
- R. Baraniuk, M. Davenport, R. DeVore, and M. Wakin, A Simple Proof of the Restricted Isometry Property for Random Matrices (aka "The Johnson-Lindenstrauss Lemma Meets Compressed Sensing"), Constructive Approximation, vol. 28, no. 3, pp. 253--263, December 2008.
Compressive Measurement Systems & Hardware
- M. A. Davenport, P. T. Boufounos, M. B. Wakin, and R. G. Baraniuk, Signal processing with compressive measurements, To appear in IEEE Journal of Selected Topics in Signal Processing, 2009.
- M. Davenport, M. Duarte, M. Wakin, J. Laska, D. Takhar, K. Kelly, and R. Baraniuk, The Smashed Filter for Compressive Classification and Target Recognition, in Computational Imaging V at IS&T/SPIE Electronic Imaging, San Jose, California, January 2007.
- M. F. Duarte, M. A. Davenport, M. B. Wakin, and R. G. Baraniuk, Sparse Signal Detection from Incoherent Projections, in IEEE 2006 International Conference on Acoustics, Speech, and Signal Processing -- ICASSP 2006, Toulouse, France, May 2006.
- M. B. Wakin, J. N. Laska, M. F. Duarte, D. Baron, S. Sarvotham, D. Takhar, K. F. Kelly, and R. G. Baraniuk, An Architecture for Compressive Imaging, in IEEE 2006 International Conference on Image Processing -- ICIP 2006, Atlanta, GA, Oct. 2006.
- J. A. Tropp, M. B. Wakin, M. F. Duarte, D. Baron, and R. G. Baraniuk, Random Filters for Compressive Sampling and Reconstruction, in IEEE 2006 International Conference on Acoustics, Speech, and Signal Processing -- ICASSP 2006, Toulouse, France, May 2006.
- See also: Compressive Imaging: A New Single Pixel Camera
Manifolds and Multi-Image Processing
Non-differentiable Image Manifolds & Parameter Estimation
- M. B. Wakin, D. L. Donoho, H. Choi, and R. G. Baraniuk, The Multiscale Structure of Non-Differentiable Image Manifolds, in SPIE Wavelets XI, San Diego, California, July 2005.
Single-Image Processing and Compression
Multiscale geometric models for approximation and compression
Generalizations and extensions to higher dimensions
- M. B. Wakin, J. K. Romberg, H. Choi, and R. G. Baraniuk, Wavelet-domain Approximation and Compression of Piecewise Smooth Images, in IEEE Transactions on Image Processing, Vol. 15, No. 5, May 2006.
- V. Chandrasekaran, M. B. Wakin, D. Baron, and R. G. Baraniuk, Representation and Compression of Multi-Dimensional Piecewise Functions Using Surflets, IEEE Transactions on Information Theory, vol. 55, no. 1, pp. 374-400, January 2009.
Additional Information & Resources
- Curriculum Vitae (pdf)
- Full publication list
- Compressed Sensing Resources Page
- The search for a standard Lena test image
Email: mwakin (at) mines (dot) e d u