No Arabic abstract
Image recovery from compressive measurements requires a signal prior for the images being reconstructed. Recent work has explored the use of deep generative models with low latent dimension as signal priors for such problems. However, their recovery performance is limited by high representation error. We introduce a method for achieving low representation error using generators as signal priors. Using a pre-trained generator, we remove one or more initial blocks at test time and optimize over the new, higher-dimensional latent space to recover a target image. Experiments demonstrate significantly improved reconstruction quality for a variety of network architectures. This approach also works well for out-of-training-distribution images and is competitive with other state-of-the-art methods. Our experiments show that test-time architectural modifications can greatly improve the recovery quality of generator signal priors for compressed sensing.
Compressed sensing (CS) is a valuable technique for reconstructing measurements in numerous domains. CS has not yet gained widespread adoption in scanning tunneling microscopy (STM), despite potentially offering the advantages of lower acquisition time and enhanced tolerance to noise. Here we applied a simple CS framework, using a weighted iterative thresholding algorithm for CS reconstruction, to representative high-resolution STM images of superconducting surfaces and adsorbed molecules. We calculated reconstruction diagrams for a range of scanning patterns, sampling densities, and noise intensities, evaluating reconstruction quality for the whole image and chosen defects. Overall we find that typical STM images can be satisfactorily reconstructed down to 30% sampling - already a strong improvement. We furthermore outline limitations of this method, such as sampling pattern artifacts, which become particularly pronounced for images with intrinsic long-range disorder, and propose ways to mitigate some of them. Finally we investigate compressibility of STM images as a measure of intrinsic noise in the image and a precursor to CS reconstruction, enabling a priori estimation of the effectiveness of CS reconstruction with minimal computational cost.
To improve the compressive sensing MRI (CS-MRI) approaches in terms of fine structure loss under high acceleration factors, we have proposed an iterative feature refinement model (IFR-CS), equipped with fixed transforms, to restore the meaningful structures and details. Nevertheless, the proposed IFR-CS still has some limitations, such as the selection of hyper-parameters, a lengthy reconstruction time, and the fixed sparsifying transform. To alleviate these issues, we unroll the iterative feature refinement procedures in IFR-CS to a supervised model-driven network, dubbed IFR-Net. Equipped with training data pairs, both regularization parameter and the utmost feature refinement operator in IFR-CS become trainable. Additionally, inspired by the powerful representation capability of convolutional neural network (CNN), CNN-based inversion blocks are explored in the sparsity-promoting denoising module to generalize the sparsity-enforcing operator. Extensive experiments on both simulated and in vivo MR datasets have shown that the proposed network possesses a strong capability to capture image details and preserve well the structural information with fast reconstruction speed.
We develop a Bayesian nonparametric model for reconstructing magnetic resonance images (MRI) from highly undersampled k-space data. We perform dictionary learning as part of the image reconstruction process. To this end, we use the beta process as a nonparametric dictionary learning prior for representing an image patch as a sparse combination of dictionary elements. The size of the dictionary and the patch-specific sparsity pattern are inferred from the data, in addition to other dictionary learning variables. Dictionary learning is performed directly on the compressed image, and so is tailored to the MRI being considered. In addition, we investigate a total variation penalty term in combination with the dictionary learning model, and show how the denoising property of dictionary learning removes dependence on regularization parameters in the noisy setting. We derive a stochastic optimization algorithm based on Markov Chain Monte Carlo (MCMC) for the Bayesian model, and use the alternating direction method of multipliers (ADMM) for efficiently performing total variation minimization. We present empirical results on several MRI, which show that the proposed regularization framework can improve reconstruction accuracy over other methods.
In this work we introduce a new method that combines Parallel MRI and Compressed Sensing (CS) for accelerated image reconstruction from subsampled k-space data. The method first computes a convolved image, which gives the convolution between a user-defined kernel and the unknown MR image, and then reconstructs the image by CS-based image deblurring, in which CS is applied for removing the inherent blur stemming from the convolution process. This method is hence termed CORE-Deblur. Retrospective subsampling experiments with data from a numerical brain phantom and in-vivo 7T brain scans showed that CORE-Deblur produced high-quality reconstructions, comparable to those of a conventional CS method, while reducing the number of iterations by a factor of 10 or more. The average Normalized Root Mean Square Error (NRMSE) obtained by CORE-Deblur for the in-vivo datasets was 0.016. CORE-Deblur also exhibited robustness regarding the chosen kernel and compatibility with various k-space subsampling schemes, ranging from regular to random. In summary, CORE-Deblur enables high quality reconstructions and reduction of the CS iterations number by 10-fold.
Compressed sensing magnetic resonance imaging (CS-MRI) is a theoretical framework that can accurately reconstruct images from undersampled k-space data with a much lower sampling rate than the one set by the classical Nyquist-Shannon sampling theorem. Therefore, CS-MRI can efficiently accelerate acquisition time and relieve the psychological burden on patients while maintaining high imaging quality. The problems with traditional CS-MRI reconstruction are solved by iterative numerical solvers, which usually suffer from expensive computational cost and the lack of accurate handcrafted priori. In this paper, inspired by deep learnings (DLs) fast inference and excellent end-to-end performance, we propose a novel cascaded convolutional neural network called MD-Recon-Net to facilitate fast and accurate MRI reconstruction. Especially, different from existing DL-based methods, which operate on single domain data or both domains in a certain order, our proposed MD-Recon-Net contains two parallel and interactive branches that simultaneously perform on k-space and spatial-domain data, exploring the latent relationship between k-space and the spatial domain. The simulated experimental results show that the proposed method not only achieves competitive visual effects to several state-of-the-art methods, but also outperforms other DL-based methods in terms of model scale and computational cost.