Randomness assisted in
Scientific Reports volume 13, Article number: 10986 (2023) Cite this article
774 Accesses
2 Altmetric
Metrics details
We propose and demonstrate a holographic imaging scheme exploiting random illuminations for recording hologram and then applying numerical reconstruction and twin image removal. We use an in-line holographic geometry to record the hologram in terms of the second-order correlation and apply the numerical approach to reconstruct the recorded hologram. This strategy helps to reconstruct high-quality quantitative images in comparison to the conventional holography where the hologram is recorded in the intensity rather than the second-order intensity correlation. The twin image issue of the in-line holographic scheme is resolved by an unsupervised deep learning based method using an auto-encoder scheme. Proposed learning technique leverages the main characteristic of autoencoders to perform blind single-shot hologram reconstruction, and this does not require a dataset of samples with available ground truth for training and can reconstruct the hologram solely from the captured sample. Experimental results are presented for two objects, and a comparison of the reconstruction quality is given between the conventional inline holography and the one obtained with the proposed technique.
Digital holography (DH) has emerged as a powerful tool for recording and reconstructing the amplitude and phase information of the wave1,2,3,4. The ability of the DH to retrieve complex amplitude information has a wide range of applications in 3D displays5, microscopy6, biomedical imaging7, and many more. The DH provides a spatially resolved quantitative phase images and depth reconstructions. In-line, off-axis, and phase shifting are a few widely used schemes. In an off-axis holography, two coherent and angularly separated beams interfere to record the hologram information8. Since available digital detectors have a limited pixel pitch, angular separation between interfering beams introduce a limitation for the off-axis DH. Moreover presence of unmodulated term and conjugate limits utilization of the full bandwidth in an off-axis DH geometry. Phase shifting is another technique that uses multiple recordings of the same object with phase shifts in the reference wave9,10,11,12. Among several holographic techniques, in-line holography has a compact design, and a high space bandwidth product (SBP)13,14. In-line holography schemes can be designed by using a single path and obtained by the interference of diffracted and un-diffracted waves emerging from the object14. However, a bottleneck of in-line holography is the ubiquitous twin image problem. Various techniques have been developed to resolve this issue using optical and computational methods15,16,17. Development of techniques such as non-interferometry and non-iterative schemes based on Kramers-Kronig method18,19 and dual-plane coupled phase retrieval for non-prior holographic imaging20 have further advanced the field of complex field imaging.
The quality of reconstruction in the DH depends on the recording configurations. Due to digital recording and constraints on the detectors, improving resolution is an emerging interest in the DH. Resolution in a digital holographic setup is influenced by factors such as; the numerical aperture, detector pitch, and diffraction. In the past, various techniques have been proposed to improve the resolution in the DH, and some of these techniques are lowering the wavelength21, down-sampling the detector pitch22, increasing the effective numerical aperture23,24, expanding computational bandwidth25. Recently, some advancements have been made to develop high SBP imaging using spatial light modulator26, Kramers-Kronig relation27,28, and off-axis digital holographic multiplexing29. Structured light illumination has also been used to improve the image quality and resolution30,31,32,33,34,35,36. Zheng et al. used structured illumination in different orientations combined with an iterative algorithm to enhance the spatial resolution in the DH36. Speckle field illumination has also been used in the DH for high-resolution imaging and in enlarging field of view6,37,38,39,40,41,42. However, these speckle illumination methods need recording of several holograms with the random illumination patterns for proper cancellation of randomness.
On the other hand, use of the randomness rather than cancellation has shown significant potential in imaging such as ghost imaging, ghost diffraction microscopy43,44, resolution enhanced wide field imaging45 and many more. Memory effect46 within a speckle pattern offers a high-resolution imaging systems47. Correlations have been exploited in super-resolution optical fluctuation imaging (SOFI) with dynamics near field speckle patterns48. It has been demonstrated that higher-order (n) intensity correlations improve the resolution by a factor of \(\sqrt{n}\) and such higher-order correlations have been utilized for improving resolution beyond the diffraction limit49,50. A sub-Rayleigh imaging has been demonstrated using a second-order correlation measurement51. However, majority of these correlation techniques mainly deal with amplitude object, without any phase signature of the signal except a recent work52.In the reference52, a sub-Rayleigh dark-field imaging by speckle illumination is demonstrated and an autocorrelation image is presented for a binary phase object.
In this paper, we propose and demonstrate a new method to record an in-line hologram in intensity correlation rather than the intensity as in conventional holography. The novelty of our work lies in demonstrating enhanced complex field imaging with a better reconstruction quality. The narrower point spread function in the intensity correlations plays a critical role in enhancing the quality of reconstruction in our technique. Further, a common issue of twin images in in-line holography is tackled with an unsupervised DL method by utilizing an auto-encoder model. Based on DL, other methods have also been proposed to address this issue, such as those used in end-to-end digital hologram reconstruction53,54,55,56, with the capabilities of convolutional neural networks (CNNs) as a universal approximator for solving inverse problems in the computational imaging. This typically involves training a CNN on a labeled dataset such as paired holograms and corresponding twin image-free phase and amplitude data, and then use the trained CNN to reconstruct twin image-free results. However, these DL methods with CNN require large datasets for training, which can be difficult and costly to obtain in the DH. Moreover, CNNs are often considered “black boxes,” because the training and inference processes are not transparent and cannot be easily explained17. This can be problematic when using a well-trained CNN to reconstruct a hologram, as it is not possible to address any issue that may arise if the reconstruction is not accurate.
Therefore, in the proposed reconstruction of the inline hologram,we prefer to use an unsupervised DL approach for a single-shot image reconstruction without a large training dataset17.This method utilizes an autoencoder to fit the solutions of physics-driven holography equations, and similar to other applications of autoencoders, our method does not rely on a training dataset, which makes the reconstruction process easier. The auto-encoder minimizes a well-defined objective function to reduce noise and remove twin images instead of suppressing it, by adjusting its weights to find the reconstructed object that is most consistent with the captured hologram. Our results show that a neural network equipped with the proposed correlation method provides recovery of the larger spectrum and hence enhanced quality of reconstruction of the complex-valued object. Our proposed scheme is helpful in imaging beyond the diffraction limit and developing new holographic techniques. The proposed technique is experimentally verified, and reconstructed results are presented for two different cases, i.e., a conventional holographic recording and hologram recording by second-order correlation. A comparison of the conventional holography and the proposed method highlight high-quality reconstruction in the new technique. Theoretical background and experimental demonstrations are discussed below.
A conventional recording of an in-line hologram and its comparison with proposed technique is shown in Fig. 1. Diffracted and undiffracted beams from the object interfere at plane 1 and make an in-line hologram as a distribution of the intensity. This inline hologram is imaged and digitally recorded at plane 2, as shown in Fig. 1a. An aperture is placed in front of the lens to control the numerical aperture and consequently analyze its impact on the image quality. An intensity of the in-line hologram at plane 1 is given by,
where \(E_H(\rho )=E_{D}(\rho ) + E_{d}(\rho )\) is the complex field at plane 1. \(E_{D}(\rho )\) and \(E_{d}(\rho )\) are diffracted and un-diffracted beams respectively and \(\rho\) is the spatial coordinate at plane 1. The optical field at plane 2 is represented as,
where the digitally recorded hologram is \(I=|E_H \circledast h|^2\), \(\circledast\) represents the convolution operator and r is the spatial coordinate at plane 2. \(h(r-\rho )\) represents the point spread function (PSF) of a diffraction-limited imaging system. The PSF for a diffraction-limited imaging lens is an airy disk and is represented as,
where P(\(\rho _0\)) is the pupil function describing the effective entrance pupil, and \(d_1\) and \(d_2\) are the distances from the lens to the object plane and image plane, respectively, and \(d_1=d_2=2\hbox {f}\). Equation (2) represents a digital recording of the hologram which is numerically reconstructed to recover the complex-valued object from the DH.
A comparison of (a) conventional and (b) proposed technique.
Now, consider a scatterer at the plane 1 which hides the direct recording of the hologram from the detector. A random scatterer in the path of the light scrambles the wavefront and generates a speckle pattern as shown in Fig. 1b.
A single realization of the field immediately after the scatterer is given by,
where \(\phi (\rho ,t)\) is the random phase introduced by the scatterer and t represents time corresponding to different random patterns.
The complex field at the recording plane 2 is represented as,
The random intensity at plane 2 is
Imaging of a hologram through a scatterer has been used in the past for looking around corners57 and in the correlation holography58. These methods rely on recovering conventional hologram i.e, \(I(\rho )\) from the averaged random fields. On the other hand, here we propose and experimentally demonstrate a new technique by recording the hologram in terms of the second-order correlation of the intensity rather than intensity.
Following Eq. (6), intensity fluctuation is given as,
where angular bracket \(\langle ...\rangle\) represents ensemble average and \(\langle I\rangle\) is mean intensity.
We introduce and use correlation of intensity fluctuations to record the hologram and this correlation function is represented as,
Equation (8) represents our quantity of interest to record the in-line hologram. In comparison to the conventional hologram recording in I(r) , the proposed technique records hologram as a distribution of \(g^{2}(r,r)\). For the Gaussian random field, second-order intensity correlation can be expressed as a modulus square of the field correlations as,
where asterisk \(*\) represents the complex conjugate. The second-order field correlation is represented as,
For a spatially incoherent source, the correlation at plane 1 is represented as,
Substituting Eq. (11) in Eq. (10) leads to
Therefore second-order intensity correlation is expressed as,
For a uniform source, i.e, \(I(\rho )=1\); the second order intensity correlation transforms to,
Equation (14) represents that the correlation of intensity fluctuations is proportional to the fourth power of the PSF of an imaging lens. A comparison of Eqs. (2) and (14) shows that the recording quality is enhanced in the higher-order correlation due to a narrower size of the PSF as compared to the conventional case. The size of the Airy disk is reduced by a factor of 0.6 in the measurement of the intensity correlation \(g^2 (r,r)\) when compared to the intensity measurement51. The proposed scheme is quantitatively analyzed and experimentally tested in the coming section. Although the quality of recording the inline hologram is improved in the randomness-assisted approach, reconstruction of an inline hologram demands the removal of the twin images. This is tackled by using an unsupervised DL method as explained in the coming section.
A monochromatic laser beam of wavelength 633 nm (Thorlabs, Model No. HNL 150L) is spatially filtered and collimated by a spatial filter assembly, and a lens L1. A beam splitter (BS) divides the incident beam into two equal reflected and transmitted components. The beam transmitted from BS is used to illuminate a reflective type spatial light modulator (SLM). This SLM is having \(1280\times 768\) pixels with a pixel pitch of \(20\,\upmu \hbox {m}\). An object is inserted in the incident light using the SLM and the light reflected from the SLM is folded by the BS to propagate toward the plane 1 (without rotating ground glass (RGG)). The distance between SLM and plane 1 is 200 mm. Interference of diffracted and undiffracted waves from the object makes an inline hologram at the plane 1 which is imaged by lens L2 at the camera plane using a 4f imaging system. Focal length of lens L2 is 100 mm and a variable aperture A2 is placed to control the numerical aperture of the imaging lens as shown in Fig. 2. A CMOS camera with \(1280\times 1024\) pixels, and pixel size 5.3 μm, records the in-line hologram.
Experimental Setup; SF: Spatial filter, L1 and L2:Lens with focal lengths 200 and 100 mm respectively, BS: Beam splitter, SLM: Spatial light modulator, RGG: Rotating ground glass, A1 and A2:Apertures, CMOS Camera: Complementary metal oxide semiconductor camera.
In order to replace conventional hologram recording by recording in the correlation of intensity fluctuations, we insert a RGG at plane 1 in the experimental system. An inline hologram at plane 1 is now scrambled due to the random phase introduced by the RGG. Therefore recorded pattern at the camera plane represents a speckle pattern for a particular position of the RGG and the pattern is represented as \(| E \circledast h|^2\). This random phase is common to both the diffracted and undiffracted beams at the plane 1, thus hologram information can be retrieved by averaging the random patterns in spite of randomness in the path of the light. The randomly scattered inline hologram is recorded using different orientations of the RGG at different times t. For experimental demonstrations of the proposed technique, we used 150 frames which are independently generated by the RGG. A series of random patterns with independent randomness are utilized to measure the correlation of the intensity fluctuations and to record the inline hologram. In the randomness-assisted recording of an inline hologram, a correlation of the intensity fluctuations is measured by estimating correlations of intensity fluctuations over varying random patterns. We considered averaging over 150 random patterns and is represented as,
This equation represents the correlation of the fluctuations of intensity patterns corresponding to 150 independent random patterns generated by the ground glass. Each shot of the recorded image has a noisy pattern for fixed orientation of RGG at a time t. We make use of averaging over a number of random patterns and \(g^2(r,r)\) is estimated. This results in a hologram with reduced noise and an inline hologram appearing as a distribution of \(g^2(r,r)\).
Once we have the recorded hologram, we digitally reconstruct it to obtain the quantitative amplitude and phase distribution. Quality of the reconstruction is influenced by the total number of incoherent random patterns59. Moreover, the object needs to be static during the recording of the random patterns. The spatial resolution achieved in the proposed scheme is also influenced by the finite correlation length of the random phase screen employed in the experiment, which imposes a cap on the hologram’s spatial fineness. We assume that the random screen is delta correlated, and any deviation from it would lead to degraded reconstruction quality of the hologram. The experiment is performed for two different objects, a Greek letter “\(\beta\)” and an English letter “V” . In order to test and prove the validity of the proposed scheme, we used two quantitative objects with sharp edges and curved structures. These objects were selected to examine the role of the high-frequency content in image quality reconstruction and quantitative evaluation of the performance of the proposed scheme with higher-order correlation by comparing it with conventional schemes. Objects, such as “\(\beta\)” of size (\(2.8~\text {mm} \times 1.48~\text {mm}\)) and \(V(2.84~\text {mm}\times 2.64~\text {mm})\) were used in the experiment with the help of SLM. An inline hologram of letter \(\beta\) is shown in Fig. 3a recorded as a distribution of the intensity I(r) and recording of an inline hologram of the same object as a distribution of second order intensity correlation \(g^2(r,r)\) is represented in Fig. 3b. The detailed procedure of retrieving quantitative information from the inline hologram with and without randomness is described below.
(a) Conventional inline hologram for \(\beta\); (b) Inline hologram in terms of second order correlation.
In the past, different methods have been proposed to tackle reconstruction of the in-line hologram, including the phase retrieval algorithms60,61,62,63,64,65. Accurate recovery of the phase can lead to strong suppression of the twin image66,67. We use an unsupervised DL approach for reconstructing the in-line hologram using an encoder–decoder architecture17. This network maps a high dimensional input image, \(\alpha\), into a low dimensional latent code, \(\beta\). The mapping from the input image to the latent code and the reconstruction of the output from the latent code are represented by the functions \(F_{\text {encode}}(\alpha ) = \beta\) and \(F_{\text {decode}}(\beta ) = {\hat{\alpha }}\), respectively. This model can learn the uncorrupted and realistic features of the input image through an iterative process, allowing it to converge on a denoised output. To address the twin image issue in an inline hologram, a physical model is designed for training the auto-encoder. The auto-encoder, denoted as \(F_{auto-encoder}(\alpha , w)\), is trained to minimize the error between the captured in-line hologram Hg(I(r) or \(g^2(r,r)\) ) and the reconstructed in-line hologram, which is the forward-propagated result of the reconstructed complex object wave to the plane 1 using \(F_{transmission}\). The weights w are randomly initialized at the start of training. The goal is to find the weights w that minimize the error between the captured in-line hologram and the reconstructed in-line hologram. The objective function can be written as:
Where \(|. |_{2}\) is \(L_2\) norm. The in-line hologram obtained from Eq. (14) is first back-propagated to the object plane to determine the amplitude and phase distributions. These are then fed into the auto-encoder model. The network outputs the reconstructed amplitude and phase, which are then forward propagated to the in-line hologram plane using \(F_{transmission}\) to get a reconstructed in-line hologram. The mean absolute error (MAE) loss between the original hologram and reconstructed hologram is calculated to update the model’s weights.
Here, we use an “Hourglass” type auto-encoder architecture. This encoder transfers the fixed network input into lower-dimensional space; encoding steps, and decoding steps are done by reconstructing the complex object from their representation by the latent variables. To get better convergence of our model, we use batch normalization68 and ReLU activation69 function after most layers. In this network architecture, we use a wavelet transform and its inverse transform to provide downsampling (encoding) and upsampling (decoding), which substitute strided convolution, pooling, or interpolation. In this case, the encoding and decoding processes make use of the 2D Haar wavelet and its inverse transform17. We found that skip connection (similar to the U-Net70) is not useful for our proposed case since the network will directly project the input to the output rather than learning a clear reconstruction of the complex field and the same notion applies when the number of channels after encoding is much higher. Skip connection maybe useful in conventional image restoration but not for phase retrieval case. To resolve this issue, encoder’s feature channels at the output is compressed from 1024 into 16 channels, as indicated by the blue arrow in Fig. 4. The input and output image shapes for the auto-encoder network are (H, W, 2), where H and W represent the height and width of the image, respectively. The two channels correspond to the amplitude and phase of the back-propagated in-line hologram.
An auto-encoder network utilizing deep convolutional layers in an hourglass architecture.
Through iterations, it was found that the network first generates a rough estimate of the reconstructed object, and then gradually recovers the details of the object. When the objective function is minimized using the gradient descent method, the network is able to find the optimal results by adjusting the model parameters within the parameter space. This is done by generating a rough estimate of the reconstructed complex object, known as the primary instance, and then progressively refining this estimate through the recovery of the twin image free amplitude, and phase details of the complex object from coarse to fine until the final reconstructed complex object is obtained. In this manner, the network tunes the model parameters within the parameter space to search for optimal results.
We record inline holograms in two different experimental configurations, as shown in Fig. 1. In the first case, an inline hologram is recorded in free space i.e., without a scatterer. The inline hologram at plane 1 is imaged by a lens L2 with a variable aperture A2 in front of the lens L2. In the second case, when a scatterer is placed at plane 1, a speckle is generated due to the randomness and interference of randomly scattered waves. Light is scrambled into the speckle pattern without any direct resemblance with the hologram I(r). We recorded the data for the conventional and proposed scheme for a fixed aperture of diameter 2.6 mm as shown in experimental Fig. 2. For randomness-assisted inline hologram recording, a series of random patterns are captured and these random patterns are digitally processed to obtain the second-order correlation of intensity. The inline hologram is back-propagated to the object plane by using an angular spectrum method. However, inline configuration of the recording introduces a twin image in the reconstruction. Therefore a deep learning is applied to quantitatively reconstruct the inline hologram without a twin image. We employ the auto-encoder model to resolve this problem and this is implemented using the PyTorch framework and runs on a GPU workstation with an Nvidia tesla P100 graphics card. The Adam optimization algorithm is utilized with a fixed learning rate of 0.005. To train the network, we used angular spectrum back-propagation reconstruction of the in-line hologram as input and use the training process for 4000 iterations until we get the final reconstruction. The entire training process takes approximately 731 s to complete. A flow chart for the process is given in Fig. 5. To prove the validity of the proposed scheme for enhanced quality reconstruction over the conventional scheme, we evaluated the Fourier spectrum of the reconstructed objects. Fig. 6a and b represent two Fourier spectrums corresponding to an object, the letter \(\beta\), for the conventional and proposed scheme. Fig. 6c and d represent two Fourier spectrums corresponding to an object, the letter V, for the conventional and proposed scheme. Reconstruction of an object with sharper edges exhibits higher frequency content in its Fourier spectrum. Fig. 6b and d clearly show an enlargement in the Fourier spectrum in comparison to Fig. 6a and c, respectively, and thus a better quality reconstruction is obtained with the use of hologram recording in terms of the intensity correlation. Reconstruction results are presented for two different objects viz, \(\beta\) and V as shown in Figs. 7 and 8, respectively, in free space and randomness-assisted geometry. Fig. 7a and b are the amplitude and phase of letter \(\beta\) in the inline holography without scatterer. Fig. 7c and d represent the retrieved amplitude and phase for the randomness-assisted hologram recording. Fig. 8a and b are the amplitude and phase for letter V in the inline holography without scatterer, and Fig. 8c and d show reconstructed amplitude and phase distribution for the proposed randomness-assisted inline holography technique. Comparison of inline holography in free space and through randomness shows that reconstruction quality is significantly enhanced in the hologram recording with the second-order intensity correlation.
A flow chart for the proposed scheme.
(a, b) Fourier spectrum for \(\beta\) in conventional case and proposed scheme respectively; (c, d) Fourier spectrum for V in conventional case and proposed scheme respectively.
(a, b) Conventional case results for letter \(\beta\); (a) Amplitude (b) Phase, (c, d) Proposed scheme based results for letter \(\beta\); (c) Amplitude (d) Phase.
(a, b) Conventional case results for letter V; (a) Amplitude (b) Phase, (c, d) Proposed scheme-based results for letter V; (c) Amplitude (d) Phase.
In order to check the reconstruction performance at various z-planes behind plane 1 and examine the effect of propagation at different distances, we have recovered the complex fields at various z planes behind plane 1 ranging from \(z=50\) to 200 mm with an interval of 50 mm using digital propagation. Figures 9a and b represent the effect of propagation on amplitude and phase distribution, respectively, for propagation distances \(z= 50,100,150\) and 200 mm behind plane 1.
Effect of propagation: (a) Amplitude distribution at different propagation distances ; (b) Phase distribution at different propagation distances.
We evaluated the performance and effectiveness of the proposed method for two different objects, i.e., for \(\beta\) and V. The performance of the technique is quantitatively evaluated and compared with the conventional holographic reconstruction results. First, we compare the quality of the spectrum recovery, where we notice that the recovered spectrum in the proposed scheme is larger in comparison to the conventional scheme, as shown in Fig. 6. and this enhancement in the spectrum recovery also appears in the quality of reconstruction in the proposed scheme when compared to the conventional scheme. Edges and frequency contents are enhanced in the holography with \(g^2(r,r)\) in comparison to the holography with I(r). This is observed by accessing the spatial frequency contents of the reconstructed object for both inline holographic recording methods, i.e., I(r) and \(g^2(r,r)\). Apart from the spectrum, we also quantitatively evaluate the results using two quantitative parameters and definitions.
For a quantitative evaluation and comparison of the quality of reconstruction of both hologram recording methods, we introduce two parameters, such as visibility and reconstruction efficiency71. Visibility gives a measure of the degree to which the signal reconstruction can be differentiated from the background noise. It is defined as the ratio of the signal region’s average intensity level to the background region’s average intensity level in the reconstructed image. On the other hand, reconstruction efficiency (\(\eta\)) is the proportion of the signal region’s measured power to the total of the signal and background regions’ measured powers in the reconstructed image. A promising higher value of visibility and reconstruction efficiency proves the validity of the enhanced quality reconstruction. Visibility values for letter \(\beta\) in the conventional and proposed scheme are 0.042 and 0.21, whereas respective reconstruction efficiency values are 0.55 and 0.885. For other object V, visibility and reconstruction efficiency values are 0.081 and 0.67 for the conventional case. The improved visibility and reconstruction efficiency values for object V in the proposed scheme are 0.55 and 0.92. For the proposed scheme, visibility for letter \(\beta\) is almost five times of conventional reconstruction and is around 6.8 times for letter V. Additionally, we have also evaluated the Fourier spectrum corresponding to the conventional and proposed scheme, and an enlarged Fourier spectrum obtained in the proposed scheme (Figs. 6b and d) also appears in an enhanced quality reconstruction of the objects, as shown in Figs. 7c,d and 8c,d. Furthermore, we have evaluated the visibility and reconstruction efficiency at different z planes to quantitatively verify the effect of propagation in the system, as shown in Table 1. Moreover, to check the robustness of our proposed scheme, we investigate the performance of the technique when the experimentally recorded hologram is added with artificially generated additive white Gaussian noise. We add noise (variance) in the experimentally recorded hologram and check its reconstruction quality for the conventional case. On the other hand, in the proposed method, the noise is added in each recorded speckle pattern, and then the intensity correlation is applied to retrieve the inline hologram from the randomness. Figure 10 shows the reconstruction of amplitude (a–c) and phase (d–f) for three different noise levels at 3,4 and 5, respectively, in the conventional scheme. Figure 11 shows the reconstruction of amplitude (a–c) and phase (d–f) for noise levels at 3,4, and 5, respectively, for our proposed scheme. A comparison of Figs. 10 and 11 demonstrate that the proposed method holds a better performance than the conventional method when encountering noise in the recorded holograms. Table 2 gives the values of visibility and reconstruction efficiency at different noise levels for the proposed scheme. We would like to point out that the reconstruction quality also depends on factors such as the delta correlation of the random phase screen in the experimental condition and the number of incoherent random patterns in the recording of the hologram.
Conventional scheme: Reconstruction under different noise levels: (a–c) represent reconstructed amplitude under noise level 3,4 and 5 respectively; (d–f) represent reconstructed phase under noise level 3,4 and 5 respectively.
Proposed scheme: Reconstruction under different noise levels:(a–c) represent reconstructed amplitude under noise level 3, 4 and 5 respectively; (d–f) represent reconstructed phase under noise level 3, 4 and 5 respectively.
In conclusion, we have demonstrated a new method to record holograms in the second-order intensity correlation, and the advantage of this recording appears in the quality of the reconstructed object from the hologram. In order to demonstrate the proposed scheme of recording in the holography, we recorded inline holograms in both conventional and randomness-assisted approaches, and the results are compared. An enlarged Fourier spectra corresponding to the reconstructed field in the proposed scheme validates the enhanced quality imaging in comparison to the conventional holographic scheme. A twin image issue of the inline hologram is resolved with a deep learning method that uses an auto-encoder model. The quantitative features are retrieved, and quality is compared in the conventional and the proposed schemes. Moreover, the robustness of the scheme is tested and quantitatively examined by adding simulated white Gaussian noise. The scheme is expected to be useful in imaging beyond the diffraction limit and developing new holographic schemes.
The data that support the findings of this study are available on reasonable request from the corresponding author.
Hariharan, P. Basics of Holography (Cambridge University Press, 2002).
Book Google Scholar
Tahara, T., Quan, X., Otani, R., Takaki, Y. & Matoba, O. Digital holography and its multidimensional imaging applications: A review. Microscopy 67, 55–67 (2018).
Article CAS PubMed PubMed Central Google Scholar
Javidi, B. et al. Roadmap on digital holography. Opt. Express 29, 35078–35118 (2021).
Article ADS CAS PubMed Google Scholar
Rosen, J. Holography (IntechOpen, 2023).
Google Scholar
Park, J., Lee, K. & Park, Y. Ultrathin wide-angle large-area digital 3d holographic display using a non-periodic photon sieve. Nat. Commun. 10, 1304 (2019).
Article ADS PubMed PubMed Central Google Scholar
Park, Y. et al. Speckle-field digital holographic microscopy. Opt. Express 17, 12285–12292 (2009).
Article ADS CAS PubMed Google Scholar
Kemper, B. & Von Bally, G. Digital holographic microscopy for live cell applications and technical inspection. Appl. Opt. 47, A52–A61 (2008).
Article PubMed Google Scholar
Leith, E. N. & Upatnieks, J. Reconstructed wavefronts and communication theory. JOSA 52, 1123–1130 (1962).
Article ADS Google Scholar
Zhang, T. & Yamaguchi, I. Three-dimensional microscopy with phase-shifting digital holography. Opt. Lett. 23, 1221–1223 (1998).
Article ADS CAS PubMed Google Scholar
Yamaguchi, I. & Zhang, T. Phase-shifting digital holography. Opt. Lett. 22, 1268–1270 (1997).
Article ADS CAS PubMed Google Scholar
Awatsuji, Y., Sasada, M. & Kubota, T. Parallel quasi-phase-shifting digital holography. Appl. Phys. Lett. 85, 1069–1071 (2004).
Article ADS CAS Google Scholar
Awatsuji, Y., Fujii, A., Kubota, T. & Matoba, O. Parallel three-step phase-shifting digital holography. Appl. Opt. 45, 2995–3002 (2006).
Article ADS PubMed Google Scholar
Kim, M. K. Principles and techniques of digital holographic microscopy. SPIE Rev. 1, 018005 (2010).
Google Scholar
Gabor, D. A new microscopic principle. Nature 161, 777–778 (1948).
Article ADS CAS PubMed Google Scholar
Latychevskaia, T. & Fink, H.-W. Solution to the twin image problem in holography. Phys. Rev. Lett. 98, 233901 (2007).
Article ADS PubMed Google Scholar
Zhang, W. et al. Twin-image-free holography: A compressive sensing approach. Phys. Rev. Lett. 121, 093902 (2018).
Article ADS PubMed Google Scholar
Li, H., Chen, X., Chi, Z., Mann, C. & Razi, A. Deep dih: Single-shot digital in-line holography reconstruction by deep learning. IEEE Access 8, 202648–202659 (2020).
Article Google Scholar
Shen, C., Liang, M., Pan, A. & Yang, C. Non-iterative complex wave-field reconstruction based on kramers-kronig relations. Photonics Res. 9, 1003–1012 (2021).
Article Google Scholar
Baek, Y. & Park, Y. Intensity-based holographic imaging via space-domain kramers-kronig relations. Nat. Photonics 15, 354–360 (2021).
Article ADS CAS Google Scholar
Huang, Z., Memmolo, P., Ferraro, P. & Cao, L. Dual-plane coupled phase retrieval for non-prior holographic imaging. PhotoniX 3, 1–16 (2022).
Article Google Scholar
Faridian, A. et al. Nanoscale imaging using deep ultraviolet digital holographic microscopy. Opt. Express 18, 14159–14164 (2010).
Article ADS CAS PubMed Google Scholar
Song, J. et al. Sparsity-based pixel super resolution for lens-free digital in-line holography. Sci. Rep. 6, 24681 (2016).
Article ADS CAS PubMed PubMed Central Google Scholar
Jiang, Z. et al. High-resolution digital holography with the aid of coherent diffraction imaging. Opt. Express 23, 20916–20925 (2015).
Article ADS CAS PubMed Google Scholar
Mico, V., Zalevsky, Z. & Garcia, J. Superresolution optical system by common-path interferometry. Opt. Express 14, 5168–5177 (2006).
Article ADS PubMed Google Scholar
Zhang, W., Zhang, H. & Jin, G. Resolution-enhanced digital in-line holography by extension of the computational bandwidth. Opt. Commun. 472, 126038 (2020).
Article CAS Google Scholar
Li, G. et al. Space bandwidth product enhancement of holographic display using high-order diffraction guided by holographic optical element. Opt. Express 23, 33170–33183 (2015).
Article ADS PubMed Google Scholar
Baek, Y., Lee, K., Shin, S. & Park, Y. Kramers-kronig holographic imaging for high-space-bandwidth product. Optica 6, 45–51 (2019).
Article ADS Google Scholar
Huang, Z. & Cao, L. High bandwidth-utilization digital holographic multiplexing: An approach using kramers-kronig relations. Adv. Photonics Res. 3, 2100273 (2022).
Article Google Scholar
Shaked, N. T., Micó, V., Trusiak, M., Kuś, A. & Mirsky, S. K. Off-axis digital holographic multiplexing for rapid wavefront acquisition and processing. Adv. Opt. Photonics 12, 556–611 (2020).
Article ADS Google Scholar
Gustafsson, M. G. Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy. J. Microsc. 198, 82–87 (2000).
Article CAS PubMed Google Scholar
Gustafsson, M. G. Nonlinear structured-illumination microscopy: wide-field fluorescence imaging with theoretically unlimited resolution. Proc. Natl. Acad. Sci. 102, 13081–13086 (2005).
Article ADS CAS PubMed PubMed Central Google Scholar
Heintzmann, R. & Cremer, C. G. Laterally modulated excitation microscopy: Improvement of resolution by using a diffraction grating. In Optical biopsies and microscopic techniques III, vol. 3568, 185–196 (SPIE, 1999).
Heintzmann, R. & Huser, T. Super-resolution structured illumination microscopy. Chem. Rev. 117, 13890–13908 (2017).
Article CAS PubMed Google Scholar
Gao, P., Pedrini, G. & Osten, W. Structured illumination for resolution enhancement and autofocusing in digital holographic microscopy. Opt. Lett. 38, 1328–1330 (2013).
Article ADS PubMed Google Scholar
Chowdhury, S., Eldridge, W. J., Wax, A. & Izatt, J. Refractive index tomography with structured illumination. Optica 4, 537–545 (2017).
Article ADS Google Scholar
Zheng, J. et al. Digital holographic microscopy with phase-shift-free structured illumination. Photonics Res. 2, 87–91 (2014).
Article Google Scholar
Zheng, J., Pedrini, G., Gao, P., Yao, B. & Osten, W. Autofocusing and resolution enhancement in digital holographic microscopy by using speckle-illumination. J. Opt. 17, 085301 (2015).
Article ADS Google Scholar
García, J., Zalevsky, Z. & Fixler, D. Synthetic aperture superresolution by speckle pattern projection. Opt. Express 13, 6073–6078 (2005).
Article ADS PubMed Google Scholar
Vinu, R., Chen, Z., Pu, J., Otani, Y. & Singh, R. K. Speckle-field digital polarization holographic microscopy. Opt. Lett. 44, 5711–5714 (2019).
Article ADS CAS PubMed Google Scholar
Meitav, N., Ribak, E. N. & Shoham, S. Point spread function estimation from projected speckle illumination. Light Sci. Appl. 5, e16048–e16048 (2016).
Article ADS CAS PubMed PubMed Central Google Scholar
Bianco, V. et al. Clear coherent imaging in turbid microfluidics by multiple holographic acquisitions. Opt. Lett. 37, 4212–4214 (2012).
Article ADS PubMed Google Scholar
Funamizu, H., Uozumi, J. & Aizu, Y. Enhancement of spatial resolution in digital holographic microscopy using the spatial correlation properties of speckle patterns. OSA Contin. 2, 1822–1837 (2019).
Article Google Scholar
Manisha, et al. Ghost diffraction: A spatial statistical approach. Opt. Commun. 528, 129002 (2023).
Article CAS Google Scholar
Vinu, R., Chen, Z., Singh, R. K. & Pu, J. Ghost diffraction holographic microscopy. Optica 7, 1697–1704 (2020).
Article ADS Google Scholar
Yilmaz, H. et al. Speckle correlation resolution enhancement of wide-field fluorescence imaging. Optica 2, 424–429 (2015).
Article ADS CAS Google Scholar
Freund, I., Rosenbluh, M. & Feng, S. Memory effects in propagation of optical waves through disordered media. Phys. Rev. Lett. 61, 2328 (1988).
Article ADS CAS PubMed Google Scholar
van Putten, E. G. et al. Scattering lens resolves sub-100 nm structures with visible light. Phys. Rev. Lett. 106, 193905 (2011).
Article ADS PubMed Google Scholar
Choi, Y. et al. Wide-field super-resolution optical fluctuation imaging through dynamic near-field speckle illumination. Nano Lett. 22, 2194–2201 (2022).
Article ADS CAS PubMed PubMed Central Google Scholar
Li, F., Altuzarra, C., Li, T., Scully, M. & Agarwal, G. Beyond sub-rayleigh imaging via high order correlation of speckle illumination. J. Opt. 21, 115604 (2019).
Article ADS CAS Google Scholar
Liu, Y., Chen, L., Liu, W., Liang, X. & Wan, W. Resolution-enhanced imaging through scattering media by high-order correlation. Appl. Opt. 58, 2350–2357 (2019).
Article ADS PubMed Google Scholar
Oh, J.-E., Cho, Y.-W., Scarcelli, G. & Kim, Y.-H. Sub-rayleigh imaging via speckle illumination. Opt. Lett. 38, 682–684 (2013).
Article ADS PubMed PubMed Central Google Scholar
Dou, L.-Y., Cao, D.-Z., Gao, L. & Song, X.-B. Sub-rayleigh dark-field imaging via speckle illumination. Opt. Lett. 48, 1347–1350 (2023).
Article ADS PubMed Google Scholar
Chen, H., Huang, L., Liu, T. & Ozcan, A. Fourier imager network (fin): A deep neural network for hologram reconstruction with superior external generalization. Light Sci. Appl. 11, 254 (2022).
Article ADS CAS PubMed PubMed Central Google Scholar
Rivenson, Y., Zhang, Y., Günaydın, H., Teng, D. & Ozcan, A. Phase recovery and holographic image reconstruction using deep learning in neural networks. Light Sci. Appl. 7, 17141–17141 (2018).
Article CAS PubMed PubMed Central Google Scholar
Ren, Z., Xu, Z. & Lam, E. Y. End-to-end deep learning framework for digital holographic reconstruction. Adv. Photonics 1, 016004 (2019).
Article ADS Google Scholar
Wang, S. et al. End-to-end reconstruction of multi-scale holograms based on cue-net. Opt. Commun. 530, 129079 (2023).
Article CAS Google Scholar
Singh, A. K., Naik, D. N., Pedrini, G., Takeda, M. & Osten, W. Looking through a diffuser and around an opaque surface: A holographic approach. Opt. Express 22, 7694–7701 (2014).
Article ADS PubMed Google Scholar
Kumar Singh, R., Vinu, R. & Sharma, M. A. Recovery of complex valued objects from two-point intensity correlation measurement. Appl. Phys. Lett. 104, 111108 (2014).
Article ADS Google Scholar
Manisha., Rathor, M. & Singh, R. K. Single shot and speckle free reconstruction of orthogonal polarization modes with a tuneable beam displacer. J. Opt. 25, 025701 (2022).
Article ADS Google Scholar
Beleggia, M., Schofield, M., Volkov, V. & Zhu, Y. On the transport of intensity technique for phase retrieval. Ultramicroscopy 102, 37–49 (2004).
Article CAS PubMed Google Scholar
Denis, L., Fournier, C., Fournel, T. & Ducottet, C. Twin-image noise reduction by phase retrieval in in-line digital holography. In Wavelets XI, vol. 5914, 148–161 (SPIE, 2005).
Liu, G. & Scott, P. D. Phase retrieval and twin-image elimination for in-line fresnel holograms. JOSA A 4, 159–165 (1987).
Article ADS CAS Google Scholar
Fienup, J. R. Phase retrieval algorithms: A comparison. Appl. Opt. 21, 2758–2769 (1982).
Article ADS CAS PubMed Google Scholar
Gerchberg, R. W. A practical algorithm for the determination of plane from image and diffraction pictures. Optik 35, 237–246 (1972).
Google Scholar
Latychevskaia, T. Iterative phase retrieval for digital holography: Tutorial. JOSA A 36, D31–D40 (2019).
Article CAS PubMed Google Scholar
Flewett, S. et al. Holographically aided iterative phase retrieval. Opt. Express 20, 29210–29216 (2012).
Article ADS CAS PubMed Google Scholar
Gnetto, M. I., Kossonou, Y. T. A., Koffi, Y., Kaduki, K. A. & Zoueu, J. T. Solving the twin image problem in in-line holography by using multiple defocused intensity images reconstructed from a single hologram. J. Mod. Opt. 69, 121–129 (2022).
Article ADS Google Scholar
Ioffe, S. & Szegedy, C. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International conference on machine learning, 448–456 (pmlr, 2015).
Agarap, A. F. Deep learning using rectified linear units (relu). Preprint at arXiv:1803.08375 (2018).
Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5–9, 2015, Proceedings, Part III 18, 234–241 (Springer, 2015).
Hillman, T. R. et al. Digital optical phase conjugation for delivering two-dimensional images through turbid media. Sci. Rep. 3, 1–5 (2013).
Article Google Scholar
Download references
This work is supported by Science and Engineering Research Board (SERB) India- CORE/2019/000026. Manisha acknowledges fellowship from the IIT (BHU).
Laboratory of Information Photonics and Optical Metrology, Department of Physics, Indian Institute of Technology (Banaras Hindu University), Varanasi, Uttar Pradesh, 221005, India
Manisha, Aditya Chandra Mandal, Mohit Rathor & Rakesh Kumar Singh
Department of Mining Engineering, Indian Institute of Technology (Banaras Hindu University), Varanasi, Uttar Pradesh, 221005, India
Aditya Chandra Mandal
Faculty of Engineering and Nano Technology Center, Bar-Ilan University, Ramat Gan, Israel
Zeev Zalevsky
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
You can also search for this author in PubMed Google Scholar
Manisha conceived of idea and build the theoretical basis, experimental design, and completed simulation and preparation of manuscript. A.C.M. was involved in experimental design, simulation, and preparation of the manuscript. M.R. supported in performing experiment. Z.Z provided advice and assistance, reviewing and editing the work. R.K.S was involved in supervision, formulation of research goals and aims, funding acquisition, reviewing, and editing.
Correspondence to Rakesh Kumar Singh.
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Reprints and Permissions
Manisha, Mandal, A.C., Rathor, M. et al. Randomness assisted in-line holography with deep learning. Sci Rep 13, 10986 (2023). https://doi.org/10.1038/s41598-023-37810-w
Download citation
Received: 02 April 2023
Accepted: 28 June 2023
Published: 07 July 2023
DOI: https://doi.org/10.1038/s41598-023-37810-w
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.