SoylentNews

upstart [soylentnews.org] writes:

████ # This file was generated bot-o-matically! Edit at your own risk. ████

This camera captures 156.3 trillion frames per second [engadget.com]:

Read full article

Scientists have created a blazing-fast scientific camera that shoots images at an encoding rate of 156.3 terahertz (THz) to individual pixels — equivalent to 156.3 trillion frames per second. Dubbed SCARF (swept-coded aperture real-time femtophotography), the research-grade camera could lead to breakthroughs in fields studying micro-events that come and go too quickly for today’s most expensive scientific sensors.

SCARF has successfully captured ultrafast events like absorption in a semiconductor and the demagnetization of a metal alloy. The research could open new frontiers in areas as diverse as shock wave mechanics or developing more effective medicine.

Leading the research team was Professor Jinyang Liang [inrs.ca] of Canada’s Institut national de la recherche scientifique (INRS). He’s a globally recognized pioneer in ultrafast photography who built on his breakthroughs from a separate study six years ago. The current research was published [nature.com] in Nature, summarized [inrs.ca] in a press release from INRS and first reported [sciencedaily.com] on by Science Daily.

Professor Liang and company tailored their research as a fresh take on ultrafast cameras. Typically, these systems use a sequential approach: capture frames one at a time and piece them together to observe the objects in motion. But that approach has limitations. “For example, phenomena such as femtosecond laser ablation, shock-wave interaction with living cells, and optical chaos cannot be studied this way,” Liang said.

The new camera builds on Liang’s previous research to upend traditional ultrafast camera logic. “SCARF overcomes these challenges,” INRS communication officer Julie Robert wrote in a statement. “Its imaging modality enables ultrafast sweeping of a static coded aperture while not shearing the ultrafast phenomenon. This provides full-sequence encoding rates of up to 156.3 THz to individual pixels on a camera with a charge-coupled device (CCD). These results can be obtained in a single shot at tunable frame rates and spatial scales in both reflection and transmission modes.”

Story continues

In extremely simplified terms, that means the camera uses a computational imaging modality to capture spatial information by letting light enter its sensor at slightly different times. Not having to process the spatial data at the moment is part of what frees the camera to capture those extremely quick “chirped” laser pulses at up to 156.3 trillion times per second. The images’ raw data can then be processed by a computer algorithm that decodes the time-staggered inputs, transforming each of the trillions of frames into a complete picture.

Remarkably, it did so “using off-the-shelf and passive optical components,” as the paper describes. The team describes SCARF as low-cost with low power consumption and high measurement quality compared to existing techniques.

Although SCARF is focused more on research than consumers, the team is already working with two companies, Axis Photonique and Few-Cycle, to develop commercial versions, presumably for peers at other higher learning or scientific institutions.

For a more technical explanation of the camera and its potential applications, you can view the full paper in Nature [nature.com].

For a more technical explanation of the camera and its potential applications, you can view the full paper in Nature [nature.com].

• Donald Trump assails judge and his daughter after gag order in New York hush-money criminal case [yahoo.com]
• Four found dead in rural Saskatchewan were members of the same family: RCMP [yahoo.com]
• Eighth suspect in Moscow attack appears in court, rights commissioner warns on torture [yahoo.com]
• Unlikely friendships: This cheetah-tortoise duo are inseparable and will melt your heart [yahoo.com]
• Conservative premiers are lying about carbon pricing: Trudeau [yahoo.com]

Read full article

Scientists have created a blazing-fast scientific camera that shoots images at an encoding rate of 156.3 terahertz (THz) to individual pixels — equivalent to 156.3 trillion frames per second. Dubbed SCARF (swept-coded aperture real-time femtophotography), the research-grade camera could lead to breakthroughs in fields studying micro-events that come and go too quickly for today’s most expensive scientific sensors.

SCARF has successfully captured ultrafast events like absorption in a semiconductor and the demagnetization of a metal alloy. The research could open new frontiers in areas as diverse as shock wave mechanics or developing more effective medicine.

Leading the research team was Professor Jinyang Liang [inrs.ca] of Canada’s Institut national de la recherche scientifique (INRS). He’s a globally recognized pioneer in ultrafast photography who built on his breakthroughs from a separate study six years ago. The current research was published [nature.com] in Nature, summarized [inrs.ca] in a press release from INRS and first reported [sciencedaily.com] on by Science Daily.

Professor Liang and company tailored their research as a fresh take on ultrafast cameras. Typically, these systems use a sequential approach: capture frames one at a time and piece them together to observe the objects in motion. But that approach has limitations. “For example, phenomena such as femtosecond laser ablation, shock-wave interaction with living cells, and optical chaos cannot be studied this way,” Liang said.

The new camera builds on Liang’s previous research to upend traditional ultrafast camera logic. “SCARF overcomes these challenges,” INRS communication officer Julie Robert wrote in a statement. “Its imaging modality enables ultrafast sweeping of a static coded aperture while not shearing the ultrafast phenomenon. This provides full-sequence encoding rates of up to 156.3 THz to individual pixels on a camera with a charge-coupled device (CCD). These results can be obtained in a single shot at tunable frame rates and spatial scales in both reflection and transmission modes.”

Story continues

In extremely simplified terms, that means the camera uses a computational imaging modality to capture spatial information by letting light enter its sensor at slightly different times. Not having to process the spatial data at the moment is part of what frees the camera to capture those extremely quick “chirped” laser pulses at up to 156.3 trillion times per second. The images’ raw data can then be processed by a computer algorithm that decodes the time-staggered inputs, transforming each of the trillions of frames into a complete picture.

Remarkably, it did so “using off-the-shelf and passive optical components,” as the paper describes. The team describes SCARF as low-cost with low power consumption and high measurement quality compared to existing techniques.

Although SCARF is focused more on research than consumers, the team is already working with two companies, Axis Photonique and Few-Cycle, to develop commercial versions, presumably for peers at other higher learning or scientific institutions.

For a more technical explanation of the camera and its potential applications, you can view the full paper in Nature [nature.com].

For a more technical explanation of the camera and its potential applications, you can view the full paper in Nature [nature.com].

• Donald Trump assails judge and his daughter after gag order in New York hush-money criminal case [yahoo.com]
• Four found dead in rural Saskatchewan were members of the same family: RCMP [yahoo.com]
• Eighth suspect in Moscow attack appears in court, rights commissioner warns on torture [yahoo.com]
• Unlikely friendships: This cheetah-tortoise duo are inseparable and will melt your heart [yahoo.com]
• Conservative premiers are lying about carbon pricing: Trudeau [yahoo.com]

don't-blink-or-you'll-miss-it dept.

Swept coded aperture real-time femtophotography [nature.com]:

Single-shot real-time femtophotography is indispensable for imaging ultrafast dynamics during their times of occurrence. Despite their advantages over conventional multi-shot approaches, existing techniques confront restricted imaging speed or degraded data quality by the deployed optoelectronic devices and face challenges in the application scope and acquisition accuracy. They are also hindered by the limitations in the acquirable information imposed by the sensing models. Here, we overcome these challenges by developing swept coded aperture real-time femtophotography (SCARF). This computational imaging modality enables all-optical ultrafast sweeping of a static coded aperture during the recording of an ultrafast event, bringing full-sequence encoding of up to 156.3 THz to every pixel on a CCD camera. We demonstrate SCARF’s single-shot ultrafast imaging ability at tunable frame rates and spatial scales in both reflection and transmission modes. Using SCARF, we image ultrafast absorption in a semiconductor and ultrafast demagnetization of a metal alloy.

Integrated lithium niobate microwave photonic processing engine [nature.com] ArticleMonolithic thin-film lithium niobate broadband spectrometer with one nanometre resolution [nature.com] ArticleOpen accessOpen-top multisample dual-view light-sheet microscope for live imaging of large multicellular systems [nature.com] ArticleOpen access

Since Abramson’s pioneering light-in-flight recording by holography1 [nature.com], imaging ultrafast events in real time (i.e., in the time duration of the event’s occurrence) has contributed to numerous studies in diverse scientific fields, including nuclear fusion2 [nature.com], photon transport in scattering media3 [nature.com], and radiative decay of molecules4 [nature.com]. Because many of these ultrafast phenomena have timespans from femtoseconds to picoseconds, femtophotography—recording two-dimensional (2D) spatial information at trillions of frames per second (Tfps)—is indispensable for clearly resolving their spatiotemporal details5 [nature.com]. Currently, femtophotography is mostly realized by using multi-shot approaches6 [nature.com]. In data acquisition, each measurement captures a temporal slice by time gating7 [nature.com],8 [nature.com], a spatiotemporal slice using ultrafast devices9 [nature.com],10 [nature.com], or a certain number of time-stamped events using photon-counting cameras11 [nature.com],12 [nature.com]. Then, repetitive measurements (with certain auxiliaries, such as temporal or spatial scanning) are performed to construct a movie. However, these methods require the dynamic events under observation to be precisely reproducible, which renders them incapable of studying non-repeatable or difficult-to-reproduce ultrafast phenomena, such as femtosecond laser ablation13 [nature.com], shock-wave interaction with living cells14 [nature.com], and optical chaos15 [nature.com].

To surmount these limitations, many single-shot ultrafast imaging techniques have been developed for direct observation of dynamic events in real time. Existing techniques can be generally grouped into the categories of passive detection and active illumination16 [nature.com]. The former is propelled by disruptive hardware designs, such as an in-situ storage CCD17 [nature.com], a shutter-stacked CMOS sensor18 [nature.com], and a framing camera19 [nature.com]. Nonetheless, thus far, these ultrafast sensors have not yet reached the Tfps level, and further increasing their frame rates is fundamentally limited by the electronic bandwidths20 [nature.com]. Streak cameras—an ultrafast imager converting time to space by pulling photoelectrons with a shearing voltage along the axis perpendicular to the device’s entrance slit—can reach an imaging speed of 10 Tfps21 [nature.com]. Although overcoming the speed limitation, streak cameras are conventionally capable of only one-dimensional imaging21 [nature.com]. To overcome the drawback in imaging dimensionality, compressed ultrafast photography (CUP)22,23,24 [nature.com] adds a single encoding mask on the wide-open entrance port of a streak camera. With the prior information provided by the encoding mask, the spatial information along the shearing direction is allowed to mix with the temporal information in a compressively recorded snapshot. The ensuing image reconstruction recovers the (\(x,y,t\)) information. Nonetheless, the produced imaging quality, especially at the Tfps level, can be considerably degraded in the generation and the propagation of photoelectrons by various effects, including the photocathode’s thickness, the space-charge effect, and the limited fill factor of the microchannel plate22 [nature.com]. Meanwhile, space-time coupling in the temporal shearing direction caps the summation of the frame size and the sequence depth in the reconstructed movie, which limits the maximum amount of acquirable information24 [nature.com]. Finally, temporal shearing induces spatial anisotropy, further reducing the image quality in the reconstructed movie24 [nature.com].

Active-illumination-based approaches work by imparting the temporal information to various photon tags—such as space, angles, spatial frequencies, and wavelengths—carried in the illumination for 2D imaging at the Tfps level. However, these methods have various limitations. For example, space-division-based techniques25 [nature.com],26 [nature.com] require the targeted scene to move at a certain velocity to accommodate the sequential arrival of spatially separated probe pulses. Angle-dependent probing is also affected by parallax in each produced frame27 [nature.com]. The systems relying on spatial frequency division28 [nature.com] and wavelength division29 [nature.com] may also face difficulties in scalability in their pattern projection modules and spatial mapping devices. Most importantly, these methods acquire data by compartmenting the focal plane array in either the spatial domain or the spatial frequency domain, which forbids information overlapping. Given the limitations in the sensor’s size and the system’s optical bandwidth, this focal-plane-division strategy inherently limits the recordable capacity of spatial and temporal information, which usually results in a shallow sequence depth (i.e., the number of frames in each movie).

The limitations in these methods can be lifted using the multi-pattern encoding strategy16 [nature.com]. Each frame of the scene is encoded with a different pattern at a rate much higher than the sensor’s acquisition speed30 [nature.com]. The captured snapshot thus represents the temporal integration of the spatiotemporally modulated dynamic scene. Then, a compressed sensing-based algorithm is used to reconstruct an ultrafast movie with high quality31 [nature.com]. As an example, a flutter shutter was implemented to globally block and transmit light in a random sequence during the camera’s exposure32 [nature.com]. This modulation created a more broadband temporal impulse response, which improved the sensing matrix’s condition number and hence reconstructed image quality. Teaming up with a multiple-aperture design, this scheme enabled an imaging speed of 200 million fps33 [nature.com]. However, this global encoding method resulted in a full spatial correlation of the modulation structure imparted on the signal, which limited the compression ratio and hence sequence depth. Thus, ultrafast encoding over each pixel is beneficial from the standpoint of improving reconstruction fidelity34 [nature.com]. This pixel-wise coded exposure was implemented by using various techniques, such as spatial light modulators (e.g., a digital micromirror device35 [nature.com],36 [nature.com] and a liquid-crystal-on-silicon device37 [nature.com]), a translating printed pattern38 [nature.com],39 [nature.com], and in-pixel memory in the CMOS architecture40 [nature.com]. However, the imaging speeds enabled by these methods are clamped to several thousand fps by either the pattern refreshing rates of the spatial light modulators41 [nature.com], the moving speed of the piezo stages, or the readout electronics of the imaging sensor. Although CUP provides an ultrafast pixel-wise encoding scheme, its operating principle requires simultaneously shearing the scene and the coded aperture. Consequently, pixels across the sensor are encoded with reduced depths, resulting in inferior image reconstruction.

To overcome the limitations in existing methods, here, we report swept coded aperture real-time femtophotography (SCARF), which enables a full pixel-wise encoding depth in single-shot ultrafast imaging by using a single chirped pulse and a modified pulse shaping setup42 [nature.com]. Leveraging time-spectrum mapping and spectrum-space sweeping, SCARF attaches pixel-wise coded apertures to an ordinary CCD camera at up to 156.3 THz in real time. We demonstrate SCARF in multiple spatial and temporal scales in both reflection and transmission modes. To show SCARF’s broad utility, we use it for single-shot real-time imaging of 2D transient light-matter interactions, including ultrafast absorption on a semiconductor and ultrafast demagnetization in a metal alloy.

System and principle of SCARF

The SCARF system is shown schematically in Fig. 1a [nature.com] (with an animated illustration in Supplementary Movie 1 [nature.com], as well as component details in Methods). A single linearly chirped laser pulse illuminates a dynamic scene as a continuous probe. Because of its linear chirp, each wavelength in the pulse’s bandwidth carries a specific timestamp. After transmitting through the dynamic scene, this probe pulse is recorded in a snapshot by an imaging system modified from a pulse-shaping setup. First, the pulse is imaged by a dispersive 4f imaging system (consisting of lenses L1 and L2 and a grating G1) to a static coded aperture embodied by a pseudo-random binary transmissive mask. The spectral dispersion shears temporal information contained in wavelengths to different positions for spatial encoding by the mask. Then, the pulse is relayed to a CCD camera by another dispersive 4f imaging system (with lenses L3 and L4 and a grating G2) that mirrors the configuration of the first one, which provides the second spectral shearing in the reverse direction. This configuration not only cancels the smearing in the dynamic scene but also sweeps the static coded masks of individual wavelengths (thus at different times). The camera records a compressed snapshot of the dynamic scene’s temporal information that is read out by the single probe pulse (details of the forward model are explained in Methods and Supplementary Note 1 [nature.com] and are illustrated in Fig. 1b [nature.com]). After data acquisition, the captured snapshot is input into a compressed sensing-based algorithm that solves a minimization problem to retrieve the \((x,y,t)\) datacube of the dynamic scene (details of image reconstruction and system calibration are explained in Methods, Supplementary Notes [nature.com]2 [nature.com]–3 [nature.com], and Supplementary Fig. 1 [nature.com]). SCARF’s specifications are summarized in Supplementary Table 1 [nature.com].

SCARF brings in several salient advantages compared to existing techniques in single-shot compressed temporal imaging (summarized here and further explained in Supplementary Notes [nature.com] 4–5, Supplementary Tables 2 [nature.com], 3 [nature.com], and Supplementary Figs. 2 [nature.com], 3 [nature.com]). Because of the two symmetric 4 f systems, the static coded aperture is swept at a speed of up to \({v}_{{{{{{\rm{s}}}}}}}\) = 1.7 × 109 m/s, which enables ultrafast pixel-wise spatiotemporal encoding. The sweeping speed also determines SCARF’s frame rate by \(r={v}_{{{{{{\rm{s}}}}}}}/d\), where \(d\) is the binned CCD camera’s pixel width in the sweeping direction (see derivation in Supplementary Note 4 [nature.com]). This configuration provides encoding rates of up to 156.3 THz to individual pixels on the employed CCD camera, hence enabling single-shot real-time femtophotography. Without using a streak camera, the all-optical data acquisition implemented in SCARF produces superior quality to CUP in the compressively recorded snapshot. Meanwhile, with a compression ratio equal to the sequence depth, SCARF’s frame size always equals the sensor size regardless of the duration of the dynamic scene. This paradigm has a stronger information acquisition ability than CUP’s sensing model, where the summation of the frame size and the sequence depth is restricted by the sensor size. Moreover, SCARF enables encoding each frame with distinct patterns, ensuring that every row of the sensing matrix is non-zero and linearly independent compared to CUP. As a result, SCARF’s full row-rank property leads to a trivial null space, which enhances the condition number, reduces sensitivity to noise, and decreases data ambiguity, all of which facilitate a faster, more reliable, and more accurate reconstruction. Finally, in the snapshot, the area with non-zero intensity delineates the region of occurrence of the dynamic scene. This spatial constraint, naturally embedded in the acquired data, facilitates image reconstruction. Detailed explanations and demonstrations are included in Supplementary Note 4 [nature.com] and Supplementary Figs. 2 [nature.com], 3 [nature.com].

SCARF of single ultrashort pulses transmitting through transparencies

We first prove the concept of SCARF by imaging single chirped pulses transmitting through patterned transparencies at multiple imaging speeds. As shown in Fig. 2a [nature.com], the chirped pulse was divided by a beam splitter. The reflected component was measured by a second harmonic generation frequency-resolved optical gating (SHG-FROG) device (see details in Supplementary Note 6 [nature.com]). The transmitted component passed through a transparency film with a printed pattern. Figure 2b [nature.com] shows five representative frames of a chirped pulse [with a full-width-at-half-maximum (FWHM) duration of 362 fs, as shown in Fig. 2c [nature.com]] passing through a bar pattern imaged by SCARF at 116.3 Tfps. Full sequences of these events (with a sequence depth of 132 frames) are shown in Supplementary Movie 2 [nature.com]. As shown in Fig. 2c [nature.com], the single-shot result well agrees with the scanned SHG-FROG measurements. Finally, the linear relationship between the spectrum and time of the pulse was verified, as shown in Fig. 2d [nature.com]. The details for two other experiments at imaging speeds of 74.9 Tfps and 56.8 Tfps are summarized in Supplementary Note 6 [nature.com], Supplementary Figs. 4 [nature.com], 5 [nature.com], and Supplementary Movies 3, 4 [nature.com].

SCARF of ultrafast absorption in semiconductor

To show the broad utility of SCARF, we implemented it to monitor two ultrashort phenomena of light-matter interactions in 2D. As the first demonstration, we imaged femtosecond laser-induced ultrafast absorption in a semiconductor (Fig. 3a [nature.com]). A single 40-fs pump pulse passed through a beam shaping stage before obliquely illuminating a zinc selenide (ZnSe) plate. The high intensity induced by this laser pulse abruptly increased the free carrier density near the surface of this plate, decreasing its transmissivity in tens of femtoseconds43 [nature.com]. Besides, the oblique incidence led to a non-information faster-than-light propagation of the absorption front on the plate (see the detailed derivation in Supplementary Note 7 [nature.com] and Supplementary Fig. 6 [nature.com]). The pump pulse damaged the sample permanently after a single pulse, thus creating non-repeatable transient phenomena.

We studied this phenomenon in two configurations. In the first configurations, the beam shaping stage consisted of an axicon and a focusing lens. By using a 360-µJ pump pulse and an incident angle of \(\theta=\)35.4°, we generated an elliptical ring on the ZnSe plate. The event was probed by a 6.5-ps chirped pulse with a normal angle of incidence, corresponding to an imaging speed of 6.5 Tfps. The reconstructed movie of SCARF is shown in Supplementary Movie 5 [nature.com], and eight selected frames are presented in Fig. 3b [nature.com]. The decrease of transmissivity at one vertex of this ellipse immediately breaks in a pair of traces propagating toward opposite directions. These traces, whose time courses delineate the ellipse, eventually converge at the other vertex. Figure 3c [nature.com] presents the normalized average intensity evolution of a five-pixel line centered at the ellipse’s upper vertex (marked by the vertical green line in Fig. 3b [nature.com]) with background compensation, which produced the temporal edge spread function (TESF). Taking the derivative of the TESF yielded SCARF’s temporal response function (TRF), whose FWHM was quantified to be 226.4 fs.

We also calculated the instantaneous velocities for both traces. As shown in Fig. 3d [nature.com], the result demonstrates in the \(y\) direction, the speeds of both traces start at infinity with opposite directions, then reduce to zero, and finally reaccelerate to infinity with the opposite propagating directions. In contrast, the speeds in the \(x\) direction stay at a constant superluminal value of (5.0 ± 0.8) ×108 m/s (mean ± standard deviation). The measured values well match the theory (i.e., 5.2 ×108 m/s), showing SCARF’s excellent ability to track even superluminally moving objects.

In the second configuration, the beam shaping stage contained a cylindrical lens. By using a 40-fs, 124-µJ pump pulse with an incident angle of \(\theta=\)~2.0°, we generated a line on the ZnSe plate. The absorption front propagated with an apparent velocity of 8.5 ×109 m/s in the –\(x\) direction. This non-repeatable phenomenon was probed by a 530-fs chirped pulse with a normal angle of incidence, corresponding to an imaging speed of 156.3 Tfps in a single shot. The reconstructed evolution is shown in Supplementary Movie 6 [nature.com], and nine selected frames are presented in Fig. 3e [nature.com]. Figure 3f [nature.com] shows the time course of the normalized averaged intensity in a four-pixel line in the middle of the generated pattern. The TRF was quantified to have an FWHM of 22.4 fs. Considering ZnSe’s response time43 [nature.com], SCARF’s temporal response was estimated to be 19.0 fs. Finally, Fig. 3g [nature.com] shows the time course displacement of the absorption front in the middle of the line. The linear-fitted front propagation speed was quantified to be (8.7 ± 0.2) ×109 m/s, showing an excellent agreement with the theory. This experiment demonstrates that SCARF’s highest imaging speed can be used to resolve fine spatiotemporal details in light-matter interactions.

SCARF of ultrafast demagnetization of an alloy film

We imaged ultrafast demagnetization of a pre-magnetized GdFeCo alloy film44 [nature.com]. As shown in Fig. 4a [nature.com], a 40-fs, 6.4-µJ pump pulse was loosely focused on this film with an incident angle of 37° to induce ultrafast demagnetization. A 1.2-ps linearly chirped pulse (with +45° linear polarization) probed two selected 2D areas (inset in Fig. 4a [nature.com]) at 19.1 Tfps via a reflection-mode microscope setup. The demagnetization induced a small change in the polarization angle of the probe pulse, which was detected by polarization-resolved SCARF (details are described in Supplementary Note 8 [nature.com] and Supplementary Fig. 7 [nature.com]). The full demagnetization process is shown in Supplementary Movie 7 [nature.com]. Figure 4b [nature.com] shows the stack-ups of the 2D intensity distribution of the s- and p-polarized light in both Bar 1 and Bar 2. Before the incidence of the pump pulse, the intensities of both channels stay almost equal. The impingement of the pump pulse on the sample increases the intensity of the p-polarized light while decreasing that of the s-polarized light. To quantitatively analyze the results, we plot the time courses of the intensity difference between s- and p-polarized light, as shown in Fig. 4c [nature.com]. The demagnetization times of Bar 1 and Bar 2 were calculated to be 187.5 ± 18.6 fs and 186.9 ± 19.8 fs, respectively. Both values are in good agreement with the literature44 [nature.com] as well as with the multi-shot experiment (see details in Supplementary Note 8 [nature.com] and Supplementary Fig. 7b [nature.com]). The result also reveals that the onset of this change was different by 36.6 fs between these two areas, which was attributed to the oblique incidence of the pump pulse. To quantitatively showcase the advantage of SCARF in this particular case, we averaged the data from these two areas as if spatially resolved imaging was not available. As shown in Supplementary Fig. 7c [nature.com], the demagnetization time is quantified to be 193.4 fs, which produces an error of 3.9%. Thus, the 2D real-time ultrafast imaging provided by SCARF leads to more informative and more accurate quantification of demagnetization time. Meanwhile, because the demagnetization strength is known to be sensitive to the energy of the pump laser45 [nature.com],46 [nature.com], single-shot SCARF is immune to the shot-to-shot variation induced by the pump laser’s fluctuation (see additional data in Supplementary Fig. 7d [nature.com]).

a Schematic of the experimental setup. The probe pulse passes through an object (see inset) to probe two different areas of the sample simultaneously. b Stack-ups of normalized intensity of s- and p-polarization in the two selected areas. c Time-resolved normalized intensity difference between the s- and p-polarization light for Bar 1 (top) and Bar 2 (bottom). The marker center and the error bar in c represent the mean value and the standard deviation, respectively.

a Schematic of the experimental setup. The probe pulse passes through an object (see inset) to probe two different areas of the sample simultaneously. b Stack-ups of normalized intensity of s- and p-polarization in the two selected areas. c Time-resolved normalized intensity difference between the s- and p-polarization light for Bar 1 (top) and Bar 2 (bottom). The marker center and the error bar in c represent the mean value and the standard deviation, respectively.

We studied this phenomenon in two configurations. In the first configurations, the beam shaping stage consisted of an axicon and a focusing lens. By using a 360-µJ pump pulse and an incident angle of \(\theta=\)35.4°, we generated an elliptical ring on the ZnSe plate. The event was probed by a 6.5-ps chirped pulse with a normal angle of incidence, corresponding to an imaging speed of 6.5 Tfps. The reconstructed movie of SCARF is shown in Supplementary Movie 5 [nature.com], and eight selected frames are presented in Fig. 3b [nature.com]. The decrease of transmissivity at one vertex of this ellipse immediately breaks in a pair of traces propagating toward opposite directions. These traces, whose time courses delineate the ellipse, eventually converge at the other vertex. Figure 3c [nature.com] presents the normalized average intensity evolution of a five-pixel line centered at the ellipse’s upper vertex (marked by the vertical green line in Fig. 3b [nature.com]) with background compensation, which produced the temporal edge spread function (TESF). Taking the derivative of the TESF yielded SCARF’s temporal response function (TRF), whose FWHM was quantified to be 226.4 fs.

We also calculated the instantaneous velocities for both traces. As shown in Fig. 3d [nature.com], the result demonstrates in the \(y\) direction, the speeds of both traces start at infinity with opposite directions, then reduce to zero, and finally reaccelerate to infinity with the opposite propagating directions. In contrast, the speeds in the \(x\) direction stay at a constant superluminal value of (5.0 ± 0.8) ×108 m/s (mean ± standard deviation). The measured values well match the theory (i.e., 5.2 ×108 m/s), showing SCARF’s excellent ability to track even superluminally moving objects.

In the second configuration, the beam shaping stage contained a cylindrical lens. By using a 40-fs, 124-µJ pump pulse with an incident angle of \(\theta=\)~2.0°, we generated a line on the ZnSe plate. The absorption front propagated with an apparent velocity of 8.5 ×109 m/s in the –\(x\) direction. This non-repeatable phenomenon was probed by a 530-fs chirped pulse with a normal angle of incidence, corresponding to an imaging speed of 156.3 Tfps in a single shot. The reconstructed evolution is shown in Supplementary Movie 6 [nature.com], and nine selected frames are presented in Fig. 3e [nature.com]. Figure 3f [nature.com] shows the time course of the normalized averaged intensity in a four-pixel line in the middle of the generated pattern. The TRF was quantified to have an FWHM of 22.4 fs. Considering ZnSe’s response time43 [nature.com], SCARF’s temporal response was estimated to be 19.0 fs. Finally, Fig. 3g [nature.com] shows the time course displacement of the absorption front in the middle of the line. The linear-fitted front propagation speed was quantified to be (8.7 ± 0.2) ×109 m/s, showing an excellent agreement with the theory. This experiment demonstrates that SCARF’s highest imaging speed can be used to resolve fine spatiotemporal details in light-matter interactions.

SCARF of ultrafast demagnetization of an alloy film

We imaged ultrafast demagnetization of a pre-magnetized GdFeCo alloy film44 [nature.com]. As shown in Fig. 4a [nature.com], a 40-fs, 6.4-µJ pump pulse was loosely focused on this film with an incident angle of 37° to induce ultrafast demagnetization. A 1.2-ps linearly chirped pulse (with +45° linear polarization) probed two selected 2D areas (inset in Fig. 4a [nature.com]) at 19.1 Tfps via a reflection-mode microscope setup. The demagnetization induced a small change in the polarization angle of the probe pulse, which was detected by polarization-resolved SCARF (details are described in Supplementary Note 8 [nature.com] and Supplementary Fig. 7 [nature.com]). The full demagnetization process is shown in Supplementary Movie 7 [nature.com]. Figure 4b [nature.com] shows the stack-ups of the 2D intensity distribution of the s- and p-polarized light in both Bar 1 and Bar 2. Before the incidence of the pump pulse, the intensities of both channels stay almost equal. The impingement of the pump pulse on the sample increases the intensity of the p-polarized light while decreasing that of the s-polarized light. To quantitatively analyze the results, we plot the time courses of the intensity difference between s- and p-polarized light, as shown in Fig. 4c [nature.com]. The demagnetization times of Bar 1 and Bar 2 were calculated to be 187.5 ± 18.6 fs and 186.9 ± 19.8 fs, respectively. Both values are in good agreement with the literature44 [nature.com] as well as with the multi-shot experiment (see details in Supplementary Note 8 [nature.com] and Supplementary Fig. 7b [nature.com]). The result also reveals that the onset of this change was different by 36.6 fs between these two areas, which was attributed to the oblique incidence of the pump pulse. To quantitatively showcase the advantage of SCARF in this particular case, we averaged the data from these two areas as if spatially resolved imaging was not available. As shown in Supplementary Fig. 7c [nature.com], the demagnetization time is quantified to be 193.4 fs, which produces an error of 3.9%. Thus, the 2D real-time ultrafast imaging provided by SCARF leads to more informative and more accurate quantification of demagnetization time. Meanwhile, because the demagnetization strength is known to be sensitive to the energy of the pump laser45 [nature.com],46 [nature.com], single-shot SCARF is immune to the shot-to-shot variation induced by the pump laser’s fluctuation (see additional data in Supplementary Fig. 7d [nature.com]).

a Schematic of the experimental setup. The probe pulse passes through an object (see inset) to probe two different areas of the sample simultaneously. b Stack-ups of normalized intensity of s- and p-polarization in the two selected areas. c Time-resolved normalized intensity difference between the s- and p-polarization light for Bar 1 (top) and Bar 2 (bottom). The marker center and the error bar in c represent the mean value and the standard deviation, respectively.

a Schematic of the experimental setup. The probe pulse passes through an object (see inset) to probe two different areas of the sample simultaneously. b Stack-ups of normalized intensity of s- and p-polarization in the two selected areas. c Time-resolved normalized intensity difference between the s- and p-polarization light for Bar 1 (top) and Bar 2 (bottom). The marker center and the error bar in c represent the mean value and the standard deviation, respectively.

SCARF advances the frontier of ultrafast optical imaging in both sensing concepts and technical specifications. Its hardware arrangement embodies the multi-pattern encoding paradigm through the ultrafast sweeping of a static coded aperture. The enabled full-sequence encoding in the spatial domain offers a bandwidth of up to 156.3 THz to every pixel on an ordinary CCD camera, which is more than three orders of magnitude greater than the theoretical limit of semiconductor sensors20 [nature.com]. Moreover, SCARF’s image acquisition paradigm is distinguished from existing coded femtophotography techniques by embedding its sensing matrix with attractive mathematical advantages (i.e., full-row rank property and trivial null space), which considerably enhances image reconstruction performance and hence overall sensing ability. Constructed by using off-the-shelf and passive optical components, SCARF is low cost, has low power consumption, and possesses high measurement quality in data acquisition compared to streak-camera-based CUP techniques. Altogether, SCARF separates itself from all existing femtophotography by exhibiting an all-optical ultrafast real-time imaging modality with tunable imaging speeds (from 6.5 to 156.3 Tfps) and sequence depths (up to 132 frames). These specifications could be further improved by using advanced supercontinuum sources47 [nature.com], high dynamic range cameras48 [nature.com], Fourier-domain amplification49 [nature.com],50 [nature.com], and machine learning image reconstruction51 [nature.com],52 [nature.com]. Provided the proper sources and sensing devices, SCARF could even be extended to other spectral ranges, such as X-ray and mid-infrared.

SCARF’s temporal imaging ability is determined by its temporal resolution rather than its inter-frame time interval. The former describes the image system’s response to an impulse in time. The latter, defined as the reciprocal of the imaging speed, expresses the sampling density in time. The relation between these two parameters can be understood in the same way as the spatial resolution and the pixel density53 [nature.com]. In this work, by using the ultrafast absorption of ZnSe as the temporal impulse, SCARF’s temporal response was quantified to have an FWHM of 226.4 fs for 6.5 Tfps (inter-frame time interval of 153.8 fs) and 19.0 fs for 156.3 Tfps (inter-frame time interval of 6.4 fs). Future theoretical studies could establish the relation between SCARF’s temporal resolution and its other parameters to optimize the system design.

SCARF allows efficient observation of transient events with high imaging quality. Detailed in Methods, the deployed light source provided pulse energy of up to 1.6 mJ. For all the experiments in this work, the maximum probe pulse energy of this active illumination saturated the CCD camera in the SCARF system. Thus, optimized signal-to-noise ratios in data acquisition could always be obtained by tuning optical attenuation, which facilitated the reconstruction of high-quality images. Meanwhile, SCARF’s tunability was leveraged to adapt the system’s specifications to the experiments. The generation of the targeted events was synchronized with SCARF’s data acquisition. According to the estimated durations of these events, the optimal combination of the imaging speed and the sequence depth was searched for each experiment with the criterion of clearly observing the event’s evolution while ensuring discernible differences in neighboring frames recording the event’s evolution. In this way, temporal oversampling, hence information redundancy, was avoided in SCARF.

SCARF expands the application scope of the classic pulse shaper to single-shot ultrafast imaging. Starting from a 4f setup54 [nature.com] (i.e., G1, L2, L3, and G2 in Fig. 1a [nature.com]), SCARF’s hardware is built with two modifications—using a pseudo-random binary mask for amplitude modulation and adding two additional lenses (i.e., L1 and L4 in Fig. 1a [nature.com]) to perform optical Fourier transformation before and after the two gratings. This arrangement converts the pulse shaper to two cascaded dispersive 4f imaging systems interlinked by the encoding mask. Its symmetric configuration naturally enables spectral shearing in opposite directions without the need for synchronization. The Fourier plane of a conventional pulse shaping setup, which is now occupied by the encoding mask, still manipulates individual wavelengths of a broadband laser pulse42 [nature.com]. However, different from the conventional operation, the incorporation of the lens L1 and the linearly chirped pulse brings the encoding of the sequential time information with different sections of a mask in the spatial domain. Moreover, the implementation of the compressed sensing model allows the mixture of spectral and spatial information, nullifying the line-focusing necessity in a conventional 4f setup. Finally, by exploiting the time-spectrum-space conversion, the SCARF system converts the ultrashort timescale of a chirped ultrafast pulse to ultrafast sweeping of the coded aperture. In summary, SCARF inherits the advantages from the classic pulse shaper and augments its optical processing ability, particularly for observing transient single events.

As a generic and economical imaging modality, SCARF has promising applications in ultrafast science. Of particular relevance are the two light-interaction phenomena studied in this work. First, single-shot SCARF of ultrafast absorption on ZnSe could contribute to the study of ultrafast carrier dynamics in semiconductor thin films and 2D materials in their sub-bandgap region55 [nature.com]. SCARF could probe the spatial distribution of the ultrafast transient absorption by the excited states of diffusing carriers. This investigation will contribute to overcoming the intrinsic bandgap limitations in modulators and photodetectors using excited carrier states56 [nature.com]. Meanwhile, single-shot SCARF of ultrafast demagnetization of metal alloys may open a new route for studying ultrafast magnetic switching for possible future applications of magnetic storage devices57 [nature.com],58 [nature.com]. Current time-resolved methods59 [nature.com],60 [nature.com] require using numerous probe pulses at different delays and rely on the reproducibility of the phenomenon to procure the dynamics. In contrast, to our knowledge, SCARF marks the debut of single-shot 2D optical imaging of ultrafast demagnetization. It could be applied to imaging longitudinal ultrafast all-optical switching of various magnetic thin films59 [nature.com],61 [nature.com],62 [nature.com], which will provide experimental evidence of the maximum reliable switching rate for the next-generation magnetic storage63 [nature.com]. Coupling SCARF into wide-field super-resolution microscopy could be particularly valuable for the study of domain dynamics during ultrafast demagnetization and switching. Other potential applications of SCARF include single-shot 2D probing of opto-mechanical motion of micro/nano-sized objects64 [nature.com], irreversible chemical reaction dynamics of organic crystals65 [nature.com], and evolution dynamics of plasma wakes in a laser wake-field accelerator66 [nature.com].

Operating principle of SCARF

SCARF’s data acquisition can be expressed by five successive operations (illustrated in Fig. 1b [nature.com] and derived in Supplementary Note 1 [nature.com]). First, time-spectrum mapping (denoted by \({{{{{\bf{M}}}}}}\)) is executed when the single chirped pulse probes the dynamic scene, storing temporal information at different wavelengths. Then, the dispersion induced in the first dispersive 4f system enables spectral shearing of the dynamics scene (denoted by \({{{{{\bf{S}}}}}}\)), followed by spatial encoding by the pseudo-random binary transmissive mask (denoted by \({{{{{\bf{C}}}}}}\)). Afterward, the second dispersive 4f system induces another spectral shearing in the reverse direction (denoted by \({{{{{\bf{S}}}}}}^{\prime}\)). Finally, the spatially encoded dynamic scene experiences spatiotemporal integration on the CCD camera (i.e., spatially integrating over each pixel and temporally integrating over the exposure time; denoted by \({{{{{\bf{T}}}}}}\)). In this way, the captured snapshot, \(E[m,n]\), is linked with the transmittance modulated by the dynamic scene \(a\left(x,y,t\right)\) by

$$E[m,n]={{{{{\bf{O}}}}}}a\left(x,y,t\right)$$ (1)

where \(m\,{{{{{\rm{and}}}}}}\,n\) are the pixel indices of the CCD camera. The operator \({{{{{\bf{O}}}}}}={{{{{\bf{TS}}}}}}^\prime {{{{{\bf{CSM}}}}}}\).

In the ensuing image reconstruction, \(E[m,n]\) is input to an algorithm developed from the plug-and-play alternating direction method of multipliers (PnP-ADMM) framework67 [nature.com] (details of derivation are shown in Supplementary Note 2 [nature.com]). Leveraging the spatiotemporal sparsity of the dynamic scene and the prior knowledge of each operator, \(a(x,y,t)\) can be retrieved by solving the minimization problem of

$$\hat{{{{{{\bf{a}}}}}}}=\mathop{{{{{{\rm{argmin}}}}}}}\limits_{\,{{{{{\bf{a}}}}}}{{{{{\mathscr{\in }}}}}}{{{{{\mathscr{A}}}}}}}\frac{1}{2}{{||}{{{{{\bf{Oa}}}}}}-{{{{{\bf{E}}}}}}{||}}_{2}^{2}+{{{{{\rm{R}}}}}}\left({{{{{\bf{a}}}}}}\right)+{{{{{{\rm{I}}}}}}}_{+}\left({{{{{\bf{a}}}}}}\right)\,$$ (2)

Here, \({{{{{\mathscr{A}}}}}}\) represents a set of solutions that satisfy the spatial constraint. \({{{{{\bf{a}}}}}}\) is the discrete version of \(a\left(x,y,t\right)\). \({{||}\cdot {||}}_{2}\) represents the l2 norm. \(\frac{1}{2}{{||}{{{{{\bf{Oa}}}}}}{{{{{\boldsymbol{-}}}}}}{{{{{\bf{E}}}}}}{||}}_{2}^{2}\) is the fidelity term representing the similarity between the measurement and the estimated result. \({{{{{\rm{R}}}}}}(\cdot )\) is the implicit regularizer that promotes sparsity in the dynamic scene68 [nature.com],69 [nature.com] (further explained in Supplementary Note 2 [nature.com]). \({{{{{{\rm{I}}}}}}}_{+}\left(\cdot \right)\) represents a non-negative intensity constraint.

Details on equipment and sample preparation

The components in the SCARF system (Fig. 1a [nature.com]) include four 100 mm-focal-lengths lenses (L1 and L4, LA1509, Thorlabs; L2 and L3, LA1050, Thorlabs), two 1200 line/mm gratings (G1 and G2, GR25-1208, Thorlabs), one static pseudo-random binary transmissive mask (HTA Photomask, 80 µm ×80 µm encoding pixel’s size), and a CCD camera (GS3-U3-41C6NIR-C, FLIR, 2048×2048 pixels).

The illumination of the SCARF system was provided by a femtosecond Titanium-Sapphire laser amplifier at the multi-kHz beamline of the Advanced Laser Light Source (ALLS) at the Centre Énergie Matériaux Télécommunications, Institut National de la Recherche Scientifique, Univeristé du Québec. The output pulses have a central wavelength of 780 nm, a pulse energy of 1.6 mJ, a pulse width of 40 fs, and a bandwidth of 26 nm. A two grating-based pulse stretcher was used to generate linearly chirped pulses used in the experiments of this work. All these pulses output from the laser pass through two bandpass filters (LD01-785/10-25 and LL01-810-25, Semrock) so that the durations of the generated probe pulses match those of the dynamic events.

In the dynamic absorption experiment (Fig. 3a [nature.com]), a 1-inch ZnSe plate (WG71050, Thorlabs) was used. An axicon (130-0278, Eksma Optics) and a 150-mm-focal length focusing lens (LA1433-B, Thorlabs) were used to generate the elliptical ring. The focusing lens was placed 360 mm away from the axicon. A 700-mm-focal-length cylindrical lens (LJ1836L1-B, Thorlabs) was used to generate the line.

In the transient demagnetization experiment (Fig. 4a [nature.com]), a GdFeCo alloy thin film was used as the sample. This multi-layer film was arranged by glass substrate/Ta(3 nm)/Cu(5 nm)/GdFeCo(20 nm)/Cu(5 nm)/Al(2.5 nm). Other components included an objective lens (MY20X-824, Mitutoyo), a beam splitter (BSW27, Thorlabs), a focusing lens (LA1433-B, Thorlabs), two tube lenses (AC254-200-B, Thorlabs). A mask of two bars (0.25 mm × 1.25 mm in size and 0.75-mm separation) was placed 200 mm away from the tube lens in the illumination beam path.

Summary of key system parameters

SCARF’s field of view depends on the CCD camera’s sensor size and the system’s overall magnification ratio. For the experiments conducted in this work, the overall magnification ratio was one except for the transient demagnetization experiment (see Fig. 4 [nature.com]). There, the use of an objective lens made the overall magnification ratio to be 20\(\times\). Moreover, the spatial resolution was measured by quantifying the edge spread function of a fine spatial feature in the reconstructed videos. Moreover, 2 × 2 pixel binning was implemented to improve the quality of the acquired snapshot. Finally, derived in Supplementary Notes [nature.com]1 [nature.com] and 4 [nature.com], SCARF’s imaging speed is determined by \(r={f}_{2}\alpha /d\beta\), where \({f}_{2}\) is the focal length of Lens 2, \(\alpha\) is the angular dispersion of grating G1, \(d\) is the binned pixel size of the deployed camera, and \(\beta\) is the linear time-spectrum mapping parameter. As shown in Section “System and principle of SCARF”, it can be derived by using the definition of the sweeping velocity \({v}_{{{{{{\rm{s}}}}}}}={f}_{2}\alpha /\beta\). Technical specifications of the SCARF system for each experiment are summarized in Supplementary Table 1 [nature.com].

All data supporting the results of this study are available within the paper and its Supplementary Information. Representative raw data generated in this study have been deposited in the Figshare data repository (https://doi.org/10.6084/m9.figshare.24407194 [doi.org]). Additional data are available for research purposes from the corresponding author upon request.

The image reconstruction and processing algorithms are described in detail in Supplementary Information. The reconstruction software uses a freely available universal ADMM algorithm (https://web.stanford.edu/~boyd/papers/admm/ [stanford.edu]) and BM3D software (https://webpages.tuni.fi/foi/GCF-BM3D/ [webpages.tuni.fi]). The customized reconstruction codes are available from the corresponding author upon request.

1. Abramson, N. Light-in-flight recording by holography. Opt. Lett.3, 121–123 (1978).

2. Kodama, R. et al. Fast heating of ultrahigh-density plasma as a step towards laser fusion ignition. Nature412, 798 (2001).

3. Liang, J. et al. Single-shot real-time video recording of photonic Mach cone induced by a scattered light pulse. Sci. Adv.3, e1601814 (2017).

4. Berezin, M. Y. & Achilefu, S. Fluorescence Lifetime Measurements and Biological Imaging. Chem. Rev.110, 2641–2684 (2010).

5. Faccio, D. & Velten, A. A trillion frames per second: the techniques and applications of light-in-flight photography. Rep. Prog. Phys.81, 105901 (2018).

6. Liang, J. & Wang, L. V. in Handbook of Laser Technology and Applications (eds Chunlei Guo & Subhash Chandra Singh) Ch. 26, (CRC Press, 2021).

7. Feurer, T., Vaughan, J. C. & Nelson, K. A. Spatiotemporal coherent control of lattice vibrational waves. Science299, 374–377 (2003).

8. Fieramonti, L. et al. Time-gated optical projection tomography allows visualization of adult zebrafish internal structures. PLoS One7, e50744 (2012).

9. Velten, A. et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nat. Commun.3, 745 (2012).

10. Becker, W., Shcheslavkiy, V., Frere, S. & Slutsky, I. Spatially resolved recording of transient fluorescence-lifetime effects by line-scanning TCSPC. Microsc. Res. Tech.77, 216–224 (2014).

11. Gariepy, G. et al. Single-photon sensitive light-in-fight imaging. Nat. Commun.6, 6021 (2015).

12. Morimoto, K., Wu, M.-L., Ardelean, A. & Charbon, E. Superluminal motion-assisted four-dimensional light-in-flight imaging. Phys. Rev. X11, 011005 (2021).

13. Chichkov, B. N., Momma, C., Nolte, S., Von Alvensleben, F. & Tünnermann, A. Femtosecond, picosecond and nanosecond laser ablation of solids. Appl. Phys. A63, 109–115 (1996).

14. Ohl, C.-D. & Wolfrum, B. Detachment and sonoporation of adherent HeLa-cells by shock wave-induced cavitation. Biochim. Biophys. Acta1624, 131–138 (2003).

15. Fan, L., Yan, X., Wang, H. & Wang, L.V. Real-time observation and control of optical chaos. Sci. Adv.7, eabc8448 (2021).

16. Liang, J. & Wang, L. V. Single-shot ultrafast optical imaging. Optica5, 1113–1127 (2018).

17. Arai, T. et al. A 252-V/lux.s, 16.7-Million-Frames-Per-Second 312-kpixel Back-Side-Illuminated Ultrahigh-Speed Charge-Coupled Device. IEEE Trans. Electron Devices60, 3450–3458 (2013).

18. Suzuki, M., Sugama, Y., Kuroda, R. & Sugawa, S. Over 100 Million Frames per Second 368 Frames Global Shutter Burst CMOS Image Sensor with Pixel-wise Trench Capacitor Memory Array. Sensors20, 1086 (2020).

19. Versluis, M. High-speed imaging in fluids. Exp. Fluids54, 1458 (2013).

20. Etoh, T. G. et al. The theoretical highest frame rate of silicon image sensors. Sensors17, 483 (2017).

21. Hamamatsu, K. Guide to streak cameras (Hamamatsu Photonics K.K., Hamamatsu City, Japan, 2008).

22. Liang, J., Zhu, L. & Wang, L. V. Single-shot real-time femtosecond imaging of temporal focusing. Light Sci. Appl.7, 42 (2018).

23. Wang, P., Liang, J. & Wang, L. V. Single-shot ultrafast imaging attaining 70 trillion frames per second. Nat. Commun.11, 2091 (2020).

24. Gao, L., Liang, J., Li, C. & Wang, L. V. Single-shot compressed ultrafast photography at one hundred billion frames per second. Nature516, 74–77 (2014).

25. Wang, X. et al. High-frame-rate observation of single femtosecond laser pulse propagation in fused silica using an echelon and optical polarigraphy technique. Appl. Opt.53, 8395–8399 (2014).

26. Kubota, T., Komai, K., Yamagiwa, M. & Awatsuji, Y. Moving picture recording and observation of three-dimensional image of femtosecond light pulse propagation. Opt. Express15, 14348–14354 (2007).

27. Yeola, S., Kuk, D. & Kim, K.-Y. Single-shot ultrafast imaging via spatiotemporal division of femtosecond laser pulses. J. Opt. Soc. Am. B35, 2822–2827 (2018).

28. Ehn, A. et al. FRAME: femtosecond videography for atomic and molecular dynamics. Light Sci. Appl.6, e17045 (2017).

29. Nakagawa, K. et al. Sequentially timed all-optical mapping photography (STAMP). Nat. Photonics8, 695–700 (2014).

30. Liang, J. Punching holes in light: recent progress in single-shot coded-aperture optical imaging. Rep. Prog. Phys.83, 116101 (2020).

31. Yuan, X., Brady, D. J. & Katsaggelos, A. K. Snapshot compressive imaging: Theory, algorithms, and applications. IEEE Signal Process. Mag.38, 65–88 (2021).

32. Raskar, R., Agrawal, A. & Tumblin, J. Coded exposure photography: motion deblurring using fluttered shutter. ACM Trans. Graph.25, 795–804 (2006).

33. Mochizuki, F. et al. Single-event transient imaging with an ultra-high-speed temporally compressive multi-aperture CMOS image sensor. Opt. Express24, 4155–4176 (2016).

34. Reddy, D., Veeraraghavan, A. & Chellappa, R. in CVPR. 329–336 (IEEE, 2011).

35. Feng, W., Zhang, F., Qu, X. & Zheng, S. Per-pixel coded exposure for high-speed and high-resolution imaging using a digital micromirror device camera. Sensors16, 331 (2016).

36. Qiao, M. & Yuan, X. Coded aperture compressive temporal imaging using complementary codes and untrained neural networks for high-quality reconstruction. Opt. Lett.48, 109–112 (2023).

37. Hitomi, Y., Gu, J., Gupta, M., Mitsunaga, T. & Nayar, S. K. Video from a single coded exposure photograph using a learned over-complete dictionary. In 2011 International Conference on Computer Vision. 287–294 (IEEE, 2011).

38. Llull, P. et al. Coded aperture compressive temporal imaging. Opt. Express21, 10526–10545 (2013).

39. Koller, R. et al. High spatio-temporal resolution video with compressed sensing. Opt. Express23, 15992–16007 (2015).

40. Zhang, J., Xiong, T., Tran, T., Chin, S. & Etienne-Cummings, R. Compact all-CMOS spatiotemporal compressive sensing video camera with pixel-wise coded exposure. Opt. Express24, 9013–9024 (2016).

41. Zhu, G. et al. A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera. Sensors18, 1524 (2018).

42. Wollenhaupt, M., Assion, A. & Baumert, T. in Springer Handbook of Lasers and Optics (ed Frank Träger) 937-983 (Springer New York, 2007).

43. Leblanc, A. et al. Phase-matching-free pulse retrieval based on transient absorption in solids. Opt. Express27, 28998–29015 (2019).

44. Hennecke, M. et al. Angular momentum flow during ultrafast demagnetization of a ferrimagnet. Phys. Rev. Lett.122, 157202 (2019).

45. Liu, X. et al. Dynamics of magnetization, reversal, and ultrafast demagnetization of TbFeCo amorphous films. Appl. Phys. Lett.92, 232501 (2008).

46. Pfau, B. et al. Ultrafast optical demagnetization manipulates nanoscale spin structure in domain walls. Nat. Commun.3, 1–6 (2012).

47. Savage, N. Supercontinuum sources. Nat. Photonics3, 114–115 (2009).

48. Artusi, A., Richter, T., Ebrahimi, T. & Mantiuk, R. K. High dynamic range imaging technology. IEEE Signal Process. Mag.34, 165–172 (2017).

49. Schmidt, B. E. et al. Frequency domain optical parametric amplification. Nat. Commun.5, 3643 (2014).

50. Lassonde, P. et al. Information transfer via temporal convolution in nonlinear optics. Sci. Rep.10, 14969 (2020).

51. Hu, C., Huang, H., Chen, M., Yang, S. & Chen, H. Video object detection from one single image through opto-electronic neural network. APL Photonics6, 046104 (2021).

52. Liu, X. et al. Single-shot real-time compressed ultrahigh-speed imaging enabled by a snapshot-to-video autoencoder. Photonics Res.9, 2464–2474 (2021).

53. Nakamura, J. Image sensors and signal processing for digital still cameras (CRC press, 2017).

54. Weiner, A. M. Ultrafast optical pulse shaping: A tutorial review. Opt. Commun.284, 3669–3692 (2011).

55. Das, S., Wang, Y., Dai, Y., Li, S. & Sun, Z. Ultrafast transient sub-bandgap absorption of monolayer MoS2. Light.: Sci. Appl.10, 27 (2021).

56. Kublitski, J. et al. Enhancing sub-bandgap external quantum efficiency by photomultiplication for narrowband organic near-infrared photodetectors. Nat. Commun.12, 4259 (2021).

57. Kimel, A. V. & Li, M. Writing magnetic memory with ultrashort light pulses. Nat. Rev. Mater.4, 189–200 (2019).

58. Hennes, M. et al. Laser-induced ultrafast demagnetization and perpendicular magnetic anisotropy reduction in a Co 88 Tb 12 thin film with stripe domains. Phys. Rev. B102, 174437 (2020).

59. Hashimoto, Y. et al. Ultrafast time-resolved magneto-optical imaging of all-optical switching in GdFeCo with femtosecond time-resolution and a μm spatial-resolution. Rev. Sci. Instrum.85, 063702 (2014).

60. Malinowski, G. et al. Control of speed and efficiency of ultrafast demagnetization by direct transfer of spin angular momentum. Nat. Phys.4, 855–858 (2008).

61. Liu, T.-M. et al. Nanoscale confinement of all-optical magnetic switching in TbFeCo-competition with nanoscale heterogeneity. Nano Lett.15, 6862–6868 (2015).

62. Vomir, M., Albrecht, M. & Bigot, J.-Y. Single shot all optical switching of intrinsic micron size magnetic domains of a Pt/Co/Pt ferromagnetic stack. Appl. Phys. Lett.111, 242404 (2017).

63. Wang, S. et al. Dual-shot dynamics and ultimate frequency of all-optical magnetic recording on GdFeCo. Light.: Sci. Appl.10, 1–8 (2021).

64. Polyakov, B. et al. Metal nanodumbbells for nanomanipulations and tribological experiments. Phys. Scr.90, 094007 (2015).

65. Poulin, P. R. & Nelson, K. A. Irreversible organic crystalline chemistry monitored in real time. Science313, 1756–1760 (2006).

66. Esarey, E., Schroeder, C. & Leemans, W. Physics of laser-driven plasma-based electron accelerators. Rev. Mod. Phys.81, 1229 (2009).

67. Chan, S. H., Wang, X. & Elgendy, O. A. Plug-and-play ADMM for image restoration: Fixed-point convergence and applications. IEEE Trans. Comput. Imaging3, 84–98 (2016).

68. Boyd, S., Parikh, N. & Chu, E. Distributed optimization and statistical learning via the alternating direction method of multipliers (Now Publishers Inc, 2011).

69. Cohen, R., Elad, M. & Milanfar, P. Regularization by denoising via fixed-point projection (RED-PRO). SIAM J. Imaging Sci.14, 1374–1406 (2021).

The authors thank Prof. Donna Strickland from the University of Waterloo for the fruitful discussion. This work was supported in part by Natural Sciences and Engineering Research Council of Canada (ALLRP-551076-20, ALLRP-549833-2020, CRDPJ-532304-18, RGPAS-507845-2017, RGPIN-2017-05959) (J.Liang), Canada Research Chairs Program (CRC-2022-00119) (J.Liang), Canada Foundation for Innovation and Ministère de l’Économie et de l’Innovation–Gouvernement du Québec (37146) (J.Liang), New Frontier in Research Fund (NFRFE-2020-00267) (J.Liang), Fonds de recherche du Québec–Nature et technologies (2019-NC-252960, 203345 - Centre d’optique, photonique et lasers) (J.Liang), and Fonds de Recherche du Québec - Santé (267406, 280229) (J.Liang).

Authors and Affiliations Contributions

J.Liu and H.I. built the SCARF system. M.M., Y.L., and X.L. developed the SCARF’s image reconstruction algorithm. M.M., J.Liu, H.I., P.L., and K.L. performed the experiments and analyzed the data. M.H., S.M., and G.M. prepared the GdFeCo sample. J.Liang, M.M., H.I., and Z.L. developed the SCARF theory. J.Liu, M.M., and J.Liang drafted the manuscript. J.Liang and F.L. initiated the project. J.Liang proposed the conceptual system and experimental design and supervised the project. All authors revised the manuscript.

Corresponding author

Correspondence to Jinyang Liang [mailto].

Competing interests

The authors declare no competing interests.

Peer review information

Nature Communications thanks the anonymous, reviewer(s) for their contribution to the peer review of this work. A peer review file is available.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information [springer.com] Peer Review File [springer.com] Description of Additional Supplementary Files [springer.com] Supplementary Movie 1 [springer.com] Supplementary Movie 2 [springer.com] Supplementary Movie 3 [springer.com] Supplementary Movie 4 [springer.com] Supplementary Movie 5 [springer.com] Supplementary Movie 6 [springer.com] Supplementary Movie 7 [springer.com]

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ [creativecommons.org].

Reprints and permissions [copyright.com]

Cite this article

Liu, J., Marquez, M., Lai, Y. et al. Swept coded aperture real-time femtophotography. Nat Commun15, 1589 (2024). " rel="url2html-3024420">https://doi.org/10.1038/s41467-024-45820-z

• Received24 February 2023

• Accepted31 January 2024

• Published21 February 2024

• DOIhttps://doi.org/10.1038/s41467-024-45820-z

Bullets vs Steel at 800,000 FPS - The Slow Mo Guys [youtube.com]:

Gav and Dan leave the 4K phantom at home and spend the day slinging metal at other metal for a surprising range of results. Instagram -

" rel="url2html-3024420">https://www.instagram...

Journal Reference:
Swept coded aperture real-time femtophotography, (DOI: 10.6084/m9.figshare.24407194 [doi.org])
Nils Abramson. Light-in-flight recording by holography, Optics Letters (DOI: 10.1364/OL.3.000121 [doi.org])
Kodama, R., Norreys, P. A., Mima, K., et al. Fast heating of ultrahigh-density plasma as a step towards laser fusion ignition, Nature (DOI: 10.1038/35090525 [doi.org])
Single-shot real-time video recording of a photonic Mach cone induced by a scattered light pulse, Science Advances (DOI: 10.1126%2Fsciadv.1601814 [doi.org])
Mikhail Y. Berezin, Samuel Achilefu. Fluorescence Lifetime Measurements and Biological Imaging, (DOI: 10.1021/cr900343z [doi.org])
A trillion frames per second: the techniques and applications of light-in-flight photography - IOPscience, Reports on Progress in Physics (DOI: 10.1088%2F1361-6633%2Faacca1 [doi.org])
Spatiotemporal Coherent Control of Lattice Vibrational Waves, Science (DOI: 10.1126%2Fscience.1078726 [doi.org])
Luca Fieramonti, Andrea Bassi, Efrem Alessandro Foglia, et al. Time-Gated Optical Projection Tomography Allows Visualization of Adult Zebrafish Internal Structures, PLOS ONE (DOI: 10.1371/journal.pone.0050744 [doi.org])
Velten, Andreas, Willwacher, Thomas, Gupta, Otkrist, et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging, Nature Communications (DOI: 10.1038/ncomms1747 [doi.org])
Wolfgang Becker, Vladislav Shcheslavkiy, Samuel Frere, et al. Spatially resolved recording of transient fluorescence‐lifetime effects by line‐scanning TCSPC, Microscopy Research and Technique (DOI: 10.1002/jemt.22331 [doi.org])
Gariepy, Genevieve, Krstajić, Nikola, Henderson, Robert, et al. Single-photon sensitive light-in-fight imaging [open], Nature Communications (DOI: 10.1038/ncomms7021 [doi.org])
Chichkov, B. N., Momma, C., Nolte, S., et al. Femtosecond, picosecond and nanosecond laser ablation of solids, Applied Physics A (DOI: 10.1007/BF01567637 [doi.org])
Redirecting, (DOI: 10.1016%2Fj.bbagen.2003.10.005 [doi.org])
Jinyang Liang, Lihong V. Wang. Single-shot ultrafast optical imaging [open], Optica (DOI: 10.1364/OPTICA.5.001113 [doi.org])
A 252--, 16.7-Million-Frames-Per-Second 312-kpixel Back-Side-Illuminated Ultrahigh-Speed Charge-Coupled Device, (DOI: 10.1109%2FTED.2013.2276005 [doi.org])
Manabu Suzuki, Yuki Sugama, Rihito Kuroda, et al. Over 100 Million Frames per Second 368 Frames Global Shutter Burst CMOS Image Sensor with Pixel-wise Trench Capacitor Memory Array, Sensors (DOI: 10.3390/s20041086 [doi.org])
Versluis, Michel. High-speed imaging in fluids, Experiments in Fluids (DOI: 10.1007/s00348-013-1458-x [doi.org])
Takeharu Goji Etoh, Anh Quang Nguyen, Yoshinari Kamakura, et al. The Theoretical Highest Frame Rate of Silicon Image Sensors, Sensors (DOI: 10.3390/s17030483 [doi.org])
Liang, Jinyang, Zhu, Liren, Wang, Lihong V.. Single-shot real-time femtosecond imaging of temporal focusing [open], Light: Science & Applications (DOI: 10.1038/s41377-018-0044-7 [doi.org])
Wang, Peng, Liang, Jinyang, Wang, Lihong V.. Single-shot ultrafast imaging attaining 70 trillion frames per second [open], Nature Communications (DOI: 10.1038/s41467-020-15745-4 [doi.org])
Gao, Liang, Liang, Jinyang, Li, Chiye, et al. Single-shot compressed ultrafast photography at one hundred billion frames per second, Nature (DOI: 10.1038/nature14005 [doi.org])
Xun Hou, Lihe Yan, Jinhai Si, et al. High-frame-rate observation of single femtosecond laser pulse propagation in fused silica using an echelon and optical polarigraphy technique, Applied Optics (DOI: 10.1364/AO.53.008395 [doi.org])
Toshihiro Kubota, Yasuhiro Awatsuji, Masatomo Yamagiwa, et al. Moving picture recording and observation of three-dimensional image of femtosecond light pulse propagation [open], Optics Express (DOI: 10.1364/OE.15.014348 [doi.org])
Ki-Yong Kim, Sarang Yeola, Donghoon Kuk. Single-shot ultrafast imaging via spatiotemporal division of femtosecond laser pulses, JOSA B (DOI: 10.1364/JOSAB.35.002822 [doi.org])
Ehn, Andreas, Bood, Joakim, Li, Zheming, et al. FRAME: femtosecond videography for atomic and molecular dynamics [open], Light: Science & Applications (DOI: 10.1038/lsa.2017.45 [doi.org])
Nakagawa, K., Iwasaki, A., Oishi, Y., et al. Sequentially timed all-optical mapping photography (STAMP), Nature Photonics (DOI: 10.1038/nphoton.2014.163 [doi.org])
Punching holes in light: recent progress in single-shot coded-aperture optical imaging - IOPscience, Reports on Progress in Physics (DOI: 10.1088%2F1361-6633%2Fabaf43 [doi.org])
Snapshot Compressive Imaging: Theory, Algorithms, and Applications, (DOI: 10.1109%2FMSP.2020.3023869 [doi.org])
Coded exposure photography, ACM Transactions on Graphics (TOG) (DOI: 10.1145%2F1141911.1141957 [doi.org])
Bo Zhang, Keiichiro Kagawa, Taishi Takasawa, et al. Single-event transient imaging with an ultra-high-speed temporally compressive multi-aperture CMOS image sensor [open], Optics Express (DOI: 10.1364/OE.24.004155 [doi.org])
Wei Feng, Fumin Zhang, Xinghua Qu, et al. Per-Pixel Coded Exposure for High-Speed and High-Resolution Imaging Using a Digital Micromirror Device Camera, Sensors (DOI: 10.3390/s16030331 [doi.org])
Xin Yuan, Mu Qiao. Coded aperture compressive temporal imaging using complementary codes and untrained neural networks for high-quality reconstruction, Optics Letters (DOI: 10.1364/OL.477542 [doi.org])
Xuejun Liao, Lawrence Carin, Guillermo Sapiro, et al. Coded aperture compressive temporal imaging [open], Optics Express (DOI: 10.1364/OE.21.010526 [doi.org])
Oliver Cossairt, Guido Schuster, Roman Koller, et al. High spatio-temporal resolution video with compressed sensing [open], Optics Express (DOI: 10.1364/OE.23.015992 [doi.org])
Tao Xiong, Trac Tran, Sang Chin, et al. Compact all-CMOS spatiotemporal compressive sensing video camera with pixel-wise coded exposure [open], Optics Express (DOI: 10.1364/OE.24.009013 [doi.org])
Ge Zhu, Xu-Ri Yao, Zhi-Bin Sun, et al. A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera, Sensors (DOI: 10.3390/s18051524 [doi.org])
E. Cormier, P. Lassonde, E. Haddad, et al. Phase-matching-free pulse retrieval based on transient absorption in solids [open], Optics Express (DOI: 10.1364/OE.27.028998 [doi.org])
Martin Hennecke, Ilie Radu, Radu Abrudan, et al. Angular Momentum Flow During Ultrafast Demagnetization of a Ferrimagnet, Physical Review Letters (DOI: 10.1103/PhysRevLett.122.157202 [doi.org])
Liu, Xiaodong, Xu, Zhen, Gao, Ruixin, et al. Dynamics of magnetization, reversal, and ultrafast demagnetization of TbFeCo amorphous films, Applied Physics Letters (DOI: 10.1063/1.2943281 [doi.org])
Pfau, B., Schaffert, S., Müller, L., et al. Ultrafast optical demagnetization manipulates nanoscale spin structure in domain walls [open], Nature Communications (DOI: 10.1038/ncomms2108 [doi.org])
Savage, Neil. Supercontinuum sources, Nature Photonics (DOI: 10.1038/nphoton.2008.286 [doi.org])
High Dynamic Range Imaging Technology [Lecture Notes], (DOI: 10.1109%2FMSP.2017.2716957 [doi.org])
Schmidt, Bruno E., Thiré, Nicolas, Boivin, Maxime, et al. Frequency domain optical parametric amplification [open], Nature Communications (DOI: 10.1038/ncomms4643 [doi.org])
Lassonde, Philippe, Ibrahim, Heide, Leblanc, Adrien, et al. Information transfer via temporal convolution in nonlinear optics [open], Scientific Reports (DOI: 10.1038/s41598-020-72170-9 [doi.org])
Hu, Chengyang, Huang, Honghao, Chen, Minghua, et al. Video object detection from one single image through opto-electronic neural network [open], APL Photonics (DOI: 10.1063/5.0040424 [doi.org])
Xianglei Liu, Yingming Lai, Jinyang Liang, et al. Single-shot real-time compressed ultrahigh-speed imaging enabled by a snapshot-to-video autoencoder [open], Photonics Research (DOI: 10.1364/PRJ.422179 [doi.org])
Redirecting, (DOI: 10.1016%2Fj.optcom.2011.03.084 [doi.org])
Das, Susobhan, Wang, Yadong, Dai, Yunyun, et al. Ultrafast transient sub-bandgap absorption of monolayer MoS2 [open], Light: Science & Applications (DOI: 10.1038/s41377-021-00462-4 [doi.org])
Kublitski, Jonas, Fischer, Axel, Xing, Shen, et al. Enhancing sub-bandgap external quantum efficiency by photomultiplication for narrowband organic near-infrared photodetectors [open], Nature Communications (DOI: 10.1038/s41467-021-24500-2 [doi.org])
Kimel, Alexey V., Li, Mo. Writing magnetic memory with ultrashort light pulses, Nature Reviews Materials (DOI: 10.1038/s41578-019-0086-3 [doi.org])
M. Hennes, A. Merhe, X. Liu, et al. Laser-induced ultrafast demagnetization and perpendicular magnetic anisotropy reduction in a ${\mathrm{Co}}_{88}{\mathrm{Tb}}_{12}$ thin film with stripe domains, Physical Review B (DOI: 10.1103/PhysRevB.102.174437 [doi.org])
Hashimoto, Y., Khorsand, A. R., Savoini, M., et al. Ultrafast time-resolved magneto-optical imaging of all-optical switching in GdFeCo with femtosecond time-resolution and a μm spatial-resolution, Review of Scientific Instruments (DOI: 10.1063/1.4880015 [doi.org])
Malinowski, G., Dalla Longa, F., Rietjens, J. H. H., et al. Control of speed and efficiency of ultrafast demagnetization by direct transfer of spin angular momentum [open], Nature Physics (DOI: 10.1038/nphys1092 [doi.org])
Tian-Min Liu, Tianhan Wang, Alexander H. Reid, et al. Nanoscale Confinement of All-Optical Magnetic Switching in TbFeCo - Competition with Nanoscale Heterogeneity, (DOI: 10.1021/acs.nanolett.5b02743 [doi.org])
Vomir, M., Albrecht, M., Bigot, J.-Y.. Single shot all optical switching of intrinsic micron size magnetic domains of a Pt/Co/Pt ferromagnetic stack, Applied Physics Letters (DOI: 10.1063/1.5010915 [doi.org])
Metal nanodumbbells for nanomanipulations and tribological experiments - IOPscience, Physica Scripta (DOI: 10.1088%2F0031-8949%2F90%2F9%2F094007 [doi.org])
Irreversible Organic Crystalline Chemistry Monitored in Real Time, Science (DOI: 10.1126%2Fscience.1127826 [doi.org])
E. Esarey, C. B. Schroeder, W. P. Leemans. Physics of laser-driven plasma-based electron accelerators, Reviews of Modern Physics (DOI: 10.1103/RevModPhys.81.1229 [doi.org])
Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications, (DOI: 10.1109%2FTCI.2016.2629286 [doi.org])
Just a moment..., (DOI: 10.1137%2F20M1337168 [doi.org])

Original Submission