Showing posts with label random lens imaging. Show all posts
Showing posts with label random lens imaging. Show all posts

Monday, July 31, 2017

Randomized apertures: high resolution imaging in far field

Using Glitter as a way to replace large structure mirrors for space telescopes: This is what is suggested and measured here. The random PSF allows for sharper resolution (and Machine Learning is used).This is another instance of the Great Convergence, woohoo ! ( and by the way, are we going to ever acknowledge that the Random Lens Imaging paper is one of the greatest preprint that did not make it into publication, ever ?)



We explore opportunities afforded by an extremely large telescope design comprised of ill-figured randomly varying subapertures. The veracity of this approach is demonstrated with a laboratory scaled system whereby we reconstruct a white light binary point source separated by 2.5 times the diffraction limit. With an inherently unknown varying random point spread function, the measured speckle images require a restoration framework that combine support vector machine based lucky imaging and non-negative matrix factorization based multiframe blind deconvolution. To further validate the approach, we model the experimental system to explore sub-diffraction-limited performance, and an object comprised of multiple point sources.







Join the CompressiveSensing subreddit or the Google+ Community or the Facebook page and post there !
Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.

Monday, June 20, 2016

SparkleGeometry: Glitter Imaging for 3D Point Tracking / Cloudmaps from Static Ground-View Video

 Making sense of the world through unusual PSFs , aka imaging with Nature, I loooooove it !



SparkleGeometry: Glitter Imaging for 3D Point Tracking by Abigail Stylianou, Robert Pless
We consider a geometric inference problem for an imaging system consisting of a camera that views the world through a planar, rectangular sheet of glitter. We describe a procedure to calibrate this imaging geometry as a generalized camera which characterizes the subset of the light field viewed through each piece of glitter. We propose an easy to construct physical prototype and characterize its performance for estimating the 3D position of a moving point light source just by viewing the changing sparkle patterns visible on the glitter sheet. 

Cloudmaps from Static Ground-View Video by Nathan Jacobs, Scott Workman, Richard Souvenir
Cloud shadows dramatically a ect the appearance of outdoor scenes. We describe three approaches that use video of cloud shadows to estimate a cloudmap, a spatio-temporal function that represents the clouds passing over the scene. Two of the methods make assumptions about the camera and/or scene geometry. The third method uses techniques from manifold learning and does not require such assumptions. None of the methods require directly viewing the clouds, but instead use the pattern of intensity changes caused by the cloud shadows. An accurate estimate of the cloudmap has potential applications in solar power estimation and forecasting, surveillance, and graphics. We present a quantitative evaluation of our methods on synthetic scenes and show qualitative results on real scenes. We also demonstrate the use of a cloudmap for foreground object detection and video editing.
 
Join the CompressiveSensing subreddit or the Google+ Community or the Facebook page and post there !
Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.

Wednesday, February 08, 2012

Around the blogs in 80 hours (and more)






Here are some interesting posts and information of the past week


Outside of other commitments, I need to do two things, finish an entry for Randy and finish a presentation for Dorkbot (people doing strange things with electricity) on "Random Imagers". I also have two questions pending on bio and CS in the CS LinkedIn group, and on calibration issues in the Calibration club.

In other news, Therese Moretto Jorgensen tells us about the next deadline for an NSF cubesat proposal is May 7. 2012



Godspeed Janice.



Credit: Discovery Channel, A clip from Discovery Channel's "Raging Planet" on the subject of lightning. If you find lightning a facinating and beautiful force, then check this clip out. The camera technology has gotten to where scientists have been able to record and playback a lightning strike at over 200X slower with really cool results.
Liked this entry ? subscribe to Nuit Blanche's feed, there's more where that came from. You can also subscribe to Nuit Blanche by Email, explore the Big Picture in Compressive Sensing or the Matrix Factorization Jungle and join the conversations on compressive sensing, advanced matrix factorization and calibration issues on Linkedin.

Friday, May 27, 2011

Through the Non Looking-Glass, and What Alice Found There

The story goes that Lewis Caroll gave a copy of "Alice in Wonderland" to Queen Victoria who then asked him in return to send her his next book as she fancied the first one. The joke is that the book was "An Elementary Treatise on Determinants, With Their Application to Simultaneous Linear Equations and Algebraic Equations". Sir Lewis Caroll then went on to write a follow-on to Alice in Wonderland called "Through the Looking-Glass, and What Alice Found There" that features a chess board.


And then it all aligned in one fell swoop a little like Alice falling in a different magic world of wonders. That chess board reminded me of the grid used in the compressive coded aperture work mentioned yesterday in Rebecca Willett's work[2][3].



The simultaneous linear equations reminded me of the obvious connection to compressive sensing and underdetermined linear systems of equations. The determinant functional of the second book reminded of the current solution technique using the rank proxy log(det) [1] to recover image from a quadratic compressive sensing approach and finally, the looking glass is nothing short of a lens. What is linking of these elements ? Quite simply: Lens Free imaging [5][6][7].

And so what did Alice found through the Non Looking Glass you ask ? Initially there are some successes but eventually we have to deal with the pesky details, actually those were details when using lenses, they are now your main issues and the way you solve for them is what makes you famous. These pesky details are ?

  • Since we are getting non human readable image, we need to perform calibration to figure out if what we see is what we want. The issue is that we have to form a combinatorial amount of trials to since now the transfer function is not symmetric or has no known features [9].
  • Noise gets in the way as found by the earlier folks who have done coded aperture for the past fifty years [4] since now the PSF is widespread. You lose resolution with a lens system but this is because you are decreasing noise.

Let us also note that these issues are similar to the ones we face when looking at other radiation than light[8].

[6] Lens-free optical tomographic microscope with a large imaging volume on a chip by Serhan O. Isikmana, Waheb Bisharaa, Sam Mavandadia, Frank W. Yua, Steve Fenga, Randy Laua, and Aydogan Ozcan
[7] Lensfree on-chip holography facilitates novel microscopy applications by Aydogan Ozcan, Serhan Isikman, Onur Mudanyali, Derek Tseng and Ikbal Sencan

Friday, May 20, 2011

Great Thoughts Friday: Unsupervised Feature Learning of Exotic Camera Systems

The issue of sparse coding is not new to our readers since it falls in the dictionary learning issue of interest in the reconstruction stage in compressive sensing. Thanks to Bob, I was reminded of the following video of Andrew Ng about unsupervised learning (one way of performing dictionary learning). As Andrew shows some of these techniques are getting better and better.


By necessity, people are using the same databases. But if we take the argument further, some of these databases are somehow dependent on the very camera parameters that took these shots and one could make the argument that the calibration issue is hidden behind some well thought out benchmark databases. While one of the need for decomposing images is important, eventually, we are often not knowledgeable about the features that were learned (an issue Andrew points to at the very end of his video/slides.) Given all this, I wonder if exotic camera systems such as multiple Spherical Catadioptric Cameras ( as featured in Axial-Cones: Modeling Spherical Catadioptric Cameras for Wide-Angle Light Field Rendering by Yuichi Taguchi, Amit Agrawal, Ashok Veeraraghavan, Srikumar Ramalingam and Ramesh Raskar) or the random lens imager that produce highly redundant information of the scene of interest, can provide better classification rate than the current techniques ?


If we take this argument further, what would then be a good way of comparing these exotic camera systems for classification purposes ?...

Note:
For those of you interested: At the end of the Andrew Ng's presentation, there is a link to this course and handouts of the corresponding course at Stanford. It features two videos.

Saturday, February 13, 2010

CS: Acoustic Kaleidoscope, reducing interference in EEG and visual resolution and cone spacing in the human fovea.


While attending the seminar of Maxime Dahan on Fluorescence imaging using compressed sensing, one of the audience member - I'm told it was Mickael Tanter - mentioned the time reversal kaleidoscope that has some very eery similarity with other concepts of using random materials to perform measurements like the Random Lens Imager. The paper that talks about it (behind a paywall) is The time reversal kaleidoscope: a new concept of smart transducers for 3d ultrasonic imaging by Gabriel Montaldo, Delphine Palacio, Mickael Tanter and Matthias Fink. The abstract reads:
The design of 2D arrays for 3D ultrasonic imaging is a major challenge in medical and non-destructive applications. Thousands of transducers are typically needed for beam focusing and steering in 3D volumes. Here, we report a completely new approach for producing 3D images with a small number of transducers using the combined concepts of time reversal mirrors and chaotic reverberating cavities. Due to multiple reverberations inside the cavity, a “kaleidoscopic” transducer array is created with thousands of virtual transducers equivalent to 2D matrices. Beyond the scope of 3D medical imaging, this work leads to the new concept of “smart” transducer.
It is interesting that they can do imaging in some analog fashion, I am sure that a compressive sensing step could provide a computational element that would (dramatically) enhance the resulting images and even provide some superresolution. We'll see.

As some of you know I am interested in a compressive sensing EEG system. This past week, the following interesting reference showed up on my radar screen: High-quality recording of bioelectric events. Part 1 Interference reduction, theory and practice. by A. C. Metting van Rijn A. Pepar C. A Grimbergen.

My webcrawler found the following paper published in Nature: The relationship between visual resolution and cone spacing in the human fovea by Ethan Rossi, Austin Roorda. [supplemental information] [video1][video2] [video3]. The abstract reads:
Visual resolution decreases rapidly outside of the foveal center. The anatomical and physiological basis for this reduction is unclear. We used simultaneous adaptive optics imaging and psychophysical testing to measure cone spacing and resolution across the fovea, and found that resolution was limited by cone spacing only at the foveal center. Immediately outside of the center, resolution was worse than cone spacing predicted and better matched the sampling limit of midget retinal ganglion cells.
This paper led me to another older one: Psychophysical estimate of extrafoveal cone spacing by Nancy J. Coletta and David R. Williams. The abstract reads:
In the extrafoveal retina, interference fringes at spatial frequencies higher than the resolution limit look like twodimensional spatial noise, the origin of which has not been firmly established. We show that over a limited range of high spatial frequencies this noise takes on a striated appearance, with the striations running perpendicular to the true fringe orientation. A model of cone aliasing based on anatomical measurements of extrafoveal cone position predicts that this orientation reversal should occur when the period of the interference fringe roughly equals the spacing between cones, i.e., when the fringe spatial frequency is about twice the cone Nyquist frequency. Psychophysical measurements of the orientation reversal at retinal eccentricities from 0.75 to 10 deg are in quantitative agreement with this prediction. This agreement implies that at least part of the spatial noise observed under these conditions results from aliasing by the cone mosaic. The orientation reversal provides a psychophysical method for estimating spacing in less regular mosaics, complementing another psychophysical technique for measuring spacing in the more regular mosaic of foveal cones [D. R. Williams, Vision Res. 25, 195 (1985); Vision Res. (submitted)].
In it one can read:
Previously, Yellott16 had proposed that disorder of the cone lattice prevents aliasing by smearing high spatial frequencies into broadband noise. The present data confirm that, although the aliasing noise is indeed smeared, it is still accessible to psychophysical observation. In fact, this aliasing noise can be used to draw inferences about the spacing of cones.
In light of this entry on Tilings, Islamic Art, Our Retina, Papoulis Sub-Nyquist Theorem, I had talked to Austin Roorda but never made that discussion into a blog entry. I am such a putz. I should unearth it sometimes.

Credit: NASA / JPL, pale blue dot, earth as seen from Voyager.

Tuesday, September 11, 2007

This is how science is done, trial and error in the mud.




As noted by the HASP folks, one of our payload fell into the mud after landing from a 37 km fall with a parachute. We just got the cameras this morning and found out it was GeoCam. Hyper-GeoCam is fine. Now we need to open the boxes and find out if there is anything in either of them. This is Science in Motion where Murphy's law always strike. The camera look fine, let's see if they actually took pictures.
[Update: GeoCam is OUT.]

Sunday, September 02, 2007

Ready to launch



the title says it all. HyperGeoCam will be lifting off in a short while over New Mexico for about 10 to 20 hours taking about 1000 snapshots if all goes well.

[ Update: it went up at 7:30 am mountain time, 8:30 Central time, 15:30 UMT, you can see LIVE what one of the webcam see here]

[ Update 2: HASP has landed. 6.55 miles from the California border after 19 hours of flight. woohoo. We won't know if we have data until the hardware is returned to us.]

Saturday, September 01, 2007

HASP will launch today.


Our fingers are crossed. The good folks at LSU (Greg Guzik and Michael Stewart) just told us the flight might be today. The CosmoCam (a webcam aboard the HASP high altitude balloon) can be viewed here. HyperGeoCam is on-board. HyperGeoCam is a random lens imager using Compressed Sensing to recover full images. HyperGeocam will be shooting photographs from 120,000 feet (36 km) down. We expect about 1000 images from this experiment. Last year we flew a simple camera (GeoCam) and automatically stitched together images obtained from that camera and produced these amazing panoramas. HyperGeoCam uses the concepts of Random Lens Imaging with random light decomposing elements in order to produce spectrally differentiable images.

Printfriendly