Xiaomi Teams Up with Light for Multi-Module Smartphone Cameras
Xiaomi and Light, a computational imaging firm, have announced at Mobile World Congress that the two companies will be working together to develop new multi-module cameras for smartphones. The two companies promised that the jointly-developed cameras will feature DSLR-level capabilities, but did not disclose when the first product from the joint project is expected to come to fruition.
Light specializes on computational imaging solutions using multiple camera arrays. The company has gone so far as to develop their own chip that can work with 6, 12, or 18-camera arrays. And while Xiaomi and Light aren't specifying just how big of a camera array they're looking to develop, we're likely looking at something in the lower-bounds of those number, if only due to the limited size of smartphones. For reference's sake, a 6-module camera would be very similar to what Nokia has done for their Nokia 9 PureView.
Cover the entire back of a smartphone with cameras, then gingerly hold it using the corners.
Related: Meta-Lens Works in the Visible Spectrum, Sees Smaller Than a Wavelength of Light
A Pocket Camera with Many Eyes - Inside the Development of Light
Caltech Replaces Lenses With Ultra-Thin Optical Phased Array
Nokia (HMD Global) Partners with Zeiss for Optics Capabilities
Google Reportedly Acquires Lytro, Which Made Refocusable Light Field Cameras
LG's V40 Smartphone Could Include Five Cameras
Leaked Image Shows Nokia-Branded Smartphone With Five Rear Cameras
Related Stories
Curved lenses, like those in cameras or telescopes, are stacked in order to reduce distortions and resolve a clear image. That's why high-power microscopes are so big and telephoto lenses so long.
While lens technology has come a long way, it is still difficult to make a compact and thin lens (rub a finger over the back of a cellphone and you'll get a sense of how difficult). But what if you could replace those stacks with a single flat -- or planar -- lens?
Researchers from the Harvard John A. Paulson School of Engineering and Applied Sciences (SEAS) have demonstrated the first planar lens that works with high efficiency within the visible spectrum of light -- covering the whole range of colors from red to blue. The lens can resolve nanoscale features separated by distances smaller than the wavelength of light. It uses an ultrathin array of tiny waveguides, known as a metasurface, which bends light as it passes through, similar to a curved lens.
The article's description of the lens sounds reminiscent of a Fresnel lens. Perhaps Soylentils more familiar with the field can comment?
The creator of the new Light digital camera explains how he made it work:
The best digital cameras today are SLRs (single-lens reflex cameras), which use a movable mirror to guide the same light rays that fall on the sensor into the viewfinder. These cameras normally have precisely ground glass lenses and large, high-quality image sensors. In the right hands, they can shoot amazing pictures, with brilliant colours and pleasing lighting effects, often showing a crisply focused subject and an aesthetically blurred background.
But these cameras are big, heavy, and expensive: A good digital SLR (DSLR) with a decent set of lenses—including a standard 50 mm, a wide angle, and a telephoto, for example—can easily set you back thousands of dollars.
So most photos today aren't being shot with DSLRs but with the tiny camera modules built into mobile phones. Nobody pretends these pictures match the quality of a photograph taken by a good DSLR; they tend to be grainy, and the camera allows very little artistic control. But smartphone cameras certainly are easy to carry around.
Can't we have it both ways ? Couldn't a high-quality yet still-tiny camera somehow be fit into a mobile device ?
The Light camera starts with a collection of inexpensive plastic-lens camera modules and mechanically driven mirrors. We put them in a device that runs the standard Android operating system along with some smart algorithms. The result is a camera that can do just about everything a DSLR can—and one thing it can't: fit in your pocket.
Caltech has created a camera without a lens:
Traditional cameras—even those on the thinnest of cell phones—cannot be truly flat due to their optics: lenses that require a certain shape and size in order to function. At Caltech, engineers have developed a new camera design that replaces the lenses with an ultra-thin optical phased array (OPA). The OPA does computationally what lenses do using large pieces of glass: it manipulates incoming light to capture an image.
[...] "Here, like most other things in life, timing is everything. With our new system, you can selectively look in a desired direction and at a very small part of the picture in front of you at any given time, by controlling the timing with femto-second—quadrillionth of a second—precision," says Ali Hajimiri, Bren Professor of Electrical Engineering and Medical Engineering in the Division of Engineering and Applied Science at Caltech, and the principal investigator of a paper describing the new camera. The paper was presented at the Optical Society of America's (OSA) Conference on Lasers and Electro-Optics (CLEO) and published online by the OSA in the OSA Technical Digest in March 2017.
"We've created a single thin layer of integrated silicon photonics that emulates the lens and sensor of a digital camera, reducing the thickness and cost of digital cameras. It can mimic a regular lens, but can switch from a fish-eye to a telephoto lens instantaneously—with just a simple adjustment in the way the array receives light," Hajimiri says.
Does this have implications for astronomy?
"The applications are endless," says graduate student Behrooz Abiri (MS '12), coauthor of the OSA paper. "Even in today's smartphones, the camera is the component that limits how thin your phone can get. Once scaled up, this technology can make lenses and thick cameras obsolete. It may even have implications for astronomy by enabling ultra-light, ultra-thin enormous flat telescopes on the ground or in space."
Okay.
Paper: An 8x8 Heterodyne Lens-less OPA Camera
http://www.anandtech.com/show/11608/nokia-smartphones-to-exclusively-use-zeiss-optics
HMD Global and Zeiss on Thursday announced that they had signed an agreement under which upcoming Nokia-branded smartphones will use Zeiss-branded optics exclusively. The companies said that they would co-develop imaging capabilities of future handsets, but did not elaborate when to expect actual devices on the market.
The collaboration announcement between HMD and Zeiss has a number of layers, all of which seem to be significant. First off, Nokia's future phones will use optics co-developed with a renowned designer of lenses. The important upshot here is that HMD is actually investing in the development of custom capabilities for its Nokia phones. Second, the two companies are talking about "advancing the quality of the total imaging experience", involving optics, display quality, software, and services, but do not elaborate. From the announcement, it looks like HMD will put R&D efforts not only into optics but will design its own software enhancements to improve imaging capabilities beyond those offered by vanilla Android. A good news here is that certain future phones carrying the Nokia brand are not going to rely completely on off-the-shelf hardware, software, and reference designs. Third, HMD announced that imaging is one of the areas that it considers important for its future smartphones. Finally, Zeiss will be used on Nokia-branded devices exclusively, which means that future halo smartphones from Microsoft (if the company decides to launch them) will have to rely on other optics.
Previously: Nokia Smartphones to Return in 2017
Nokia (HMD Global) Attempting U.S. Comeback With Midrange Android Smartphones
Google is reportedly acquiring Lytro, a company that made light field cameras and hoped to pivot to virtual reality video capture. Google appears to have gotten a good (or at least cheap) deal:
Multiple sources tell us that Google is acquiring Lytro, the imaging startup that began as a ground-breaking camera company for consumers before pivoting to use its depth-data, light-field technology in VR.
One source described the deal as an "asset sale" with Lytro going for no more than $40 million. Another source said the price was even lower: $25 million. A third source tells us that not all employees are coming over with the company's technology: some have already received severance and parted ways with the company, and others have simply left. Assets would presumably also include Lytro's 59 patents related to light-field and other digital imaging technology.
The sale would be far from a big win for Lytro and its backers. The startup has raised just over $200 million in funding and was valued at around $360 million after its last round in 2017, according to data from PitchBook.
Despite a lot of hype, Lytro had little success with its expensive, ergonomically challenged, and low resolution light field cameras for consumers.
Also at 9to5Google and Engadget.
Related: LinkedIn's Top 10 Silicon Valley Startups for 'Talent Brand' - Note: Both Lytro and Theranos are on the list.
A Pocket Camera with Many Eyes - Inside the Development of Light
LG says screw everything, we're doing five cameras for the V40
It's tough to stand out in the premium smartphone world, but LG may have a solution for its upcoming V40 flagship. There's a rumor from Android Police that says the company is throwing caution to the wind and putting five cameras on its new phone, a device that will surely succeed where last year's V30's (and its V35 variant's) paltry three cameras did not.
According to Android Police's source, the V40 will feature three cameras on the back of the device. It's similar to the Huawei P20 Pro, which was the first major smartphone to offer a triple-camera system. The V40 will also feature dual cameras on the front of the device (like the HTC U12 Plus), in what's rumored be a stereo system to follow for 3D face mapping and unlocking. While both the dual-front camera and triple-rear camera configurations aren't new, the five-camera system would the first time we've seen both on a single device. If the rumor is correct, this would be the most cameras on a smartphone.
Leaked image teases Nokia phone with five cameras
HMD appears to be working on an impressive camera array for a future Android-powered Nokia handset. Leaked design sketches and images hint that we could be about to see a Nokia-branded phone with five cameras on the rear. The penta-lens setup first appeared in rumors about a Nokia 10 device earlier this year, and now an alleged photo has leaked of the handset.
The camera module includes five lenses arranged in what looks like a circle, with prominent Zeiss branding. HMD Global, the Finnish company that licensed the rights to produce Nokia phones, teamed up with Zeiss last year to reunite the Nokia and Zeiss brands for the Android era. HMD has started to use Zeiss optics in its latest Android handsets, and the lens maker has even patented a miniaturized zoom camera system that looks very similar to this leak.
F*** Everything, We're Doing Five Rear Cameras.
But you still have a long way to go.
Also at Engadget.
Previously: Nokia (HMD Global) Partners with Zeiss for Optics Capabilities
LG's V40 Smartphone Could Include Five Cameras (total)
Related: Nokia Smartphones to Return in 2017
Nokia (HMD Global) Attempting U.S. Comeback With Midrange Android Smartphones
(Score: 2) by jasassin on Thursday March 07 2019, @08:33PM (4 children)
I just imagined a comical device like one of those huge cannon cameras with a Samsung galaxy attached to the bottom.
jasassin@gmail.com GPG Key ID: 0xE6462C68A9A3DB5A
(Score: 4, Informative) by takyon on Thursday March 07 2019, @08:43PM (3 children)
This was basically part of the use case for the Red Hydrogen One [wikipedia.org] high-end smartphone, which was poorly reviewed [soylentnews.org].
Ultimately, weight and thickness (thinness) are top concerns for smartphone manufacturers. Adding different lenses with varying focal lengths, zoom levels, etc. and then combining data from them and cleaning it up with an algorithm is a smart approach to the problem of offering high quality photography/videography in that form factor. You also need two cameras at minimum to do something like VR180 recording [google.com]. Many here will mock the 3+ camera trend but I like it and nobody has to pick up the latest new smartphone... just wait a couple years for the features to trickle down to cheaper or used phones.
There's also a possibility of using something like a phased array or some sort of metamaterial lens to go beyond the bounds of what is normally possible optically. These still seem to be in the lab phase. It will be interesting to see which machinery gets the technology first: space telescopes, smartphones, VR headsets...?
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]
(Score: 1, Insightful) by Anonymous Coward on Thursday March 07 2019, @09:58PM (2 children)
Phased array on a smartphone is a completely idiotic idea. First, you aren't going to phase it in any stable fashion in that form factor because you'll need to combine the beams, and you're not doing that in a thin smart phone. Plus, let's say you do phase them, what are you gaining? You effectively now have the resolution of a lens that is the width of the phone, but only in that one dimension. And you've thrown out all your signal because though you have an effective aperture that is the size of whatever circle you encircle the two lenses, you have the photon collection efficiency that is the ratio of the areas of the lenses to the area of the effective aperture. Kind of get the worst of all cases.
(Score: 4, Interesting) by takyon on Thursday March 07 2019, @10:12PM
https://www.caltech.edu/about/news/ultra-thin-camera-creates-images-without-lenses-78731 [caltech.edu]
They are either hyping it up or they genuinely think it can be used in smartphones at some point. I wouldn't rule this technology out just yet.
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]
(Score: 2) by driverless on Friday March 08 2019, @02:37AM
You can tell that that's been written by advertising copywriters. To get DSLR-level capabilities you need an actual DSLR, big glass, big sensors. Claiming you can get DSLR-level performance from a tiny fixed lens and equally tiny sensor on a cellphone is the same as claiming you can get Wharfedale-level performance from a tiny sound bar. You can try really, really hard to fake it, and under just the right conditions with just the right audience marginally pull it off, but the rest of the time you are just faking it.
(Score: 1, Interesting) by Anonymous Coward on Thursday March 07 2019, @10:37PM (1 child)
I'd like to see software create arrays from cameras on multiple cellphones, more than on a single phone.
Imagine concert footage that combines the videos from dozens of attendees cameras into a single high-resolution scene.
Bonus points for also recording depth and recreating the venue in VR.
(Score: 2) by takyon on Thursday March 07 2019, @11:50PM
That was done years ago:
http://www.kurzweilai.net/how-to-create-a-seamless-panorama-video-from-multiple-cameras [kurzweilai.net]
https://petapixel.com/2017/09/23/canons-new-virtual-camera-system-something-straight-sci-fi/ [petapixel.com]
https://www.nbcnews.com/mach/innovation/virtual-reality-major-sports-are-bringing-stadium-you-n716506 [nbcnews.com]
There are probably other examples, and more work could be done to make it suitable for VR and usable applications, but it's in the works and definitely feasible. Given the commercial potential, pre-positioned high resolution cameras rather than attendees' cameras will be used in certain instances like sports games.
You have some smartphones with depth sensors, but is that information ending up in video containers? Because the easiest way to prove this concept would be to use pre-existing videos rather than doing it live. It would be great to save dozens of online videos of some event from varying angles/timestamps, then combine it all years later using a high-end system and machine learning algorithms.
[SIG] 10/28/2017: Soylent Upgrade v14 [soylentnews.org]