Amazing Jing for Life: Brighter, steadier, smarter: How smartphone cameras will improve in 2022 LOOKING AHEAD WITH TECNO

December 17, 2021

LOOKING AHEAD WITH TECNO

Sensor shift stabilisation, new RGBW sensors, personalised AI algorithms, and more – here’s why your selfies and holiday photos are going to level up next year

Smartphone cameras are no longer just the most convenient option – they are quickly becoming the best one, beating traditional digital cameras with computational power and innovation.

In 2021, smartphones with multiple lens systems became mainstream. Improved sensor size and resolution mean users can capture more details and render images accurately in complex lighting conditions. Artificial intelligence (AI) algorithms enhanced many facets of image processing. And they’re not done. A slew of changes are coming in 2022, as smartphone manufacturers push the envelope.

What are the trends that will drive this change? At a recent webinar, Global Mobile Camera Trends 2022, organised by Counterpoint Research, experts from TECNO, Samsung, and DXOMARK Image Labs, discussed some of the key trends we are likely to see in the coming year – and what we will soon be holding in our hands

High-resolution sensors with pixel binning: Balancing resolution and light sensitivity

Presenting trends in camera resolution, Tarun Pathak, director of research, smartphone, Counterpoint Research, said about 40% of all smartphones in Q2 of 2021 had 48-64 megapixel (MP) sensors, and 3% of all smartphones had 108 MP sensors. According to Pathak, smartphones with 200 MP sensors are likely to launch in 2022.

Sensors with a high pixel count tend to capture more details from the scene. However, the size of pixels on such sensors is usually smaller. “The smaller the pixel, the less light you can capture in each pixel, and the harder it is to get a good image quality in darker environments,” said Pan Xuebao, VP and head of R&D, Samsung Electronics.

However, sensor manufacturers such as Samsung are deploying an algorithm-driven technique called pixel binning that enables high-resolution sensors (with a small pixel size) to perform better in low-light conditions. “Just like our human eye will dilate when we are in a darker environment to let in more light, similarly, in low light conditions, our algorithm will automatically put the sensor in high sensitivity mode,” Xuebao said. In this mode, the smaller individual pixels ‘combine’ and act like bigger pixels. This mode is turned off in brighter conditions.

Continuous optical zoom: Closer to the action

Phones are getting sleeker, but these aesthetics can be a technological challenge. This trend is presenting more of a challenge for manufacturers as they try to incorporate bulky telephoto lenses. Such technologies, such as periscope lenses which use innovative positioning to allow for 5x or 10x optical zoom, started appearing in smartphones during 2021.

The next step is to offer continuous optical zoom, which will allow users to shift between different focal lengths smoothly. This requires precise movement of lenses within small spaces without affecting image quality.

At the webinar, Hsu predicted the market could see continuous optical zoom in the second half of 2022, allowing users to shift between 3x to 5x optical zoom. Driven by advances such as long-stroke motor development and Active Optical Alignment, we could even see 3x to 10x zoom in 2023, he said.

RGBW Sensors: Let there be (more) light

Cat photos not up to the mark? It could be down to the lighting. Indoor environments have less than ideal light conditions. Yet, that’s where people usually take most of their photographs.

“[A solution to] low light is the holy grail of mobile photography,” said Hervé Macudzinski, image science director and product owner of DXOMARK Image Labs, which tests camera, audio, display and battery quality. “This is one [aspect] that can lead to disappointing quality. In low light, users capture portrait photos, pictures of family, pets and so on. So there is a lot of challenge in this use case.”

While smartphone manufacturers use differe

Localised algorithms: Using AI to personalise portraits

As cameras improve, we can see ourselves more clearly. New technologies allow our portraits to be more accurate, especially for people of colour.

While hardware enhancements are essential, smartphone software is playing a more significant role in determining the final image or video quality of these portraits. “We need to have very good processing – that is, to understand what the user’s intention was and modify the image adequately,” Macudzinski said.

That’s why some smartphone manufacturers use big data and deep neural networks to drive personalised and localised image processing. For instance, TECNO’s TAIVOS signal processing technology recognises and accurately reproduces dark skin elements. According to Hsu, the company uses a large dark skin database to “produce more than 6,120 Evaluation Scenarios spanning 115 countries”.

For portrait photography, the AI engine recognises and classifies different elements such as faces and hair colour to determine the subject's age, gender, and skin tone. The photo is then optimised for better clarity, colour, and light, which helps with more accurate reproduction of darker skin tones – even in low-light environments.

Scene, light, and colour enhancement: Behind every subject is a background

It’s not just the subject of a photo that matters – it's what’s behind them. Whether it’s the sun or a beautiful view, smartphone cameras are adapting to capturing these details better.

With traditional photography, professional photographers use their experience and training to make adjustments that highlight not just the subject but also background scene elements. They also typically spend significant time in post-production that brings images to life.

“Smartphone cameras need to provide all these capabilities in the default mode,” Macudzinski said. “That means the final smartphone user does not have to think through everything. They just have to press the button.”

That’s where AI-driven image processing comes in. According to Counterpoint Research’s whitepaper, AI is becoming advanced enough to recognise dynamic scene elements such as trees or sky in the background. Once identified, the image-processing system optimises their colour, contrast, and exposure.

AI will also help interpret light information. For instance, if a user is shooting against the sun, the algorithm works to underexpose the sun and brighten the subject. Smartphone manufacturers are also working on software-based solutions to correct distortions caused by wide-angle lenses.

Time of flight and dynamic vision sensors: Getting a sense of depth

Photos with sharply rendered foreground and blurred background can make for a pleasing effect – especially while shooting portraits. However, to do this, the smartphone must recognise depth and subject edges.

With Time of Flight (ToF) and Dynamic Vision Sensors (DVS) improving, smartphones will get better at generating 3D models of the scene and detecting edges. This will allow for more precise measurements and offer users features such as. enhanced and gradual blurring of backgrounds.

“ToF and DVS could be the opportunities where mobile phone cameras start to outperform (DSLR) cameras,” Hsu said.

A brighter, more intelligent 2022

These trends point to technology growing more intricate and catering to diverse use cases – whether that’s through personalised portrait rendition, stable imaging or allowing users to zoom in to the action.

However, the advancements will not be defined just by cutting-edge features on pricey smartphones. It’s a win across budget tiers - the developments result not just in technological advancement, but also trickle-down premium features to smartphones in the low and medium price bands. With the way smartphone cameras are levelling up, the best moments of your life will be remembered more clearly than ever.

Looking ahead with TECNO

Hosted by Counterpoint Research, Global Mobile Camera Trends 2022 Innovation Talk discussed new trends in imaging technology. TECNO aims to provide an excellent photography and videography experience through constant innovation and a deep understanding of consumer needs.

WATCH THE WEBINAR