If your phone takes amazing photos, chances are its camera has been augmented by artificial intelligence embedded in the operating system. Now videos are getting the same treatment.
In recent years, smartphone makers have been gradually transforming their cameras into devices that capture data for AI processing beyond what the lens and sensor pick up in a single shot. That effectively turns a smartphone into a professional camera on auto mode and lowers the bar of capturing compelling images and videos.
In an era of TikTok and vlogging, there’s a huge demand to easily produce professional-looking videos on the go. Like still images, videos shot on smartphones rely not just on the lens and sensor but also on enhancement algorithms. To some extent, those lines of codes are more critical than the hardware, argued Andreas Lifvendahl, founder and chief executive of Swedish company Imint, whose software now enhances video production in roughly 250 million devices — most of which come from Chinese manufacturers.
“[Smartphone makers] source different kinds of camera solutions — motion sensors, gyroscopes, and so on. But the real differentiator, I would say, is more on the software side,” Lifvendahl told TechCrunch over the phone.
Smart video recording
Imint started life in 2007 as a spin-off academic research team from Uppsala University in Sweden. It spent the first few years building software for aerial surveillance, just as many cutting-edge innovations that find their first clients in the defense market. In 2013, Lifvendahl saw the coming of widespread smartphone adaptation and a huge opportunity to bring the same technology used in defense drones into the handsets in people’s pockets.
“Smartphone companies were investing a lot in camera technology and that was a clever move,” he recalled. “It was very hard to find features with a direct relationship to consumers in daily use, and the camera was one of those because people wanted to document their life.”
“But they were missing the point by focusing on megapixels and still images. Consumers wanted to express themselves in a nice fashion of using videos,” the founder added.
The next February, the Swedish founder attended Mobile World Congress in Barcelona to gauge vendor interest. Many exhibitors were, unsurprisingly, Chinese phone makers scouring the conference for partners. They were immediately intrigued by Imint’s solution, and Lifvendahl returned home to set about tweaking his software for smartphones.
“I’ve never met this sort of open attitude to have a look so quickly, a clear signal that something is happening here with smartphones and cameras, and especially videos,” Lifvendahl said.
Vidhance, Imint’s enhancement software suite mainly for Android, was soon released. These days, it can enhance precision, reduce motion, track moving objects, auto-correct horizon, reduce noise, and strengthen other aspects of a video in real-time — all through deep learning.
In search of growth capital, the founder took the startup public on the Stockholm Stock Exchange at the end of 2015. The next year, Imint landed its first major account with Huawei, the Chinese telecoms equipment giant that was playing aggressive catch-up on smartphones at the time.
“It was a turning point for us because once we could work with Huawei, all the other guys thought, ‘Okay, these guys know what they are doing,’” the founder recalled. “And from there, we just grew and grew.”
Working with Chinese clients
The hyper-competitive nature of Chinese phone makers means they are easily sold on new technology that can help them stand out. The flipside is the intensity that comes with competition. The Chinese tech industry is both well-respected — and notorious — for its fast pace. Slow movers can be crushed in a matter of a few months.
“In some aspects, it’s very U.S.-like. It’s very straight to the point and very opportunistic,” Lifvendahl reflected on his experience with Chinese clients. “You can get an offer even in the first or second meeting, like, ‘Okay, this is interesting, if you can show that this works in our next product launch, which is due in three months. Would you set up a contract now?’”
“That’s a good side,” he continued. “The drawback for a Swedish company is the demand they have on suppliers. They want us to go on-site and offer support, and that’s hard for a small Swedish company. So we need to be really efficient, making good tools and have good support systems.”
The fast pace also permeates into the phone makers’ development cycle, which is not always good for innovation, suggested Lifvendahl. They are reacting to market trends, not thinking ahead of the curve — what Apple excels in — or conducting adequate market research.
Despite all the scrambling inside, Lifvendahl said he was surprised that Chinese manufacturers could “get such high-quality phones out.”
“They can launch one flagship, maybe take a weekend break, and then next Monday they are rushing for the next project, which is going to be released in three months. So there’s really no time to plan or prepare. You just dive into a project, so there would be a lot of loose ends that need to be tied up in four or five weeks. You are trying to tie hundreds of different pieces together with fifty different suppliers.”
High-end niche
Imint is one of those companies that thrive by finding a tough-to-crack niche. Competition certainly exists, often coming from large Japanese and Chinese companies. But there’s always a market for a smaller player who focuses on one thing and does it very well. The founder compares his company to a “little niche boutique in the corner, the hi-fi store with expensive speakers.” His competitors, on the other hand, are the Walmarts with thick catalogs of imaging software.
About three-quarters of Imint’s revenues come from licensing its proprietary software that does these tricks. Some clients pay royalties on the number of devices shipped that use Vidhance, while others opt for a flat annual fee. The rest of the income comes from licensing its development tools or SDK, and maintenance fees.
With a staff of around 40, Imint now supplies its software to 20 clients around the world, including the Chinese big-four of Huawei, Xiaomi, Oppo and Vivo as well as chip giants like Qualcomm and Mediatek. ByteDance also has a deal to bake Imint’s software into Smartisan, which sold its core technology to the TikTok parent last year. Imint is beginning to look beyond handsets into other devices that can benefit from high-quality footage, from action cameras, consumer drones, through to body cameras for law enforcement.
So far, the Swedish company has been immune from the U.S.-China trade tensions, but Lifvendahl worried as the two superpowers move towards technological self-reliance, outsiders like itself will have a harder time entering the two respective markets.
“We are in a small, neutral country but also are a small company, so we’re not a strategic threat to anyone. We come in and help solve a puzzle,” assured the founder.
Source: TechCrunch
