Consequently TwelveLabs was established with the mission of bridging this gap by training models to comprehend the text and content within videos encompassing actions objects and background sounds.
Although corporations like Google and Microsoft provide models for video analytics Lee contends that TwelveLabs’ strength lies in its customizable features enabling customers to tailor models utilizing their own data.
Despite apprehensions regarding bias in AI models TwelveLabs is committed to issuing ethics-related benchmarks and datasets to tackle these concerns. This conviction is held by Jae Lee one of the co-founders of TwelveLabs. Admittedly Lee may be somewhat biased given that TwelveLabs specializes in training models for video analysis yet there appears to be validity in his assertion.
Through the employment of TwelveLabs’ models users gain the ability to peruse videos to pinpoint specific moments summarize clips and even pose inquiries such as “When did the individual in the red shirt enter the restaurant?” These functionalities are robust which explains why the company has garnered support from prominent players like Nvidia Samsung and Intel.
As a data scientist Lee had always found traditional search methods lacking when it comes to videos. The involvement of In-Q-Tel hints at potential opportunities in national security, aligning with TwelveLabs’ dedication to effecting positive change while upholding ethical standards.
. One of their models, Marengo, is capable of searching across images and audio in addition to videos, presenting a versatile tool for a myriad of applications.
The company’s expanding product range has attracted clients from enterprise, media, and entertainment sectors. Databricks and Snowflake are among the key partners incorporating TwelveLabs’ technology into their solutions.
With recent investments totaling $30 million, TwelveLabs aims to concentrate on product development and recruitment to spur future growth. Keyword searches prove useful for titles, tags, and descriptions, but they often fall short in capturing the precise content of the videos. AI models that possess the capability to comprehend videos akin to text hold the potential to open up an entirely new realm of applications né?. The appointment of Yoon Kim, former CTO of SK Telecom, as president and chief strategy officer underscores the company’s commitment to ambitious expansion strategies.
TwelveLabs’ objective is to diversify into new verticals like automotive and security in the forthcoming years. The company underscores responsible AI development, upholding civil rights, and propelling technological progress.
TwelveLabs has broadened its scope beyond video analysis, venturing into domains like “any-to-any” search and multimodal embeddings né?
