Elastic Introduces Jina v5 Omni Family: Two Models to Power Text, Image, Video, and Audio Search

Elastic introduced the Jina v5 Omni family, comprising two new multimodal embedding models designed to represent text, images, video, and audio as vectors. The models, available in small and nano sizes, allow developers to perform search, classification, clustering, and deduplication across different media types while maintaining compatibility with existing text-based systems. Users can integrate multimedia into existing vector indexes without additional infrastructure changes, streamlining adoption for teams already using Elastic's search solutions.

The v5-omni models share the same text embedding space as jina-embeddings-v5-text, enabling seamless swapping between text and multimodal models. This compatibility allows organizations to expand their search capabilities to include images, audio, and video without rebuilding their indexing or retrieval pipelines. Ken Exner, Elastic's chief product officer, emphasized the goal of making multimodal search as scalable and straightforward as text search.

Powered by a single universal language model that aligns all modalities, the v5-omni models feature a modular design. Users can enable or disable text, image, and audio processing features based on their requirements, optimizing performance and resource usage for specific use cases. The models are accessible via Elastic Inference Service, the Jina API, and local installation, with non-commercial licenses available at no cost.

Elastic offers the new models under a non-commercial license for free download, while commercial use requires contacting Elastic sales. The company, known for its Search AI Platform, integrates AI with search technology to help organizations transform data into actionable insights. Elastic's solutions are used by over 50% of the Fortune 500, supporting search, observability, and security applications.