Author: Nomic Team

The Nomic Embedding Ecosystem

Over the past several months, Nomic has released a number of State-of-the-Art (SOTA) open source embedding models. With so many models, it can be hard to know which one to use for your application. In this post, we'll explore the ecosystem of Nomic Embed models and how they can be used for a wide range of applications. We will describe the benefits and features of each model, and provide benchmark comparisons to the relevant peer models.

The Ecosystem at a Glance

Nomic Embed V2

Nomic Embed v2 is a state of the art multilingual embedder that supports over a hundred languages. Nomic Embed v2 is the first general purpose embedder to utilize a mixute-of-experts architecture, which enables highly efficient inference by activating only a small subset of the model's parameters at inference time. This enables it to outperform other general purpose embedders of its size on the multilingual MMTEB benchmark, as shown below:

Note that we use $/1M Tokens as a proxy for model size, as some models do not report their size publicly. Further, we also only report publicly available metrics from the MMTEB leaderboard, as some private models do not report all MMTEB subscores.

Nomic Embed v2 also achieves SOTA performance on the MIRACL benchmark, outperforming much larger models including Voyage-3-Large and OpenAI Text Embedding 3 Large.

Note that OpenAI does not report their MIRACL subscores, so we only report their average score.

Nomic Embed v2's size makes it ideal for retrieve-rerank workflows, where a small model surfaces a candidate pool which is reordered by a larger, more expensive model.

For a full breakdown of the model, see the Nomic Embed v2 paper or blog post. To use the model, see the Nomic Embed v2 Hugging Face model page.

Nomic Embed Multimodal

Nomic Embed Multimodal is a state-of-the-art multimodal embedder that supports interleaved text and image inputs, including rich visual documents like PDFs, slides, and Arxiv papers, for accurate multimodal retrieval. Nomic Embed Multimodal achieves SOTA performance on the Vidore v1 and v2 Benchmark.

Nomic Embed Code

Nomic Embed Code is a 7B parameter code embedding model optimized for code search that achieves state-of-the-art performance on the CodeSearchNet (CSN) benchmark. The Nomic Embed Code ecosystem also includes Nomic CodeRankEmbed-137M, a highly efficient code embedding model that achieves SOTA performance on the CSN benchmark for size. Nomic Embed Code can be used as a standalone model, or paired with Nomic CodeRankEmbedr-137M in a retrieve-rerank workflow.

Nomic Embed Text v1.5

As of the time of this writing, Nomic Embed v1.5 is the most popular open source embedder on Hugging Face, having been downloaded over 35 million times.

It's easy to see why - Nomic Embed Text v1.5 outperforms the industry standard OpenAI Embeddings on the MTEB benchmark, and at only 137M parameters, it's incredibly easy to scale to massive text collections. Its compact size also makes it ideal for locally running applications - a full precision Nomic Embed v1.5 clocks in at over 100qps on a standard M2 MacBook. Nomic Embed Text v1.5 also supports two efficient storage formats: Matryoshka and Binary.

When combined, Nomic Embed's local inference and binary storage capabilities enable a powerful workflow we call Retrieve-Rerank with Local Embedding Models, which reduces vector storage costs by up to 100x with virtually no loss in downstream performance. We illustrate this binary retrieve-rerank in the figure below:

In the chart above, average precision measures how closely the documents surfaced by retrieve-rerank match a full precision retrieval. From this chart, we can see that the performance of binary retrieve-rerank workflow is virtually identical to the performance of the full precision retrieval.

Moreover, Nomic Embed Text v1.5 can be paired with other powerful rerankers to achieve powerful retrieval performance at a fraction of the cost. For example, Nomic Embed Text v1.5 paired with Voyage-3-Large achieves SOTA performance on the MicroBEIR benchmark at a fraction of the cost of other methods.

For a full breakdown of the model, see the Nomic Embed Text paper or blog post. To use the model, see the Nomic Embed v1.5 Hugging Face model page.

Nomic Embed Vision v1.5

Nomic Embed Vision v1.5 is a vision embedder that is aligned to the Nomic Embed Text v1.5 latent space. This enables the Nomic Embed 1.5 latent space to achieve strong performance across text, image, and mixed modality search. This stands in contrast to most CLIP style models, which sacrifice performance on text search to achieve strong performance on image search.

For a full breakdown of the model, see the Nomic Embed Vision v1.5 paper or blog post. To use the model, see the Nomic Embed v1.5 Hugging Face model page.

Conclusion

In this post, we've explored the Nomic embedding ecosystem - a collection of truly open source state-of-the-art models for text, vision, and code embedding applications. From the powerful multilingual Nomic Embed v2, to the widely-adopted Nomic Embed Text v1.5, to specialized models like Nomic Embed Vision and Nomic Embed Code, each model is designed to excel at specific tasks while remaining efficient and accessible. These models demonstrate that it's possible to achieve industry-leading performance while maintaining open access to weights, data, and code.