At Skypoint, we have a strict SLA of five seconds to generate responses for our frontline healthcare providers," Mathew said. "Hitting this SLA is especially difficult in the scenario that there are multiple LLM and vector search queries. Being able to shave off time from generating embeddings is of vast importance to improving the user experience."
NVIDIA and DataStax
Enterprise RAG with NVIDIA and DataStax
Astra DB integrates the NVIDIA GenAI framework to bring developers faster embeddings for Enterprise RAG (retrieval-augmented generation) in an easy-to-use API.
Why Astra DB and NVIDIA?
GenAI end-users expect fast responses without perceptible latency. To deliver this, developers need high-performance vector embeddings generation and indexing for Enterprise data.
Astra DB directly integrates NVIDIA's framework so that developers can create high-performance embeddings directly with an easy to use Data API for more responsive RAG (retrieval-augmented generation) applications.
This means developers and companies can provide better GenAI experiences to end-users with higher performance and lower TCO (total cost of ownership).
20x Faster Embedding and Indexing
9x Throughput
74x Faster Response Time*
80% Lower TCO*
*Based on findings from Dec 2023 GigaOm Report: Vector Databases Compared v1.0
Trusted by
Get Started with Astra DB, RAGStack and NVIDIA
Astra DB + NVIDIA
Developers can use NVIDIA to create high performance vector embeddings directly through the Astra DB Data API.
Vectorize with NVIDIA
RAGStack for NVIDIA
DataStax RAGSTack, a supported, one-stop generative AI stack for developers integrates NVIDIA.
Use NVIDIA with RAGStackFAQ
What is Astra DB?
DataStax Astra DB is a cloud-native, scalable Database-as-a-Service built on Apache Cassandra. Vector search capabilities enable complex, context-sensitive searches across diverse data formats for use in generative AI applications.
Can I use Astra DB with NVIDIA?
Yes, there is an integration between Astra DB and NVIDIA that enables developers to create vector embeddings with NVIDIA through the Astra DB Data API to deliver high-performance, retrieval-augmented data solutions.
How do I run Astra DB on NVIDIA?
Generate vector embeddings with one line of code using DataStax Astra DB and NVIDIA's microservices. Integrate these services using RAGStack in your development environment, which is powered by LangChain and LlamaIndex for out-of-the-box integration. This setup allows you to leverage the fast vector search capabilities provided by the partnership for your GenAI projects.
Is Astra DB free on NVIDIA?
Astra DB has a free tier that’s ideal for trying out the service as you get started. Beyond the free tier, you’re only billed for what you use. You can get started with NVIDIA and Astra DB here.
What benefits does the partnership between DataStax and NVIDIA offer for GenAI applications?
The partnership between DataStax and NVIDIA offers several benefits for GenAI applications, including drastically reduced latency in generating vector embeddings and indexing documents, higher throughput, and significantly lower operational costs.