At Skypoint, we have a strict SLA of five seconds to generate responses for our frontline healthcare providers," Mathew said. "Hitting this SLA is especially difficult in the scenario that there are multiple LLM and vector search queries. Being able to shave off time from generating embeddings is of vast importance to improving the user experience."
DataStax and NVIDIA
The Complete Enterprise Solution
The DataStax AI Platform, built with NVIDIA AI gives enterprises a complete solution for all parts of the AI development and production lifecycle - from data ingestion to application deployment.
Why Astra DB and NVIDIA?
GenAI end-users expect fast responses without perceptible latency. To deliver this, developers need high-performance vector embeddings generation and indexing for Enterprise data.
Astra DB directly integrates NVIDIA's framework so that developers can create high-performance embeddings directly with an easy to use Data API for more responsive RAG (retrieval-augmented generation) applications.
This means developers and companies can provide better GenAI experiences to end-users with higher performance and lower TCO (total cost of ownership).
20x Faster Embedding and Indexing
9x Throughput
74x Faster Response Time*
80% Lower TCO*
*Based on findings from Dec 2023 GigaOm Report: Vector Databases Compared v1.0
Trusted by
Get Started with Astra DB and NVIDIA
DataStax AI Platform, Built with NVIDIA AI
Orchestrate all parts of the AI development and production lifecycle: from data ingestion through development to deployment and beyond, built for enterprises.
Learn More
Astra DB + NVIDIA
Developers can use NVIDIA to create high performance vector embeddings directly through the Astra DB Data API.
Vectorize with NVIDIA
Langflow for NVIDIA
DataStax Langflow is the application development environment that simplifies creating and understanding complex logic flows via an intuitive visual interface.
Use NVIDIA with LangflowFAQ
What is Astra DB?
DataStax Astra DB is a cloud-native, scalable Database-as-a-Service built on Apache Cassandra. Vector search capabilities enable complex, context-sensitive searches across diverse data formats for use in generative AI applications.
Can I use Astra DB with NVIDIA?
Yes, there is an integration between Astra DB and NVIDIA that enables developers to create vector embeddings with NVIDIA through the Astra DB Data API to deliver high-performance, retrieval-augmented data solutions.
How do I run Astra DB on NVIDIA?
Generate vector embeddings with one line of code using DataStax Astra DB and NVIDIA's microservices. Integrate these services using RAGStack in your development environment, which is powered by LangChain and LlamaIndex for out-of-the-box integration. This setup allows you to leverage the fast vector search capabilities provided by the partnership for your GenAI projects.
Is Astra DB free on NVIDIA?
Astra DB has a free tier that’s ideal for trying out the service as you get started. Beyond the free tier, you’re only billed for what you use. You can get started with NVIDIA and Astra DB here.
What benefits does the partnership between DataStax and NVIDIA offer for GenAI applications?
The partnership between DataStax and NVIDIA offers several benefits for GenAI applications, including drastically reduced latency in generating vector embeddings and indexing documents, higher throughput, and significantly lower operational costs.