TechnologySeptember 23, 2024

Glean and DataStax Partner to Help Developers Harness Powerful Enterprise Search

Glean and DataStax Partner to Help Developers Harness Powerful Enterprise Search

Glean and DataStax are pleased to announce a collaboration that will empower developers to build generative AI applications with ease and efficiency. This partnership  enables developers to combine these best-in-class tools to harness the power of advanced search capabilities and robust database solutions.

The DataStax Langflow Glean Component: Enhancing AI-driven workflows

The DataStax Langflow Glean Component is a tool designed to enhance Langflow agent flows. It enables developers to seamlessly integrate the Glean Work AI platform within their Langflow implementations, tapping into Glean's powerful retrieval capabilities to enrich the context of their operations and drive more informed decision-making processes. Users can take advantage of Glean’s native integrations with Google, Slack, and over 100 connectors to the world’s most-used applications. 

For GenAI practitioners using Langflow in their projects, the Glean Search API component represents an exciting new addition to their toolkit. By incorporating Glean into their Langflow implementations, developers can enhance their AI-driven workflows, making them more efficient, context-aware, and capable of delivering superior results. Because Glean can perform an aggregated search across multiple document and data repositories, it opens up new use cases for agentic workflows. 

For example, a Langflow developer could quickly build a flow for a new-hire onboarding agent. The agent could leverage the Search API to query the corporate knowledge base, provide basic information about corporate policies around vacation, and then offer to take further action in the HR system to submit a PTO request. Langflow promotes an iterative development experience where developers can rapidly experiment with different prompts, agent frameworks, LLMs, and connectors.

Seamless interoperability: A new era of data utilization

One of the most significant advantages of this partnership is the seamless interoperability it offers between DataStax and Glean solutions. Developers can now easily transfer and use data between the two platforms, whether they're pulling information from Astra DB into Glean for advanced search and insights or integrating Glean's retrieval capabilities into their DataStax workflows. This interoperability streamlines the development process, allowing for more efficient and effective creation of GenAI applications.

Bridging the gap between data and insights

At DataStax, we’re proud to use Glean daily. With Glean's comprehensive connectors, we integrated and aggregated data from multiple sources, such as Slack, Google Docs, our websites, and our issue management system.

Like most companies, we also have specialized tools, such as middleware with custom settings or even completely custom applications we own. In scenarios where Glean doesn't provide an out-of-the-box connector, we can leverage the Glean Indexing API to create our own data sources.

We first implemented a batch process to push our sales meeting minutes (we call them “TILs”: Things I Learned) into our Glean instance. This enables us to correlate customer and prospect requirements with most of the documents in our information system.

Indexing raw text data from Astra DB

The data you’re interested in may already be structured and stored in Astra DB. For that reason, we wanted to provide Astra DB users with a way to push their information to Glean using the Glean Indexing API. This enables Glean’s Chat assistant to provide a natural language query interface into Astra DB. Here’s an example. Using one of our standard Astra DB data sets, we created a database populated with philosopher quotes. We then indexed this data with the Glean Indexing API and exposed it to our internal Glean users. Anyone could then ask questions against the data set.

To check the accuracy of the chat assistant’s response we ran a similar query against the collection in Astra DB’s Data Explorer and validated the passage that was returned from Glean Chat.

While it’s more common to use Glean to index and search document repositories, we found that even for more structured data that’s stored in a database like Astra DB, Glean enables more types of users to access database data and ask interesting questions through a simple chat interface. 

You can learn more about the component here, and you can try this yourself with Google Colab. Use this documentation with a notebook and a standalone script, to learn how to move your data and use it in Glean Chat.

Sign up today

Begin exploring how these tools can transform your data-driven projects and elevate your GenAI applications to new heights—register for Astra DB and Glean today.

 

Discover more
Langflow
Share

One-Stop Data API for Production GenAI

Astra DB gives developers a complete data API and out-of-the-box integrations that make it easier to build production RAG apps with high relevancy and low latency.