CAP LLM Plugin

CAP LLM Plugin helps developers create tailored Generative AI based CAP applications:

1. Without exposing confidential data to LLM by anonymizing sensitive data leveraging SAP HANA Cloud Data Anonymization.
2. Seamlessly generate vector embeddings via SAP AI Core.
3. Easily retrieve Chat Completion response via SAP AI Core.
4. Efforlessly perform similarity search via SAP HANA Cloud Vector engine.
5. Simplified single RAG (retrieval-augmented generation) retrieval method powered by SAP AI Core and SAP HANA Cloud Vector Engine.

✔️ Anonymization Features

Feature	Details
Seamlessly anonymize sensitive data using a variety of SAP HANA Cloud's anonymization capabilities	Effortlessly anonymize sensitive data within a CAP application by employing a single @anonymize annotation using a diverse range of SAP HANA Cloud's anonymization algorithms, including but not limited to: k-Anonymity l-Diversity Differential Privacy
Effortlessly replace the anonymized data within the LLM response with genuine information	Given that the data provided to the LLM consists of anonymized information, the CAP LLM plugin ensures a seamless replacement of anonymized content within the LLM response with the corresponding authentic data.

🎯 LLM Access Layer Features

Feature	Details
Embedding generation via SAP AI Core	Easily connect to embedding models via SAP AI Core and generate embeddings seamlessly
Similarity search	Leverage the SAP HANA Cloud's Vector engine to perform similarity search via CAP LLM Plugin
Chat LLM Access via SAP AI Core	Simple access to LLM models via SAP AI Core with simplified method for chat completion
Streamlining RAG retrieval	Single method to streamline the entire RAG retrieval process leveraging SAP AI Core and SAP HANA Cloud Vector Engine

📚 Samples and documentation

For API documentation for the CAP LLM plugin, check api-documentation.md under folder docs.

For how to use Anonymization with CAP LLM plugin, check anonymization-usage.md under folder docs.

For sample use cases leveraging CAP LLM Plugin, refer to SAP Samples.

🙌 Support and Contact

This project is provided "as-is" with no expectation for major changes or support.