Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Robust Intelligence AI Firewall integration tile #2122

Merged
merged 25 commits into from
Nov 13, 2023
Merged
Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions robust_intelligence_ai_firewall/CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
# CHANGELOG - Robust Intelligence AI Firewall

## 1.0.0 / 2023-09-22

***Added***:

* Initial Release
* Collect and display metrics for the rules flagged and allowed by the Firewall
76 changes: 76 additions & 0 deletions robust_intelligence_ai_firewall/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,76 @@
# Agent Check: Robust Intelligence AI Firewall

## Overview

The [Robust Intelligence AI Firewall][1] is a protective layer for AI models.

The AI Firewall inspects incoming user prompts to block malicious payloads, including any that attempt prompt injection, prompt extraction, or PII detection. The AI Firewall scans LLM model output to ensure it's free of false information, sensitive data, and harmful content. Responses that fall outside your organization’s standards are blocked from the application.

This integration monitors the AI Firewall results through the Datadog Agent. It provides users with observability of their AI security issues. This includes metrics for allowed data points and blocked data points, as well as why each data point was blocked.
MayankR marked this conversation as resolved.
Show resolved Hide resolved

## Setup

Follow the instructions below to install and configure this check for an Agent running on a host. For containerized environments, see the [Autodiscovery Integration Templates][3] for guidance on applying these instructions.

### Installation

For Agent v7.21+ / v6.21+, follow the instructions below to install the Robust Intelligence AI Firewall check on your host. See [Use Community Integrations][2] to install with the Docker Agent or earlier versions of the Agent.

1. Run the following command to install the Agent integration:

```shell
datadog-agent integration install -t datadog-robust-intelligence-ai-firewall==1.0.0
```

2. Configure your integration similar to core [integrations][3].
emarsha94 marked this conversation as resolved.
Show resolved Hide resolved

### Configuration

1. Edit the `robust_intelligence_ai_firewall.d/conf.yaml` file, in the `conf.d/` folder at the root of your Agent's configuration directory to start collecting your Robust Intelligence AI Firewall performance data.
emarsha94 marked this conversation as resolved.
Show resolved Hide resolved
```yaml
init_config:

instances:
## @param metrics_endpoint - string - required
## The URL to Robust Intelligence AI Firewall
## internal metrics per loaded plugin in Prometheus
## format.
#
- metrics_endpoint: http://localhost:8080/metrics
```
See the [sample robust_intelligence_ai_firewall.d/conf.yaml][4] file for all available configuration options.
anawishnoff marked this conversation as resolved.
Show resolved Hide resolved

2. [Restart the Agent][5].

### Validation

[Run the Agent's status subcommand][6] and look for `robust_intelligence_ai_firewall` under the Checks section.

## Data Collected

### Metrics

See [metadata.csv][7] for a list of metrics provided by this check.

### Service Checks

Robust Intelligence AI Firewall does not include any service checks.

### Events

Robust Intelligence AI Firewall does not include any events.

## Troubleshooting

Need Help? Contact [Robust Intelligence Support][9].

[1]: https://www.robustintelligence.com/platform/ai-firewall
[2]: https://app.datadoghq.com/account/settings/agent/latest
[3]: https://docs.datadoghq.com/agent/kubernetes/integrations/
[4]: https://github.com/DataDog/integrations-extras/blob/master/robust_intelligence_ai_firewall/datadog_checks/robust_intelligence_ai_firewall/data/conf.yaml.example
[5]: https://docs.datadoghq.com/agent/guide/agent-commands/#start-stop-and-restart-the-agent
[6]: https://docs.datadoghq.com/agent/guide/agent-commands/#agent-status-and-information
[7]: https://github.com/DataDog/integrations-extras/blob/master/robust_intelligence_ai_firewall/metadata.csv
[8]: https://github.com/DataDog/integrations-extras/blob/master/robust_intelligence_ai_firewall/assets/service_checks.json
[9]: mailto:[email protected]

13 changes: 13 additions & 0 deletions robust_intelligence_ai_firewall/assets/configuration/spec.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
name: Robust Intelligence AI Firewall
files:
- name: robust_intelligence_ai_firewall.yaml
options:
- template: init_config
options:
- template: init_config/openmetrics
- template: instances
options:
- template: instances/openmetrics
options:
overrides:
openmetrics_endpoint.value.example: http://localhost:8080/metrics
Loading