Alerting Notifications

Alerting is only available in Grafana v4.0 and above.

When an alert changes state it sends out notifications. Each alert rule can have multiple notifications. But in order to add a notification to an alert rule you first need to add and configure a notification

channel (can be email, Pagerduty or other integration). This is done from the Notification Channels page.

Alerting Notification Channels

On the Notification Channels page hit the New Channel button to go the page where you can configure and setup a new Notification Channel.

Send on all alerts

Supported Notification Types

Email

Slack

To set up slack you need to configure an incoming webhook url at slack. You can follow their guide for how to do that https://api.slack.com/incoming-webhooks If you want to include screenshots of the firing alerts in the slack messages you have to configure either the external image destination in Grafana, or a bot integration via Slack Apps. Follow Slack’s guide to set up a bot integration and use the token provided https://api.slack.com/bot-users, which starts with “xoxb”.

To set up PagerDuty, all you have to do is to provide an api key.

The webhook notification is a simple way to send information about an state change over HTTP to a custom endpoint. Using this notification you could integrate Grafana into any system you choose, by yourself.

  • state – The possible values for alert state are: ok, paused, alerting, pending, no_data.

Instructions in Chinese.

  1. Click “more” icon on left bottom of the panel.

  2. Click “Robot Manage” item in the pop menu, there will be a new panel call “Robot Manage”.

  3. In the “Robot Manage” panel, select “customised: customised robot with Webhook”.

  4. In the next new panel named “robot detail”, click “Add” button.

  5. In “Add Robot” panel, input a nickname for the robot and select a “message group” which the robot will join in. click “next”.

  6. There will be a Webhook URL in the panel, looks like this: https://oapi.dingtalk.com/robot/send?access_token=xxxxxxxxx. Copy this URL to the grafana Dingtalk setting page and then click “finish”.

Kafka

  1. Kafka REST Proxy endpoint.

  2. Kafka Topic.

Other Supported Notification Channels

  • HipChat

  • VictorOps

  • Sensu

  • OpsGenie

  • Threema

  • Pushover

  • Telegram

  • LINE

Currently only the Email Channels attaches images if no external image store is specified. To include images in alert notifications for other channels then you need to set up an external image store.

All alert notifications contains a link back to the triggered alert in the Grafana instance. This url is based on the domain setting in Grafana.

Leave a Reply

Your email address will not be published. Required fields are marked *