We've been busy at Compose making our database Add-on's do more for you, and we're happy to announce we've got a new Add-on view and a new Telegraf Add-on for Datadog.
A View for the Future
Let's start with the new Add-on view. We have more add-on's coming and we noted the Addon page was becoming somewhat long. So, the new Add-on view looks like this:
If an Add-on is available, but not configured, there'll be a Add button next to it. Click it and you'll be presented with the details of the Add-on, any parameters you need to set it up and a button to confirm adding that Add-on. If you don't want to add that Add-on, just click back in your browser.
If the Add-on is configured and running, there'll be a Configure button next to it. Click that and you'll see details of how it is currently configured; some details will be obscured and revealed only if you click a Show link. There'll also be a button allowing you to remove the Add-on completely. If you want to make configuration changes, remove the Add-on and create a new instance of it. And if you were just looking, just click on your browsers back button to get back to the Add-on menu.
The Telegraf Add-on
We're mentioning the new view because it has a new entry, the Telegraf Add-on which is available to users of MongoDB, Elasticsearch, PostgreSQL, Redis, RethinkDB and RabbitMQ.
Telegraf is a package for collecting metrics from numerous sources and delivering them to one or more metric consuming systems. Telegraf collects those metrics using plugin inputs; each one customised to the target system. The input plugin list is big and ranges from databases to dns, from proxies to systems, and from sensors to filesystems. These generate metrics are then delivered to another plugin set, the outputs, which can connect to other services, write to file or record events in whatever way needed ready for further analysis. The output plugin list is a little shorter.
As we're focussed on the practical application of technology at Compose, we've taken Telegraf and created configurations for it which plug into the various databases we have available. We've given these configurations one output, the DataDog performance monitoring platform so you can slice and dice your metrics there.
You'll need to create a DataDog account and that means you will also have to set up a single agent (that isn't Compose) to initialise the account. We suggest you configure a desktop agent for Mac OS X or Windows not only because these are easiest to turn off but also give you a quick way to confirm your account is working and to create some monitoring on your system where you should know exactly whats going on.
Once you've got familiar with Datadog, on it's main menu is an option for Integrations. Click that and the select APIs. Create a new API key and copy the key value. You are now ready to add the Compose add-on.
Go to the Compose web console, log in and select your database. Select Add-ons in the sidebar and then Add on the Telegraf Add-on.
Paste the API key into the text field and click Add Telegraf Add-on. That's all you'll need to do. The Add-on will be configured and start sending data immediately to DataDog. If you return to DataDog you can start configuring new dashboards and monitoring to explore the new source of data. DataDog adds new incoming data fields to its autocomplete/dropdown menus automatically.
The data generated by the input plugins varies by database. There's details for Elasticsearch, Redis and PostgreSQL in those plugin's Readme files. For MongoDB, RethinkDB and RabbitMQ don't currently have explicit README information on their metrics, but a glance at the Go code will show what each gathers. As we said though, the actual names are populated in DataDog's menus so you can just pick and choose metrics that interest you... DataDog makes it easy to play with the graphs so...
You can start simple and build up to a complex visualization. The Telegraf Add-on is priced at $9/month per deployment. If you don't have a Compose account, the Telegraf Add-on, like all Compose databases and Add-ons, is available at no cost as part of our free 30 day trial of Compose.