Sin descripción
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Vladimir Smirnov ce5d84c03a Update changelog for 0.12.3 hace 1 semana
cache remove memcache support hace 2 años
carbonapipb Add support for headersToLog hace 2 semanas
cmd Functions: make aliasSub graphite-compatible hace 1 semana
contrib Better versioning for autobuilds for RPM-based distros hace 3 semanas
date Remove unnecessary type casts hace 1 año
doc Prometheus backend: fix handling of value lists hace 1 semana
expr Functions: make aliasSub graphite-compatible hace 1 semana
internal Update generateFuncs code hace 5 meses
intervalset Remove unnecessary type casts hace 1 año
limiter gofmt everything hace 2 semanas
mstats mstats: add TotalAlloc hace 3 años
pathcache Broadcast group shouldn't get stuck anymore hace 4 semanas
pkg/parser Remove debug prints hace 2 semanas
scripts Add function "aggregate" (WIP) hace 3 semanas
tests gofmt everything hace 2 semanas
util/ctx Add support for headersToLog hace 2 semanas
vendor Commit vendored dependency required for cairo build hace 4 semanas
zipper Prometheus backend: add special case to handle request for '*' hace 1 semana
.codacy.yaml Adding codacy config file for better control of codacy checks. (#266) hace 1 año
.gitignore Remove carbonzipper dependency from carbonapi hace 1 año
.travis.yml Update travis yaml and Readme hace 3 semanas
BUILD.md Move `.md` files from cmd/carbonapi to root folder hace 5 meses
CHANGES.md Update changelog for 0.12.3 hace 1 semana
COMPATIBILITY.md Update COMPATIBILITY list hace 2 semanas
Dockerfile Adding Dockerfile for automated build hace 5 meses
LICENSE Initial tests for BroadcastGroup hace 1 año
Makefile Commit vendored dependency required for cairo build hace 4 semanas
README.md Update travis yaml and Readme hace 3 semanas
go.mod Fix panic when unsupported UnicodeRangeTable is specified in config hace 3 semanas
go.sum Commit vendored dependency required for cairo build hace 4 semanas

README.md

carbonapi: replacement graphite API server

Build Status GoDoc PR Stats Issues Stats

We are using to host our packages!

CarbonAPI supports a significant subset of graphite functions [see COMPATIBILITY]. In our testing it has shown to be 5x-10x faster than requesting data from graphite-web.

For requirements see Requirements section below.

Installation

At this moment we are building packages for CentOS 6, CentOS 7, Ubuntu 14.04 and Ubuntu 16.04. Installation guides are available on packagecloud (see the links below).

Stable versions: Stable repo

Autobuilds (master, might be unstable): Autobuild repo

General information

Carbonapi can be configured by environment variables or by config file. For an example see carbonapi.example.yaml

$ ./carbonapi -config /etc/carbonapi.yaml

Request metrics will be dumped to graphite if coresponding config options are set, or if the GRAPHITEHOST/GRAPHITEPORT environment variables are found.

Request data will be stored in memory (default) or in memcache.

Configuration is described in docs

Configuration by environment variables

Every parameter in config file are mapped to environment variable. I.E.

concurency: 20
cache:
   # Type of caching. Valid: "mem", "memcache", "null"
   type: "mem"
upstreams:
    backends:
        - "http://10.0.0.1:8080"
        - "http://10.0.0.2:8080"

That config can be replaced by

CARBONAPI_CONCURENCY=20
CARBONAPI_CACHE_TYPE=mem
CARBONAPI_UPSTREAMS_BACKENDS="http://10.0.0.1:8080 http://10.0.0.2:8080"

You should be only aware of logging: because carbonapi support a list of logger, env variables will replace only first logger.

If you apply variable LOGGER_FILE=stdout to config:

logger:
    - logger: ""
      file: "stderr"
      level: "debug"
      encoding: "console"
      encodingTime: "iso8601"
      encodingDuration: "seconds"
    - logger: ""
      file: "carbonapi.log"
      level: "info"
      encoding: "json"

it will be equal to config:

logger:
    - logger: ""
      file: "stdout" # Changed only here
      level: "debug"
      encoding: "console"
      encodingTime: "iso8601"
      encodingDuration: "seconds"
    - logger: ""
      file: "carbonapi.log" # Not changed
      level: "info"
      encoding: "json"

Supported protocols

  • auto - carbonapi will do it’s best to determine backend’s protocol. Currently it can identify only carbonapi_v2_pb or carbonapi_v3_pb
  • carbonapi_v2_pb, pb, pb3, protobuf - carbonapi <0.11 style protocol. Supported by go-carbon, graphite-clickhouse
  • carbonapi_v3_pb - new carbonapi protocol, that supports passing metadata through. Supported by carbonzipper >=1.0.0.alpha.3. Implementing support for that is in-progress for go-carbon
  • carbonapi_v3_grpc - grpc version of new carbonapi protocol. Currently no known implementation exists.
  • msgpack - messagepack based protocol, used in graphite-web 1.1 and metrictank. It’s still experimental and might contain bugs.
  • prometheus - prometheus HTTP API

Requirements

You need to have Go >= 1.11 to build carbonapi from sources. Building with Go 1.10 or earlier is not supported since 0.11.0

CarbonAPI uses protobuf-based protocol to talk with underlying storages. For current version the compatibility list is:

  1. go-carbon >= 0.9.0 (Note: you need to enable carbonserver in go-carbon). Recommended to run latest version, that currently supports carbonapi_v3_pb
  2. graphite-clickhouse any. That’s alternative storage that doesn’t use Whisper.
  3. metrictank - supported via msgpack protocol. Support is not very well tested and might contain bugs. Use with cautions. Tags are not supported.
  4. carbonapi >= 0.5. Note: starting from carbonapi 3596e96476 (post 0.8) carbonapi can be used as a zipper’s replacement
  5. carbonserver@master (Note: you should probably switch to go-carbon in that case).
  6. carbonzipper >= 0.50. Please note, carbonzipper functionality was merged to carbonapi and it’s no longer needed to run separate zipper. Current version of carbonzipper can be build from cmd/carbonzipper

Some remarks on different backends

For backends that uses proper database (e.x. graphite-clickhouse) you should set maxGlobs: 0 in your config file for this backend group.

For other backends (e.x. go-carbon) you should set it to some reasonable value. It increases response speed, but the cost is increased memory consumption.

Tag support was only tested with graphite-clickhouse, however it should work with any other database.

OSX Build Notes

Some additional steps may be needed to build carbonapi with cairo rendering on MacOSX.

Install cairo:

$ brew install Caskroom/cask/xquartz

$ brew install cairo --with-x11

Acknowledgement

This program was originally developed for Booking.com. With approval from Booking.com, the code was generalised and published as Open Source on github, for which the author would like to express his gratitude.

Booking.com’s Fork

In summer 2018, Booking.com forked version 0.11 of carbonapi and continued development in their own repo: github.com/bookingcom/carbonapi.

License

This code is licensed under the BSD-2 license.