ZeroDownTime
/
streamlogs2fluentd
3
0
Fork 0
Code Issues Pull Requests 1 Releases Wiki Activity
Lambda function to parse and forward log events from various AWS sources to Fluentd
17 Commits 2 Branches 10 Tags 72 KiB
Python 96.2%
Makefile 3.8%
Go to file
Stefan Reimer ce57cf70f4
continuous-integration/drone/push Build encountered an error Details
Introduce shorter timeouts for AWS API calls to fail fast and prevent cost explosions due to high log volume 		2020-01-04 16:11:52 +00:00
tests Fix for ALB access log parser, improved vpc flowlog augmentation 2019-07-28 11:34:05 +00:00
.drone.yml First public commit incl. Drone integration 2019-05-08 11:51:48 +00:00
.gitignore First public commit incl. Drone integration 2019-05-08 11:51:48 +00:00
CHANGES.md Introduce shorter timeouts for AWS API calls to fail fast and prevent cost explosions due to high log volume 2020-01-04 16:11:52 +00:00
LICENSE.md First public commit incl. Drone integration 2019-05-08 11:51:48 +00:00
Makefile Add us-west-1 to supported regions 2019-06-24 12:06:35 +00:00
README.md First public commit incl. Drone integration 2019-05-08 11:51:48 +00:00
dev-requirements.txt First public commit incl. Drone integration 2019-05-08 11:51:48 +00:00
index.py Introduce shorter timeouts for AWS API calls to fail fast and prevent cost explosions due to high log volume 2020-01-04 16:11:52 +00:00
requirements.txt First public commit incl. Drone integration 2019-05-08 11:51:48 +00:00

README.md

Build Status

streamlogs2fluentd

About

Lambda function to parse and forward log events from various AWS sources to Fluentd.

Features

  • sends events to upstream fluentd encoded as msg_pack to a http_in endpoint
  • sends events in chunks up to 128 events

Example Fluentd endpoint config:

<source>
  @type http
</source>

Available parsers

CloudWatch Logs

Lambda

Cloudtrail

RDS metrics

S3

Cloudfront Access Logs

ALB Access Logs