Commit Graph

175 Commits

Author SHA1 Message Date
32e12eaeb2 chore: fluent-bit,fluentd chart updates 2021-08-27 12:14:46 +02:00
448e768d53 fix: various minor tweaks and updates 2021-08-25 16:02:21 +02:00
ed6302f900 feat: add temp filter for fluent-bit multiline noise to fluentd 2021-08-12 21:47:26 +02:00
d8ec82a35d feat: update ES and fluent-bit versions, bugfixes 2021-08-03 13:44:38 +02:00
77862a16ab chore: bump logging chart version 2021-07-29 14:23:07 +02:00
7f9027c754 fix: logging fluent-bit tag version 2021-07-29 13:58:22 +02:00
0a649e659f Fix: revert logging test image 2021-07-29 13:53:40 +02:00
be2d903c26 feat: relase metrics update to fix new apiserver metrics in 1.20 amongst others 2021-07-29 13:50:16 +02:00
4cbdedc7eb fix: prepare for fluent-bit multiline support, still broken though, minor tuning 2021-07-20 13:28:37 +02:00
df22fb072d fix: fix toleration 2021-07-19 16:38:32 +02:00
696bd67f6f Feat: add workergroup toleration to fluent-bit 2021-07-19 16:20:25 +02:00
e123b18f89 fix: update aws-efs driver 2021-07-15 01:26:25 +02:00
32d0095d3a fix: more fine tuning for fluent pipeline 2021-07-14 17:38:32 +02:00
e31c44481a chore: update docs 2021-07-01 16:42:39 +02:00
bab6c90185 feat: Version bump of all things kubezero-logging to tackle logging hickups 2021-06-30 12:32:37 +02:00
b378f7ffc3 fix: Switch fluentd ES to file buffer 2021-06-15 16:53:18 +02:00
260e4b88b3 chore: more logging tuning 2021-05-28 17:16:58 +02:00
94165efff3 chore: update helm-docs 2021-05-17 12:13:03 +02:00
d053b3484c fix: performance tuning for logging pipeline / fluentd 2021-05-17 12:04:46 +02:00
117ee6be49 fix: fix broken CRDs handling for ECK operator 2021-05-14 00:11:13 +02:00
567a7f94ff fix: bump eck operator to 1.5.0 as 1.4.1 could not upgrade ES due to license issues 2021-05-13 16:44:45 +02:00
21c9176cb7 fix: minor performance tuning for logging pipeline 2021-05-13 16:21:16 +02:00
fb95ba9024 chore: checkin diffs to sync desktop 2021-05-12 16:32:33 +02:00
9be889efed chore: update ES dashboard DS 2021-04-25 22:29:55 +02:00
8ddf39b383 feat: Add Grafana dashboards for logging 2021-04-25 22:19:06 +02:00
c912860b60 chore: fluent-bit version bump to fix excessive logging 2021-04-07 12:00:53 +02:00
eca69f8b5f Reduce fluent-bit memory consumption under backpressure 2021-03-26 10:56:17 +01:00
4d015cc4c6 Update chart READMEs 2021-03-25 16:32:49 +01:00
1018270620 Add nodeAffinity to all logging components, add resources to fluent-bit, tuning 2021-03-19 16:15:58 +01:00
64a0736dfd Bump ECK operator to 1.4.1 2021-03-11 09:00:47 +01:00
cde586a0df Reduce fluentd chunk size and increase retry timeout 2021-03-10 10:44:51 +01:00
22a1e8d171 Update fluentd.patch for helm chart 2021-03-10 10:34:17 +01:00
e666d1079a Upgrade fluentd to use new upstream helm and image 2021-03-10 10:32:12 +01:00
0d6d22b0d4 Disable metadata via kubelet for now 2021-03-09 10:33:40 +01:00
9dc2881f15 Remove unnecessary docker mount 2021-03-07 12:47:06 +01:00
05b2edf089 Switch fluent-bit to use kubelet rather than kube-api 2021-03-07 12:38:53 +01:00
50ffcf28eb Version upgrade ES/Kibana and Fluentbit, various tunings 2021-03-05 16:53:02 +01:00
1218033166 Further tuning of fluentd throughput 2021-02-22 21:34:45 +01:00
7587564da0 Version bump for aws-ebs-csi and kiam, ES bugfix bump, fluentd tuning 2021-01-21 12:31:06 +00:00
a26b652690 Allow custom memory overwrites for ES cluster 2021-01-18 17:18:30 +00:00
fdcb6f7e6f Remove repositories to make argo happy 2020-12-17 12:24:12 -08:00
214bfec2a4 Remove repositories to make argo happy 2020-12-17 12:22:48 -08:00
38b2d56da9 Re-add fluentd chart until we migrate off 2020-12-17 12:17:19 -08:00
79dc6e9413 EBS driver version bump 2020-12-10 07:06:31 -08:00
3820858046 More logging tuning 2020-12-10 06:44:58 -08:00
89dc890c74 More logging tuning 2020-12-10 06:36:26 -08:00
a8314d4074 Lua fix fluent-bit 2020-12-08 07:15:00 -08:00
77a7ba2ed6 Integrare fluent-bit into logging to allow better config 2020-12-08 07:05:25 -08:00
5909fcd841 Fix empty CRDs, only deploy eck-operator if needed 2020-12-07 13:06:00 -08:00
835aae9df8 Re-enable geoip lookups 2020-12-07 04:33:33 -08:00
b30b41ab15 Disable CRDs from eck-operator defaults 2020-12-05 14:16:33 -08:00
2a56489273 ECK fixes for Kube 1.18, Redis cluster support incl. Enyoy proxy 2020-12-04 06:05:35 -08:00
2be387b87b ArgoCd naming fixes 2020-11-30 09:30:06 -08:00
052efd077c Latest fixes, fluent-bit version bump 2020-11-26 09:37:10 -08:00
c8a903110f More fixes now adding ArgoCD 2020-11-26 05:21:10 -08:00
5b317db251 Bug fixes and argo tweaks 2020-11-24 07:18:14 -08:00
cd24b9fa1a First try adding argoCD day 2 2020-11-24 06:44:57 -08:00
35b1570d18 Update of various components, new aroless bootstrap working 2020-11-21 04:24:57 -08:00
53b638da5e Update docs, bump argo-cd parallel jobs 2020-10-27 11:54:44 +00:00
4285db835d Typo 2020-10-07 09:11:22 -07:00
a951e7d9a0 New Lua function to nest entries into kube.<namespace>.* 2020-10-07 09:09:24 -07:00
cb3c6a93ba fluent-bit tag improvements 2020-10-05 17:27:58 -07:00
b0286ff858 Add some spaces 2020-10-05 09:03:47 -07:00
846d7d2d87 More logging fixes, try to decode json at the source 2020-10-05 09:01:50 -07:00
5854468f09 Derp 2020-10-05 04:09:03 -07:00
c556df65ff Updated helm-docs, fluentd SSL handled by Istio, ES&Istio tuning 2020-10-05 03:50:23 -07:00
4aeb23d8cc Disable borken json parsing for now 2020-10-02 14:46:07 -07:00
bbd6d25429 Disable borken json parsing for now 2020-10-02 14:41:40 -07:00
4cb3bd01c5 Minor fluent-bit tuning 2020-10-01 12:32:21 -07:00
84a80f3b97 Fluentd tuning 2020-10-01 10:14:04 -07:00
ea2391a212 Fluentd tuning 2020-10-01 10:11:48 -07:00
fad0597302 Disable pipeline still cpu issues 2020-09-28 04:54:47 -07:00
8de44f18d4 Reenable fluentd ingest pipeline again 2020-09-28 04:45:39 -07:00
0939405c7a Logging fixes for NOT using nameoverride 2020-09-18 16:12:52 +01:00
2c600c2fd0 Slightly allow ArgoCD a bit more processing 2020-09-18 14:21:39 +01:00
d61752703e Revert TCP keepalive for fluentd listener 2020-09-17 19:44:34 +01:00
bcf8093b84 Enable TCP keepalive for fluentd listener 2020-09-17 19:24:24 +01:00
93723e6a6a Docs update 2020-09-14 17:26:39 +01:00
c9a5691acf fluent-bit version bump 2020-09-14 17:26:19 +01:00
2577ba826c Fix math in resources calc 2020-09-11 11:07:49 +01:00
0c6f4d06e3 Make ES heap configurable, set resources accordingly 2020-09-11 11:00:51 +01:00
7c08700e71 Change log tag for audit log to not collide with regular tags 2020-09-09 20:59:03 +01:00
862fb4be9d Calico version bump to 3.16.1 2020-09-09 14:17:02 +01:00
777fe64f01 Dont remove other fields for valid json 2020-09-08 15:41:20 +01:00
8217fdd623 Fix fluentd parsing of json 2020-09-08 15:34:16 +01:00
75002ce2eb Fix fluentd typo 2020-09-08 15:07:17 +01:00
b49a864cbb Update fluentd to latest quay.io image, add json parser for message 2020-09-08 15:05:31 +01:00
1546415746 Remove CRD property to fix OutofSync Argo 2020-09-08 13:44:31 +01:00
6be2f0697f Handle empty message events 2020-09-08 13:40:09 +01:00
d04e7fa0f1 Add Lua functions to reassemble partial cri-o logs 2020-09-08 13:12:21 +01:00
48045d7afc Fluent-bit version bump and support for api audit logs 2020-09-08 12:40:28 +01:00
88725c33be Move scrape username to its own secret as eck operator cleans up otherwise 2020-09-04 01:13:39 +01:00
1fec29b05f More fluentd tuning 2020-08-27 01:13:34 +01:00
28e3ce4f8e Disable ingest pipeline until we know what breaks / jams in ES 2020-08-27 01:03:35 +01:00
3e55e27bf1 Revert ES fixes as servicemonitor is retarted 2020-08-26 23:02:47 +01:00
51d9dc48fc Hardcode es user for now 2020-08-26 22:50:51 +01:00
8b82972d06 fluentd / ES fixes 2020-08-26 18:13:21 +01:00
6adcddf4d6 Revert default fluentd image, latest has issues 2020-08-24 11:38:47 +01:00
1f0d7fae29 Increase default read-timeout for fluentd 2020-08-23 17:47:28 +01:00
6a34a198f4 Use quay.io fluentd-es image until we roll our own 2020-08-23 17:41:37 +01:00