Commit Graph

170 Commits

Author SHA1 Message Date
Stefan Reimer 8d923c5eea fix: logging fluent-bit tag version 2021-07-29 13:58:22 +02:00
Stefan Reimer f31f3635d2 Fix: revert logging test image 2021-07-29 13:53:40 +02:00
Stefan Reimer 154ede3314 feat: relase metrics update to fix new apiserver metrics in 1.20 amongst others 2021-07-29 13:50:16 +02:00
Stefan Reimer 99b42e2781 fix: prepare for fluent-bit multiline support, still broken though, minor tuning 2021-07-20 13:28:37 +02:00
Stefan Reimer 84b31c3ddc fix: fix toleration 2021-07-19 16:38:32 +02:00
Stefan Reimer b0de45d360 Feat: add workergroup toleration to fluent-bit 2021-07-19 16:20:25 +02:00
Stefan Reimer ed848a4ce4 fix: update aws-efs driver 2021-07-15 01:26:25 +02:00
Stefan Reimer 540f7be368 fix: more fine tuning for fluent pipeline 2021-07-14 17:38:32 +02:00
Stefan Reimer eab6f8253c chore: update docs 2021-07-01 16:42:39 +02:00
Stefan Reimer 08d3a940ec feat: Version bump of all things kubezero-logging to tackle logging hickups 2021-06-30 12:32:37 +02:00
Stefan Reimer a459525847 fix: Switch fluentd ES to file buffer 2021-06-15 16:53:18 +02:00
Stefan Reimer a67d1674e8 chore: more logging tuning 2021-05-28 17:16:58 +02:00
Stefan Reimer f00b6e163c chore: update helm-docs 2021-05-17 12:13:03 +02:00
Stefan Reimer cb35dea200 fix: performance tuning for logging pipeline / fluentd 2021-05-17 12:04:46 +02:00
Stefan Reimer 92729085c9 fix: fix broken CRDs handling for ECK operator 2021-05-14 00:11:13 +02:00
Stefan Reimer 8e75ebe300 fix: bump eck operator to 1.5.0 as 1.4.1 could not upgrade ES due to license issues 2021-05-13 16:44:45 +02:00
Stefan Reimer c614f216a7 fix: minor performance tuning for logging pipeline 2021-05-13 16:21:16 +02:00
Stefan Reimer 9a0a2602c8 chore: checkin diffs to sync desktop 2021-05-12 16:32:33 +02:00
Stefan Reimer b0b74aab66 chore: update ES dashboard DS 2021-04-25 22:29:55 +02:00
Stefan Reimer de7ed134f7 feat: Add Grafana dashboards for logging 2021-04-25 22:19:06 +02:00
Stefan Reimer ec94a3443b chore: fluent-bit version bump to fix excessive logging 2021-04-07 12:00:53 +02:00
Stefan Reimer fca96c0de5 Reduce fluent-bit memory consumption under backpressure 2021-03-26 10:56:17 +01:00
Stefan Reimer 45e21d48ff Update chart READMEs 2021-03-25 16:32:49 +01:00
Stefan Reimer d8994cead2 Add nodeAffinity to all logging components, add resources to fluent-bit, tuning 2021-03-19 16:15:58 +01:00
Stefan Reimer 4f71b6a6cf Bump ECK operator to 1.4.1 2021-03-11 09:00:47 +01:00
Stefan Reimer b070416e45 Reduce fluentd chunk size and increase retry timeout 2021-03-10 10:44:51 +01:00
Stefan Reimer 815a8b54f9 Update fluentd.patch for helm chart 2021-03-10 10:34:17 +01:00
Stefan Reimer 54fad23983 Upgrade fluentd to use new upstream helm and image 2021-03-10 10:32:12 +01:00
Stefan Reimer b0d0bc61b4 Disable metadata via kubelet for now 2021-03-09 10:33:40 +01:00
Stefan Reimer 46303eaff9 Remove unnecessary docker mount 2021-03-07 12:47:06 +01:00
Stefan Reimer 16998a5243 Switch fluent-bit to use kubelet rather than kube-api 2021-03-07 12:38:53 +01:00
Stefan Reimer 5d57cf5480 Version upgrade ES/Kibana and Fluentbit, various tunings 2021-03-05 16:53:02 +01:00
Stefan Reimer af010a2033 Further tuning of fluentd throughput 2021-02-22 21:34:45 +01:00
Stefan Reimer 77a20df965 Version bump for aws-ebs-csi and kiam, ES bugfix bump, fluentd tuning 2021-01-21 12:31:06 +00:00
Stefan Reimer a9d03f929f Allow custom memory overwrites for ES cluster 2021-01-18 17:18:30 +00:00
Stefan Reimer 34e9ec2b44 Remove repositories to make argo happy 2020-12-17 12:24:12 -08:00
Stefan Reimer c7d22dd631 Remove repositories to make argo happy 2020-12-17 12:22:48 -08:00
Stefan Reimer 57b143f1c9 Re-add fluentd chart until we migrate off 2020-12-17 12:17:19 -08:00
Stefan Reimer 89c21cb1fe EBS driver version bump 2020-12-10 07:06:31 -08:00
Stefan Reimer cd561228e7 More logging tuning 2020-12-10 06:44:58 -08:00
Stefan Reimer c2fb56a0d8 More logging tuning 2020-12-10 06:36:26 -08:00
Stefan Reimer f1a6e7a3e8 Lua fix fluent-bit 2020-12-08 07:15:00 -08:00
Stefan Reimer 6c7bd71e81 Integrare fluent-bit into logging to allow better config 2020-12-08 07:05:25 -08:00
Stefan Reimer 7998d93d17 Fix empty CRDs, only deploy eck-operator if needed 2020-12-07 13:06:00 -08:00
Stefan Reimer 99ceceda56 Re-enable geoip lookups 2020-12-07 04:33:33 -08:00
Stefan Reimer a6950196b4 Disable CRDs from eck-operator defaults 2020-12-05 14:16:33 -08:00
Stefan Reimer ed72dd796b ECK fixes for Kube 1.18, Redis cluster support incl. Enyoy proxy 2020-12-04 06:05:35 -08:00
Stefan Reimer 3497392c39 ArgoCd naming fixes 2020-11-30 09:30:06 -08:00
Stefan Reimer ca2d2763d3 Latest fixes, fluent-bit version bump 2020-11-26 09:37:10 -08:00
Stefan Reimer 74e07acf13 More fixes now adding ArgoCD 2020-11-26 05:21:10 -08:00
Stefan Reimer 486ea0fa56 Bug fixes and argo tweaks 2020-11-24 07:18:14 -08:00
Stefan Reimer 33bf724618 First try adding argoCD day 2 2020-11-24 06:44:57 -08:00
Stefan Reimer f711655c58 Update of various components, new aroless bootstrap working 2020-11-21 04:24:57 -08:00
Stefan Reimer 7c945fbac7 Update docs, bump argo-cd parallel jobs 2020-10-27 11:54:44 +00:00
Stefan Reimer 6975e79fec Typo 2020-10-07 09:11:22 -07:00
Stefan Reimer 9b4d49575b New Lua function to nest entries into kube.<namespace>.* 2020-10-07 09:09:24 -07:00
Stefan Reimer 694d1b79ca fluent-bit tag improvements 2020-10-05 17:27:58 -07:00
Stefan Reimer e32d258986 Add some spaces 2020-10-05 09:03:47 -07:00
Stefan Reimer bddafc142e More logging fixes, try to decode json at the source 2020-10-05 09:01:50 -07:00
Stefan Reimer 19769f97d4 Derp 2020-10-05 04:09:03 -07:00
Stefan Reimer 1429694e43 Updated helm-docs, fluentd SSL handled by Istio, ES&Istio tuning 2020-10-05 03:50:23 -07:00
Stefan Reimer 3f054a96ec Disable borken json parsing for now 2020-10-02 14:46:07 -07:00
Stefan Reimer a2ba9fa085 Disable borken json parsing for now 2020-10-02 14:41:40 -07:00
Stefan Reimer 2ee31f60e2 Minor fluent-bit tuning 2020-10-01 12:32:21 -07:00
Stefan Reimer c6ae3d2461 Fluentd tuning 2020-10-01 10:14:04 -07:00
Stefan Reimer 21c6b0ea58 Fluentd tuning 2020-10-01 10:11:48 -07:00
Stefan Reimer 6003765dc9 Disable pipeline still cpu issues 2020-09-28 04:54:47 -07:00
Stefan Reimer 0b50dbcfbe Reenable fluentd ingest pipeline again 2020-09-28 04:45:39 -07:00
Stefan Reimer 4a918f6d83 Logging fixes for NOT using nameoverride 2020-09-18 16:12:52 +01:00
Stefan Reimer f753a1fc71 Slightly allow ArgoCD a bit more processing 2020-09-18 14:21:39 +01:00
Stefan Reimer 182ae141a0 Revert TCP keepalive for fluentd listener 2020-09-17 19:44:34 +01:00
Stefan Reimer dd9e465ead Enable TCP keepalive for fluentd listener 2020-09-17 19:24:24 +01:00
Stefan Reimer 900863acae Docs update 2020-09-14 17:26:39 +01:00
Stefan Reimer ce5290591f fluent-bit version bump 2020-09-14 17:26:19 +01:00
Stefan Reimer d13fc9d519 Fix math in resources calc 2020-09-11 11:07:49 +01:00
Stefan Reimer e56d0661d6 Make ES heap configurable, set resources accordingly 2020-09-11 11:00:51 +01:00
Stefan Reimer c9b830f727 Change log tag for audit log to not collide with regular tags 2020-09-09 20:59:03 +01:00
Stefan Reimer 122cf5bd52 Calico version bump to 3.16.1 2020-09-09 14:17:02 +01:00
Stefan Reimer 9e043a6241 Dont remove other fields for valid json 2020-09-08 15:41:20 +01:00
Stefan Reimer da503ab38c Fix fluentd parsing of json 2020-09-08 15:34:16 +01:00
Stefan Reimer a1af1a2753 Fix fluentd typo 2020-09-08 15:07:17 +01:00
Stefan Reimer 3b438711dc Update fluentd to latest quay.io image, add json parser for message 2020-09-08 15:05:31 +01:00
Stefan Reimer b7feeae83c Remove CRD property to fix OutofSync Argo 2020-09-08 13:44:31 +01:00
Stefan Reimer 9e0e819fd6 Handle empty message events 2020-09-08 13:40:09 +01:00
Stefan Reimer e09935a819 Add Lua functions to reassemble partial cri-o logs 2020-09-08 13:12:21 +01:00
Stefan Reimer 6b1b02a743 Fluent-bit version bump and support for api audit logs 2020-09-08 12:40:28 +01:00
Stefan Reimer 63537919a4 Move scrape username to its own secret as eck operator cleans up otherwise 2020-09-04 01:13:39 +01:00
Stefan Reimer 42b792bb4b More fluentd tuning 2020-08-27 01:13:34 +01:00
Stefan Reimer e2d560c881 Disable ingest pipeline until we know what breaks / jams in ES 2020-08-27 01:03:35 +01:00
Stefan Reimer 7f540d57db Revert ES fixes as servicemonitor is retarted 2020-08-26 23:02:47 +01:00
Stefan Reimer ea3432445e Hardcode es user for now 2020-08-26 22:50:51 +01:00
Stefan Reimer f9821762f7 fluentd / ES fixes 2020-08-26 18:13:21 +01:00
Stefan Reimer 31aa92a971 Revert default fluentd image, latest has issues 2020-08-24 11:38:47 +01:00
Stefan Reimer e4c478ed19 Increase default read-timeout for fluentd 2020-08-23 17:47:28 +01:00
Stefan Reimer 8b5d9ad785 Use quay.io fluentd-es image until we roll our own 2020-08-23 17:41:37 +01:00
Stefan Reimer 80867bd1c2 Fix default fluentd hostname 2020-08-23 15:50:14 +01:00
Stefan Reimer 2d58d73798 Remove Cri parser as it is already incl. upstream now 2020-08-22 19:24:58 +01:00
Stefan Reimer 93edcec5a2 Update docs 2020-08-22 18:27:31 +01:00
Stefan Reimer be346b592f Add fluent-bit support to kuberzero-logging, istio fixes 2020-08-22 18:27:18 +01:00
Stefan Reimer d49ff51379 Disable default syncPolicy, use values instead 2020-08-20 11:40:08 +01:00