Commit Graph

157 Commits

Author SHA1 Message Date
d053b3484c fix: performance tuning for logging pipeline / fluentd 2021-05-17 12:04:46 +02:00
117ee6be49 fix: fix broken CRDs handling for ECK operator 2021-05-14 00:11:13 +02:00
567a7f94ff fix: bump eck operator to 1.5.0 as 1.4.1 could not upgrade ES due to license issues 2021-05-13 16:44:45 +02:00
21c9176cb7 fix: minor performance tuning for logging pipeline 2021-05-13 16:21:16 +02:00
fb95ba9024 chore: checkin diffs to sync desktop 2021-05-12 16:32:33 +02:00
9be889efed chore: update ES dashboard DS 2021-04-25 22:29:55 +02:00
8ddf39b383 feat: Add Grafana dashboards for logging 2021-04-25 22:19:06 +02:00
c912860b60 chore: fluent-bit version bump to fix excessive logging 2021-04-07 12:00:53 +02:00
eca69f8b5f Reduce fluent-bit memory consumption under backpressure 2021-03-26 10:56:17 +01:00
4d015cc4c6 Update chart READMEs 2021-03-25 16:32:49 +01:00
1018270620 Add nodeAffinity to all logging components, add resources to fluent-bit, tuning 2021-03-19 16:15:58 +01:00
64a0736dfd Bump ECK operator to 1.4.1 2021-03-11 09:00:47 +01:00
cde586a0df Reduce fluentd chunk size and increase retry timeout 2021-03-10 10:44:51 +01:00
22a1e8d171 Update fluentd.patch for helm chart 2021-03-10 10:34:17 +01:00
e666d1079a Upgrade fluentd to use new upstream helm and image 2021-03-10 10:32:12 +01:00
0d6d22b0d4 Disable metadata via kubelet for now 2021-03-09 10:33:40 +01:00
9dc2881f15 Remove unnecessary docker mount 2021-03-07 12:47:06 +01:00
05b2edf089 Switch fluent-bit to use kubelet rather than kube-api 2021-03-07 12:38:53 +01:00
50ffcf28eb Version upgrade ES/Kibana and Fluentbit, various tunings 2021-03-05 16:53:02 +01:00
1218033166 Further tuning of fluentd throughput 2021-02-22 21:34:45 +01:00
7587564da0 Version bump for aws-ebs-csi and kiam, ES bugfix bump, fluentd tuning 2021-01-21 12:31:06 +00:00
a26b652690 Allow custom memory overwrites for ES cluster 2021-01-18 17:18:30 +00:00
fdcb6f7e6f Remove repositories to make argo happy 2020-12-17 12:24:12 -08:00
214bfec2a4 Remove repositories to make argo happy 2020-12-17 12:22:48 -08:00
38b2d56da9 Re-add fluentd chart until we migrate off 2020-12-17 12:17:19 -08:00
79dc6e9413 EBS driver version bump 2020-12-10 07:06:31 -08:00
3820858046 More logging tuning 2020-12-10 06:44:58 -08:00
89dc890c74 More logging tuning 2020-12-10 06:36:26 -08:00
a8314d4074 Lua fix fluent-bit 2020-12-08 07:15:00 -08:00
77a7ba2ed6 Integrare fluent-bit into logging to allow better config 2020-12-08 07:05:25 -08:00
5909fcd841 Fix empty CRDs, only deploy eck-operator if needed 2020-12-07 13:06:00 -08:00
835aae9df8 Re-enable geoip lookups 2020-12-07 04:33:33 -08:00
b30b41ab15 Disable CRDs from eck-operator defaults 2020-12-05 14:16:33 -08:00
2a56489273 ECK fixes for Kube 1.18, Redis cluster support incl. Enyoy proxy 2020-12-04 06:05:35 -08:00
2be387b87b ArgoCd naming fixes 2020-11-30 09:30:06 -08:00
052efd077c Latest fixes, fluent-bit version bump 2020-11-26 09:37:10 -08:00
c8a903110f More fixes now adding ArgoCD 2020-11-26 05:21:10 -08:00
5b317db251 Bug fixes and argo tweaks 2020-11-24 07:18:14 -08:00
cd24b9fa1a First try adding argoCD day 2 2020-11-24 06:44:57 -08:00
35b1570d18 Update of various components, new aroless bootstrap working 2020-11-21 04:24:57 -08:00
53b638da5e Update docs, bump argo-cd parallel jobs 2020-10-27 11:54:44 +00:00
4285db835d Typo 2020-10-07 09:11:22 -07:00
a951e7d9a0 New Lua function to nest entries into kube.<namespace>.* 2020-10-07 09:09:24 -07:00
cb3c6a93ba fluent-bit tag improvements 2020-10-05 17:27:58 -07:00
b0286ff858 Add some spaces 2020-10-05 09:03:47 -07:00
846d7d2d87 More logging fixes, try to decode json at the source 2020-10-05 09:01:50 -07:00
5854468f09 Derp 2020-10-05 04:09:03 -07:00
c556df65ff Updated helm-docs, fluentd SSL handled by Istio, ES&Istio tuning 2020-10-05 03:50:23 -07:00
4aeb23d8cc Disable borken json parsing for now 2020-10-02 14:46:07 -07:00
bbd6d25429 Disable borken json parsing for now 2020-10-02 14:41:40 -07:00
4cb3bd01c5 Minor fluent-bit tuning 2020-10-01 12:32:21 -07:00
84a80f3b97 Fluentd tuning 2020-10-01 10:14:04 -07:00
ea2391a212 Fluentd tuning 2020-10-01 10:11:48 -07:00
fad0597302 Disable pipeline still cpu issues 2020-09-28 04:54:47 -07:00
8de44f18d4 Reenable fluentd ingest pipeline again 2020-09-28 04:45:39 -07:00
0939405c7a Logging fixes for NOT using nameoverride 2020-09-18 16:12:52 +01:00
2c600c2fd0 Slightly allow ArgoCD a bit more processing 2020-09-18 14:21:39 +01:00
d61752703e Revert TCP keepalive for fluentd listener 2020-09-17 19:44:34 +01:00
bcf8093b84 Enable TCP keepalive for fluentd listener 2020-09-17 19:24:24 +01:00
93723e6a6a Docs update 2020-09-14 17:26:39 +01:00
c9a5691acf fluent-bit version bump 2020-09-14 17:26:19 +01:00
2577ba826c Fix math in resources calc 2020-09-11 11:07:49 +01:00
0c6f4d06e3 Make ES heap configurable, set resources accordingly 2020-09-11 11:00:51 +01:00
7c08700e71 Change log tag for audit log to not collide with regular tags 2020-09-09 20:59:03 +01:00
862fb4be9d Calico version bump to 3.16.1 2020-09-09 14:17:02 +01:00
777fe64f01 Dont remove other fields for valid json 2020-09-08 15:41:20 +01:00
8217fdd623 Fix fluentd parsing of json 2020-09-08 15:34:16 +01:00
75002ce2eb Fix fluentd typo 2020-09-08 15:07:17 +01:00
b49a864cbb Update fluentd to latest quay.io image, add json parser for message 2020-09-08 15:05:31 +01:00
1546415746 Remove CRD property to fix OutofSync Argo 2020-09-08 13:44:31 +01:00
6be2f0697f Handle empty message events 2020-09-08 13:40:09 +01:00
d04e7fa0f1 Add Lua functions to reassemble partial cri-o logs 2020-09-08 13:12:21 +01:00
48045d7afc Fluent-bit version bump and support for api audit logs 2020-09-08 12:40:28 +01:00
88725c33be Move scrape username to its own secret as eck operator cleans up otherwise 2020-09-04 01:13:39 +01:00
1fec29b05f More fluentd tuning 2020-08-27 01:13:34 +01:00
28e3ce4f8e Disable ingest pipeline until we know what breaks / jams in ES 2020-08-27 01:03:35 +01:00
3e55e27bf1 Revert ES fixes as servicemonitor is retarted 2020-08-26 23:02:47 +01:00
51d9dc48fc Hardcode es user for now 2020-08-26 22:50:51 +01:00
8b82972d06 fluentd / ES fixes 2020-08-26 18:13:21 +01:00
6adcddf4d6 Revert default fluentd image, latest has issues 2020-08-24 11:38:47 +01:00
1f0d7fae29 Increase default read-timeout for fluentd 2020-08-23 17:47:28 +01:00
6a34a198f4 Use quay.io fluentd-es image until we roll our own 2020-08-23 17:41:37 +01:00
6620416047 Fix default fluentd hostname 2020-08-23 15:50:14 +01:00
256877b736 Remove Cri parser as it is already incl. upstream now 2020-08-22 19:24:58 +01:00
94622b4f9a Update docs 2020-08-22 18:27:31 +01:00
7310235fa2 Add fluent-bit support to kuberzero-logging, istio fixes 2020-08-22 18:27:18 +01:00
f1ef778075 Disable default syncPolicy, use values instead 2020-08-20 11:40:08 +01:00
4fcf2c0ed3 Revert to default images 2020-08-18 13:13:30 +01:00
2f48198ffb Fix istio to service mapping 2020-08-18 12:45:15 +01:00
3e581471ff Revert ot quay image, disable plugins 2020-08-18 12:36:56 +01:00
09886b10b2 Disable persistence by default 2020-08-18 12:08:49 +01:00
695318eada Add missing fluentd secrets 2020-08-18 11:58:37 +01:00
51921f3d47 Disable statefulset for fluentd being broken upstream 2020-08-18 11:41:09 +01:00
d36bf246d6 Add fluentd to logging 2020-08-18 11:34:34 +01:00
05da44c191 Make old ECK resources optional 2020-08-17 13:12:07 +01:00
6f981eabc0 EBS-CSI version bump, reduce ArgoCD concurrency to reduce load spikes, sync from 180s to 300s 2020-08-15 23:37:45 +01:00
7be12de4e8 Add cert-manager state handling for argo 2020-08-15 15:59:57 +01:00
56ef55ef7a Exlude stateuful service objects to prevent double scrapes 2020-08-15 14:49:30 +01:00
bef01e96ab Exlude stateuful service objects to prevent double scrapes 2020-08-15 14:45:43 +01:00
dd8337660f Add label for servicemonitor 2020-08-15 14:33:41 +01:00