Reassemble Java Stack Traces in Fluent Bit with Multiline Parser
Fluent Bit’s multiline parser is fundamentally a state machine that stitches together log lines based on regular expression matching and timeouts.
Fluentbit Articles
47 articles
Flatten and Nest JSON Fields in Fluent Bit with Nest Filter
The nest filter in Fluent Bit can dramatically simplify your log processing by restructuring complex JSON into a more manageable, hierarchical format.
Export Fluent Bit Logs to OpenTelemetry Collectors via OTLP
Fluent Bit can export logs to OpenTelemetry Collectors via the OTLP protocol, but it's not always straightforward to get the data structured correctly f.
Send Fluent Bit Logs to AWS CloudWatch Logs
Fluent Bit can ship logs to CloudWatch, but it’s not just a simple pipe; it’s a sophisticated buffering and retry mechanism designed to handle network i.
Ship Fluent Bit Logs to Datadog
Fluent Bit, a log processor, is failing to send logs to Datadog because the Datadog agent is not properly configured to receive them.
Index Fluent Bit Logs in Elasticsearch
Fluent Bit, when configured to send logs to Elasticsearch, can sometimes fail to index those logs, leaving you with a gap in your observability.
Produce Logs to Kafka from Fluent Bit
Fluent Bit's Kafka output plugin doesn't actually produce logs to Kafka; it acts as a Kafka producer, forwarding log records it receives from its input .
Ship Fluent Bit Logs to Grafana Loki
Ship Fluent Bit Logs to Grafana Loki — practical guide covering fluentbit setup, configuration, and troubleshooting with real-world examples.
Archive Fluent Bit Logs to S3 with Batching and Compression
Archive Fluent Bit Logs to S3 with Batching and Compression — Fluent Bit doesn't just send logs; it shapes them. Let's say you're sending application lo...
Forward Fluent Bit Logs to Splunk HEC
Fluent Bit's HTTP Event Collector HEC output plugin is surprisingly flexible, but its default configuration often leads to unparseable events in Splunk.
Parse Unstructured Logs with Fluent Bit Regex, JSON, and Logfmt Parsers
Fluent Bit's parsers are the secret sauce for turning a chaotic log stream into something actionable, and the regex, JSON, and logfmt parsers are your p.
Dynamically Route Fluent Bit Records by Rewriting Tags
Fluent Bit's tag rewriting is how you dynamically route records by changing their tag field. Here's Fluent Bit processing logs from two different applic.
Write Fluent Bit Log Records to a SQL Database
Fluent Bit can write its log records to a SQL database, but it's not about simply dumping logs; it's about turning unstructured log data into structured.
Monitor Fluent Bit Storage Metrics to Prevent Data Loss
Fluent Bit's internal storage mechanism can silently drop incoming logs if not monitored, leading to data loss that's hard to trace back.
Ingest Syslog Messages with Fluent Bit RFC 3164 and 5424 Parsers
Ingest Syslog Messages with Fluent Bit RFC 3164 and 5424 Parsers — practical guide covering fluentbit setup, configuration, and troubleshooting with rea...
Collect systemd Journal Logs with Fluent Bit
Fluent Bit can ingest systemd journal logs and send them to a backend, but it often fails to start up correctly if not configured to exactly match the j.
Route Fluent Bit Records to Outputs with Wildcard Tag Matching
Route Fluent Bit Records to Outputs with Wildcard Tag Matching — practical guide covering fluentbit setup, configuration, and troubleshooting with real-...
Rate-Limit Fluent Bit Log Output with the Throttle Filter
Fluent Bit's Throttle filter allows you to control the rate of logs being processed, preventing downstream systems from being overwhelmed.
Configure Mutual TLS on Fluent Bit Inputs and Outputs
Fluent Bit can be configured to use mutual TLS for securing communication between its inputs and outputs, ensuring both parties authenticate each other.
Upgrade Fluent Bit and Migrate Legacy Configuration
Fluent Bit's configuration is a labyrinth of directives, and migrating from an older version can feel like navigating that labyrinth blindfolded.
Load-Balance Fluent Bit Output Across Multiple Upstream Hosts
Fluent Bit's output plugins are designed to send logs to a single destination. When you need to distribute logs across multiple upstream hosts, you're e.
Extend Fluent Bit with WebAssembly Custom Filter Plugins
Fluent Bit's extensibility is a major draw, and while C plugins are the most common way to extend it, WebAssembly Wasm offers a compelling, safer, and l.
Collect Windows Event Log Entries with Fluent Bit
Fluent Bit can grab Windows Event Log entries, but it treats them like any other log stream, which is usually not what you want.
Enrich Fluent Bit Log Records with AWS EC2 Metadata
Enrich Fluent Bit Log Records with AWS EC2 Metadata — practical guide covering fluentbit setup, configuration, and troubleshooting with real-world examp...
Handle Fluent Bit Backpressure with Pause and Resume Flow Control
Handle Fluent Bit Backpressure with Pause and Resume Flow Control — practical guide covering fluentbit setup, configuration, and troubleshooting with re...
Tune Fluent Bit Chunk Size Limits for High-Volume Log Streams
Fluent Bit's chunk size isn't just a buffer; it's a critical performance knob that dictates how much data your output plugins have to process at once.
Configure Fluent Bit Coroutine Worker Threads for Parallel I/O
Fluent Bit can process logs faster by using coroutines to handle I/O operations concurrently. Here's Fluent Bit processing logs from a file, parsing the.
Build Custom Fluent Bit Plugins in Go
Go's concurrency model makes it a surprisingly good fit for building custom Fluent Bit plugins. Let's see what that looks like
Set Fluent Bit DaemonSet CPU and Memory Limits on Kubernetes
Fluent Bit pods are crashing due to resource starvation, specifically when the Kubernetes scheduler evicts them for exceeding their CPU or memory limits.
Debug Fluent Bit Pipelines with Trace Mode and Debug Logging
Fluent Bit's trace mode is surprisingly powerful for understanding how data flows, but most people only use it for basic debugging.
Collect Docker Container Logs with Fluent Bit
Fluent Bit can collect Docker container logs, but it doesn't actually collect them in the sense of pulling them from the Docker daemon's logging driver.
Run Fluent Bit as a Sidecar in ECS Task Definitions
Fluent Bit doesn't actually send logs to CloudWatch Logs; it just tails log files and forwards them to a designated endpoint.
Add, Remove, and Rename Fields in Fluent Bit with Record Modifier
Add, Remove, and Rename Fields in Fluent Bit with Record Modifier — practical guide covering fluentbit setup, configuration, and troubleshooting with re...
Forward Fluent Bit Logs to a Fluentd Aggregator
Fluent Bit is surprisingly bad at sending logs to Fluentd by default. Let's say you've got Fluent Bit running on your edge machines, collecting logs fro.
Handle SIGTERM for Graceful Fluent Bit Shutdown and Buffer Flush
Handle SIGTERM for Graceful Fluent Bit Shutdown and Buffer Flush — practical guide covering fluentbit setup, configuration, and troubleshooting with rea...
Filter Fluent Bit Log Lines with Grep Include and Exclude
Fluent Bit's grep filter is surprisingly powerful, and often people miss that it can filter both incoming and outgoing log lines, not just what eventual.
Enable Fluent Bit HTTP Health Check Endpoint
A health check endpoint is surprisingly useless if it doesn't tell you why it's unhealthy. Let's get Fluent Bit's HTTP health check endpoint up and running
Install Fluent Bit on Kubernetes with the Official Helm Chart
Fluent Bit's official Helm chart is surprisingly flexible, letting you choose between running it as a DaemonSet the default, one per node or a Deploymen.
Reduce Fluent Bit CPU Usage with Threading and Buffer Tuning
Fluent Bit's default configuration can lead to surprisingly high CPU usage, especially under heavy load, because it processes incoming log streams seque.
Reload Fluent Bit Configuration Without Restarting
Reloading Fluent Bit's configuration without a full restart is surprisingly easy, but the command you use depends entirely on how Fluent Bit was started.
Watch Log Files on Linux with Fluent Bit Inotify
Watching log files on Linux with Fluent Bit's inotify input is more about understanding how file system events trigger processing than about the inotify.
Handle Log File Rotation and Truncation with Fluent Bit Tail Input
Fluent Bit’s tail input plugin can get bogged down if it’s not configured to handle log file rotation and truncation gracefully.
Enrich Kubernetes Pod Logs with Namespace and Label Metadata
Kubernetes Pods can generate a lot of logs, and without context, they're just a wall of text. This article shows you how to automatically add namespace .
Collect and Route Kubernetes Pod Logs with Fluent Bit
Kubernetes itself doesn't store logs; it just gives pods a place to write them, and then those logs vanish when the pod dies.
Write Custom Fluent Bit Log Transformations in Lua
Write Custom Fluent Bit Log Transformations in Lua — practical guide covering fluentbit setup, configuration, and troubleshooting with real-world examples.
Fluent Bit Memory Buffer vs Filesystem Buffer: Choose the Right One
The primary difference isn't about where data is stored, but when and how it's acknowledged. Let's see Fluent Bit in action
Add Conditional Logic to Fluent Bit with the Modify Filter
Fluent Bit's modify filter can dynamically alter record data, but its real power emerges when you combine it with conditional logic, allowing you to rou.