| Fluentd | |
| Developer: | Treasure Data |
| Latest Release Version: | 1.15.3 |
| Latest Release Date: | [1] |
| Operating System: | Linux (Amazon Linux, CentOS, RHEL), macOS (10.9 and above), Ruby, Windows (7 and above) |
| Programming Language: | C, Ruby |
| Genre: | Logging tool |
| License: | Apache 2.0 |
Fluentd is a cross-platform open-source data collection software project originally developed at Treasure Data. It is written primarily in the C programming language with a thin-Ruby wrapper that gives users flexibility.[2]
Fluentd was positioned for "big data," semi- or un-structured data sets. It analyzes event logs, application logs, and clickstreams.[3] According to Suonsyrjä and Mikkonen, the "core idea of Fluentd is to be the unifying layer between different types of log inputs and outputs.",[4] Fluentd is available on Linux, macOS, and Windows.[5]
Fluentd was created by Sadayuki Furuhashi as a project of the Mountain View-based firm Treasure Data. Written primarily in Ruby, its source code was released as open-source software in October 2011.[6] [7] The company announced $5 million of funding in 2013.[8] Treasure Data was then sold to Arm Ltd. in 2018.[9]
Fluentd was one of the data collection tools recommended by Amazon Web Services in 2013, when it was said to be similar to Apache Flume or Scribe.[10] Google Cloud Platform's BigQuery recommends Fluentd as the default real-time data-ingestion tool, and uses Google's customized version of Fluentd, called google-fluentd, as a default logging agent.[11] [12]
Fluent Bit is a log processor and log forwarder which is being developed as a CNCF sub-project under the umbrella of Fluentd project.[13] Fluentd is written in C and Ruby and built as a Ruby gem so it consumes some amount of memory resources. On the other hand, since Fluent Bit is written only in C and has no dependencies, the consumed memory usage much decreased compared to Fluentd which makes it easy to run on the embedded Linux and container environment.[14]