diff --git a/README.md b/README.md index a1c322c2..f0753c15 100644 --- a/README.md +++ b/README.md @@ -4,5 +4,5 @@ [Fluentd](https://www.fluentd.org/) is an open-source data collector for a unified logging layer. Fluentd allows you to unify data collection and consumption for better use and understanding of data. -[Fluentd](https://www.fluentd.org/) is licensed under the terms of the [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0). This project is made and sponsored by [Treasure Data](https://www.treasuredata.com). +[Fluentd](https://www.fluentd.org/) is licensed under the terms of the [Apache License v2.0](https://www.apache.org/licenses/LICENSE-2.0). This project is made and sponsored by [Treasure Data](https://www.treasuredata.com). diff --git a/container-deployment/docker-logging-driver.md b/container-deployment/docker-logging-driver.md index 6a4f88b5..812c27cb 100644 --- a/container-deployment/docker-logging-driver.md +++ b/container-deployment/docker-logging-driver.md @@ -1,6 +1,6 @@ # Docker Logging Driver -The article describes how to implement a unified logging system for your [Docker](http://www.docker.com) containers. An application in a production environment needs to register certain events or problems during its runtime. +The article describes how to implement a unified logging system for your [Docker](https://www.docker.com) containers. An application in a production environment needs to register certain events or problems during its runtime. The old-fashioned way is to write these messages into a log file, but that inherits certain problems. Specifically, when we try to perform some analysis over the registers, or on the other hand, if the application has multiple instances running, the scenario becomes even more complex. diff --git a/container-deployment/install-by-docker.md b/container-deployment/install-by-docker.md index 8120a664..4058a178 100644 --- a/container-deployment/install-by-docker.md +++ b/container-deployment/install-by-docker.md @@ -1,6 +1,6 @@ # Docker Image -This article explains how to use the official [Fluentd Docker image](https://hub.docker.com/r/fluent/fluentd/), maintained by [Treasure Data, Inc](http://www.treasuredata.com/). +This article explains how to use the official [Fluentd Docker image](https://hub.docker.com/r/fluent/fluentd/), maintained by [Treasure Data, Inc](https://www.treasuredata.com/). * [Fluentd official Docker image](https://hub.docker.com/r/fluent/fluentd/) * [Fluentd official Docker image \(Source\)](https://github.com/fluent/fluentd-docker-image) diff --git a/container-deployment/kubernetes.md b/container-deployment/kubernetes.md index 41866956..15aa0853 100644 --- a/container-deployment/kubernetes.md +++ b/container-deployment/kubernetes.md @@ -2,7 +2,7 @@ ![Fluentd + Kubernetes](../.gitbook/assets/fluentd_kubernetes.png) -[Kubernetes](http://kubernetes.io) provides two logging endpoints for applications and cluster logs: +[Kubernetes](https://kubernetes.io) provides two logging endpoints for applications and cluster logs: 1. Stackdriver Logging for use with Google Cloud Platform; and, 2. Elasticsearch. diff --git a/deployment/plugin-management.md b/deployment/plugin-management.md index 1cc6fda9..820e5fd1 100644 --- a/deployment/plugin-management.md +++ b/deployment/plugin-management.md @@ -93,7 +93,7 @@ You should specify the target version with `-v` option: ## `--gemfile` option -A Ruby application manages gem dependencies using Gemfile and [`Bundler`](http://bundler.io/). Fluentd's `--gemfile` option takes the same approach, and is useful for managing plugin versions separated from shared gems. +A Ruby application manages gem dependencies using Gemfile and [`Bundler`](https://bundler.io/). Fluentd's `--gemfile` option takes the same approach, and is useful for managing plugin versions separated from shared gems. For example, if you have the following Gemfile at `/etc/fluent/Gemfile`: diff --git a/deployment/trouble-shooting.md b/deployment/trouble-shooting.md index 50d482ed..dc607e2c 100644 --- a/deployment/trouble-shooting.md +++ b/deployment/trouble-shooting.md @@ -76,7 +76,7 @@ If `fluentd` suddenly hits an unexpected high CPU usage problem, there are sever * regular expression with broken data * system calls have a bug, e.g. `inotify` with lots of files -In such cases, you can use `perf` tool on recent Linux to investigate the problem. See [Linux perf Examples](http://www.brendangregg.com/perf.html) page. If you want to know which call causes the problem, [`pid2line.rb`](https://gist.github.com/nurse/0619b6af90df140508c2) is useful. +In such cases, you can use `perf` tool on recent Linux to investigate the problem. See [Linux perf Examples](https://www.brendangregg.com/perf.html) page. If you want to know which call causes the problem, [`pid2line.rb`](https://gist.github.com/nurse/0619b6af90df140508c2) is useful. ## Check Uncaught Logs diff --git a/filter/geoip.md b/filter/geoip.md index 7b7c34dd..1f0ecfa4 100644 --- a/filter/geoip.md +++ b/filter/geoip.md @@ -140,7 +140,7 @@ Set backend library. #### Plot Realtime Access Statistics on a World Map using Elasticsearch and Kibana -The `country_code` field is needed to visualize access statistics on a world map using [Kibana](http://www.elasticsearch.org/overview/kibana/). +The `country_code` field is needed to visualize access statistics on a world map using [Kibana](https://www.elasticsearch.org/overview/kibana/). Required plugins: diff --git a/how-to-guides/apache-to-mongodb.md b/how-to-guides/apache-to-mongodb.md index f3bd54df..a54e61fc 100644 --- a/how-to-guides/apache-to-mongodb.md +++ b/how-to-guides/apache-to-mongodb.md @@ -4,9 +4,9 @@ This article explains how to use [Fluentd](https://fluentd.org/)'s MongoDB Outpu ## Background -[Fluentd](https://fluentd.org/) is an advanced open-source log collector originally developed at [Treasure Data, Inc](http://www.treasuredata.com/). Because Fluentd handles logs as semi-structured data streams, the ideal database should have strong support for semi-structured data. Several candidates meet this criterion, but we believe [MongoDB](http://www.mongodb.org/) is the market leader. +[Fluentd](https://fluentd.org/) is an advanced open-source log collector originally developed at [Treasure Data, Inc](https://www.treasuredata.com/). Because Fluentd handles logs as semi-structured data streams, the ideal database should have strong support for semi-structured data. Several candidates meet this criterion, but we believe [MongoDB](https://www.mongodb.org/) is the market leader. -MongoDB is an open-source, document-oriented database developed at [MongoDB, Inc](http://www.mongodb.com/). It is schema-free and uses a JSON-like format to manage semi-structured data. +MongoDB is an open-source, document-oriented database developed at [MongoDB, Inc](https://www.mongodb.com/). It is schema-free and uses a JSON-like format to manage semi-structured data. This article will show you how to use [Fluentd](https://fluentd.org/) to import Apache logs into MongoDB. @@ -30,7 +30,7 @@ Fluentd does these three \(3\) things: The following software/services are required to be set up correctly: * [Fluentd](https://www.fluentd.org/) -* [MongoDB](http://www.mongodb.org/) +* [MongoDB](https://www.mongodb.org/) * [Apache](https://httpd.apache.org/) (with the Combined Log Format) For simplicity, this article will describe how to set up a one-node configuration. @@ -42,7 +42,7 @@ You can install Fluentd via major packaging systems. For MongoDB, please refer to the following downloads page: -* [MongoDB Downloads](http://www.mongodb.org/downloads) +* [MongoDB Downloads](https://www.mongodb.org/downloads) ## Install MongoDB Plugin diff --git a/how-to-guides/apache-to-s3.md b/how-to-guides/apache-to-s3.md index a17edf0c..b62ed149 100644 --- a/how-to-guides/apache-to-s3.md +++ b/how-to-guides/apache-to-s3.md @@ -4,7 +4,7 @@ This article explains how to use [Fluentd](https://fluentd.org/)'s Amazon S3 Out ## Background -[Fluentd](https://fluentd.org/) is an advanced open-source log collector originally developed at [Treasure Data, Inc](http://www.treasuredata.com/). One of the main objectives of log aggregation is data archiving. [Amazon S3](http://aws.amazon.com/s3/), the cloud object storage provided by Amazon, is a popular solution for data archiving. +[Fluentd](https://fluentd.org/) is an advanced open-source log collector originally developed at [Treasure Data, Inc](https://www.treasuredata.com/). One of the main objectives of log aggregation is data archiving. [Amazon S3](https://aws.amazon.com/s3/), the cloud object storage provided by Amazon, is a popular solution for data archiving. This article will show you how to use [Fluentd](https://fluentd.org/) to import Apache logs into Amazon S3. diff --git a/how-to-guides/http-to-hdfs.md b/how-to-guides/http-to-hdfs.md index 65280294..dad664f9 100644 --- a/how-to-guides/http-to-hdfs.md +++ b/how-to-guides/http-to-hdfs.md @@ -1,10 +1,10 @@ # Data Collection with Hadoop \(HDFS\) -This article explains how to use [Fluentd](https://fluentd.org/)'s [WebHDFS Output plugin](http://github.com/fluent/fluent-plugin-webhdfs/) to aggregate semi-structured logs into Hadoop HDFS. +This article explains how to use [Fluentd](https://fluentd.org/)'s [WebHDFS Output plugin](https://github.com/fluent/fluent-plugin-webhdfs/) to aggregate semi-structured logs into Hadoop HDFS. ## Background -[Fluentd](https://fluentd.org/) is an advanced open-source log collector originally developed at [Treasure Data, Inc](http://www.treasuredata.com/). Fluentd is specifically designed to solve the big-data log collection problem. A lot of users are using Fluentd with MongoDB, and have found that it doesn't scale well for now. +[Fluentd](https://fluentd.org/) is an advanced open-source log collector originally developed at [Treasure Data, Inc](https://www.treasuredata.com/). Fluentd is specifically designed to solve the big-data log collection problem. A lot of users are using Fluentd with MongoDB, and have found that it doesn't scale well for now. HDFS \(Hadoop\) is a natural alternative for storing and processing a huge amount of data. It supports an HTTP interface called WebHDFS in addition to its Java library. @@ -128,14 +128,14 @@ drwxr-xr-x - 1 supergroup 0 2012-10-22 09:40 /log/20121022_14/access. ## Conclusion -Fluentd with WebHDFS makes the realtime log collection simple, robust and scalable! [@tagomoris](http://github.com/tagomoris) has already been using this plugin to collect 20,000 msgs/sec, 1.5 TB/day without any major problems for several months now. +Fluentd with WebHDFS makes the realtime log collection simple, robust and scalable! [@tagomoris](https://github.com/tagomoris) has already been using this plugin to collect 20,000 msgs/sec, 1.5 TB/day without any major problems for several months now. ## Learn More * [Fluentd Architecture](https://www.fluentd.org/architecture) * [Fluentd Get Started](../quickstart/) * [WebHDFS Output Plugin](../output/webhdfs.md) -* [Slides: Fluentd and WebHDFS](http://www.slideshare.net/tagomoris/fluentd-and-webhdfs) +* [Slides: Fluentd and WebHDFS](https://www.slideshare.net/tagomoris/fluentd-and-webhdfs) If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs-gitbook/issues?state=open). [Fluentd](https://www.fluentd.org/) is an open-source project under [Cloud Native Computing Foundation \(CNCF\)](https://cncf.io/). All components are available under the Apache 2 License. diff --git a/how-to-guides/http-to-td.md b/how-to-guides/http-to-td.md index 8b377320..e4827dd6 100644 --- a/how-to-guides/http-to-td.md +++ b/how-to-guides/http-to-td.md @@ -128,7 +128,7 @@ Result : +-----+ ``` -It is not advisable to send sensitive user information to the cloud. To assist with this need, `out_tdlog` comes with some anonymization systems. For more details, see [Treasure Data plugin](http://github.com/treasure-data/fluent-plugin-td/). +It is not advisable to send sensitive user information to the cloud. To assist with this need, `out_tdlog` comes with some anonymization systems. For more details, see [Treasure Data plugin](https://github.com/treasure-data/fluent-plugin-td/). ## Conclusion @@ -139,7 +139,7 @@ Fluentd + Treasure Data gives you a data collection and analysis system in days, * [Fluentd Architecture](https://www.fluentd.org/architecture) * [Fluentd Get Started](../quickstart/) * [Treasure Data](https://www.fluentd.org/treasuredata) -* [Treasure Data: Documentation](http://docs.treasuredata.com/) +* [Treasure Data: Documentation](https://docs.treasuredata.com/) If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs-gitbook/issues?state=open). [Fluentd](https://www.fluentd.org/) is an open-source project under [Cloud Native Computing Foundation \(CNCF\)](https://cncf.io/). All components are available under the Apache 2 License. diff --git a/how-to-guides/kinesis-stream.md b/how-to-guides/kinesis-stream.md index 0ae5ef4d..d7e340bc 100644 --- a/how-to-guides/kinesis-stream.md +++ b/how-to-guides/kinesis-stream.md @@ -6,7 +6,7 @@ This article explains how to use [Fluentd](https://fluentd.org/)'s [Amazon Kines ## Background -[Fluentd](https://fluentd.org/) is an advanced open-source log collector originally developed at [Treasure Data, Inc](http://www.treasuredata.com/). Because Fluentd can collect logs from various sources, [Amazon Kinesis](https://aws.amazon.com/kinesis/) is one of the popular destinations for the output. +[Fluentd](https://fluentd.org/) is an advanced open-source log collector originally developed at [Treasure Data, Inc](https://www.treasuredata.com/). Because Fluentd can collect logs from various sources, [Amazon Kinesis](https://aws.amazon.com/kinesis/) is one of the popular destinations for the output. Amazon Kinesis is a platform for streaming data on AWS, offering powerful services to make it easy to load and analyze streaming data, and also providing the ability for you to build custom streaming data applications for specialized needs. @@ -122,7 +122,7 @@ The `random_partition_key true` option will generate the partition key via UUID For additional configurations, see [Kinesis Output plugin](https://github.com/awslabs/aws-fluent-plugin-kinesis). -For those who are interested in security, all communication between Fluentd and Amazon Kinesis are done via HTTPS. If you do not want to have AES keys in the configuration file, [IAM Role-based authentication](http://docs.aws.amazon.com/kinesis/latest/dev/controlling-access.html) is available too for EC2 nodes. +For those who are interested in security, all communication between Fluentd and Amazon Kinesis are done via HTTPS. If you do not want to have AES keys in the configuration file, [IAM Role-based authentication](https://docs.aws.amazon.com/kinesis/latest/dev/controlling-access.html) is available too for EC2 nodes. ## Test diff --git a/how-to-guides/raspberrypi-cloud-data-logger.md b/how-to-guides/raspberrypi-cloud-data-logger.md index 23a89f60..c2526a46 100644 --- a/how-to-guides/raspberrypi-cloud-data-logger.md +++ b/how-to-guides/raspberrypi-cloud-data-logger.md @@ -1,6 +1,6 @@ # Cloud Data Logging with Raspberry Pi -[Raspberry Pi](http://www.raspberrypi.org/) is a credit-card-sized single-board computer. Because it is low-cost and easy to equip with various types of sensors, using Raspberry Pi as a cloud data logger is one of its ideal use cases. +[Raspberry Pi](https://www.raspberrypi.org/) is a credit-card-sized single-board computer. Because it is low-cost and easy to equip with various types of sensors, using Raspberry Pi as a cloud data logger is one of its ideal use cases. ![Cloud Data Logger by Raspberry Pi](../.gitbook/assets/raspberry-pi-cloud-data-logger.png) @@ -10,7 +10,7 @@ This article introduces how to transport sensor data from Raspberry Pi to the cl [Raspbian](http://www.raspbian.org/) is a free operating system based on Debian, optimized for the Raspberry Pi. Please install Raspbian on your Raspberry Pi by following the instructions in the blog post below: -* [Getting Started with Raspberry Pi: Installing Raspbian](http://www.andrewmunsell.com/blog/getting-started-raspberry-pi-install-raspbian) +* [Getting Started with Raspberry Pi: Installing Raspbian](https://www.andrewmunsell.com/blog/getting-started-raspberry-pi-install-raspbian) ## Install Fluentd diff --git a/input/exec.md b/input/exec.md index 29192c4e..df3572ee 100644 --- a/input/exec.md +++ b/input/exec.md @@ -184,7 +184,7 @@ If you already have a script that runs periodically \(say, via `cron`\) that you The only requirement for the script is that it outputs TSV, JSON or MessagePack. -For example, this [script](https://gist.github.com/kiyoto/1bd903ad1bdd6ac51fcc) scrapes the front page of [Hacker News](http://news.ycombinator.com) and scrapes information about each post: +For example, this [script](https://gist.github.com/kiyoto/1bd903ad1bdd6ac51fcc) scrapes the front page of [Hacker News](https://news.ycombinator.com) and scrapes information about each post: Suppose that script is called `hn.rb`. Then, you can run it every 5 minutes with the following configuration: diff --git a/input/forward.md b/input/forward.md index 5a37ecb5..9b97e7e6 100644 --- a/input/forward.md +++ b/input/forward.md @@ -337,7 +337,7 @@ The array of usernames. ## Protocol -This plugin accepts both JSON and [MessagePack](http://msgpack.org/) messages and automatically detects which one is used. Internally, Fluentd uses MessagePack as it is more efficient than JSON. +This plugin accepts both JSON and [MessagePack](https://msgpack.org/) messages and automatically detects which one is used. Internally, Fluentd uses MessagePack as it is more efficient than JSON. The time value is an `EventTime` or a platform-specific integer and is based on the output of Ruby's `Time.now.to_i` function. On Linux, BSD, and Mac systems, this is the number of seconds since 1970. diff --git a/input/syslog.md b/input/syslog.md index 93c9cbd0..93ef1c53 100644 --- a/input/syslog.md +++ b/input/syslog.md @@ -26,7 +26,7 @@ This tells Fluentd to create a socket listening on port 5140. You need to set up ### Example Usage -The retrieved data is organized as follows. Fluentd's tag is generated by the `tag` parameter \(tag prefix\), [facility level](http://en.wikipedia.org/wiki/Syslog#Facility_Levels), and [priority](http://en.wikipedia.org/wiki/Syslog#Severity_levels). The record is parsed by the `regexp` [here](https://github.com/fluent/fluentd/blob/master/lib/fluent/plugin/parser_syslog.rb#L23). +The retrieved data is organized as follows. Fluentd's tag is generated by the `tag` parameter \(tag prefix\), [facility level](https://en.wikipedia.org/wiki/Syslog#Facility_Levels), and [priority](https://en.wikipedia.org/wiki/Syslog#Severity_levels). The record is parsed by the `regexp` [here](https://github.com/fluent/fluentd/blob/master/lib/fluent/plugin/parser_syslog.rb#L23). ```text tag = "#{@tag}.#{facility}.#{priority}" @@ -57,7 +57,7 @@ The value must be `syslog`. ### `tag` \(required\) -The prefix of the tag. The tag itself is generated by the tag prefix, [facility level](http://en.wikipedia.org/wiki/Syslog#Facility_Levels), and [priority](http://en.wikipedia.org/wiki/Syslog#Severity_levels). +The prefix of the tag. The tag itself is generated by the tag prefix, [facility level](https://en.wikipedia.org/wiki/Syslog#Facility_Levels), and [priority](https://en.wikipedia.org/wiki/Syslog#Severity_levels). ### `port` diff --git a/installation/before-install.md b/installation/before-install.md index d0bdd45d..b69ccd7f 100644 --- a/installation/before-install.md +++ b/installation/before-install.md @@ -57,7 +57,7 @@ net.ipv4.ip_local_reserved_ports = 24224 Use `sysctl -p` command or reboot your node for the changes to take effect. -These kernel options were originally taken from the presentation [How Netflix Tunes EC2 Instances for Performance](https://www.slideshare.net/brendangregg/how-netflix-tunes-ec2-instances-for-performance) by [Brendan Gregg](http://www.brendangregg.com/), Senior Performance Architect at AWS re:Invent 2017. +These kernel options were originally taken from the presentation [How Netflix Tunes EC2 Instances for Performance](https://www.slideshare.net/brendangregg/how-netflix-tunes-ec2-instances-for-performance) by [Brendan Gregg](https://www.brendangregg.com/), Senior Performance Architect at AWS re:Invent 2017. ## Use sticky bit symlink/hardlink protection diff --git a/installation/install-by-deb-td-agent-v3.md b/installation/install-by-deb-td-agent-v3.md index 108d2087..1065fa10 100644 --- a/installation/install-by-deb-td-agent-v3.md +++ b/installation/install-by-deb-td-agent-v3.md @@ -1,12 +1,12 @@ # Install by DEB Package v3 \(Debian/Ubuntu\) -This article explains how to install the `td-agent` deb package, the stable Fluentd distribution package maintained by [Treasure Data, Inc](http://www.treasuredata.com/). +This article explains how to install the `td-agent` deb package, the stable Fluentd distribution package maintained by [Treasure Data, Inc](https://www.treasuredata.com/). ## What is `td-agent`? Fluentd is written in Ruby for flexibility, with performance-sensitive parts in C. However, some users may have difficulty installing and operating a Ruby daemon. -That is why [Treasure Data, Inc](http://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). +That is why [Treasure Data, Inc](https://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). ## Installing `td-agent` diff --git a/installation/install-by-deb-td-agent-v4.md b/installation/install-by-deb-td-agent-v4.md index 8c5e8e5b..c84aac38 100644 --- a/installation/install-by-deb-td-agent-v4.md +++ b/installation/install-by-deb-td-agent-v4.md @@ -1,12 +1,12 @@ # Install by DEB Package \(Debian/Ubuntu\) -This article explains how to install stable versions of `td-agent` deb packages, the stable Fluentd distribution packages maintained by [Treasure Data, Inc](http://www.treasuredata.com/). +This article explains how to install stable versions of `td-agent` deb packages, the stable Fluentd distribution packages maintained by [Treasure Data, Inc](https://www.treasuredata.com/). ## What is `td-agent`? Fluentd is written in Ruby for flexibility, with performance-sensitive parts in C. However, some users may have difficulty installing and operating a Ruby daemon. -That is why [Treasure Data, Inc](http://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). +That is why [Treasure Data, Inc](https://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). This installation guide is for `td-agent` v4. `td-agent` v4 uses fluentd v1 in the core. See [this page](../appendix/td-agent-v2-vs-v3-vs-v4.md) for the comparison and supported OS. diff --git a/installation/install-by-dmg-td-agent-v3.md b/installation/install-by-dmg-td-agent-v3.md index 4bd78963..5a32d54c 100644 --- a/installation/install-by-dmg-td-agent-v3.md +++ b/installation/install-by-dmg-td-agent-v3.md @@ -6,7 +6,7 @@ This article explains how to install `td-agent`, the stable Fluentd distribution Fluentd is written in Ruby for flexibility, with performance-sensitive parts in C. However, some users may have difficulty installing and operating a Ruby daemon. -That is why [Treasure Data, Inc](http://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). +That is why [Treasure Data, Inc](https://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). ## `td-agent` v3 diff --git a/installation/install-by-dmg-td-agent-v4.md b/installation/install-by-dmg-td-agent-v4.md index e3164979..05781d07 100644 --- a/installation/install-by-dmg-td-agent-v4.md +++ b/installation/install-by-dmg-td-agent-v4.md @@ -6,7 +6,7 @@ This article explains how to install `td-agent`, the stable Fluentd distribution Fluentd is written in Ruby for flexibility, with performance-sensitive parts in C. However, some users may have difficulty installing and operating a Ruby daemon. -That is why [Treasure Data, Inc](http://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). +That is why [Treasure Data, Inc](https://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). For macOS, `td-agent` is distributed as a `.dmg` installer. diff --git a/installation/install-by-gem.md b/installation/install-by-gem.md index 8882e79b..95cfa56c 100644 --- a/installation/install-by-gem.md +++ b/installation/install-by-gem.md @@ -42,9 +42,9 @@ For large deployments, you must use [`jemalloc`](http://www.canonware.com/jemall The Fluentd gem does not come with `/etc/init.d/` scripts. You should use Process Management tools such as: -* [`daemontools`](http://cr.yp.to/daemontools.html) -* [`runit`](http://smarden.org/runit/) -* [`supervisord`](http://supervisord.org/) +* [`daemontools`](https://cr.yp.to/daemontools.html) +* [`runit`](https://smarden.org/runit/) +* [`supervisord`](https://supervisord.org/) * [`upstart`](http://upstart.ubuntu.com/) * `systemd` diff --git a/installation/install-by-msi-td-agent-v3.md b/installation/install-by-msi-td-agent-v3.md index a9717491..43e23152 100644 --- a/installation/install-by-msi-td-agent-v3.md +++ b/installation/install-by-msi-td-agent-v3.md @@ -8,7 +8,7 @@ The recommended way to install Fluentd on Windows is to use MSI installers of `t * Includes Ruby and other library dependencies \(since most Windows machines don't have them installed\). * Includes a set of commonly-used 3rd-party plugins such as `out_es`. -* Originally developed by [Treasure Data, Inc](http://www.treasuredata.com/) \(hence the name\). +* Originally developed by [Treasure Data, Inc](https://www.treasuredata.com/) \(hence the name\). Currently two versions of `td-agent` are available. diff --git a/installation/install-by-msi-td-agent-v4.md b/installation/install-by-msi-td-agent-v4.md index 2dd9950c..8a8a61fd 100644 --- a/installation/install-by-msi-td-agent-v4.md +++ b/installation/install-by-msi-td-agent-v4.md @@ -8,7 +8,7 @@ The recommended way to install Fluentd on Windows is to use MSI installers of `t * Includes Ruby and other library dependencies \(since most Windows machines don't have them installed\). * Includes a set of commonly-used 3rd-party plugins such as `out_es`. -* Originally developed by [Treasure Data, Inc](http://www.treasuredata.com/) \(hence the name\). +* Originally developed by [Treasure Data, Inc](https://www.treasuredata.com/) \(hence the name\). Currently two versions of `td-agent` are available. diff --git a/installation/install-by-rpm-td-agent-v3.md b/installation/install-by-rpm-td-agent-v3.md index 716d15f8..97611225 100644 --- a/installation/install-by-rpm-td-agent-v3.md +++ b/installation/install-by-rpm-td-agent-v3.md @@ -1,12 +1,12 @@ # Install by RPM Package v3 \(Red Hat Linux\) -This article explains how to install the `td-agent` rpm package, the stable Fluentd distribution package maintained by [Treasure Data, Inc](http://www.treasuredata.com/). +This article explains how to install the `td-agent` rpm package, the stable Fluentd distribution package maintained by [Treasure Data, Inc](https://www.treasuredata.com/). ## What is `td-agent`? Fluentd is written in Ruby for flexibility, with performance-sensitive parts in C. However, some users may have difficulty installing and operating a Ruby daemon. -That is why [Treasure Data, Inc](http://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). +That is why [Treasure Data, Inc](https://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). ## How to install `td-agent` diff --git a/installation/install-by-rpm-td-agent-v4.md b/installation/install-by-rpm-td-agent-v4.md index abd890be..df07105e 100644 --- a/installation/install-by-rpm-td-agent-v4.md +++ b/installation/install-by-rpm-td-agent-v4.md @@ -1,12 +1,12 @@ # Install by RPM Package \(Red Hat Linux\) -This article explains how to install the `td-agent` rpm package, the stable Fluentd distribution package maintained by [Treasure Data, Inc](http://www.treasuredata.com/). +This article explains how to install the `td-agent` rpm package, the stable Fluentd distribution package maintained by [Treasure Data, Inc](https://www.treasuredata.com/). ## What is `td-agent`? Fluentd is written in Ruby for flexibility, with performance-sensitive parts in C. However, some users may have difficulty installing and operating a Ruby daemon. -That is why [Treasure Data, Inc](http://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). +That is why [Treasure Data, Inc](https://www.treasuredata.com/) provides **the stable distribution of Fluentd**, called `td-agent`. The differences between Fluentd and `td-agent` can be found [here](https://www.fluentd.org/faqs). This installation guide is for `td-agent` v4. `td-agent` v4 uses fluentd v1 in the core. See [this page](../appendix/td-agent-v2-vs-v3-vs-v4.md) for the comparison and supported OS. diff --git a/installation/install-from-source.md b/installation/install-from-source.md index 34070585..e80084b1 100644 --- a/installation/install-from-source.md +++ b/installation/install-from-source.md @@ -8,7 +8,7 @@ Install Ruby `>= 3.2` and `bundler` on your local environment. ## Step 2: Fetch Source Code -Fetch the source code from GitHub. The official repository is located [here](http://github.com/fluent/fluentd/). +Fetch the source code from GitHub. The official repository is located [here](https://github.com/fluent/fluentd/). ```text $ git clone https://github.com/fluent/fluentd.git diff --git a/language-bindings/java.md b/language-bindings/java.md index 9bea7b2d..3b695d5d 100644 --- a/language-bindings/java.md +++ b/language-bindings/java.md @@ -1,6 +1,6 @@ # Java -The [`fluent-logger-java`](http://github.com/fluent/fluent-logger-java) library is used to post records from Java applications to Fluentd. +The [`fluent-logger-java`](https://github.com/fluent/fluent-logger-java) library is used to post records from Java applications to Fluentd. This article explains how to use it. diff --git a/language-bindings/nodejs.md b/language-bindings/nodejs.md index 03f9b30f..8f4f9f12 100644 --- a/language-bindings/nodejs.md +++ b/language-bindings/nodejs.md @@ -50,7 +50,7 @@ The most recent version of `@fluent-org/logger` can be found [here](https://www. ### A Sample Application -Here is a sample [Express](http://expressjs.com/) app using `@fluent-org/logger`: +Here is a sample [Express](https://expressjs.com/) app using `@fluent-org/logger`: #### `package.json` diff --git a/language-bindings/perl.md b/language-bindings/perl.md index a41a9f6d..1a287d9c 100644 --- a/language-bindings/perl.md +++ b/language-bindings/perl.md @@ -1,6 +1,6 @@ # Perl -The [`Fluent::Logger`](http://github.com/fluent/fluent-logger-perl) library is used to post records from Perl applications to Fluentd. +The [`Fluent::Logger`](https://github.com/fluent/fluent-logger-perl) library is used to post records from Perl applications to Fluentd. This article explains how to use it. @@ -42,7 +42,7 @@ $ sudo systemctl restart td-agent.service ## Using `Fluent::Logger` -Install [`Fluent::Logger`](http://search.cpan.org/dist/Fluent-Logger/) library via CPAN: +Install [`Fluent::Logger`](https://search.cpan.org/dist/Fluent-Logger/) library via CPAN: ```text $ cpan diff --git a/language-bindings/php.md b/language-bindings/php.md index 074818f8..2878c50f 100644 --- a/language-bindings/php.md +++ b/language-bindings/php.md @@ -1,6 +1,6 @@ # PHP -The [`fluent-logger-php`](http://github.com/fluent/fluent-logger-php) library is used to post records from PHP applications to Fluentd. +The [`fluent-logger-php`](https://github.com/fluent/fluent-logger-php) library is used to post records from PHP applications to Fluentd. This article explains how to use it. diff --git a/language-bindings/python.md b/language-bindings/python.md index 2e6f920a..022a1581 100644 --- a/language-bindings/python.md +++ b/language-bindings/python.md @@ -1,6 +1,6 @@ # Python -The [`fluent-logger-python`](http://github.com/fluent/fluent-logger-python) library is used to post records from Python applications to Fluentd. +The [`fluent-logger-python`](https://github.com/fluent/fluent-logger-python) library is used to post records from Python applications to Fluentd. This article explains how to use it. diff --git a/language-bindings/ruby.md b/language-bindings/ruby.md index 06836ea2..092d294f 100644 --- a/language-bindings/ruby.md +++ b/language-bindings/ruby.md @@ -1,6 +1,6 @@ # Ruby -The [`fluent-logger-ruby`](http://github.com/fluent/fluent-logger-ruby) library is used to post records from Ruby applications to Fluentd. +The [`fluent-logger-ruby`](https://github.com/fluent/fluent-logger-ruby) library is used to post records from Ruby applications to Fluentd. This article explains how to use it. diff --git a/language-bindings/scala.md b/language-bindings/scala.md index 5b29396d..75b50bc1 100644 --- a/language-bindings/scala.md +++ b/language-bindings/scala.md @@ -46,7 +46,7 @@ $ sudo systemctl restart td-agent.service Add the following lines to `build.sbt`: ```text -resolvers += "Apache Maven Central Repository" at "http://repo.maven.apache.org/maven2/" +resolvers += "Apache Maven Central Repository" at "https://repo.maven.apache.org/maven2/" libraryDependencies += "org.fluentd" %% "fluent-logger-scala" % "(version)" ``` diff --git a/monitoring-fluentd/monitoring-prometheus.md b/monitoring-fluentd/monitoring-prometheus.md index b56fbcef..b132420c 100644 --- a/monitoring-fluentd/monitoring-prometheus.md +++ b/monitoring-fluentd/monitoring-prometheus.md @@ -264,7 +264,7 @@ For more advanced visualization and alerting, we recommend [Grafana](https://gra ## Further Readings * [Prometheus Documentation](https://prometheus.io/docs/introduction/overview/) -* [Grafana Documentation](http://docs.grafana.org/) +* [Grafana Documentation](https://docs.grafana.org/) If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs-gitbook/issues?state=open). [Fluentd](https://www.fluentd.org/) is an open-source project under [Cloud Native Computing Foundation \(CNCF\)](https://cncf.io/). All components are available under the Apache 2 License. diff --git a/monitoring-fluentd/monitoring-rest-api.md b/monitoring-fluentd/monitoring-rest-api.md index b790c15e..aa648a4b 100644 --- a/monitoring-fluentd/monitoring-rest-api.md +++ b/monitoring-fluentd/monitoring-rest-api.md @@ -69,7 +69,7 @@ Use [`flowcounter`](https://github.com/tagomoris/fluent-plugin-flowcounter) or [ For more details: -* [Datadog-Fluentd Integration](http://docs.datadoghq.com/integrations/fluentd/) +* [Datadog-Fluentd Integration](https://docs.datadoghq.com/integrations/fluentd/) If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs-gitbook/issues?state=open). [Fluentd](https://www.fluentd.org/) is an open-source project under [Cloud Native Computing Foundation \(CNCF\)](https://cncf.io/). All components are available under the Apache 2 License. diff --git a/output/exec.md b/output/exec.md index 33a52a88..fc65abf9 100644 --- a/output/exec.md +++ b/output/exec.md @@ -28,7 +28,7 @@ Please see the [Configuration File](../configuration/config-file.md) article for This example illustrates how to run FizzBuzz with `out_exec`. -We assume that the input file is specified by the last argument in the command line \(`ARGV[-1]`\). The following script `fizzbuzz.py` runs [FizzBuzz](http://en.wikipedia.org/wiki/Fizz_buzz) against the new-line delimited sequence of natural numbers \(1, 2, 3...\) and writes the output to `foobar.out`: +We assume that the input file is specified by the last argument in the command line \(`ARGV[-1]`\). The following script `fizzbuzz.py` runs [FizzBuzz](https://en.wikipedia.org/wiki/Fizz_buzz) against the new-line delimited sequence of natural numbers \(1, 2, 3...\) and writes the output to `foobar.out`: ```text #!/usr/bin/env python diff --git a/output/mongo.md b/output/mongo.md index a6d93613..faabc67f 100644 --- a/output/mongo.md +++ b/output/mongo.md @@ -2,7 +2,7 @@ ![](../.gitbook/assets/mongo%20%283%29.png) -The `out_mongo` Output plugin writes records into [MongoDB](http://mongodb.org/), the emerging document-oriented database system. +The `out_mongo` Output plugin writes records into [MongoDB](https://mongodb.org/), the emerging document-oriented database system. If you're using `ReplicaSet`, please see the [`out_mongo_replset`](mongo_replset.md) article instead. diff --git a/output/mongo_replset.md b/output/mongo_replset.md index d7b1cc6a..9a832095 100644 --- a/output/mongo_replset.md +++ b/output/mongo_replset.md @@ -2,7 +2,7 @@ ![](../.gitbook/assets/mongo_replset.png) -The `out_mongo_replset` Output plugin writes records into [MongoDB](http://mongodb.org/), the emerging document-oriented database system. +The `out_mongo_replset` Output plugin writes records into [MongoDB](https://mongodb.org/), the emerging document-oriented database system. This plugin is for users using ReplicaSet. If you are not using `ReplicaSet`, please see the [`out_mongo`](mongo.md) article instead. diff --git a/output/s3.md b/output/s3.md index 8fa73a1f..71fe089c 100644 --- a/output/s3.md +++ b/output/s3.md @@ -103,7 +103,7 @@ Here are some regions: * `ap-southeast-1` * `sa-east-1` -See the complete list of regions [here](http://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region). +See the complete list of regions [here](https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region). ### `` Directive diff --git a/output/webhdfs.md b/output/webhdfs.md index ab90befd..479c6e53 100644 --- a/output/webhdfs.md +++ b/output/webhdfs.md @@ -155,7 +155,7 @@ For common output / buffer parameters, please check the following articles: ## Further Reading * [`fluent-plugin-webhdfs`](https://github.com/fluent/fluent-plugin-webhdfs) -* [Slides: Fluentd and WebHDFS](http://www.slideshare.net/tagomoris/fluentd-and-webhdfs) +* [Slides: Fluentd and WebHDFS](https://www.slideshare.net/tagomoris/fluentd-and-webhdfs) If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs-gitbook/issues?state=open). [Fluentd](https://www.fluentd.org/) is an open-source project under [Cloud Native Computing Foundation \(CNCF\)](https://cncf.io/). All components are available under the Apache 2 License. diff --git a/parser/csv.md b/parser/csv.md index e54591b5..6776919e 100644 --- a/parser/csv.md +++ b/parser/csv.md @@ -32,7 +32,7 @@ The parser type used to parse the log line. * `normal` uses Ruby's - [`CSV.parse_line`](http://ruby-doc.org/stdlib-2.4.1/libdoc/csv/rdoc/CSV.html#method-c-parse_line) + [`CSV.parse_line`](https://ruby-doc.org/stdlib-2.4.1/libdoc/csv/rdoc/CSV.html#method-c-parse_line) method. diff --git a/parser/regexp.md b/parser/regexp.md index e8beb9e7..269a37fa 100644 --- a/parser/regexp.md +++ b/parser/regexp.md @@ -105,7 +105,7 @@ record: ### How to debug my regexp pattern? -[fluentd-ui's `in_tail` editor](../deployment/fluentd-ui.md#in_tail-setting) helps your regexp testing. Another way, [Fluentular](http://fluentular.herokuapp.com/) is a great website to test your regexp for Fluentd configuration. +[fluentd-ui's `in_tail` editor](../deployment/fluentd-ui.md#in_tail-setting) helps your regexp testing. Another way, [Fluentular](https://fluentular.herokuapp.com/) is a great website to test your regexp for Fluentd configuration. NOTE: You may hit Application Error at Fluentular due to [heroku's free plan limitation](https://www.heroku.com/pricing). Retry a few hours later or use `fluentd-ui` instead. diff --git a/plugin-development/README.md b/plugin-development/README.md index 24100afe..7995db38 100644 --- a/plugin-development/README.md +++ b/plugin-development/README.md @@ -312,7 +312,7 @@ For more details, see `fluent-plugin-config-format --help`. The following slides can help understand how Fluentd works before diving into writing custom plugins. -These slides are from [Naotoshi Seo's](https://github.com/sonots) [RubyKaigi 2014 talk](http://rubykaigi.org/2014/presentation/S-NaotoshiSeo/). +These slides are from [Naotoshi Seo's](https://github.com/sonots) [RubyKaigi 2014 talk](https://rubykaigi.org/2014/presentation/S-NaotoshiSeo/). The slides are based on Fluentd v0.12. There are many differences between v0.12 and v1 API, but it may help build an understanding of overall Fluentd's design. @@ -340,7 +340,7 @@ Fluentd's plug-in mechanism has a merit to extend functionality, but plugin deve ## Further Reading -* [Slides: Fluentd v0.14 Plugin API Details](http://www.slideshare.net/tagomoris/fluentd-v014-plugin-api-details) -* [Slides: Dive into Fluentd Plugin](http://www.slideshare.net/repeatedly/dive-into-fluentd-plugin-v012) (outdated) +* [Slides: Fluentd v0.14 Plugin API Details](https://www.slideshare.net/tagomoris/fluentd-v014-plugin-api-details) +* [Slides: Dive into Fluentd Plugin](https://www.slideshare.net/repeatedly/dive-into-fluentd-plugin-v012) (outdated) If this article is incorrect or outdated, or omits critical information, please [let us know](https://github.com/fluent/fluentd-docs-gitbook/issues?state=open). [Fluentd](https://www.fluentd.org/) is an open-source project under [Cloud Native Computing Foundation \(CNCF\)](https://cncf.io/). All components are available under the Apache 2 License. diff --git a/quickstart/faq.md b/quickstart/faq.md index 93e0ee7b..64eaf0b2 100644 --- a/quickstart/faq.md +++ b/quickstart/faq.md @@ -108,7 +108,7 @@ Please refer to the [Plugin Development Guide](../plugin-development/). ### How can I parse ``? -If you are willing to write Regexp, [fluentd-ui's `in_tail` editor](../deployment/fluentd-ui.md#in_tail-setting) or [Fluentular](http://fluentular.herokuapp.com) is a great tool to verify your Regexps. +If you are willing to write Regexp, [fluentd-ui's `in_tail` editor](../deployment/fluentd-ui.md#in_tail-setting) or [Fluentular](https://fluentular.herokuapp.com) is a great tool to verify your Regexps. If you do NOT want to write any Regexp, look at [the Grok parser](https://github.com/kiyoto/fluent-plugin-grok-parser).