Commit Graph
55 Commits
Author SHA1 Message Date
Daniel NelsonandGitHub 601f499126 Remove tail cleanup call to avoid double decrement (#6089) 2019-07-08 14:48:47 -07:00
Daniel Nelson c023ffe0a5 Add unique_timestamp option from grok parser to logparser grok 2019-02-26 18:05:04 -08:00
Daniel Nelson 0a2cc3ac3f Update link to grok built in patterns 2019-02-21 12:11:00 -08:00
Daniel Nelson 3c95b25588 Update link to grok built in patterns 2019-02-21 12:08:59 -08:00
Samuel-BFandDaniel Nelson f530ca6e7c Use godirwalk in globpath (#5145) 2018-12-18 14:23:25 -08:00
GregandDaniel Nelson 83bc3d1277 Improve docs to clarify common issues (#5054) 2018-12-10 16:14:20 -08:00
Daniel NelsonandGitHub f5af2ab799 Remove dead link from logparser sampleconfig and fix syntax (#4883) 2018-10-18 23:26:42 -07:00
Greg 6e8b7e3cc6 Fix panic in logparser input (#4849) 2018-10-17 13:02:03 -06:00
Daniel NelsonandGreg c3bab78ea8 Fix case of timezone/grok_timezone options. (#4799) 2018-10-03 13:58:21 -06:00
Daniel NelsonandGitHub b5299f4cc4 Fix cleanup of csv parser options, use per file parser (#4712) 2018-09-18 09:23:45 -07:00
Daniel Nelson 710c101fe0 Undeprecate logparser
Until dynamic file tailing can be added to the tail plugin.
2018-09-07 16:13:46 -07:00
Adrián LópezandGreg e50b0c17ad Document how to parse telegraf logs (#4285) 2018-08-14 14:53:25 -06:00
Daniel NelsonandGitHub 83c4b81abe Copy grok documentation from logparser to data format doc (#4475) 2018-07-27 18:28:33 -07:00
Daniel Nelson 14d25af4d4 Remove DS_Store files 2018-07-13 23:23:47 -07:00
maxuntandDaniel Nelson 774a9f0492 Add file input plugin and grok parser (#4332) 2018-07-13 23:22:59 -07:00
AyrdrieandDaniel Nelson 9fe90d71f4 Add plugin development framework (#4324) 2018-07-02 16:34:40 -07:00
Daniel NelsonandGitHub 9bd5e10133 Fix syslog timestamp parsing with single digit day of month (#4334) 2018-06-29 18:05:46 -07:00
maxuntandDaniel Nelson a10262c5d6 Add log message when tail is added or removed from a file (#4322) 2018-06-29 16:15:33 -07:00
AyrdrieandDaniel Nelson 61e197d254 Add support for comma in logparser timestamp format (#4311) 2018-06-21 14:19:15 -07:00
Daniel NelsonandGitHub 14d97e5416 Add special syslog timestamp parser that uses current year (#4190)
Previously it was impossible to parse syslog timestamps without the date
being reported as year 0, due to the year not being specified
2018-05-23 16:37:14 -07:00
Daniel Nelson 239333ad90 Remove dead link from logparser sample config 2018-05-02 11:49:51 -07:00
Daniel Nelson 377547aa4c Document one field per line requirement in logparser 2018-04-30 16:15:51 -07:00
Daniel NelsonandGitHub 55cfc383f3 Allow grok pattern to contain newlines (#4005) 2018-04-10 18:16:21 -07:00
Scott AndersonandDaniel Nelson a50acadc44 Add details about why not all logstash patterns are supported (#3971) 2018-04-04 14:42:58 -07:00
Daniel NelsonandGitHub 1c0f63a90d Add new line protocol parser and serializer, influxdb output (#3924) 2018-03-27 17:30:51 -07:00
Daniel NelsonandGitHub 4deb6238a3 Add support for decimal timestamps to ts-epoch modifier (#3358) 2017-10-19 16:36:32 -07:00
Daniel NelsonandGitHub 32f313a6a6 Add polling method to logparser and tail inputs (#3213) 2017-09-11 11:56:04 -07:00
Daniel NelsonandGitHub ca394fcfb2 Discard logging from tail library (#3128) 2017-08-16 12:06:07 -07:00
Daniel Nelson 9bc13f143e Test for nil metric before reading tags in logparser 2017-08-15 11:43:16 -07:00
Daniel NelsonandGitHub 287a44de5e Skip compilcation of logparser and tail on solaris (#3113)
Allows compilation for solaris
2017-08-10 12:36:11 -07:00
Daniel NelsonandGitHub 3e27134872 Add path tag to logparser containing path of logfile (#3098) 2017-08-07 16:16:31 -07:00
Daniel NelsonandGitHub a26fc52181 Fix panic in logparser if file cannot be opened (#3055) 2017-07-25 17:08:03 -07:00
Daniel NelsonandGitHub 3ecfd32df5 Allow dos line endings in tail and logparser (#2920)
Parsing dos line ending delimited line protocol is still illegal in most
cases.
2017-06-16 13:16:48 -07:00
Sebastian BorzaandDaniel Nelson 035905d65e Add timezone support to logparser timestamps (#2882) 2017-06-05 14:45:11 -07:00
Daniel NelsonandGitHub f7f1eaef65 Return an error if no valid patterns. (#2753) 2017-05-02 14:54:38 -07:00
Patrick HemmerandDaniel Nelson 06baf7cf78 use AddError everywhere (#2372) 2017-04-24 11:13:26 -07:00
Daniel NelsonandGitHub b90a5b48a1 Improve logparser README (#2664) 2017-04-14 13:47:43 -07:00
Daniel NelsonandGitHub 3e0c55bff9 Update grok version (#2662) 2017-04-12 17:10:17 -07:00
Daniel NelsonandGitHub 2d7f612bd7 Use fork of hpcloud/tail (#2595) 2017-03-29 14:25:33 -07:00
Patrick HemmerandDaniel Nelson 1402c158b7 remove sleep from tests (#2555) 2017-03-24 12:03:36 -07:00
Cameron Sparr b9457a1092 log error message when invalid regex is used
closes #2178
2017-02-28 12:48:14 +00:00
njwhiteandCameron Sparr 2932db8480 Make Logparser Plugin Check For New Files (#2141)
* Make Logparser Plugin Check For New Files

Check in the Gather metric to see if any new files matching the glob
have appeared. If so, start tailing them from the beginning.

* changelog update for #2141
2017-02-01 14:11:39 +00:00
Cameron Sparr a90afd95c6 Fix & unit test logparser CLF pattern with IPv6
deals partially with #1973

see also https://github.com/vjeantet/grok/issues/17
2016-12-20 15:57:32 +00:00
Cameron Sparr 12db3b9120 Check if metric is nil before calling SetAggregate
fixes #2146
2016-12-13 12:27:10 +00:00
Cameron Sparr db7a4b24b6 Implement telegraf's own full metric type
main reasons behind this:
- make adding/removing tags cheap
- make adding/removing fields cheap
- make parsing cheaper
- make parse -> decorate -> write out bytes metric flow much faster

Refactor serializer to use byte buffer
2016-12-01 18:17:02 +00:00
Cameron Sparr d627bdbbdb logparser: allow numbers in ident & auth parameters
fixes #1810
2016-10-10 11:27:35 +01:00
Cameron Sparr c7834209d2 Major Logging Overhaul
in this commit:

- centralize logging output handler.
- set global Info/Debug/Error log levels based on config file or flags.
- remove per-plugin debug arg handling.
- add a I!, D!, or E! to every log message.
- add configuration option to specify where to send logs.

closes #1786
2016-10-03 17:13:03 +01:00
Cameron Sparr 4bc6fdb09e Removing INFLUXDB_HTTP_LOG from logparser usage/docs
this log format is likely soon going to be removed from a future
influxdb release, so we should not be recommending that users base any
of their log parsing infra on this.
2016-08-04 16:42:59 +01:00
Cameron Sparr 2b43b385de Begin implementing generic timestamp logparser capability 2016-08-04 16:08:55 +01:00
Cameron Sparr dabb6f5466 Internally name all patterns for log parsing flexibility
closes #1436

This also fixes the bad behavior of waiting until runtime to return log
parsing pattern compile errors when a pattern was simply unfound.

closes #1418

Also protect against user error when the telegraf user does not have
permission to open the provided file. We will now error and exit in this
case, rather than silently waiting to get permission to open it.
2016-07-18 15:44:58 +01:00