Skip to content

Releases: pinterest/singer

Singer 0.8.0.80

30 Apr 00:10
ca0a01f
Compare
Choose a tag to compare

Adds fleet level disable decider logic (#377)

Singer 0.8.0.28

22 Aug 01:20
d37c9cd
Compare
Choose a tag to compare

This release includes:

  1. remove non-inclusion words
    #75
    #76

  2. enable Singer memory efficiency
    #77
    #78

  3. audit client library uses fixed partition instead of random partition to reduce TCP connections
    #80

  4. size metrics for message key and message value
    #82
    #81

Singer 0.8.0.24

04 Aug 23:05
d6585a7
Compare
Choose a tag to compare

This release added crc32 checksum validattion at thrift-logger and Singer to detect and remove corrupted messages. #71 #72 #73 #74

Singer 0.8.0.2

14 Feb 01:44
22a66a2
Compare
Choose a tag to compare

Added support for Kafka producer memory metrics tracking.

Singer 0.8.0-rc.6

09 Jan 04:55
6c3f42a
Compare
Choose a tag to compare
Singer 0.8.0-rc.6 Pre-release
Pre-release

this release 0.8.0-rc.6 for logging-audit branch includes:

(1) merge master branch to logging-audit branch
(2) init HOST_NAME to be "n/a"

Singer 0.8.0-rc.5

19 Dec 00:30
ed4c023
Compare
Choose a tag to compare
Singer 0.8.0-rc.5 Pre-release
Pre-release

this version bump is for #28

Add timestamp field to logging audit headers. This timestamp is used to bucket audit events (containing logging audit headers) into same time window. timestamp generation and setting are handled by the audit client library under the hood.

Singer 0.8.0-rc.4

18 Dec 22:38
40550a6
Compare
Choose a tag to compare
Singer 0.8.0-rc.4 Pre-release
Pre-release

Enable Singer to attach LoggingAuditHeaders if logging audit starts at Singer. It is used for log files not generated by ThriftLogger.

Singer 0.8.0-rc.3

18 Dec 22:36
e5ed537
Compare
Choose a tag to compare
Singer 0.8.0-rc.3 Pre-release
Pre-release
  1. update libthrift version to be consistent across modules of Singer project
  2. change TSerializer to be object variable for thread-safety

Singer 0.7.3.1

07 Dec 09:14
6ed4d41
Compare
Choose a tag to compare

two changes in this release:

(1) Add metric to track number of kafka producers

(2) Remove Singer's dependency on finagle and remove Twitter public Maven repo.

Singer 0.8.0-rc.2

26 Nov 08:52
7e40a48
Compare
Choose a tag to compare
Singer 0.8.0-rc.2 Pre-release
Pre-release

logging-audit client implementation part 2:

(1) add LoggingAuditClient and its configuration parsing code. LoggingAuditClient maintains LinkedBlockingDeque of LoggingAuditEvent, has a AuditEventSender (wrapper of KafkaProducer) and provides audit() method for various clients. audit() method is called by client such as ThriftLogger instance and Singer's KafkaWriter in order to generate and enqueue a LoggingAuditEvent. LoggingAuditEvent is corresponding to LoggingAuditHeaders injected into the LogMessage.

(2) add implementations to singer module in order to enable LoggingAudit feature which is configurable per logStream (SingerLogConfig). SingerSettings will maintain an instance of LoggingAuditClient for handling LoggingAuditEvent generation and emission. Singer cleanup thread will call the close method of LoggingAuditClient to gracefully shutdown and cleanup LoggingAuditEvents left in the LinkedBlockingDeque.

(3) add implementations to thrift-logger module in order to enable LoggingAudit feature which is configurable per topic. AuditableLogbackThriftLoggerFactory will maintain an instance LoggingAuditClient for handling LoggingAuditEvent generation and emission. The close method of LoggingAuditClient is added at the end of shutdown method of AuditableLogbackThriftLoggerFactory.

(4) refactor ThriftLoggerFactory, AuditableLogbackThriftLoggerFactory and AuditableLogbackThriftLogger to make sure: AuditableLogbackThriftLoggerFactory is called by default in ThriftLoggerFactory. Whether LoggingAudit feature is enabled or not for AuditableLogbackThriftLoggerFactory depends on LoggingAuditClient being created properly; whether LoggingAudit feature is enabled or not for certain topic depends on ThriftLoggerConfig being created properly when creating AuditableLogbackThriftLogger instance. If LoggingAudit required fields are not set in ThriftLoggerConfig, the created AuditableLogbackThriftLogger instance behaves the same as the normal LogbackThriftLogger instance.