Skip to content

Latest commit

 

History

History
72 lines (66 loc) · 6.74 KB

data-prepper.release-notes-2.1.0.md

File metadata and controls

72 lines (66 loc) · 6.74 KB
Raw

2023-03-02 Version 2.1.0

Features

  • Support OpenTelementry Logs (#1372)
  • New type conversion processor (#2010)
  • New anomaly detection processor (#2040)
  • Support histogram action in aggregate processor (#2078)
  • Support percent sampler action in aggregate processor (#2094)
  • Support rate limiter action in aggregate processor (#2088)
  • Provide a circuit breaking capability (#2150)

Enhancements

  • Support custom headers when assuming AWS IAM roles (#1888)
  • Provide additional metrics for S3 source (#2025)
  • Support "when" condition in aggregate processor actions (#2021)
  • Support dynamic index name in OpenSearch sink (#1459)
  • Support latest OTEL metrics features (#1310)
  • Support loading files from S3 in OpenSearch sink (#2120)
  • Support metric tags based on metric name pattern (#2229)
  • Support retry when sink fails to initialize (#936)
  • Add more metrics for OpenSearch sink (#2168)
  • Validate file content from S3 for OpenSearch sink (#2178)
  • Add more configurable values to OTEL trace raw processor (#2165)
  • Add more metrics for OTEL trace raw processor (#2166)
  • Provide logging markers to filter sensitive data and events (#1990)
  • Support sensitive data masking in logs (#2187)
  • Emit Metrics for ACM and AWS CloudMap related calls (#2087)
  • Add buffer overflow metric in AbstractBuffer (#2167)
  • Support configurable read batch delay for peer-forwarder (#2158)
  • Improve ReceiveBuffer Performance (#2142)
  • Support OTEL scope logs (#2115)
  • Implement batching for peer forwarder request documents (#2197)
  • Add more metrics to OTEL metrics source (#2283)
  • Support a version property in pipeline YAML configurations (#2263)
  • Change the path prefix for OTEL endpoints (#2257)
  • Change the path for HTTP source (#2258)
  • Improve peer-forwarding serialization (#2242)
  • Add null support to Data Prepper Expressions (#1136)
  • Support for complex document ID and routing ID (#1966)
  • Add PluginMetrics in the Auth Plugin for HTTP, OTEL and Metrics Source (#2023)
  • Support Long type in expressions (#2265)
  • Add backoff for SQS in S3 source to reduce logging (#2326)
  • Add several performance improvement changes (#2190, #2228, #2238, #2239, #2241, #2246, #2250, #2290)

Bug Fixes

  • Fix logging by updating related packages for SLF4J 2.0 (#2113)
  • Fix null pointer exception in remote peer forwarding (#2124)
  • Fix Data Prepper to not terminate on invalid open telemetry metric/trace data (#2176)
  • Fix Armeria exception when under pressure (#2274)
  • Fix release build issue (#2345)

Security

  • Fix CVE-2022-3509, CVE-2022-3510 (#2079)
  • Fix CVE-2022-41881, CVE-2021-21290 and CVE-2022-41915 (#2093)
  • Fix CVE-2020-8908, CVE-2018-10237 (#2254)
  • Update OpenTelemetry dependencies to address CVE-2023-25577 and CVE-2023-23934 (#2288)
  • Use secure Java serialization with Java serialization (#2310)

Maintenance

  • Test against multiple OTEL version (#1963)
  • Document trace_peer_forwarder in README (#2141)
  • Use consistent AWS pipeline configurations (#2184)
  • Use snake case for all configurations (#2203)