Can otel send logs to fluentd aggregator

[jrohitdev]

Describe the bug

Can otel be used to send logs to fluentd aggregator (In this we use fluentd as the base image where we do log level filtering) and then forward it to splunk(this logic will be taken care in fluentd aggregator part).

I tried adding the below config to the otel

 exporters:
  otlp/logs:
    endpoint: <fluentd-aggregator-service-endpoint>
 
 receivers:
      filelog:
        encoding: utf-8
        include:
        - /var/log/pods/*/*/*.log
        include_file_name: false
        include_file_path: true
        max_concurrent_files: 1024
        max_log_size: 1MiB

processors:
  batch: null

service:
   pipelines:
     logs:
         receivers: [filelog]
         processors: [batch]
         exporters: [otlp/logs]

With above config I see below error's in fluentd aggregator logs

2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=22
2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=3
2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=1
2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=1
2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=53
2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=1
2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=0
2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=1
2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=49
2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=3
2024-11-14 06:32:32 +0000 [warn]: #2 incoming chunk is broken: host="a.x.y.z" msg=3

I mainly wanted to understand are otel and fluentd aggregator compatible with each other(i.e otel sending collected logs to fluentd aggregator and fluentd-aggregator processing those logs)?

Steps to reproduce
Apply config mentioned in the description

What did you expect to see?
Fluentd aggregator processing the logs provided from otel

What did you see instead?
incoming chunk is broken: warning message in fluentd

What version did you use?
0.83.0

What config did you use?

Environment

Additional context