CfnDeliveryStream.ExtendedS3DestinationConfigurationProperty: file_extension parameter does not exist

[ayankowsky]

Describe the issue

Using the file_extension parameter results in an error.

TypeError: CfnDeliveryStream.ExtendedS3DestinationConfigurationProperty.__init__() got an unexpected keyword argument 'file_extension'

Links

https://docs.aws.amazon.com/cdk/api/v2/python/aws_cdk.aws_kinesisfirehose/CfnDeliveryStream.html#aws_cdk.aws_kinesisfirehose.CfnDeliveryStream.ExtendedS3DestinationConfigurationProperty

[khushail]

Hi @ayankowsky , thanks for reaching out. The cloudformation docs specify FileExtension as property under ExtendedS3Configuration -https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-kinesisfirehose-deliverystream-extendeds3destinationconfiguration.html#cfn-kinesisfirehose-deliverystream-extendeds3destinationconfiguration-fileextension.

Could you please share a minimum code snippet which can repro the error.
Thanks

[github-actions]

This issue has not received a response in a while. If you want to keep this issue open, please leave a comment below and auto-close will be canceled.

[ayankowsky]

Creating any Firehose with an ExtendedS3DestinationConfigurationProperty that specifies a file_extension will recreate the error:

example_firehose = firehose.CfnDeliveryStream(
    self,
    "ExampleFirehose",
    delivery_stream_name="ExampleFirehose",
    delivery_stream_type="DirectPut",
    extended_s3_destination_configuration=firehose.CfnDeliveryStream.ExtendedS3DestinationConfigurationProperty(
        bucket_arn=example_bucket.bucket_arn,
        role_arn=example_firehose_role.role_arn,
        compression_format="GZIP",
        prefix="Example/",
        buffering_hints=firehose.CfnDeliveryStream.BufferingHintsProperty(
            interval_in_seconds=60,
            size_in_m_bs=64,
        ),
        file_extension=".json.gz",
        error_output_prefix="ErrorLogs/",
    ),
)

If you look at the ExtendedS3DestinationConfigurationProperty class init() function, you'll see file_extension is not a parameter, as the documentation suggests.

    class ExtendedS3DestinationConfigurationProperty:
        def __init__(
            self,
            *,
            bucket_arn: builtins.str,
            role_arn: builtins.str,
            buffering_hints: typing.Optional[typing.Union[_IResolvable_da3f097b, typing.Union["CfnDeliveryStream.BufferingHintsProperty", typing.Dict[builtins.str, typing.Any]]]] = None,
            cloud_watch_logging_options: typing.Optional[typing.Union[_IResolvable_da3f097b, typing.Union["CfnDeliveryStream.CloudWatchLoggingOptionsProperty", typing.Dict[builtins.str, typing.Any]]]] = None,
            compression_format: typing.Optional[builtins.str] = None,
            data_format_conversion_configuration: typing.Optional[typing.Union[_IResolvable_da3f097b, typing.Union["CfnDeliveryStream.DataFormatConversionConfigurationProperty", typing.Dict[builtins.str, typing.Any]]]] = None,
            dynamic_partitioning_configuration: typing.Optional[typing.Union[_IResolvable_da3f097b, typing.Union["CfnDeliveryStream.DynamicPartitioningConfigurationProperty", typing.Dict[builtins.str, typing.Any]]]] = None,
            encryption_configuration: typing.Optional[typing.Union[_IResolvable_da3f097b, typing.Union["CfnDeliveryStream.EncryptionConfigurationProperty", typing.Dict[builtins.str, typing.Any]]]] = None,
            error_output_prefix: typing.Optional[builtins.str] = None,
            prefix: typing.Optional[builtins.str] = None,
            processing_configuration: typing.Optional[typing.Union[_IResolvable_da3f097b, typing.Union["CfnDeliveryStream.ProcessingConfigurationProperty", typing.Dict[builtins.str, typing.Any]]]] = None,
            s3_backup_configuration: typing.Optional[typing.Union[_IResolvable_da3f097b, typing.Union["CfnDeliveryStream.S3DestinationConfigurationProperty", typing.Dict[builtins.str, typing.Any]]]] = None,
            s3_backup_mode: typing.Optional[builtins.str] = None,
        ) -> None:

This seems to be unintentionally left out from CDK, especially since CloudFormation supports this parameter, while CDK does not.