Error while Unzipping .tar.gz files using Copy activity - Failing for csv file having 8GB of data

Question

Error while Unzipping .tar.gz files using Copy activity - Failing for csv file having 8GB of data

Nagarajan Arumugam 0

Hi,

I am trying to uncompress .tar.gz files using Copy Activity and it was working fine till yesterday. Today we have received a file with more data and it got failed while copying one file with 8GB of data with following error "ErrorCode=UserErrorWriteFailedFileOperation,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The file operation is failed, upload file failed at path: 'xxx-xx/yy/zzz/Test/251963-20250310-0000-F '.,Source=Microsoft.DataTransfer.Common,''Type=ICSharpCode.SharpZipLib.Tar.TarException,Message=Header checksum is invalid,Source=ICSharpCode.SharpZipLib,'".

Note : .tar.gz file contents multiple csv file data. We are unzipping and copying to further layer in our data lake.,

Venkat Reddy Navari 80 Reputation points Microsoft External Staff

2025-03-12T09:15:55.23+00:00

@Nagarajan Arumugam
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Venkat Reddy Navari 80 Reputation points Microsoft External Staff

2025-03-13T09:52:49.7+00:00

@Nagarajan Arumugam
Following up to see if the below answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Your answer

Venkat Reddy Navari 80 Reputation points Microsoft External Staff

2025-03-12T09:15:55.23+00:00

@Nagarajan Arumugam
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Venkat Reddy Navari 80 Reputation points Microsoft External Staff

2025-03-13T09:52:49.7+00:00

@Nagarajan Arumugam
Following up to see if the below answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 1

Hi Nagarajan Arumugam.

It looks like you're encountering an issue while trying to uncompress an 8GB.tar.gz file using the Copy Activity in Azure Data Factory. The error indicates a checksum issue with the file's header, which can be caused by several factors.

Verify the file integrity to ensure the.tar.gz file isn’t corrupted. You can check the file’s integrity or compare it with the source file if possible. If needed, attempt to download or transfer the file again from the original source.
Ensure there is enough disk space in the destination where you're attempting to uncompress and transfer the files. A lack of available space could lead to the operation failing.
Try testing with smaller files to determine if the issue is related to the 8GB file. If the smaller files work without issues, then the size of the file might be a contributing factor.
If the issue persists, you might want to try extracting the files manually using tools like tar or gzip before uploading them to your data lake. This can help you identify whether the issue is with Azure Data Factory or the file itself.
Verify that the.tar.gz file is correctly structured and includes valid CSV files, as any formatting issues could lead to the checksum error. Take a look at the logs for any other error messages or information that might provide more insight into the issue.

I hope this helps. Please let us know if you have any further questions.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.

Share via

Error while Unzipping .tar.gz files using Copy activity - Failing for csv file having 8GB of data

1 answer

Your answer