Page 1 of 1

7zip multithreading deadlock on ~100Gb files

PostPosted: Nov 9th, '20, 22:22
by Northsoft
Hello, 7zip freezes on compressing big file when I specify -mx=9 -myx=9. If I call strace on running processes, I see single futex syscall in every process. If I specify -mmt=off, I face great decrease of compression speed, but no freeze. How can I troubleshoot that? 5.9.6-desktop-1.mga8, 7z 16.02 2016-05-21. Ryzen 5 3500X, 16 Gb RAM.

Re: 7zip multithreading deadlock on ~100Gb files

PostPosted: Nov 9th, '20, 23:48
by doktor5000
You may want to add some basic context information. What type of file are you running this on, where is it located (underlying filesystem and what physical type of storage).

Also, what do you expect to happen when you do this? Your box will basically be using 100% CPU which might be freezing e.g. your graphical desktop partially or fully, depending on what scheduler is being used for that device and if you're not using something like ionice or similar.

Re: 7zip multithreading deadlock on ~100Gb files

PostPosted: Nov 10th, '20, 07:10
by Northsoft
doktor5000 wrote:What type of file are you running this on

Disk image got by dd. AFAIR this issue also happened if I use 7z a -si to compress stdin.

doktor5000 wrote:where is it located (underlying filesystem and what physical type of storage).

NTFS, HDD. AFAIR this issue also happened on Ext4.

doktor5000 wrote:Also, what do you expect to happen when you do this? Your box will basically be using 100% CPU which might be freezing e.g. your graphical desktop partially or fully, depending on what scheduler is being used for that device and if you're not using something like ionice or similar.

Had no experience of freezing GUI, using default Mageia settings. Just saw that strace shows futex syscall being executed in every process, single call longs in a minute for every subprocess.

Re: 7zip multithreading deadlock on ~100Gb files

PostPosted: Nov 10th, '20, 09:45
by morgano
Also, maybe check with a 7zip forum for similar experiences or tips.