Page 4 of 37

Re: DGDemux development

Posted: Wed Nov 27, 2019 2:05 pm
by Rocky
Thank you, renols. Fixes need to be retrofitted. I plan to do it within a few days. This is what is pending:

* Suppress video filler NALUs for AVC. Not too common.

* Gaps processing for DTS. You need lots of M2TS files in the playlist to notice desync.

* Option to not split THD+AC3 audio.

The skip first/last is not needed as you can use File/Open and just delete the unwanted M2TS files from the list. Force FPS is a hack that should never be needed. It affects gaps processing only. DGIndexNV is really good at detecting the frame rate, thanks to NVDec/CUVID parsing. DGDemux uses my own parsing which I haven't shaken down thoroughly yet. I've never seen it fail but if it does, you have a way to set it manually. That could be removed. Angles are already supported with a prompt when the MPLS is opened in DGIndexNV.

I will keep the two apps in sync functionality-wise and bug-fix-wise.

Re: DGDemux development

Posted: Wed Nov 27, 2019 2:19 pm
by Rocky
@renols

Do you have disks with plain vanilla DTS and DTS HDHR (not DTS HDMA)? I need to test those.

Re: DGDemux development

Posted: Wed Nov 27, 2019 2:46 pm
by renols
Rocky wrote:
Wed Nov 27, 2019 2:19 pm
@renols

Do you have disks with plain vanilla DTS and DTS HDHR (not DTS HDMA)? I need to test those.
I am not at home right now. But when I get home tomorrow, I will have a look. I think that most of the disks I have will be DTS-MA or TrueHD.

I'll get back to you.

renols

Re: DGDemux development

Posted: Wed Nov 27, 2019 4:23 pm
by Rocky
Thank you, renols!

Re: DGDemux development

Posted: Thu Nov 28, 2019 8:46 am
by Natasha
You did not know my father was Count Dracula?! That nonsense about me getting expelled from college for subversive activities in cemetary is fake news. Spread that nonsense and I will drink your blood, suck you dry. Oh, don't forget I am former Miss Transylvania. Check out avatar, honey.

Re: DGDemux development

Posted: Thu Nov 28, 2019 8:48 am
by admin
Stay on topic, Natasha, or I will give you a spanking you will never forget.

Re: DGDemux development

Posted: Thu Nov 28, 2019 8:55 am
by Boris
Forum Mr. Big is harassing lady. Shameful!

Tashie, remember when we got busted for throwing rocks at Girl Scouts? This forum Mr. Big is asking for it. Moose and squirrel can wait. Russian hackers can destroy this place in seconds. After that we interfere in elections and give them fake Indian. How! :twisted:

Re: DGDemux development

Posted: Thu Nov 28, 2019 11:54 am
by Bullwinkle
Get in touch with Shifty Schiff, Comrade! Don't forget, moose can kill. Want some?

https://www.youtube.com/watch?v=wN0eb1HwRIM

We've given out lots of free DGDemux/DGDemuxGUI licenses. Guess who's not getting one. ................. [r0lZ]

Happy Thanksgiving!

Re: DGDemux development

Posted: Fri Nov 29, 2019 8:21 am
by Rocky
Here is a small update with GUI improvements:

* Added a decorative banner to the GUI. [Boris]

* Added a minimize button to the GUI. [redbtn]

* In the GUI, defaulted the output directory to the current directory. [redbtn]

* GUI layout tweaking. [Rocky]

http://rationalqm.us/dgdemux/DGDemux_1007.rar

GUI is good enough for now. Returning to functionality issues for DGDemux.

Re: DGDemux development

Posted: Fri Nov 29, 2019 4:23 pm
by renols
renols wrote:
Wed Nov 27, 2019 2:46 pm
Rocky wrote:
Wed Nov 27, 2019 2:19 pm
@renols

Do you have disks with plain vanilla DTS and DTS HDHR (not DTS HDMA)? I need to test those.
I am not at home right now. But when I get home tomorrow, I will have a look. I think that most of the disks I have will be DTS-MA or TrueHD.

I'll get back to you.

renols
I have now had the time to look through several of the disks I have. As I expected none of them have pure DTS though. They all have DTS-MA.

renols

Re: DGDemux development

Posted: Fri Nov 29, 2019 4:32 pm
by Rocky
Thanks for the report!

Re: DGDemux development

Posted: Sat Nov 30, 2019 6:51 am
by Rocky
Here is DGDemux/DGDemuxGUI 1.0.0.8:

* Added a new option -nsthd (no split THD audio) and corresponding GUI option. When this option is given,
THD audio with embedded AC3 will not be split into separate streams. Note that gaps correction for the
embedded AC3 stream is done only when the streams are separated. This option was added to allow
demuxing of THD audio that is compatible with TSMuxer. [von Suppé]

* Further GUI tweaks, including sound effect on completion of demuxing.

* Updated the user manual and to-do list.

http://rationalqm.us/dgdemux/DGDemux_1008.rar

Re: DGDemux development

Posted: Sat Nov 30, 2019 8:04 am
by zqslzwzw
I have tested toy.story.4 of both the UHD and 3D (2K) disks, and find two possible problems. One is regard to disk IO performance and the other is regard to DTSMA audio.
1. The IO performance problem of the extracted files of both the two disks: I set the output location to HDD disk. After a demuxing is finished, if I try to move or copy the extracted files to another HDD or SSD (with the file explorer of windows 10), the maximum speed is merely about 1-6 M/s in the whole move/copy progress and the source HDD is fully occupied (No other program and operation). However, another move/copy of these files behave as normal speed at about 100 M/s as long as they have been moved ever. So, it seems that these extracted files are written as disk fragmentation. If so, could you please improve the disk IO performance?
2. The extracted DTSMA audio of the 3D disk behave abnormally: The 3D disk has a DTSMA stream, a DTS high Resolution stream, a True-HD stream, and so on in turn. Both the 1st and the 3rd are demuxed perfectly (Their duration is 1:40:03 which is in consistence with the original video stream), whereas the duration of the extracted audio file of 2nd one (DTS high Resolution) is 1:21:00. By contrast, tsmuxer and mkvtoolnix behave much better when demux this stream as their extracted files by them are with the duration of only 1:40:05. As the source disk is with the size of 43.5GB, how can I provide further useful information?

Re: DGDemux development

Posted: Sat Nov 30, 2019 8:13 am
by Rocky
Thank you for your report.

I/O performance is already on my to-do list. In the meantime, use an SSD. ;) Regarding your second point, please give me a link to purchase the exact same disk you use. Then I can investigate.

Welcome to the forum!

Re: DGDemux development

Posted: Sat Nov 30, 2019 8:35 am
by Rocky
Please re-download 1.0.0.8 if you have already downloaded. Bullwinkle added a little surprise that happens after demuxing finishes. Or just hit Abort.

Re: DGDemux development

Posted: Sat Nov 30, 2019 7:44 pm
by Bullwinkle
Greetings, lovers of all things cerebral. Moose high-level thinking beckons!

This looks perfect for reducing fragmentation without a total redesign:

https://devblogs.microsoft.com/oldnewth ... 0/?p=93875

Each stream output file could effectively have (say) a 1GB file system buffer managed by the OS. Sure, buffering could be done inside DG code using RAM (which could be severely limited), but why not use the OS file system, which is not limited by RAM?

Did you know moose hooves are razor sharp? Like my intellect. People call me intellectual.

Re: DGDemux development

Posted: Sat Nov 30, 2019 7:55 pm
by Rocky
Wow, Bullwinkle, you're on a roll. C'mon, let's go. Whee!

Re: DGDemux development

Posted: Sun Dec 01, 2019 5:26 am
by zqslzwzw
Rocky wrote:
Sat Nov 30, 2019 8:13 am
Thank you for your report.

I/O performance is already on my to-do list. In the meantime, use an SSD. ;) Regarding your second point, please give me a link to purchase the exact same disk you use. Then I can investigate.

Welcome to the forum!
Thank you for your nice project. I am anxious to see perfect DGDemux and willing to report my test results on the BD disks at hand.

The correlated 3D disk, whose extracted DTS audio by DGDemux behaves abnormally , is a DIY one and released by hobbyist on private tracker to research on. Itself can be played without finding any problem. And I just have found that eac3to, tsmuxer and mkvtoolnix actually can perfectly demux the correlated DTS High Resolution audio stream without duration error.

Could you go to that private track to obtain this source? If you do not have its account, I am pleased to invite you as long as you are willing to be and agree with its rule.

Re: DGDemux development

Posted: Sun Dec 01, 2019 7:04 am
by redbtn
Bullwinkle it looks very good! Your intellect is razor sharp!

Re: DGDemux development

Posted: Sun Dec 01, 2019 8:51 am
by Bullwinkle
Thank you, redbtn, and welcome to the forum! We are so lucky to have a high-level thinker like yourself, even if hoomin. Some of my best friends are hoomin. Nobody calls me hoomin!

Managed to add the file preallocation but need someone to test it and see if it actually improves performance and/or fragmentation. Here is the test version. Your testing will be appreciated.

http://rationalqm.us/misc/DGDemux_test.rar

Preallocation amounts:

video 50GB
each audio 5GB
each sup 1GB

Ran it on HOBBS and things looked fine to me.

BTW, next release will allow you to disable sound, or replace it with a moose snorting!

Re: DGDemux development

Posted: Sun Dec 01, 2019 8:53 am
by Rocky
zqslzwzw wrote:
Sun Dec 01, 2019 5:26 am
Could you go to that private track to obtain this source? If you do not have its account, I am pleased to invite you as long as you are willing to be and agree with its rule.
We've been looking for DTS HDHR streams so this would help both of us. If I gave you an FTP would you be able to upload it there? We don't do torrents.

Re: DGDemux development

Posted: Sun Dec 01, 2019 10:30 am
by Guest
Test version
Movie Unforgiven 2:10 approximately
Video
Demux time between the two versions is about the same (1:50 to 1:55)
Test version appears to be contiguous
Normal version is highly fragmented
Results look good

Re: DGDemux development

Posted: Sun Dec 01, 2019 10:59 am
by Bullwinkle
That's moose-ik to my ears, gonca! Thank you for your testing. If we had ranks here, you'd be promoted to high-level thinker. Maybe even Honorary Moose.

Didn't expect performance gains but hoped for less fragmentation, so...mission accomplished. Snort!

Re: DGDemux development

Posted: Sun Dec 01, 2019 11:04 am
by redbtn
Testing Test version in progress.
Sometimes I have some glitches

Re: DGDemux development

Posted: Sun Dec 01, 2019 11:10 am
by Bullwinkle
redbtn, don't move the dialog while operations are pending. Rocky will fix it at some point. Some kind of Windows deficiency. More interested in the fragmentation results.

Cuz hoomins are asking...

Bullwinkle: High-level thinker, architect, and visionary for DG tools. The brains of the operation!
Rocky (mod): Chief coder and debugger for DG tools. Industrious and occasionally has interesting ideas.
admin (mod): Dumbass that takes care of forum admin and legal stuff. Known to harass people for no reason.
Boris and Natasha: Russian spies. Don't fall for the gold coins and counseling scams! Natasha will drink your blood.

Hey, gonca, what happened to your avatar? Come back with a great one. Snort! Oh, and how do you measure fragmentation? Mark Russinovich's contig works very well. Such a great body of work from Mark. Moose salutations!