DGDemux development

User avatar
admin
Posts: 4551
Joined: Thu Sep 09, 2010 3:08 pm

Re: DGDemux development

Post by admin »

Stay on topic, Natasha, or I will give you a spanking you will never forget.
User avatar
Boris
Posts: 92
Joined: Sun Nov 10, 2019 2:55 pm

Re: DGDemux development

Post by Boris »

Forum Mr. Big is harassing lady. Shameful!

Tashie, remember when we got busted for throwing rocks at Girl Scouts? This forum Mr. Big is asking for it. Moose and squirrel can wait. Russian hackers can destroy this place in seconds. After that we interfere in elections and give them fake Indian. How! :twisted:
User avatar
Bullwinkle
Posts: 338
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

Get in touch with Shifty Schiff, Comrade! Don't forget, moose can kill. Want some?

https://www.youtube.com/watch?v=wN0eb1HwRIM

We've given out lots of free DGDemux/DGDemuxGUI licenses. Guess who's not getting one. ................. [r0lZ]

Happy Thanksgiving!
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Here is a small update with GUI improvements:

* Added a decorative banner to the GUI. [Boris]

* Added a minimize button to the GUI. [redbtn]

* In the GUI, defaulted the output directory to the current directory. [redbtn]

* GUI layout tweaking. [Rocky]

http://rationalqm.us/dgdemux/DGDemux_1007.rar

GUI is good enough for now. Returning to functionality issues for DGDemux.
DAE avatar
renols
Posts: 149
Joined: Tue Feb 22, 2011 2:34 am

Re: DGDemux development

Post by renols »

renols wrote:
Wed Nov 27, 2019 2:46 pm
Rocky wrote:
Wed Nov 27, 2019 2:19 pm
@renols

Do you have disks with plain vanilla DTS and DTS HDHR (not DTS HDMA)? I need to test those.
I am not at home right now. But when I get home tomorrow, I will have a look. I think that most of the disks I have will be DTS-MA or TrueHD.

I'll get back to you.

renols
I have now had the time to look through several of the disks I have. As I expected none of them have pure DTS though. They all have DTS-MA.

renols
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Thanks for the report!
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Here is DGDemux/DGDemuxGUI 1.0.0.8:

* Added a new option -nsthd (no split THD audio) and corresponding GUI option. When this option is given,
THD audio with embedded AC3 will not be split into separate streams. Note that gaps correction for the
embedded AC3 stream is done only when the streams are separated. This option was added to allow
demuxing of THD audio that is compatible with TSMuxer. [von Suppé]

* Further GUI tweaks, including sound effect on completion of demuxing.

* Updated the user manual and to-do list.

http://rationalqm.us/dgdemux/DGDemux_1008.rar
DAE avatar
zqslzwzw
Posts: 18
Joined: Fri Nov 29, 2019 8:35 am

Re: DGDemux development

Post by zqslzwzw »

I have tested toy.story.4 of both the UHD and 3D (2K) disks, and find two possible problems. One is regard to disk IO performance and the other is regard to DTSMA audio.
1. The IO performance problem of the extracted files of both the two disks: I set the output location to HDD disk. After a demuxing is finished, if I try to move or copy the extracted files to another HDD or SSD (with the file explorer of windows 10), the maximum speed is merely about 1-6 M/s in the whole move/copy progress and the source HDD is fully occupied (No other program and operation). However, another move/copy of these files behave as normal speed at about 100 M/s as long as they have been moved ever. So, it seems that these extracted files are written as disk fragmentation. If so, could you please improve the disk IO performance?
2. The extracted DTSMA audio of the 3D disk behave abnormally: The 3D disk has a DTSMA stream, a DTS high Resolution stream, a True-HD stream, and so on in turn. Both the 1st and the 3rd are demuxed perfectly (Their duration is 1:40:03 which is in consistence with the original video stream), whereas the duration of the extracted audio file of 2nd one (DTS high Resolution) is 1:21:00. By contrast, tsmuxer and mkvtoolnix behave much better when demux this stream as their extracted files by them are with the duration of only 1:40:05. As the source disk is with the size of 43.5GB, how can I provide further useful information?
Attachments
Untitled-2.png
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Thank you for your report.

I/O performance is already on my to-do list. In the meantime, use an SSD. ;) Regarding your second point, please give me a link to purchase the exact same disk you use. Then I can investigate.

Welcome to the forum!
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Please re-download 1.0.0.8 if you have already downloaded. Bullwinkle added a little surprise that happens after demuxing finishes. Or just hit Abort.
User avatar
Bullwinkle
Posts: 338
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

Greetings, lovers of all things cerebral. Moose high-level thinking beckons!

This looks perfect for reducing fragmentation without a total redesign:

https://devblogs.microsoft.com/oldnewth ... 0/?p=93875

Each stream output file could effectively have (say) a 1GB file system buffer managed by the OS. Sure, buffering could be done inside DG code using RAM (which could be severely limited), but why not use the OS file system, which is not limited by RAM?

Did you know moose hooves are razor sharp? Like my intellect. People call me intellectual.
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Wow, Bullwinkle, you're on a roll. C'mon, let's go. Whee!
DAE avatar
zqslzwzw
Posts: 18
Joined: Fri Nov 29, 2019 8:35 am

Re: DGDemux development

Post by zqslzwzw »

Rocky wrote:
Sat Nov 30, 2019 8:13 am
Thank you for your report.

I/O performance is already on my to-do list. In the meantime, use an SSD. ;) Regarding your second point, please give me a link to purchase the exact same disk you use. Then I can investigate.

Welcome to the forum!
Thank you for your nice project. I am anxious to see perfect DGDemux and willing to report my test results on the BD disks at hand.

The correlated 3D disk, whose extracted DTS audio by DGDemux behaves abnormally , is a DIY one and released by hobbyist on private tracker to research on. Itself can be played without finding any problem. And I just have found that eac3to, tsmuxer and mkvtoolnix actually can perfectly demux the correlated DTS High Resolution audio stream without duration error.

Could you go to that private track to obtain this source? If you do not have its account, I am pleased to invite you as long as you are willing to be and agree with its rule.
User avatar
redbtn
Posts: 44
Joined: Sat Nov 16, 2019 2:35 pm

Re: DGDemux development

Post by redbtn »

Bullwinkle it looks very good! Your intellect is razor sharp!
User avatar
Bullwinkle
Posts: 338
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

Thank you, redbtn, and welcome to the forum! We are so lucky to have a high-level thinker like yourself, even if hoomin. Some of my best friends are hoomin. Nobody calls me hoomin!

Managed to add the file preallocation but need someone to test it and see if it actually improves performance and/or fragmentation. Here is the test version. Your testing will be appreciated.

http://rationalqm.us/misc/DGDemux_test.rar

Preallocation amounts:

video 50GB
each audio 5GB
each sup 1GB

Ran it on HOBBS and things looked fine to me.

BTW, next release will allow you to disable sound, or replace it with a moose snorting!
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

zqslzwzw wrote:
Sun Dec 01, 2019 5:26 am
Could you go to that private track to obtain this source? If you do not have its account, I am pleased to invite you as long as you are willing to be and agree with its rule.
We've been looking for DTS HDHR streams so this would help both of us. If I gave you an FTP would you be able to upload it there? We don't do torrents.
DAE avatar
Guest

Re: DGDemux development

Post by Guest »

Test version
Movie Unforgiven 2:10 approximately
Video
Demux time between the two versions is about the same (1:50 to 1:55)
Test version appears to be contiguous
Normal version is highly fragmented
Results look good
User avatar
Bullwinkle
Posts: 338
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

That's moose-ik to my ears, gonca! Thank you for your testing. If we had ranks here, you'd be promoted to high-level thinker. Maybe even Honorary Moose.

Didn't expect performance gains but hoped for less fragmentation, so...mission accomplished. Snort!
User avatar
redbtn
Posts: 44
Joined: Sat Nov 16, 2019 2:35 pm

Re: DGDemux development

Post by redbtn »

Testing Test version in progress.
Sometimes I have some glitches
Attachments
FS - 2019-12-01--21-58-16.png
User avatar
Bullwinkle
Posts: 338
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

redbtn, don't move the dialog while operations are pending. Rocky will fix it at some point. Some kind of Windows deficiency. More interested in the fragmentation results.

Cuz hoomins are asking...

Bullwinkle: High-level thinker, architect, and visionary for DG tools. The brains of the operation!
Rocky (mod): Chief coder and debugger for DG tools. Industrious and occasionally has interesting ideas.
admin (mod): Dumbass that takes care of forum admin and legal stuff. Known to harass people for no reason.
Boris and Natasha: Russian spies. Don't fall for the gold coins and counseling scams! Natasha will drink your blood.

Hey, gonca, what happened to your avatar? Come back with a great one. Snort! Oh, and how do you measure fragmentation? Mark Russinovich's contig works very well. Such a great body of work from Mark. Moose salutations!
DAE avatar
Guest

Re: DGDemux development

Post by Guest »

He really wasn't smarter than the average bear
User avatar
Bullwinkle
Posts: 338
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

You're right, average is a pretty low bar to set. Maybe good for europeons.

gonca, my friend, you get the heel nippers like you know who and his flying monkeys. Deal with them like this:

https://www.youtube.com/watch?v=O_s6-sfsWq0

Poor thing! The pit bull was smart enough to get out of Dodge. Don't wrestle with pigs! Stomp them and move on.
User avatar
redbtn
Posts: 44
Joined: Sat Nov 16, 2019 2:35 pm

Re: DGDemux development

Post by redbtn »

Bullwinkle wrote:
Sun Dec 01, 2019 11:10 am
redbtn, don't move the dialog while operations are pending. Rocky will fix it at some point.
It happens after minimize, Moving the dialog while operations are pending looks fine.

1Gb for every sub is too much, isn't it? I think 100-150mb is enough.
Bullwinkle wrote:
Sun Dec 01, 2019 11:10 am
Oh, and how do you measure fragmentation?
You can use Defraggler (Analyze, then FIle list and see how many fragments uses the file)

Audio and subs are good now. But video still has fragmentation, not that much as earlier, but still. Can you please preallocate 75GB for video and 150mb for each sub? I'll test it again, maybe it solves the problem completaly.

PS: I demuxed BD with video track smaller than 50gb and it's perfect. So, defenetly need increase it for video. I think 75gb will be enough for most discs.
User avatar
Bullwinkle
Posts: 338
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

Looking at your minimize issue.

Sure, let's adjust prealloc as you suggest. Maybe should be configurable.
User avatar
redbtn
Posts: 44
Joined: Sat Nov 16, 2019 2:35 pm

Re: DGDemux development

Post by redbtn »

Bullwinkle wrote:
Sun Dec 01, 2019 12:33 pm
Looking at your minimize issue.

Sure, let's adjust prealloc as you suggest.
Thx! Can't wait to test it! Looks like you duplicate my issue already, while i was recording a video.
Post Reply