DGDemux development

[Bullwinkle]

Greetings, lovers of all things cerebral. Moose high-level thinking beckons!

This looks perfect for reducing fragmentation without a total redesign:

https://devblogs.microsoft.com/oldnewth ... 0/?p=93875

Each stream output file could effectively have (say) a 1GB file system buffer managed by the OS. Sure, buffering could be done inside DG code using RAM (which could be severely limited), but why not use the OS file system, which is not limited by RAM?

Did you know moose hooves are razor sharp? Like my intellect. People call me intellectual.

[Rocky]

Wow, Bullwinkle, you're on a roll. C'mon, let's go. Whee!

[zqslzwzw]

Thank you for your report.

I/O performance is already on my to-do list. In the meantime, use an SSD. Regarding your second point, please give me a link to purchase the exact same disk you use. Then I can investigate.

Welcome to the forum!

Thank you for your nice project. I am anxious to see perfect DGDemux and willing to report my test results on the BD disks at hand.

The correlated 3D disk, whose extracted DTS audio by DGDemux behaves abnormally , is a DIY one and released by hobbyist on private tracker to research on. Itself can be played without finding any problem. And I just have found that eac3to, tsmuxer and mkvtoolnix actually can perfectly demux the correlated DTS High Resolution audio stream without duration error.

Could you go to that private track to obtain this source? If you do not have its account, I am pleased to invite you as long as you are willing to be and agree with its rule.

[redbtn]

Bullwinkle it looks very good! Your intellect is razor sharp!

[Bullwinkle]

Thank you, redbtn, and welcome to the forum! We are so lucky to have a high-level thinker like yourself, even if hoomin. Some of my best friends are hoomin. Nobody calls me hoomin!

Managed to add the file preallocation but need someone to test it and see if it actually improves performance and/or fragmentation. Here is the test version. Your testing will be appreciated.

http://rationalqm.us/misc/DGDemux_test.rar

Preallocation amounts:

video 50GB
each audio 5GB
each sup 1GB

Ran it on HOBBS and things looked fine to me.

BTW, next release will allow you to disable sound, or replace it with a moose snorting!

[Rocky]

Could you go to that private track to obtain this source? If you do not have its account, I am pleased to invite you as long as you are willing to be and agree with its rule.

We've been looking for DTS HDHR streams so this would help both of us. If I gave you an FTP would you be able to upload it there? We don't do torrents.

[Guest]

Test version
Movie Unforgiven 2:10 approximately
Video
Demux time between the two versions is about the same (1:50 to 1:55)
Test version appears to be contiguous
Normal version is highly fragmented
Results look good

[Bullwinkle]

That's moose-ik to my ears, gonca! Thank you for your testing. If we had ranks here, you'd be promoted to high-level thinker. Maybe even Honorary Moose.

Didn't expect performance gains but hoped for less fragmentation, so...mission accomplished. Snort!

[redbtn]

Testing Test version in progress.
Sometimes I have some glitches

[Bullwinkle]

redbtn, don't move the dialog while operations are pending. Rocky will fix it at some point. Some kind of Windows deficiency. More interested in the fragmentation results.

Cuz hoomins are asking...

Bullwinkle: High-level thinker, architect, and visionary for DG tools. The brains of the operation!
Rocky (mod): Chief coder and debugger for DG tools. Industrious and occasionally has interesting ideas.
admin (mod): Dumbass that takes care of forum admin and legal stuff. Known to harass people for no reason.
Boris and Natasha: Russian spies. Don't fall for the gold coins and counseling scams! Natasha will drink your blood.

Hey, gonca, what happened to your avatar? Come back with a great one. Snort! Oh, and how do you measure fragmentation? Mark Russinovich's contig works very well. Such a great body of work from Mark. Moose salutations!

[Guest]

He really wasn't smarter than the average bear

[Bullwinkle]

You're right, average is a pretty low bar to set. Maybe good for europeons.

gonca, my friend, you get the heel nippers like you know who and his flying monkeys. Deal with them like this:

https://www.youtube.com/watch?v=O_s6-sfsWq0

Poor thing! The pit bull was smart enough to get out of Dodge. Don't wrestle with pigs! Stomp them and move on.

[redbtn]

redbtn, don't move the dialog while operations are pending. Rocky will fix it at some point.

It happens after minimize, Moving the dialog while operations are pending looks fine.

1Gb for every sub is too much, isn't it? I think 100-150mb is enough.

Oh, and how do you measure fragmentation?

You can use Defraggler (Analyze, then FIle list and see how many fragments uses the file)

Audio and subs are good now. But video still has fragmentation, not that much as earlier, but still. Can you please preallocate 75GB for video and 150mb for each sub? I'll test it again, maybe it solves the problem completaly.

PS: I demuxed BD with video track smaller than 50gb and it's perfect. So, defenetly need increase it for video. I think 75gb will be enough for most discs.

[Bullwinkle]

Looking at your minimize issue.

Sure, let's adjust prealloc as you suggest. Maybe should be configurable.

[redbtn]

Looking at your minimize issue.

Sure, let's adjust prealloc as you suggest.

Thx! Can't wait to test it! Looks like you duplicate my issue already, while i was recording a video.

[Bullwinkle]

Didn't duplicate it, just keeping an open investigatory Moose mind. What are your steps exactly to show it?

People call me Inspector!

[redbtn]

Didn't duplicate it, just keeping an open invesigatory Moose mind. What are your steps exactly to show it?

People call me Inspector!

Open DGDemux GUI. open mpls, click minimize.
Here is a video below.

[Bullwinkle]

Can't duplicate that. What OS etc.? C'mon, windows can't minimize and restore a dialog? Don't hand us some WinXP/Win7 nonsense. We use latest libraries and runtimes.

Gonna tell Rocky to go with video 100 GB, audio 5 GB each, sups 1 GB.

[redbtn]

Can't duplicate that. What OS etc.? C'mon, windows can't minimize and restore a dialog? Don't hand us some WinXP/Win7 nonsense. We use latest libraries and runtimes.

I'ma tell Rocky to go with video 100 GB, audio 5 GB each, sups 1 GB.

Windows 10 1809.
I never saw sup more than 100mb, ok, you can do 200mb. 1GB is too much IMO.

[Bullwinkle]

So you say that Windows cannot minimize and restore a dialog? We run 1909.

If we come up short on preallocs, people will rag on us.

[redbtn]

So you say that Windows cannot minimize and restore a dialog? We run 1909.

If we come up short on preallocs, people will rag on us.

I don't know, I have no issues with my windows, only DGDemux GUI has this issue. I saw TrueHD more than 5GB. You can't do 7-8 GB for THD and DTS-MA, and 1GB for AC3?

Ps: I use 1809 LTSC, can it make sense?

[Bullwinkle]

Let's see if anyone else reports your GUI corruption after minimize.

Don't want to get too deep in the weeds on prealloc and make a mess. 10 GB for audio then. Any failure to prealloc is not fatal and the affected streams are just not prealloc'ed.

[redbtn]

Let's see if anyone else reports your GUI corruption after minimize.

Don't want to get too deep in the weeds on prealloc and make a mess. 10 GB for audio then. Any failure to prealloc is not fatal and the affected streams are just not prealloc'ed.

Deal!

[Bullwinkle]

You drive a hard bargain...for a hoomin!

[redbtn]

You drive a hard bargain...for a hoomin!

I'll risk it!
How much RAM uses DGDemux for now? I'd like to use at least 1GB RAM. I can give it 20, but other users possibly can't.