DGDemux development

User avatar
admin
Site Admin
Posts: 4415
Joined: Thu Sep 09, 2010 3:08 pm

Re: DGDemux development

Post by admin » Wed Sep 23, 2020 2:33 pm

Britney wrote:
Tue Sep 22, 2020 11:04 am
Wow, admin. You can really dance! Kisses, Brit.
Talk about exposing people's early careers. Still, not quite in your league:

https://youtu.be/76pYZjhVylw?t=40

:bow:

User avatar
Curly
Moose Approved
Posts: 69
Joined: Sun Mar 15, 2020 11:05 am

Re: DGDemux development

Post by Curly » Wed Sep 23, 2020 2:38 pm

Let's expose Natasha. Sunlight kills vampires. Nyuh nyuh.

User avatar
Natasha
Mosquito
Posts: 58
Joined: Wed Nov 20, 2019 12:11 pm

Re: DGDemux development

Post by Natasha » Wed Sep 23, 2020 10:02 pm

Spin in circles, doughboy.

User avatar
Rocky
Moose Approved
Posts: 1052
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Thu Sep 24, 2020 7:51 pm

Settle down children! Love and respect one another.

Sherman, thank you for checking in your code and for reporting the DV marking bug. I noticed that gaps correction is not working for DTS in fast mode (AC3 is OK). Can you look into it please? Great speedup BTW.

User avatar
Bullwinkle
Moose Approved
Posts: 159
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle » Thu Sep 24, 2020 7:55 pm

Rocky wrote:
Thu Sep 24, 2020 7:51 pm
Great speedup BTW.
Not too shabby for a 7-year-old hoomin.

Sherman, did you solve the quantum measurement problem yet?

User avatar
Rocky
Moose Approved
Posts: 1052
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Sat Sep 26, 2020 6:40 pm

Thank you, Sherman, for the DTS fix for fast mode. Now I see that LPCM is demuxing differently between fast and slow modes. Please check it out. Looking good!

User avatar
Emulgator
Moose Approved
Posts: 17
Joined: Tue May 12, 2020 9:39 am

Re: DGDemux development

Post by Emulgator » Mon Sep 28, 2020 4:37 pm

I LOVE the preview !
Many thanks ! :bow: :bravo:

User avatar
Sherman
Moose Approved
Posts: 121
Joined: Mon Jan 06, 2020 11:19 pm

Re: DGDemux development

Post by Sherman » Mon Oct 05, 2020 9:11 am

Sorry I took so long for the LPCM fix. It's all better. Bullwinkle had me laying floors for a week!

Typical disk demuxing the LPCM track:

slow mode 3:45
fast mode 0:35

Anyway, I just have to add the following and then you can let it out to the wild:

* THD and embedded AC3
* PGS
* preallocation
* garbage stripping option

Shouldn't take too long. However:

But Mousie, thou art no thy-lane,
In proving foresight may be vain:
The best laid schemes o’ Mice an’ Men
Gang aft agley,
An’ lea’e us nought but grief an’ pain,
For promis’d joy!


-- Robert Burns

User avatar
Rocky
Moose Approved
Posts: 1052
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Mon Oct 05, 2020 9:13 am

Sounds great, Sherman. I confirmed that the LPCM is fixed in fast mode.

As they say in the swimming world: Finish Strong!

User avatar
Sherman
Moose Approved
Posts: 121
Joined: Mon Jan 06, 2020 11:19 pm

Re: DGDemux development

Post by Sherman » Mon Oct 05, 2020 8:06 pm

Bullwinkle wrote:
Thu Sep 24, 2020 7:55 pm
Sherman, did you solve the quantum measurement problem yet?
I don't see any problem. Would you be able to explain why you think there is a problem?

@Rocky

I can't swim. :oops:

User avatar
Britney
Curly Approved
Posts: 18
Joined: Sun Aug 09, 2020 3:24 pm

Re: DGDemux development

Post by Britney » Mon Oct 05, 2020 9:22 pm

Sherman wrote:
Mon Oct 05, 2020 8:06 pm
I don't see any problem.
:bow:

Kisses, Brit

User avatar
Mr. Peabody
Posts: 20
Joined: Tue Dec 24, 2019 10:20 am

Re: DGDemux development

Post by Mr. Peabody » Mon Oct 05, 2020 9:57 pm

Propping up straw men is a not-so-subtle form of rhetoric to be eschewed. I refer of course to the quantum measurement straw man.

User avatar
Sherman
Moose Approved
Posts: 121
Joined: Mon Jan 06, 2020 11:19 pm

Re: DGDemux development

Post by Sherman » Tue Oct 06, 2020 2:29 pm

Mr. Peabody wrote:
Mon Oct 05, 2020 9:57 pm
eschewed
Does that mean hard to swallow?

@Rocky

Got PGS demuxing working in fast mode. The fast and slow demuxed SUP files are binary identical. Now have to do THD and embedded AC3. Then a little cleanup and we can give it out.

There is enough supported to fully demux La Notte (Criterion). Here are the timings for demuxing everything:

slow: 5:00
fast: 1:19

That's a 3.8 times speedup!

User avatar
Natasha
Mosquito
Posts: 58
Joined: Wed Nov 20, 2019 12:11 pm

Re: DGDemux development

Post by Natasha » Tue Oct 06, 2020 7:59 pm

Sherman wrote:
Tue Oct 06, 2020 2:29 pm
That's a 3.8 times speedup!
Is that the best you can do? Pathetic.

User avatar
Curly
Moose Approved
Posts: 69
Joined: Sun Mar 15, 2020 11:05 am

Re: DGDemux development

Post by Curly » Tue Oct 06, 2020 8:01 pm

Give the kid a break. He's doing his best.

User avatar
Bullwinkle
Moose Approved
Posts: 159
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle » Tue Oct 06, 2020 8:19 pm

If you can do better, Nattie, bring it. Otherwise, stand down.

You're doing great Sherman. Moose Approved!

User avatar
Curly
Moose Approved
Posts: 69
Joined: Sun Mar 15, 2020 11:05 am

Re: DGDemux development

Post by Curly » Wed Oct 07, 2020 7:22 am

Sabine Hossenfelder wrote:

"The two biggest problems with superdeterminism at the moment are (a) the lack of a generally applicable fundamental theory and (b) the lack of experiment." *

From which we easily conclude that it is metaphysical mumbo-jumbo. :roll:

* https://arxiv.org/pdf/2010.01324.pdf

User avatar
Levi
Moose Approved
Posts: 10
Joined: Sat Apr 18, 2020 6:12 pm

Re: DGDemux development

Post by Levi » Wed Oct 07, 2020 8:27 pm

Somebody here said you cannot blame a mosquito for being a mosquito. Makes sense to me.

User avatar
Sherman
Moose Approved
Posts: 121
Joined: Mon Jan 06, 2020 11:19 pm

Re: DGDemux development

Post by Sherman » Thu Oct 08, 2020 11:34 am

Thank you Bullwinkle. I really appreciate your support! And Levi too.

I have the first half of THD working, that is, the do-not-split-THD is working. Now working on splitting out the AC3 stream.

User avatar
Sherman
Moose Approved
Posts: 121
Joined: Mon Jan 06, 2020 11:19 pm

Re: DGDemux development

Post by Sherman » Thu Oct 08, 2020 12:24 pm

Now I have THD splitting working. All stream types are now working in fast mode. Still gotta do:

* preallocation
* garbage stripping option
* check that all DELAY values are correct

I see the light at the end of the tunnel!

Nattie, how is your implementation coming along?
:belly-laugh:

User avatar
Bullwinkle
Moose Approved
Posts: 159
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle » Thu Oct 08, 2020 7:53 pm

Sherman wrote: ...laying floors...
Ya gotta earn your keep, kid.
Sherman wrote:
Thu Oct 08, 2020 12:24 pm
I see the light at the end of the tunnel!
I can almost taste it.
Sherman wrote:
Thu Oct 08, 2020 12:24 pm
Nattie, how is your implementation coming along?
That's a pretty fine stomping for a hoomin. Snort!

User avatar
Sherman
Moose Approved
Posts: 121
Joined: Mon Jan 06, 2020 11:19 pm

Re: DGDemux development

Post by Sherman » Fri Oct 09, 2020 12:33 pm

Girls and boys! Rocky gave me permission to release an alpha test version of the fast mode implementation, so here it is:

http://rationalqm.us/dgdemux/binaries/D ... t_test.rar

Notes:

0) To run in fast mode, hold down the left SHIFT key when pressing the Show or Demux buttons. If you use DGDemux.exe directly, include the option '-fast'.

1) I haven't found an efficient way yet to do filler NALU stripping for AVC video, so you will see a difference (which is inconsequential) between the demuxed video in slow and fast mode in this case. The fast code simply processes transport packets one-by-one and has no concept of anything that spans multiple packets (such as NALUs); that's what makes it so fast.

2) All other streams should be bit identical in slow and fast mode.

3) All file names should be the same between slow and fast modes, so change the output name if you want to do both ways to compare (without leaving the GUI).

4) Garbage stripping is not yet implemented.

This is the hardest thing I ever did, including laying floors and installing appliances, so I mighta goofed something up. Your testing and feedback will be greatly appreciated. Enjoy!

Mr Peabody and I are off to visit Albert Einstein again, as there are some loose ends regarding Lorenz invariance I want to clear up, and I want to persuade him to join the forum. See ya in a while!

User avatar
Bullwinkle
Moose Approved
Posts: 159
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle » Fri Oct 09, 2020 12:34 pm

Tastes great, less filling!

gonca
Moose Approved/Curly Approved
Posts: 907
Joined: Sun Apr 08, 2012 6:12 pm

Re: DGDemux development

Post by gonca » Sat Oct 10, 2020 10:59 am

Tested using 4K version of Wonder Woman

external HDD >> internal SSD
normal 16:00
fast 9:31

suspected that HDD was a bottleneck so I copied the movie to an internal SSD

internal SSD >> internal SSD
normal 8:57
fast 2:59

edit
folders containing each set of the demux were identical in size

User avatar
Rocky
Moose Approved
Posts: 1052
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Sat Oct 10, 2020 12:10 pm

Thank you for the testing, gonca. The ideal situation is SSD->SSD with enough free space to ensure all the preallocations succeed. That's where we see 3-4 times speedup.

The directories will not be exactly the same size when there is AVC video containing filler NALUs (not your case). I have been demuxing into two subfolders (fast and slow) by changing the output path. Then get in the folder holding those two and open a DOS prompt. Execute:

fc /b slow\* fast\*

That will compare all the files. If you have the AVC video with filler get that out before running the compare, or you will be inundated with output.

I have tested two disks so far and all is well. Will test more today.

Post Reply