DGDemux development

User avatar
admin
Site Admin
Posts: 4453
Joined: Thu Sep 09, 2010 3:08 pm

Re: DGDemux development

Post by admin »

Britney wrote:
Tue Sep 22, 2020 11:04 am
Wow, admin. You can really dance! Kisses, Brit.
Talk about exposing people's early careers. Still, not quite in your league:

https://youtu.be/76pYZjhVylw?t=40

:bow:
User avatar
Curly
Moose Approved
Posts: 112
Joined: Sun Mar 15, 2020 11:05 am

Re: DGDemux development

Post by Curly »

Let's expose Natasha. Sunlight kills vampires. Nyuh nyuh.
User avatar
Natasha
Mosquito
Posts: 72
Joined: Wed Nov 20, 2019 11:11 am

Re: DGDemux development

Post by Natasha »

Spin in circles, doughboy.
User avatar
Rocky
Moose Approved
Posts: 1644
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Settle down children! Love and respect one another.

Sherman, thank you for checking in your code and for reporting the DV marking bug. I noticed that gaps correction is not working for DTS in fast mode (AC3 is OK). Can you look into it please? Great speedup BTW.
User avatar
Bullwinkle
Moose Approved
Posts: 200
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

Rocky wrote:
Thu Sep 24, 2020 7:51 pm
Great speedup BTW.
Not too shabby for a 7-year-old hoomin.

Sherman, did you solve the quantum measurement problem yet?
User avatar
Rocky
Moose Approved
Posts: 1644
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Thank you, Sherman, for the DTS fix for fast mode. Now I see that LPCM is demuxing differently between fast and slow modes. Please check it out. Looking good!
User avatar
Emulgator
Moose Approved
Posts: 17
Joined: Tue May 12, 2020 9:39 am

Re: DGDemux development

Post by Emulgator »

I LOVE the preview !
Many thanks ! :bow: :bravo:
User avatar
Sherman
Moose Approved
Posts: 172
Joined: Mon Jan 06, 2020 10:19 pm

Re: DGDemux development

Post by Sherman »

Sorry I took so long for the LPCM fix. It's all better. Bullwinkle had me laying floors for a week!

Typical disk demuxing the LPCM track:

slow mode 3:45
fast mode 0:35

Anyway, I just have to add the following and then you can let it out to the wild:

* THD and embedded AC3
* PGS
* preallocation
* garbage stripping option

Shouldn't take too long. However:

But Mousie, thou art no thy-lane,
In proving foresight may be vain:
The best laid schemes o’ Mice an’ Men
Gang aft agley,
An’ lea’e us nought but grief an’ pain,
For promis’d joy!


-- Robert Burns
User avatar
Rocky
Moose Approved
Posts: 1644
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Sounds great, Sherman. I confirmed that the LPCM is fixed in fast mode.

As they say in the swimming world: Finish Strong!
User avatar
Sherman
Moose Approved
Posts: 172
Joined: Mon Jan 06, 2020 10:19 pm

Re: DGDemux development

Post by Sherman »

Bullwinkle wrote:
Thu Sep 24, 2020 7:55 pm
Sherman, did you solve the quantum measurement problem yet?
I don't see any problem. Would you be able to explain why you think there is a problem?

@Rocky

I can't swim. :oops:
User avatar
Britney
Curly Approved
Posts: 36
Joined: Sun Aug 09, 2020 3:24 pm

Re: DGDemux development

Post by Britney »

Sherman wrote:
Mon Oct 05, 2020 8:06 pm
I don't see any problem.
:bow:

Kisses, Brit
User avatar
Mr. Peabody
Posts: 26
Joined: Tue Dec 24, 2019 9:20 am

Re: DGDemux development

Post by Mr. Peabody »

Propping up straw men is a not-so-subtle form of rhetoric to be eschewed. I refer of course to the quantum measurement straw man.
User avatar
Sherman
Moose Approved
Posts: 172
Joined: Mon Jan 06, 2020 10:19 pm

Re: DGDemux development

Post by Sherman »

Mr. Peabody wrote:
Mon Oct 05, 2020 9:57 pm
eschewed
Does that mean hard to swallow?

@Rocky

Got PGS demuxing working in fast mode. The fast and slow demuxed SUP files are binary identical. Now have to do THD and embedded AC3. Then a little cleanup and we can give it out.

There is enough supported to fully demux La Notte (Criterion). Here are the timings for demuxing everything:

slow: 5:00
fast: 1:19

That's a 3.8 times speedup!
User avatar
Natasha
Mosquito
Posts: 72
Joined: Wed Nov 20, 2019 11:11 am

Re: DGDemux development

Post by Natasha »

Sherman wrote:
Tue Oct 06, 2020 2:29 pm
That's a 3.8 times speedup!
Is that the best you can do? Pathetic.
User avatar
Curly
Moose Approved
Posts: 112
Joined: Sun Mar 15, 2020 11:05 am

Re: DGDemux development

Post by Curly »

Give the kid a break. He's doing his best.
User avatar
Bullwinkle
Moose Approved
Posts: 200
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

If you can do better, Nattie, bring it. Otherwise, stand down.

You're doing great Sherman. Moose Approved!
User avatar
Curly
Moose Approved
Posts: 112
Joined: Sun Mar 15, 2020 11:05 am

Re: DGDemux development

Post by Curly »

Sabine Hossenfelder wrote:

"The two biggest problems with superdeterminism at the moment are (a) the lack of a generally applicable fundamental theory and (b) the lack of experiment." *

From which we easily conclude that it is metaphysical mumbo-jumbo. :roll:

* https://arxiv.org/pdf/2010.01324.pdf
User avatar
Levi
Moose Approved
Posts: 14
Joined: Sat Apr 18, 2020 6:12 pm

Re: DGDemux development

Post by Levi »

Somebody here said you cannot blame a mosquito for being a mosquito. Makes sense to me.
User avatar
Sherman
Moose Approved
Posts: 172
Joined: Mon Jan 06, 2020 10:19 pm

Re: DGDemux development

Post by Sherman »

Thank you Bullwinkle. I really appreciate your support! And Levi too.

I have the first half of THD working, that is, the do-not-split-THD is working. Now working on splitting out the AC3 stream.
User avatar
Sherman
Moose Approved
Posts: 172
Joined: Mon Jan 06, 2020 10:19 pm

Re: DGDemux development

Post by Sherman »

Now I have THD splitting working. All stream types are now working in fast mode. Still gotta do:

* preallocation
* garbage stripping option
* check that all DELAY values are correct

I see the light at the end of the tunnel!

Nattie, how is your implementation coming along?
:belly-laugh:
User avatar
Bullwinkle
Moose Approved
Posts: 200
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

Sherman wrote: ...laying floors...
Ya gotta earn your keep, kid.
Sherman wrote:
Thu Oct 08, 2020 12:24 pm
I see the light at the end of the tunnel!
I can almost taste it.
Sherman wrote:
Thu Oct 08, 2020 12:24 pm
Nattie, how is your implementation coming along?
That's a pretty fine stomping for a hoomin. Snort!
User avatar
Sherman
Moose Approved
Posts: 172
Joined: Mon Jan 06, 2020 10:19 pm

Re: DGDemux development

Post by Sherman »

Girls and boys! Rocky gave me permission to release an alpha test version of the fast mode implementation, so here it is:

http://rationalqm.us/dgdemux/binaries/D ... t_test.rar

Notes:

0) To run in fast mode, hold down the left SHIFT key when pressing the Show or Demux buttons. If you use DGDemux.exe directly, include the option '-fast'.

1) I haven't found an efficient way yet to do filler NALU stripping for AVC video, so you will see a difference (which is inconsequential) between the demuxed video in slow and fast mode in this case. The fast code simply processes transport packets one-by-one and has no concept of anything that spans multiple packets (such as NALUs); that's what makes it so fast.

2) All other streams should be bit identical in slow and fast mode.

3) All file names should be the same between slow and fast modes, so change the output name if you want to do both ways to compare (without leaving the GUI).

4) Garbage stripping is not yet implemented.

This is the hardest thing I ever did, including laying floors and installing appliances, so I mighta goofed something up. Your testing and feedback will be greatly appreciated. Enjoy!

Mr Peabody and I are off to visit Albert Einstein again, as there are some loose ends regarding Lorenz invariance I want to clear up, and I want to persuade him to join the forum. See ya in a while!
User avatar
Bullwinkle
Moose Approved
Posts: 200
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

Tastes great, less filling!
User avatar
gonca
DG Approved/Curly Approved/Moose Approved
Posts: 1062
Joined: Sun Apr 08, 2012 6:12 pm

Re: DGDemux development

Post by gonca »

Tested using 4K version of Wonder Woman

external HDD >> internal SSD
normal 16:00
fast 9:31

suspected that HDD was a bottleneck so I copied the movie to an internal SSD

internal SSD >> internal SSD
normal 8:57
fast 2:59

edit
folders containing each set of the demux were identical in size
User avatar
Rocky
Moose Approved
Posts: 1644
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Thank you for the testing, gonca. The ideal situation is SSD->SSD with enough free space to ensure all the preallocations succeed. That's where we see 3-4 times speedup.

The directories will not be exactly the same size when there is AVC video containing filler NALUs (not your case). I have been demuxing into two subfolders (fast and slow) by changing the output path. Then get in the folder holding those two and open a DOS prompt. Execute:

fc /b slow\* fast\*

That will compare all the files. If you have the AVC video with filler get that out before running the compare, or you will be inundated with output.

I have tested two disks so far and all is well. Will test more today.
Post Reply