DGDemux development

Post Reply
DAE avatar
TufInside
Posts: 2
Joined: Wed Nov 06, 2019 8:51 pm

Re: DGDemux development

Post by TufInside »

Probably a stupid question but will this be able to scan playlists (like eac3to) instead of having to manually point to a specific playlist ?
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

"scan playlists (like eac3to)"

Don't know about eac3to. What exactly are you asking for? Scan playlists means what?
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

We're back in the shop for repairs. The main issue is that the audio gaps processing relies on knowing the video frame rate. But DGIndexNV obtained that from the CUVID decoder parsing. Since the CUVID code was removed, now the frame rate is seen as 0fps. Not good. So I am adding back the old-fashioned manual parsing to get the frame rate.
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

OK, working good now. Below is the current to-do list with completed stuff marked [DONE]. I'll probably release this as a beta today or tomorrow after some additional testing.

To-Do:

The DTS audio gets tagged with 1536 which is the core audio but the
actual DTS is DTS MA. E.g: PID 1101 C+L+R+SL+SR 48 1536 eng DELAY 0ms.dts

The listing when no output is specified should show THD embedded stream.

DTS express streams are not demuxed.

Doesn't demux the secondary video.

Need DTS audio gaps processing?

Demux simultaneously forced-only subtitle stream and normal stream.

Split by chapters, i.e., Japanese disks with one episode per M2TS.

Needs a GUI.

Linux version.

------------------------------------------------------------------------

[DONE] Create destination directory if it does not exist.

[DONE] Verify handling of mark_type != 1. E.g., Terminators 2, 95 chapters
extracted when 72 is claimed to be correct.

[DONE] Fix missing Frame_Rate for all video types.

[DONE] Info only option and stream selection.

[DONE] FPS CLI option to force frame rate. Warning if FPS not detected.

[DONE] Verify angle numbering base 1 and fix if needed.
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Here is DGDemux 1.0.0.1. Note that you can now get a listing and you can demux only desired streams. See the DGDemux.txt file for details.

http://rationalqm.us/dgdemux/DGDemux_1001.rar

I am most interested in sync issues at this time. The way to test that is to demux the video and the audio stream of interest, and then mux them using mkvtoolnix. Then open the MKV in your player and see if there is sync throughout. Please report any sync issues. DO NOT use tsmuxer for this testing. It is unreliable.

Current to-do list:

The DTS audio gets tagged with 1536 which is the core audio but the
actual DTS is DTS MA. E.g: PID 1101 C+L+R+SL+SR 48 1536 eng DELAY 0ms.dts

DTS express streams are not demuxed.

Doesn't demux the secondary video.

Demux simultaneously forced-only subtitle stream and normal stream.

Split by chapters, i.e., Japanese disks with one episode per M2TS.

Needs a GUI.

Linux version.
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Please re-download 1.0.0.1 as there was a boo-boo in the video demuxing.
DAE avatar
Guest

Re: DGDemux development

Post by Guest »

Picked a BD with THD
Did a demux and then two remuxes
First
Video + thd > in sync
Second
Video + embedded ac3 + pgs > in sync
However

Code: Select all

DGDemux -i E:\AUTOMATA_BD\BDMV\PLAYLIST\00000.mpls
works but

Code: Select all

DGDemux -i E:\AUTOMATA BD\BDMV\PLAYLIST\00000.mpls

DGDemux -i E:\"AUTOMATA BD"\BDMV\PLAYLIST\00000.mpls
Does not
Movies with longer titles could be cumbersome to those that don't use underscores
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Great to hear that the streams are in sync. Thank you gonca for the testing.

Of course you are right to be concerned about spaces versus underscores. This would be correct:

DGDemux -i "E:\AUTOMATA BD\BDMV\PLAYLIST\00000.mpls"

Does that work?
DAE avatar
Guest

Re: DGDemux development

Post by Guest »

DGDemux -i "E:\AUTOMATA BD\BDMV\PLAYLIST\00000.mpls"
works
All one long path, the whole thing has to be in quotes DOH, feel like Homer Simpson
DAE avatar
borderline
Posts: 3
Joined: Thu Nov 14, 2019 5:01 am

Re: DGDemux development

Post by borderline »

Hi I wanted to test this with a Kino Lorber Blu-ray as many of them have a short (around ~11 second) logo in a separate m2ts that plays before the main feature. The logo m2ts has no audio or subtitle streams. If you handle these with eac3to by parsing the playlist eac3to doesn't delay the audio to account for the logo and any mkv muxes will end up out of sync. If you use eac3to directly with the movie m2ts its fine. MakeMKV works fine (it automatically skips the logo in the resulting mkv and adjusts the chapter times accordingly).

Anyhow for Naked Alibi by Kino Lorber:

Code: Select all

eac3to.exe "D:\NAKED ALIBI"
1) 00004.mpls, 00010.m2ts+00004.m2ts+00000.m2ts, 1:26:06
   - Chapters, 8 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)

eac3to.exe "D:\NAKED ALIBI" 1)
M2TS, 1 video track, 2 audio tracks, 1 subtitle track, 1:26:06, 24p /1.001
1: Chapters, 8 chapters
2: h264/AVC, 1080p24 /1.001 (16:9)
3: DTS Master Audio, 2.0 channels, 16 bits, 48kHz
   (core: DTS, 2.0 channels, 1509kbps, 48kHz)
4: AC3, 2.0 channels, 192kbps, 48kHz, 32ms
5: Subtitle (PGS)
DGDemux initially fails to detect a framerate, which is fine as it can be specified but even once specified it only detects the video track, no audio or subtitles. My guess would be its only parsing the initial logo m2ts.

Code: Select all

DGDemux.exe -i "D:\NAKED ALIBI\BDMV\PLAYLIST\00004.mpls" -fps 23.976

D:\NAKED ALIBI>
1011: Video
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Interesting. Thank you for the report. Can you please give me a link to buy that BD?
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Thank you. Ordered. Will arrive tomorrow.
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

The license for DGDemux is revised as follows:

-----
DGDemux by Donald A. Graft may be freely used by end users directly
invoking the executable DGDemux.exe. DGDemux is not licensed
for use by, or for incorporation into, any third-party software,
unless explicit permission has been granted by Donald A. Graft
upon a request for the same. DGDemux.exe and its documentation are
copyrighted and may not be redistributed.

No guarantees of any kind are offered or implied for DGDemux.

Donald A. Graft
-----
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Added a listing of the opened M2TS files and fixed the angle processing hopefully for good. Want to have a look at LPCM wrapping before making a new release.

Naked Alibi is ripping right now.
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

OK borderline, here's what I have done for you (already tested). There is a new option -ffsl (first file size limit). This option defaults to 0 (check disabled). If ffsl > 0 and if the size of the first M2TS file in the playlist is less than the ffsl value, then the first M2TS is ignored.The option -ffsl 1000000 enables correct fps detection and demuxing of Naked Alibi with AV sync.

BTW, eac3to also fails with Naked Alibi and needs a fix like this.

If you absolutely must have that logo then you will have to re-append it in your encoding process and provide some audio for it. Seems pretty pointless to me though. Great flick, BTW.

EDIT: Need to adjust the chapter times apparently, too. Hmm, may not be so easy. Investigating.
-----
> dgdemux -i h:\rips\naked_alibi\bdmv\playlist\00004.mpls -ffsl 1000000
DGDemux 1.0.0.2 by Donald A. Graft
Copyright (C) 2019-2020 Donald A. Graft, All Rights Reserved

DGDemux: Ignoring h:\rips\naked_alibi\bdmv\STREAM\00010.m2ts as too small.

h:\rips\naked_alibi\bdmv\STREAM\00004.m2ts
h:\rips\naked_alibi\bdmv\STREAM\00000.m2ts

1011: Video
1100: DTS HDMA L+R 48 1536 [fra]
1101: AC3 2.0 48 192 [eng]
1200: PGS subtitles [eng]
-----
User avatar
Bullwinkle
Posts: 338
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

Rock, just make a 'skip first M2TS' option. ffsl? Really? Snort.

Been thinking about investing in gold coins. Wanna make a fortune? Hoomins,
send a PM and we will make you rich beyond even your wildest, most Moose-like,
dreams. :wow:

https://www.youtube.com/watch?v=_lTB8m6z_sY
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

That's right, Bullwinkle. Let's go!
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Revised to use -sf (skip first). Also the chapters are adjusted when -sf is given. Release later today.
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Here is version 1.0.0.2. The most important changes are:

* Now prints a listing of the M2TS files in the playlist when omitting the -o option.

* Fully fixed the angle handling. All angles are now accessible using 1-based numbering.

* Added a -sf option to skip the first M2TS (and adjust the chapters) for disks such as Naked Alibi.

* The presence of an embedded AC3 for THD audio is now indicated in the stream listing. E.g.:
1100: THD 48000 8ch (plus embedded AC3) [eng]

* Updated the help file, the to-do list, and the license.

http://rationalqm.us/dgdemux/DGDemux_1002.rar

Probably implement WAV wrapping for LPCM next. Whee!
User avatar
hydra3333
Posts: 394
Joined: Wed Oct 06, 2010 3:34 am
Contact:

Re: DGDemux development

Post by hydra3333 »

If there was a like button on the forum, I'd click it :)
I really do like it here.
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

You're right, hydra3333! Where is that button? :?

We aim to please and we thank the divine for energizing us all. Whee!

Bullwinkle told me to watch out for a Russian spy lady seen several times. Can't be too careful these days.
DAE avatar
borderline
Posts: 3
Joined: Thu Nov 14, 2019 5:01 am

Re: DGDemux development

Post by borderline »

I'm glad you liked the movie.

Testing v1.0.0.2 with -sf and DGDemux worked great.
Cheers.
User avatar
Rocky
Posts: 3555
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky »

Following is the current to-do list (in no particular order). Looking at a GUI release and updated DGDemux later today.

----------------------------------------------------------------------------------------------
The DTS audio gets tagged with 1536 which is the core audio but the
actual DTS is DTS MA. E.g: PID 1101 C+L+R+SL+SR 48 1536 eng DELAY 0ms.dts

DTS express streams are not demuxed.

Doesn't demux the secondary video.

Demux simultaneously forced-only subtitle stream and normal stream.

Split by chapters, i.e., Japanese disks with one episode per M2TS.

Linux version.

I had forgotten to ask for the most important feature which I need for chapterEditor to create
Mulit-Edition-mkvs. With eac3to is it possible to use the m2ts files as input and only so I can
create such mkvs. In eac3to I can append all the m2ts-path with a "+". [hubblec4]

Mitigate the console interface issue. E.g., cannot kill with CTRL-C in powershell,
don't get shell prompt after DGDemux terminates, etc.

It would be nice if DGDemux could also show the codec or similar infos like BDInfo does, if possible.

This is maybe not a DGDemux problem, but I can not import/open the extracted .pcm audio file in mkvtoolnix. Tools like DVDFab can save to mkv with pcm audio. Or maybe DGDemux could save it as wav?
pcm = raw wave audio without a header, correct? [ChaosKing]

It would be nice to have some indication of completed process, like "done". Just "100" a
little weird IMO. [redbtn]

It would be nice to have option to demux files to directory where cmd is located (instead of setting output directory directly). Like "E:\Films>dgdemux -i input-dir\00800.mpls -newoption" demuxing to E:\Films [redbtn]

Need 'skip last' and 'skip duplicates' options.

Some kind of playlist scanning aka eac3to.

Default output name prefix. Maybe it is possible to have default output name like "DGDemux"
or "playlist name" when using just "-o"? I like "-o NAME" feature, but I think having a
default name is even better. [redbtn]

[DONE] Create destination directory if it does not exist.

[DONE] Verify handling of mark_type != 1. E.g., Terminators 2, 95 chapters
extracted when 72 is claimed to be correct.

[DONE] Fix missing Frame_Rate for all video types.

[DONE] Info only option and stream selection.

[DONE] FPS CLI option to force frame rate. Warning if FPS not detected.

[DONE] Verify angle numbering base 1 and fix if needed.

[DONE] The listing when no output is specified should show THD embedded stream.

[DONE] Needs a GUI.

[DONE] Your info about a mpls file need an extension to show all the used m2ts files.
User avatar
Bullwinkle
Posts: 338
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle »

I saw the Russian spy lady again, Rock. Watch out!

Who is this Overdrive80 twerp? We're here slaving away to give free solutions to modern dilemmas, and this guy attacks DG because he feels "offended". Snort!
Post Reply