DGDemux development

Post Reply
TufInside
Posts: 2
Joined: Wed Nov 06, 2019 9:51 pm

Re: DGDemux development

Post by TufInside » Wed Nov 06, 2019 9:56 pm

Probably a stupid question but will this be able to scan playlists (like eac3to) instead of having to manually point to a specific playlist ?

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Wed Nov 06, 2019 10:00 pm

"scan playlists (like eac3to)"

Don't know about eac3to. What exactly are you asking for? Scan playlists means what?

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Mon Nov 11, 2019 2:53 pm

We're back in the shop for repairs. The main issue is that the audio gaps processing relies on knowing the video frame rate. But DGIndexNV obtained that from the CUVID decoder parsing. Since the CUVID code was removed, now the frame rate is seen as 0fps. Not good. So I am adding back the old-fashioned manual parsing to get the frame rate.

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Tue Nov 12, 2019 12:37 pm

OK, working good now. Below is the current to-do list with completed stuff marked [DONE]. I'll probably release this as a beta today or tomorrow after some additional testing.

To-Do:

The DTS audio gets tagged with 1536 which is the core audio but the
actual DTS is DTS MA. E.g: PID 1101 C+L+R+SL+SR 48 1536 eng DELAY 0ms.dts

The listing when no output is specified should show THD embedded stream.

DTS express streams are not demuxed.

Doesn't demux the secondary video.

Need DTS audio gaps processing?

Demux simultaneously forced-only subtitle stream and normal stream.

Split by chapters, i.e., Japanese disks with one episode per M2TS.

Needs a GUI.

Linux version.

------------------------------------------------------------------------

[DONE] Create destination directory if it does not exist.

[DONE] Verify handling of mark_type != 1. E.g., Terminators 2, 95 chapters
extracted when 72 is claimed to be correct.

[DONE] Fix missing Frame_Rate for all video types.

[DONE] Info only option and stream selection.

[DONE] FPS CLI option to force frame rate. Warning if FPS not detected.

[DONE] Verify angle numbering base 1 and fix if needed.

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Wed Nov 13, 2019 11:48 am

Here is DGDemux 1.0.0.1. Note that you can now get a listing and you can demux only desired streams. See the DGDemux.txt file for details.

http://rationalqm.us/dgdemux/DGDemux_1001.rar

I am most interested in sync issues at this time. The way to test that is to demux the video and the audio stream of interest, and then mux them using mkvtoolnix. Then open the MKV in your player and see if there is sync throughout. Please report any sync issues. DO NOT use tsmuxer for this testing. It is unreliable.

Current to-do list:

The DTS audio gets tagged with 1536 which is the core audio but the
actual DTS is DTS MA. E.g: PID 1101 C+L+R+SL+SR 48 1536 eng DELAY 0ms.dts

DTS express streams are not demuxed.

Doesn't demux the secondary video.

Demux simultaneously forced-only subtitle stream and normal stream.

Split by chapters, i.e., Japanese disks with one episode per M2TS.

Needs a GUI.

Linux version.

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Wed Nov 13, 2019 5:23 pm

Please re-download 1.0.0.1 as there was a boo-boo in the video demuxing.

gonca
Moose Approved/Curly Approved
Posts: 911
Joined: Sun Apr 08, 2012 6:12 pm

Re: DGDemux development

Post by gonca » Wed Nov 13, 2019 6:49 pm

Picked a BD with THD
Did a demux and then two remuxes
First
Video + thd > in sync
Second
Video + embedded ac3 + pgs > in sync
However

Code: Select all

DGDemux -i E:\AUTOMATA_BD\BDMV\PLAYLIST\00000.mpls
works but

Code: Select all

DGDemux -i E:\AUTOMATA BD\BDMV\PLAYLIST\00000.mpls

DGDemux -i E:\"AUTOMATA BD"\BDMV\PLAYLIST\00000.mpls
Does not
Movies with longer titles could be cumbersome to those that don't use underscores

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Wed Nov 13, 2019 9:31 pm

Great to hear that the streams are in sync. Thank you gonca for the testing.

Of course you are right to be concerned about spaces versus underscores. This would be correct:

DGDemux -i "E:\AUTOMATA BD\BDMV\PLAYLIST\00000.mpls"

Does that work?

gonca
Moose Approved/Curly Approved
Posts: 911
Joined: Sun Apr 08, 2012 6:12 pm

Re: DGDemux development

Post by gonca » Thu Nov 14, 2019 5:57 am

DGDemux -i "E:\AUTOMATA BD\BDMV\PLAYLIST\00000.mpls"
works
All one long path, the whole thing has to be in quotes DOH, feel like Homer Simpson

borderline
Posts: 3
Joined: Thu Nov 14, 2019 6:01 am

Re: DGDemux development

Post by borderline » Thu Nov 14, 2019 6:35 am

Hi I wanted to test this with a Kino Lorber Blu-ray as many of them have a short (around ~11 second) logo in a separate m2ts that plays before the main feature. The logo m2ts has no audio or subtitle streams. If you handle these with eac3to by parsing the playlist eac3to doesn't delay the audio to account for the logo and any mkv muxes will end up out of sync. If you use eac3to directly with the movie m2ts its fine. MakeMKV works fine (it automatically skips the logo in the resulting mkv and adjusts the chapter times accordingly).

Anyhow for Naked Alibi by Kino Lorber:

Code: Select all

eac3to.exe "D:\NAKED ALIBI"
1) 00004.mpls, 00010.m2ts+00004.m2ts+00000.m2ts, 1:26:06
   - Chapters, 8 chapters
   - h264/AVC, 1080p24 /1.001 (16:9)

eac3to.exe "D:\NAKED ALIBI" 1)
M2TS, 1 video track, 2 audio tracks, 1 subtitle track, 1:26:06, 24p /1.001
1: Chapters, 8 chapters
2: h264/AVC, 1080p24 /1.001 (16:9)
3: DTS Master Audio, 2.0 channels, 16 bits, 48kHz
   (core: DTS, 2.0 channels, 1509kbps, 48kHz)
4: AC3, 2.0 channels, 192kbps, 48kHz, 32ms
5: Subtitle (PGS)
DGDemux initially fails to detect a framerate, which is fine as it can be specified but even once specified it only detects the video track, no audio or subtitles. My guess would be its only parsing the initial logo m2ts.

Code: Select all

DGDemux.exe -i "D:\NAKED ALIBI\BDMV\PLAYLIST\00004.mpls" -fps 23.976

D:\NAKED ALIBI>
1011: Video

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Thu Nov 14, 2019 10:23 am

Interesting. Thank you for the report. Can you please give me a link to buy that BD?


User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Thu Nov 14, 2019 11:17 am

Thank you. Ordered. Will arrive tomorrow.

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Fri Nov 15, 2019 12:37 pm

The license for DGDemux is revised as follows:

-----
DGDemux by Donald A. Graft may be freely used by end users directly
invoking the executable DGDemux.exe. DGDemux is not licensed
for use by, or for incorporation into, any third-party software,
unless explicit permission has been granted by Donald A. Graft
upon a request for the same. DGDemux.exe and its documentation are
copyrighted and may not be redistributed.

No guarantees of any kind are offered or implied for DGDemux.

Donald A. Graft
-----

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Fri Nov 15, 2019 3:52 pm

Added a listing of the opened M2TS files and fixed the angle processing hopefully for good. Want to have a look at LPCM wrapping before making a new release.

Naked Alibi is ripping right now.

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Fri Nov 15, 2019 5:16 pm

OK borderline, here's what I have done for you (already tested). There is a new option -ffsl (first file size limit). This option defaults to 0 (check disabled). If ffsl > 0 and if the size of the first M2TS file in the playlist is less than the ffsl value, then the first M2TS is ignored.The option -ffsl 1000000 enables correct fps detection and demuxing of Naked Alibi with AV sync.

BTW, eac3to also fails with Naked Alibi and needs a fix like this.

If you absolutely must have that logo then you will have to re-append it in your encoding process and provide some audio for it. Seems pretty pointless to me though. Great flick, BTW.

EDIT: Need to adjust the chapter times apparently, too. Hmm, may not be so easy. Investigating.
-----
> dgdemux -i h:\rips\naked_alibi\bdmv\playlist\00004.mpls -ffsl 1000000
DGDemux 1.0.0.2 by Donald A. Graft
Copyright (C) 2019-2020 Donald A. Graft, All Rights Reserved

DGDemux: Ignoring h:\rips\naked_alibi\bdmv\STREAM\00010.m2ts as too small.

h:\rips\naked_alibi\bdmv\STREAM\00004.m2ts
h:\rips\naked_alibi\bdmv\STREAM\00000.m2ts

1011: Video
1100: DTS HDMA L+R 48 1536 [fra]
1101: AC3 2.0 48 192 [eng]
1200: PGS subtitles [eng]
-----

User avatar
Bullwinkle
Moose Approved
Posts: 167
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle » Fri Nov 15, 2019 9:24 pm

Rock, just make a 'skip first M2TS' option. ffsl? Really? Snort.

Been thinking about investing in gold coins. Wanna make a fortune? Hoomins,
send a PM and we will make you rich beyond even your wildest, most Moose-like,
dreams. :wow:

https://www.youtube.com/watch?v=_lTB8m6z_sY

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Fri Nov 15, 2019 9:47 pm

That's right, Bullwinkle. Let's go!

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Sat Nov 16, 2019 11:13 am

Revised to use -sf (skip first). Also the chapters are adjusted when -sf is given. Release later today.

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Sat Nov 16, 2019 8:54 pm

Here is version 1.0.0.2. The most important changes are:

* Now prints a listing of the M2TS files in the playlist when omitting the -o option.

* Fully fixed the angle handling. All angles are now accessible using 1-based numbering.

* Added a -sf option to skip the first M2TS (and adjust the chapters) for disks such as Naked Alibi.

* The presence of an embedded AC3 for THD audio is now indicated in the stream listing. E.g.:
1100: THD 48000 8ch (plus embedded AC3) [eng]

* Updated the help file, the to-do list, and the license.

http://rationalqm.us/dgdemux/DGDemux_1002.rar

Probably implement WAV wrapping for LPCM next. Whee!

User avatar
hydra3333
Moose Approved
Posts: 206
Joined: Wed Oct 06, 2010 3:34 am
Contact:

Re: DGDemux development

Post by hydra3333 » Sat Nov 16, 2019 11:15 pm

If there was a like button on the forum, I'd click it :)

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Sun Nov 17, 2019 12:09 am

You're right, hydra3333! Where is that button? :?

We aim to please and we thank the divine for energizing us all. Whee!

Bullwinkle told me to watch out for a Russian spy lady seen several times. Can't be too careful these days.

borderline
Posts: 3
Joined: Thu Nov 14, 2019 6:01 am

Re: DGDemux development

Post by borderline » Mon Nov 18, 2019 4:25 pm

I'm glad you liked the movie.

Testing v1.0.0.2 with -sf and DGDemux worked great.
Cheers.

User avatar
Rocky
Moose Approved
Posts: 1064
Joined: Fri Sep 06, 2019 12:57 pm

Re: DGDemux development

Post by Rocky » Wed Nov 20, 2019 11:00 am

Following is the current to-do list (in no particular order). Looking at a GUI release and updated DGDemux later today.

----------------------------------------------------------------------------------------------
The DTS audio gets tagged with 1536 which is the core audio but the
actual DTS is DTS MA. E.g: PID 1101 C+L+R+SL+SR 48 1536 eng DELAY 0ms.dts

DTS express streams are not demuxed.

Doesn't demux the secondary video.

Demux simultaneously forced-only subtitle stream and normal stream.

Split by chapters, i.e., Japanese disks with one episode per M2TS.

Linux version.

I had forgotten to ask for the most important feature which I need for chapterEditor to create
Mulit-Edition-mkvs. With eac3to is it possible to use the m2ts files as input and only so I can
create such mkvs. In eac3to I can append all the m2ts-path with a "+". [hubblec4]

Mitigate the console interface issue. E.g., cannot kill with CTRL-C in powershell,
don't get shell prompt after DGDemux terminates, etc.

It would be nice if DGDemux could also show the codec or similar infos like BDInfo does, if possible.

This is maybe not a DGDemux problem, but I can not import/open the extracted .pcm audio file in mkvtoolnix. Tools like DVDFab can save to mkv with pcm audio. Or maybe DGDemux could save it as wav?
pcm = raw wave audio without a header, correct? [ChaosKing]

It would be nice to have some indication of completed process, like "done". Just "100" a
little weird IMO. [redbtn]

It would be nice to have option to demux files to directory where cmd is located (instead of setting output directory directly). Like "E:\Films>dgdemux -i input-dir\00800.mpls -newoption" demuxing to E:\Films [redbtn]

Need 'skip last' and 'skip duplicates' options.

Some kind of playlist scanning aka eac3to.

Default output name prefix. Maybe it is possible to have default output name like "DGDemux"
or "playlist name" when using just "-o"? I like "-o NAME" feature, but I think having a
default name is even better. [redbtn]

[DONE] Create destination directory if it does not exist.

[DONE] Verify handling of mark_type != 1. E.g., Terminators 2, 95 chapters
extracted when 72 is claimed to be correct.

[DONE] Fix missing Frame_Rate for all video types.

[DONE] Info only option and stream selection.

[DONE] FPS CLI option to force frame rate. Warning if FPS not detected.

[DONE] Verify angle numbering base 1 and fix if needed.

[DONE] The listing when no output is specified should show THD embedded stream.

[DONE] Needs a GUI.

[DONE] Your info about a mpls file need an extension to show all the used m2ts files.

User avatar
Bullwinkle
Moose Approved
Posts: 167
Joined: Thu Sep 05, 2019 6:37 pm

Re: DGDemux development

Post by Bullwinkle » Wed Nov 20, 2019 3:24 pm

I saw the Russian spy lady again, Rock. Watch out!

Who is this Overdrive80 twerp? We're here slaving away to give free solutions to modern dilemmas, and this guy attacks DG because he feels "offended". Snort!

Post Reply