[RESOLVED] Issue with subtitles demuxing

Support forum for DGDecNV
Post Reply
DAE avatar
Guest 2
Posts: 903
Joined: Mon Sep 20, 2010 2:18 pm

[RESOLVED] Issue with subtitles demuxing

Post by Guest 2 »

[admin: Moved subtitles-related posts from the EAC3 issues thread to this new thread. The order of posts may not be completely accurate and some posts have been edited to get rid of EAC3 issues and other superfluous matter. Links may be broken. Members, please make a separate thread for each issue. Thank you.]

REJOICE! I have just bought Onward BD for the daughter of my cousin and it's even more messed up as structure:

0802.mpls = 00901.m2ts+01438.m2ts+00903.m2ts+01482.m2ts+00905.m2ts+01483.m2ts+00907.m2ts+01440.m2ts+01484.m2ts+00911.m2ts+01442.m2ts+00913.m2ts+01444.m2ts+00915.m2ts+01446.m2ts+00917.m2ts+01448.m2ts+01312.m2ts+01450.m2ts+01314.m2ts+01452.m2ts+01589.m2ts+01318.m2ts+01456.m2ts+01320.m2ts+01485.m2ts+01322.m2ts+01458.m2ts+01324.m2ts+01486.m2ts+01326.m2ts+01460.m2ts+01328.m2ts+01487.m2ts+01330.m2ts+01488.m2ts+01332.m2ts+01489.m2ts+01334.m2ts+01462.m2ts+01336.m2ts+01490.m2ts+01338.m2ts+01491.m2ts+01340.m2ts+01492.m2ts+01342.m2ts+01464.m2ts+01352.m2ts+01493.m2ts+01344.m2ts+01494.m2ts+01346.m2ts+01495.m2ts+01348.m2ts+01496.m2ts+01350.m2ts+01466.m2ts+01362.m2ts+01468.m2ts+01354.m2ts+01497.m2ts+01356.m2ts+01470.m2ts+01358.m2ts+01498.m2ts+01360.m2ts+01499.m2ts+01372.m2ts+01500.m2ts+01364.m2ts+01472.m2ts+01382.m2ts+01474.m2ts+01374.m2ts+01501.m2ts+01366.m2ts+01502.m2ts+01368.m2ts+01503.m2ts+01370.m2ts+01476.m2ts+01376.m2ts+01504.m2ts+01378.m2ts+01434.m2ts+01479.m2ts+01381.m2ts+01481.m2ts+00007.m2ts

And track list:

Streams:
1011: Video [AVC 23.976 1080p 16:9]
1100: DTS HDMA C+L+R+SL+SR 48 1536 [eng]
1101: DTS HDHR C+L+R+SL+SR 48 1536
1102: AC3 2.0 48 320 [eng]
1103: E-AC3 7.1 48 896 [deu]
1104: E-AC3 7.1 48 896 [ita]
1105: AC3 5.1 48 640 [ces]
1106: AC3 2.0 48 320 [eng]
1200: PGS subtitles [eng]
1201: PGS subtitles [deu]
1202: PGS subtitles [ita]
1203: PGS subtitles [ces]
1204: PGS subtitles [eng]
1205: PGS subtitles [deu]
1206: PGS subtitles [ita]

SUP files timing difference examples (when OCR with SubtitleEdit to .ass):

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] DGIndexNV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.59,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.68,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.69,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.77,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.98,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.36,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:04.51,1:32:08.39,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] MakeMKV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.55,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.64,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.64,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.73,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.94,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.32,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:03.68,1:32:08.35,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

Some (and there are more than one) are relatively huge (1 sec out of sync).

The difference between 0803.mpls and the MKV version is 1 second. Perhaps the little out of sync are where the m2ts changes.

-----

In the meantime I gave a try to TSMuxer.

It extract a good eac3 (same lenght as AC3 as the movie, not -1 second like MakeMKV) but gives bad DTS-HDMA leading to FFMPEG errors when converting to AC3. The DTS extraction works ok on Solo movie. WTF. :lol:

The ASS from the SUP are almost equal to the ones of MakeMKV, with a max difference of .01 frames and the same max difference of 1 secondwith DGIndex ones.

I am thinking, now, that the issue is not only with EAC3 but with SUP too.

-----

Please notice that I am finding discrepancies in total frames too:

DGindexNV 147252
MakeMKV 147246
TSMuxer (nightly 2020_0702) 147252

Pheeeeeew.

-----

Updating the ASS from SUP sync issue: here is the comparison with TSMuxer ASS too.

Rocky, feel free to split this thread in two, if you prefer to face audio and sub things separately.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] DGIndexNV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.59,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.68,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.69,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.77,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.98,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.36,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:04.51,1:32:08.39,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] MakeMKV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.55,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.64,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.64,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.73,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.94,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.32,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:03.68,1:32:08.35,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] TSMuxer
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.55,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.64,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.64,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.73,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.94,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.32,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:03.68,1:32:08.35,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

-----

I checked the BD of Avatar (extended collector's cut) for SUP issue.

There are 3 main MPLS with different versions of the movie, each with complex M2TS combo.

Same problem and this is a very old BD I have, not a new one with strange protections or whatsoever.

EDIT: My OCD made another victim.

I have tried to compare the subtitles of a simple structure BD, i.e. MPLS = 1 M2TS only, and there are discrepancies there too.

BD name is Promare, an anime, OCR to SRT format, to be sure not to touch other triggers.

DGIndexNV:

1 00:03:04,684 --> 00:03:08,563 <i>In diversi luoghi del mondo si stanno</i>
2 00:03:08,688 --> 00:03:12,109 <i>verificando fenomeni di combustione umana...</i>
3 00:03:12,192 --> 00:03:13,235 <i>I governi hanno messo in atto politiche</i>
4 00:03:13,276 --> 00:03:14,569 <i>segregazioniste nei confronti dei Burnish...</i>

MakeMKV:

1 00:03:04,643 --> 00:03:08,480 <i>In diversi luoghi del mondo si stanno</i>
2 00:03:08,647 --> 00:03:12,025 <i>verificando fenomeni di combustione umana...</i>
3 00:03:12,150 --> 00:03:13,151 <i>I governi hanno messo in atto politiche</i>
4 00:03:13,235 --> 00:03:14,486 <i>segregazioniste nei confronti dei Burnish...</i>

TSMuxer:

1 00:03:04,643 --> 00:03:08,480 <i>In diversi luoghi del mondo si stanno</i>
2 00:03:08,647 --> 00:03:12,025 <i>verificando fenomeni di combustione umana...</i>
3 00:03:12,150 --> 00:03:13,151 <i>I governi hanno messo in atto politiche</i>
4 00:03:13,235 --> 00:03:14,486 <i>segregazioniste nei confronti dei Burnish...</i>

EDIT: eac3to same values as MakeMKV and TSMuxer
DAE avatar
Guest 2
Posts: 903
Joined: Mon Sep 20, 2010 2:18 pm

Re: Issue with subtitles demuxing

Post by Guest 2 »

Rocky wrote:
Thu Jul 16, 2020 8:59 am
I care about real problems that you can demonstrate that in some way make the subs unusable.
Very easy.

Demux the sup(s) with DGIndexNV plus any other tool such as eac3to, MakeMKV or TSMuxer and look at their timings, even without OCRing them.

I suggest you to use SubtitleEdit, as I find it really comfortable but you can use any tool that can show you the timings of sup.

From the english subtitle of Onward:

Code: Select all

DGIndexNV                              MakeMKV

1                                      1
00:00:49,841 --> 00:00:53,554          00:00:49,841 --> 00:00:53,[b]512[/b]
WILDEN: <i>Long ago,                   WILDEN: <i>Long ago,
the world was full of wonder.</i>      the world was full of wonder.</i>

2                                      2
00:00:56,765 --> 00:00:58,392          00:00:56,765 --> 00:00:58,350
(WHINNYING)                            (WHINNYING)

3                                      3
00:00:59,810 --> 00:01:01,645          00:00:59,810 --> 00:01:01,603
<i>It was adventurous...</i>           <i>It was adventurous...</i>

[…]

37                                     37
00:03:18,615 --> 00:03:19,699          00:03:18,532 --> 00:03:19,658
I'm a mighty warrior.                  I'm a mighty warrior.

[…]

1466                                   1466
01:05:26,089 --> 01:05:27,090          01:05:25,880 --> 01:05:27,048
(GRUNTS)                               (GRUNTS)

[…]

1902                                   1902
01:36:02,799 --> 01:36:03,800          01:36:01,923 --> 01:36:03,758
<i>♪ Yeah, it's true</i>               <i>♪ Yeah, it's true</i>
As you can see, the issue can go from wrong duration (1,2,3) to wrong starting time, from a few frames (37) up to almost one second (1466, 1902).

On some other movies, I saw errors of more than one second.
DAE avatar
Guest 2
Posts: 903
Joined: Mon Sep 20, 2010 2:18 pm

Re: Issue with subtitles demuxing

Post by Guest 2 »

Please remember I found discrepancies in single M2TS movies too.
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: Issue with subtitles demuxing

Post by Rocky »

Candidate fix for subtitles demuxing:

http://rationalqm.us/dgdemux/binaries/DGDemux_pgs.exe
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: Issue with subtitles demuxing

Post by Rocky »

Fix for DGDemux released as slipstream 32. Corresponding changes for DGIndexNV are in progress.
DAE avatar
Guest 2
Posts: 903
Joined: Mon Sep 20, 2010 2:18 pm

Re: Issue with subtitles demuxing

Post by Guest 2 »

Rocky wrote:
Fri Jul 17, 2020 9:02 am
Candidate fix for subtitles demuxing
Will try tomorrow when home :) :salute:
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: Issue with subtitles demuxing

Post by Rocky »

Cool, thank you.

On the dinner plate:

* Port EAC3 and PGS subtitle fixes to DGDecNV and release with the version 4 MKV fix.
* Fix chapters for DGDemux episode demuxing.
* 3D planes for DGDemux.
* Look into W64 channel placement for DGDemux.
* More tonemapping curves for DGHDRtoSDR and other reported issues.
DAE avatar
Guest 2
Posts: 903
Joined: Mon Sep 20, 2010 2:18 pm

Re: Issue with subtitles demuxing

Post by Guest 2 »

Rocky wrote:
Sun Jul 19, 2020 12:14 pm
On the dinner plate
Getting hungry!
User avatar
Natasha
Posts: 150
Joined: Wed Nov 20, 2019 11:11 am

Re: Issue with subtitles demuxing

Post by Natasha »

admin, send me a PM, I will make you happy.

https://www.youtube.com/watch?v=yC3ttBeOgb4
DAE avatar
Guest 2
Posts: 903
Joined: Mon Sep 20, 2010 2:18 pm

Re: Issue with subtitles demuxing

Post by Guest 2 »

Rocky wrote:
Sun Jul 19, 2020 12:14 pm
Cool, thank you.
Some discepancies on "In full bloom":

TSMuxer & eac3to:

1
00:00:29,520 --> 00:00:31,840
Dicono che i fiori di ciliegio siano..

2
00:00:32,160 --> 00:00:33,160
Noti...

3
00:00:33,600 --> 00:00:35,120
per la loro breve e magnifica stagione...

4
00:00:35,760 --> 00:00:36,800
di fioritura...

DGDemux:

1
00:00:29,280 --> 00:00:31,840
Dicono che i fiori di ciliegio siano..

2
00:00:31,920 --> 00:00:33,160
Noti...

3
00:00:33,360 --> 00:00:35,120
per la loro breve e magnifica stagione...

4
00:00:35,520 --> 00:00:36,800
di fioritura...

Line 2 is about 1 second different.
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: Issue with subtitles demuxing

Post by Rocky »

Investigating...
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: Issue with subtitles demuxing

Post by Rocky »

Are you sure you are using the latest version 1.0.0.32? I tested it with PID 1201 and the first 4 subtitles match what you have shown for TSMUXER and EAC3TO, not what you have shown for DGDemux.

Image

BTW, what's up with the PID 1200 PGS track? It does not look valid.
User avatar
admin
Posts: 4551
Joined: Thu Sep 09, 2010 3:08 pm

Re: Issue with subtitles demuxing

Post by admin »

Natasha wrote:
Sun Jul 19, 2020 7:58 pm
admin, send me a PM, I will make you happy.
Sorry Nattie, this is more my style:

https://youtu.be/2HD6a0XoyDA?t=945 (live vocals no lipsync)
https://youtu.be/TrFwSjJafeA?list=PLfKw ... mTxT8&t=15 (beautiful tears)
https://www.youtube.com/watch?v=kDTvGtqbXH0 (the kids be like Bryan McKnight OMG)
https://www.youtube.com/watch?v=MsKmgKNdGL0 (bonus feature for Guest 2)
DAE avatar
Guest 2
Posts: 903
Joined: Mon Sep 20, 2010 2:18 pm

Re: Issue with subtitles demuxing

Post by Guest 2 »

Rocky wrote:
Mon Jul 20, 2020 8:12 am
Are you sure you are using the latest version 1.0.0.32?
Yes and WTF... I demuxed again and sup(s) are correct.

Perhaps I had a old sup when I tried it and I was convinced that it was from latest version. I have so many BD on SSD to make tests on that I lost idea of what was demuxed with old and new softare.

Sorry to have made you losing your precious time.

Anyway I will do more testing in the next days, when you will release DGIndexNV.
Rocky wrote:
Mon Jul 20, 2020 8:12 am
BTW, what's up with the PID 1200 PGS track? It does not look valid.
It doesn't look valid with any demuxer I tried. BDs sometimes have authoring or subtitle errors. Really dunno.
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: Issue with subtitles demuxing

Post by Rocky »

Good news, Guest 2, thank you.

I want a 100TB SSD. My 2TB drives are getting full. :shock:
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: Issue with subtitles demuxing

Post by Rocky »

Cheaper to just add more 2TB drives.
DAE avatar
Guest 2
Posts: 903
Joined: Mon Sep 20, 2010 2:18 pm

Re: Issue with subtitles demuxing

Post by Guest 2 »

https://www.liqid.com/products/composab ... ie-aic-ssd

I offloaded my storage to a FreeNAS, built with what was laying in the garage.

Nice rig, though.
User avatar
Curly
Posts: 712
Joined: Sun Mar 15, 2020 11:05 am

Re: Issue with subtitles demuxing

Post by Curly »

admin wrote:
Mon Jul 20, 2020 9:24 am
https://www.youtube.com/watch?v=MsKmgKNdGL0 (bonus feature for Guest 2)
After Britney's great performance that creepy guy sneaks up behind Britney and scares her. Then hawks his stupid CDs in her face. Then starts to give her the second CD and when she reaches for it he takes it away and gives it to his co-host. What a loser, no respect.
Curly Howard
Director of EAC3TO Development
User avatar
Bullwinkle
Posts: 338
Joined: Thu Sep 05, 2019 6:37 pm

Re: Issue with subtitles demuxing

Post by Bullwinkle »

Leave it to Curly to get to the heart of the matter. :salute:
User avatar
Sherman
Posts: 576
Joined: Mon Jan 06, 2020 10:19 pm

Re: Issue with subtitles demuxing

Post by Sherman »

Sherman Peabody
Director of Linux Development
User avatar
Rocky
Posts: 3557
Joined: Fri Sep 06, 2019 12:57 pm

Re: [RESOLVED] Issue with subtitles demuxing

Post by Rocky »

Fix released in slipstream 212. Marking RESOLVED.
User avatar
Sherman
Posts: 576
Joined: Mon Jan 06, 2020 10:19 pm

Re: [RESOLVED] Issue with subtitles demuxing

Post by Sherman »

Wow, Levi, thanks!

Britney Jean's early work is unreal too:

https://www.youtube.com/watch?v=76pYZjhVylw

I'm going to ask Mr. Peabody if we can go back and watch the Mickey Mouse Club live!
Sherman Peabody
Director of Linux Development
Post Reply