Page 1 of 1

[RESOLVED] Issue with subtitles demuxing

Posted: Tue Jul 14, 2020 3:15 pm
by Guest 2
[admin: Moved subtitles-related posts from the EAC3 issues thread to this new thread. The order of posts may not be completely accurate and some posts have been edited to get rid of EAC3 issues and other superfluous matter. Links may be broken. Members, please make a separate thread for each issue. Thank you.]

REJOICE! I have just bought Onward BD for the daughter of my cousin and it's even more messed up as structure:

0802.mpls = 00901.m2ts+01438.m2ts+00903.m2ts+01482.m2ts+00905.m2ts+01483.m2ts+00907.m2ts+01440.m2ts+01484.m2ts+00911.m2ts+01442.m2ts+00913.m2ts+01444.m2ts+00915.m2ts+01446.m2ts+00917.m2ts+01448.m2ts+01312.m2ts+01450.m2ts+01314.m2ts+01452.m2ts+01589.m2ts+01318.m2ts+01456.m2ts+01320.m2ts+01485.m2ts+01322.m2ts+01458.m2ts+01324.m2ts+01486.m2ts+01326.m2ts+01460.m2ts+01328.m2ts+01487.m2ts+01330.m2ts+01488.m2ts+01332.m2ts+01489.m2ts+01334.m2ts+01462.m2ts+01336.m2ts+01490.m2ts+01338.m2ts+01491.m2ts+01340.m2ts+01492.m2ts+01342.m2ts+01464.m2ts+01352.m2ts+01493.m2ts+01344.m2ts+01494.m2ts+01346.m2ts+01495.m2ts+01348.m2ts+01496.m2ts+01350.m2ts+01466.m2ts+01362.m2ts+01468.m2ts+01354.m2ts+01497.m2ts+01356.m2ts+01470.m2ts+01358.m2ts+01498.m2ts+01360.m2ts+01499.m2ts+01372.m2ts+01500.m2ts+01364.m2ts+01472.m2ts+01382.m2ts+01474.m2ts+01374.m2ts+01501.m2ts+01366.m2ts+01502.m2ts+01368.m2ts+01503.m2ts+01370.m2ts+01476.m2ts+01376.m2ts+01504.m2ts+01378.m2ts+01434.m2ts+01479.m2ts+01381.m2ts+01481.m2ts+00007.m2ts

And track list:

Streams:
1011: Video [AVC 23.976 1080p 16:9]
1100: DTS HDMA C+L+R+SL+SR 48 1536 [eng]
1101: DTS HDHR C+L+R+SL+SR 48 1536
1102: AC3 2.0 48 320 [eng]
1103: E-AC3 7.1 48 896 [deu]
1104: E-AC3 7.1 48 896 [ita]
1105: AC3 5.1 48 640 [ces]
1106: AC3 2.0 48 320 [eng]
1200: PGS subtitles [eng]
1201: PGS subtitles [deu]
1202: PGS subtitles [ita]
1203: PGS subtitles [ces]
1204: PGS subtitles [eng]
1205: PGS subtitles [deu]
1206: PGS subtitles [ita]

SUP files timing difference examples (when OCR with SubtitleEdit to .ass):

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] DGIndexNV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.59,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.68,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.69,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.77,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.98,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.36,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:04.51,1:32:08.39,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] MakeMKV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.55,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.64,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.64,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.73,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.94,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.32,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:03.68,1:32:08.35,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

Some (and there are more than one) are relatively huge (1 sec out of sync).

The difference between 0803.mpls and the MKV version is 1 second. Perhaps the little out of sync are where the m2ts changes.

-----

In the meantime I gave a try to TSMuxer.

It extract a good eac3 (same lenght as AC3 as the movie, not -1 second like MakeMKV) but gives bad DTS-HDMA leading to FFMPEG errors when converting to AC3. The DTS extraction works ok on Solo movie. WTF. :lol:

The ASS from the SUP are almost equal to the ones of MakeMKV, with a max difference of .01 frames and the same max difference of 1 secondwith DGIndex ones.

I am thinking, now, that the issue is not only with EAC3 but with SUP too.

-----

Please notice that I am finding discrepancies in total frames too:

DGindexNV 147252
MakeMKV 147246
TSMuxer (nightly 2020_0702) 147252

Pheeeeeew.

-----

Updating the ASS from SUP sync issue: here is the comparison with TSMuxer ASS too.

Rocky, feel free to split this thread in two, if you prefer to face audio and sub things separately.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] DGIndexNV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.59,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.68,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.69,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.77,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.98,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.36,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:04.51,1:32:08.39,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] MakeMKV
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.55,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.64,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.64,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.73,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.94,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.32,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:03.68,1:32:08.35,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

[Script Info]
; This is an Advanced Sub Station Alpha v4+ script.
Title: [ita] TSMuxer
ScriptType: v4.00+
Collisions: Normal
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:49.88,0:00:53.55,Default,,0,0,0,,{\i1}In passato,\Nil mondo era pieno di meraviglia.{\i0}
Dialogue: 0,0:00:59.85,0:01:01.64,Default,,0,0,0,,{\i1}C'era avventura...{\i0}
Dialogue: 0,0:01:03.35,0:01:04.64,Default,,0,0,0,,{\i1}entusiasmo...{\i0}
Dialogue: 0,0:01:07.02,0:01:08.73,Default,,0,0,0,,{\i1}e ciò che più conta...{\i0}
Dialogue: 0,0:01:09.31,0:01:10.94,Default,,0,0,0,,{\i1}c'era magia.{\i0}
Dialogue: 0,0:01:12.48,0:01:14.32,Default,,0,0,0,,{\i1}Pirotecniósa!{\i0}
[…]
Dialogue: 0,1:32:03.68,1:32:08.35,Default,,0,0,0,,Ok, il percorso migliore per il parco\Nè una cosuccia chiamata Via della Rovina.

-----

I checked the BD of Avatar (extended collector's cut) for SUP issue.

There are 3 main MPLS with different versions of the movie, each with complex M2TS combo.

Same problem and this is a very old BD I have, not a new one with strange protections or whatsoever.

EDIT: My OCD made another victim.

I have tried to compare the subtitles of a simple structure BD, i.e. MPLS = 1 M2TS only, and there are discrepancies there too.

BD name is Promare, an anime, OCR to SRT format, to be sure not to touch other triggers.

DGIndexNV:

1 00:03:04,684 --> 00:03:08,563 <i>In diversi luoghi del mondo si stanno</i>
2 00:03:08,688 --> 00:03:12,109 <i>verificando fenomeni di combustione umana...</i>
3 00:03:12,192 --> 00:03:13,235 <i>I governi hanno messo in atto politiche</i>
4 00:03:13,276 --> 00:03:14,569 <i>segregazioniste nei confronti dei Burnish...</i>

MakeMKV:

1 00:03:04,643 --> 00:03:08,480 <i>In diversi luoghi del mondo si stanno</i>
2 00:03:08,647 --> 00:03:12,025 <i>verificando fenomeni di combustione umana...</i>
3 00:03:12,150 --> 00:03:13,151 <i>I governi hanno messo in atto politiche</i>
4 00:03:13,235 --> 00:03:14,486 <i>segregazioniste nei confronti dei Burnish...</i>

TSMuxer:

1 00:03:04,643 --> 00:03:08,480 <i>In diversi luoghi del mondo si stanno</i>
2 00:03:08,647 --> 00:03:12,025 <i>verificando fenomeni di combustione umana...</i>
3 00:03:12,150 --> 00:03:13,151 <i>I governi hanno messo in atto politiche</i>
4 00:03:13,235 --> 00:03:14,486 <i>segregazioniste nei confronti dei Burnish...</i>

EDIT: eac3to same values as MakeMKV and TSMuxer

Re: Issue with subtitles demuxing

Posted: Thu Jul 16, 2020 4:06 pm
by Guest 2
Rocky wrote:
Thu Jul 16, 2020 8:59 am
I care about real problems that you can demonstrate that in some way make the subs unusable.
Very easy.

Demux the sup(s) with DGIndexNV plus any other tool such as eac3to, MakeMKV or TSMuxer and look at their timings, even without OCRing them.

I suggest you to use SubtitleEdit, as I find it really comfortable but you can use any tool that can show you the timings of sup.

From the english subtitle of Onward:

Code: Select all

DGIndexNV                              MakeMKV

1                                      1
00:00:49,841 --> 00:00:53,554          00:00:49,841 --> 00:00:53,[b]512[/b]
WILDEN: <i>Long ago,                   WILDEN: <i>Long ago,
the world was full of wonder.</i>      the world was full of wonder.</i>

2                                      2
00:00:56,765 --> 00:00:58,392          00:00:56,765 --> 00:00:58,350
(WHINNYING)                            (WHINNYING)

3                                      3
00:00:59,810 --> 00:01:01,645          00:00:59,810 --> 00:01:01,603
<i>It was adventurous...</i>           <i>It was adventurous...</i>

[…]

37                                     37
00:03:18,615 --> 00:03:19,699          00:03:18,532 --> 00:03:19,658
I'm a mighty warrior.                  I'm a mighty warrior.

[…]

1466                                   1466
01:05:26,089 --> 01:05:27,090          01:05:25,880 --> 01:05:27,048
(GRUNTS)                               (GRUNTS)

[…]

1902                                   1902
01:36:02,799 --> 01:36:03,800          01:36:01,923 --> 01:36:03,758
<i>♪ Yeah, it's true</i>               <i>♪ Yeah, it's true</i>
As you can see, the issue can go from wrong duration (1,2,3) to wrong starting time, from a few frames (37) up to almost one second (1466, 1902).

On some other movies, I saw errors of more than one second.

Re: Issue with subtitles demuxing

Posted: Thu Jul 16, 2020 6:17 pm
by Guest 2
Please remember I found discrepancies in single M2TS movies too.

Re: Issue with subtitles demuxing

Posted: Fri Jul 17, 2020 9:02 am
by Rocky
Candidate fix for subtitles demuxing:

http://rationalqm.us/dgdemux/binaries/DGDemux_pgs.exe

Re: Issue with subtitles demuxing

Posted: Sun Jul 19, 2020 7:33 am
by Rocky
Fix for DGDemux released as slipstream 32. Corresponding changes for DGIndexNV are in progress.

Re: Issue with subtitles demuxing

Posted: Sun Jul 19, 2020 12:11 pm
by Guest 2
Rocky wrote:
Fri Jul 17, 2020 9:02 am
Candidate fix for subtitles demuxing
Will try tomorrow when home :) :salute:

Re: Issue with subtitles demuxing

Posted: Sun Jul 19, 2020 12:14 pm
by Rocky
Cool, thank you.

On the dinner plate:

* Port EAC3 and PGS subtitle fixes to DGDecNV and release with the version 4 MKV fix.
* Fix chapters for DGDemux episode demuxing.
* 3D planes for DGDemux.
* Look into W64 channel placement for DGDemux.
* More tonemapping curves for DGHDRtoSDR and other reported issues.

Re: Issue with subtitles demuxing

Posted: Sun Jul 19, 2020 2:19 pm
by Guest 2
Rocky wrote:
Sun Jul 19, 2020 12:14 pm
On the dinner plate
Getting hungry!

Re: Issue with subtitles demuxing

Posted: Sun Jul 19, 2020 7:58 pm
by Natasha
admin, send me a PM, I will make you happy.

https://www.youtube.com/watch?v=yC3ttBeOgb4

Re: Issue with subtitles demuxing

Posted: Mon Jul 20, 2020 4:44 am
by Guest 2
Rocky wrote:
Sun Jul 19, 2020 12:14 pm
Cool, thank you.
Some discepancies on "In full bloom":

TSMuxer & eac3to:

1
00:00:29,520 --> 00:00:31,840
Dicono che i fiori di ciliegio siano..

2
00:00:32,160 --> 00:00:33,160
Noti...

3
00:00:33,600 --> 00:00:35,120
per la loro breve e magnifica stagione...

4
00:00:35,760 --> 00:00:36,800
di fioritura...

DGDemux:

1
00:00:29,280 --> 00:00:31,840
Dicono che i fiori di ciliegio siano..

2
00:00:31,920 --> 00:00:33,160
Noti...

3
00:00:33,360 --> 00:00:35,120
per la loro breve e magnifica stagione...

4
00:00:35,520 --> 00:00:36,800
di fioritura...

Line 2 is about 1 second different.

Re: Issue with subtitles demuxing

Posted: Mon Jul 20, 2020 5:48 am
by Rocky
Investigating...

Re: Issue with subtitles demuxing

Posted: Mon Jul 20, 2020 8:12 am
by Rocky
Are you sure you are using the latest version 1.0.0.32? I tested it with PID 1201 and the first 4 subtitles match what you have shown for TSMUXER and EAC3TO, not what you have shown for DGDemux.

Image

BTW, what's up with the PID 1200 PGS track? It does not look valid.

Re: Issue with subtitles demuxing

Posted: Mon Jul 20, 2020 9:24 am
by admin
Natasha wrote:
Sun Jul 19, 2020 7:58 pm
admin, send me a PM, I will make you happy.
Sorry Nattie, this is more my style:

https://youtu.be/2HD6a0XoyDA?t=945 (live vocals no lipsync)
https://youtu.be/TrFwSjJafeA?list=PLfKw ... mTxT8&t=15 (beautiful tears)
https://www.youtube.com/watch?v=kDTvGtqbXH0 (the kids be like Bryan McKnight OMG)
https://www.youtube.com/watch?v=MsKmgKNdGL0 (bonus feature for Guest 2)

Re: Issue with subtitles demuxing

Posted: Mon Jul 20, 2020 9:46 am
by Guest 2
Rocky wrote:
Mon Jul 20, 2020 8:12 am
Are you sure you are using the latest version 1.0.0.32?
Yes and WTF... I demuxed again and sup(s) are correct.

Perhaps I had a old sup when I tried it and I was convinced that it was from latest version. I have so many BD on SSD to make tests on that I lost idea of what was demuxed with old and new softare.

Sorry to have made you losing your precious time.

Anyway I will do more testing in the next days, when you will release DGIndexNV.
Rocky wrote:
Mon Jul 20, 2020 8:12 am
BTW, what's up with the PID 1200 PGS track? It does not look valid.
It doesn't look valid with any demuxer I tried. BDs sometimes have authoring or subtitle errors. Really dunno.

Re: Issue with subtitles demuxing

Posted: Mon Jul 20, 2020 10:13 am
by Rocky
Good news, Guest 2, thank you.

I want a 100TB SSD. My 2TB drives are getting full. :shock:

Re: Issue with subtitles demuxing

Posted: Mon Jul 20, 2020 4:01 pm
by Guest

Re: Issue with subtitles demuxing

Posted: Mon Jul 20, 2020 9:34 pm
by Rocky
Cheaper to just add more 2TB drives.

Re: Issue with subtitles demuxing

Posted: Tue Jul 21, 2020 4:00 am
by Guest 2
https://www.liqid.com/products/composab ... ie-aic-ssd

I offloaded my storage to a FreeNAS, built with what was laying in the garage.

Nice rig, though.

Re: Issue with subtitles demuxing

Posted: Tue Jul 21, 2020 12:12 pm
by Curly
admin wrote:
Mon Jul 20, 2020 9:24 am
https://www.youtube.com/watch?v=MsKmgKNdGL0 (bonus feature for Guest 2)
After Britney's great performance that creepy guy sneaks up behind Britney and scares her. Then hawks his stupid CDs in her face. Then starts to give her the second CD and when she reaches for it he takes it away and gives it to his co-host. What a loser, no respect.

Re: Issue with subtitles demuxing

Posted: Tue Jul 21, 2020 12:14 pm
by Bullwinkle
Leave it to Curly to get to the heart of the matter. :salute:

Re: Issue with subtitles demuxing

Posted: Tue Jul 21, 2020 12:33 pm
by Sherman

Re: [RESOLVED] Issue with subtitles demuxing

Posted: Wed Jul 22, 2020 5:34 am
by Rocky
Fix released in slipstream 212. Marking RESOLVED.

Re: Issue with subtitles demuxing

Posted: Sat Jul 25, 2020 9:30 pm
by Levi

Re: [RESOLVED] Issue with subtitles demuxing

Posted: Sun Jul 26, 2020 12:11 pm
by Sherman
Wow, Levi, thanks!

Britney Jean's early work is unreal too:

https://www.youtube.com/watch?v=76pYZjhVylw

I'm going to ask Mr. Peabody if we can go back and watch the Mickey Mouse Club live!