Support forum for DG Tools

Thank you. Investigating...

Please confirm the cut range you gave me was from the ORIGINAL TS and not one that you edited.

I didn't edit anything. This is from the 81GB TS that I indexed and examined and reported.

(Are you sure you gave me the correct range?)

A bit off topic performance issue

When indexing files with so many frames, the refreshing frame number on the statistic window slows down the speed quite a bit.

I was indexing a file on SSD and I saw it reading @ 80MB/s and maxing out a single core.

Close the statistic panel and it spikes to 150MB/s and keeps that speed till the end.

It usually happens when you are indexing files with high fps -- a lot small but more frames are involved.

Suggestion: refresh the frame number every couple frames, i.e. every 64 frames or every 50, 100, etc.

-----

Regarding to decoding performance, without remote desktop I get the following speed.

Let's address performance later.

No, I can't be sure about the range. And the piece you gave me appears fine.

Suggestion: I need the whole 81GB stream. If I ship you a hard disk, can you put the stream on it and ship it back? If you can do this please send me an email with the shipping address. Alternatively put it on multiple bluray data disks and send to me. I will pay you back your expenses.

I can upload to an ftp server and PM you a download link, if that works better for you. RAR with rr3 split into multiple parts and should be uploaded within 8 hours. Shipping usually takes much longer time though.

Just FYI, tested with other (shorter) videos and no problems found so far. This is the only case that fails.

Sure, that would be great.

It's very strange. The POC jumps back to -2, -1, 0, for a while and then back to normal. That's guaranteed to screw up random access. With the full stream I'll be able to figure out why it's happening.

I am downloading the 84GB stream. Thank you for providing it.

Meanwhile, I have found the reason for all those PPS's in the DGI file and fixed it so now only one is shown. I compare the PPS NALU to see if it changed from the last one. But the HEVC NALU header has a temporal ID which isn't present in AVC. So my comparison thought the PPS changed when its content really did not; only the NALU temporal ID changed. So I fixed the comparison to look only at the PPS semantic content.

Perhaps this affects our problem; I'm not sure. I will see when I complete downloading your stream.

Making progress, keep your chin up.

Good job!

(I was also wondering why there're so many PPSes, as I recalled to read about duplicate PPSes being filtered in the manual.)

You read the manual? That's a first!

Given that, it's pretty easy to see why the multiple PPS's caught my attention. My startle reflex is easily triggered by stuff like this.

Yea that's the first step when I was trying to understand the DGI format. //

I added a new smilie just for you:

I just slipstreamed the PPS fix if you'd like to run with it.

I am slowly downloading the stream to avoid my ISP capping me out. Don't forget I am binge watching Breaking Bad at the same time. It's getting exciting; 5 episodes to go. No spoilers people, on pain of banning!

admin wrote:I just slipstreamed the PPS fix if you'd like to run with it.

I am slowly downloading the stream to avoid my ISP capping me out. Don't forget I am binge watching Breaking Bad at the same time. It's getting exciting; 5 episodes to go. No spoilers people, on pain of banning!

Good, no more handwriting dgi.

"Good, no more handwriting dgi."

Handwriting wasn't strictly necessary, but if the extra PPS's offended your sense of aesthetics, I can surely empathize with that. It offended mine too.

Nice graphics there!

Virgo -- A Perfectionist

(Can't compete with your graphics.)

Try this: https://imgur.com/a/obW5S

Nice. Thanks for the link!

I finally finished the download and recreated the TS file. I indexed it and was able to recreate the problem. Whew!

Two more episodes of BB tonight and then tomorrow I will get cracking on this.

Feel free to delete the stream from your FTP. I have a backup just in case.

Gotcha, enjoy your time!

I got lucky and found the HEVC indexing problem pretty fast. Please re-download 2052 and give it a whirl.

When you give the AOK I'll update the binaries notification thread.

With the fix, I now support a maximum of 2000000 frames for HEVC (about 9 hours at 60fps). I will fix this for a future version. Previously my limit was 1000000 frames, and your stream had more than that.

admin wrote:Previously my limit was 1000000 frames, and your stream had more than that.

That's what I thought. Usually this kind of thing indicates an overflow -- cut the stream = un-reproducible.

Hindsight is 20-20.

Looking into performance issues with the info dialog now...

I can test when I get home, but I should let you know that this is the only file that's such long -- if it works on your side, it must be good on my side.

(Also I'd still suggest you fix the FPS issue to 60000/1001. "FPS 210938 / 3520" is kinda annoying -- have to put assumefps each time or I get something wrong.)

(Also the #Coded and #Playback on the stats panel. I see it refresh every 1000 frames for AVC contents, but every single frame for HEVC contents. Did you forget to copy the code there?)

(Also I observed a crash when indexing a (small, don't panic ) stream. Will report back later.)

OK I reproduced the issue.

Find any MP4 file (file format should not matter), and execute "dgindexnv -i x.mp4 -o b", guaranteed to crash.