[RESOLVED] HEVC/H.265 10/12-bit Support
Re: HEVC/H.265 10-bit Support
Thank you. Investigating...
Please confirm the cut range you gave me was from the ORIGINAL TS and not one that you edited.
Please confirm the cut range you gave me was from the ORIGINAL TS and not one that you edited.
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
I didn't edit anything. This is from the 81GB TS that I indexed and examined and reported.
(Are you sure you gave me the correct range?)
(Are you sure you gave me the correct range?)
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
A bit off topic performance issue
When indexing files with so many frames, the refreshing frame number on the statistic window slows down the speed quite a bit.
I was indexing a file on SSD and I saw it reading @ 80MB/s and maxing out a single core.
Close the statistic panel and it spikes to 150MB/s and keeps that speed till the end.
It usually happens when you are indexing files with high fps -- a lot small but more frames are involved.
Suggestion: refresh the frame number every couple frames, i.e. every 64 frames or every 50, 100, etc.
-----
Regarding to decoding performance, without remote desktop I get the following speed.
When indexing files with so many frames, the refreshing frame number on the statistic window slows down the speed quite a bit.
I was indexing a file on SSD and I saw it reading @ 80MB/s and maxing out a single core.
Close the statistic panel and it spikes to 150MB/s and keeps that speed till the end.
It usually happens when you are indexing files with high fps -- a lot small but more frames are involved.
Suggestion: refresh the frame number every couple frames, i.e. every 64 frames or every 50, 100, etc.
-----
Regarding to decoding performance, without remote desktop I get the following speed.
Code: Select all
Frames processed: 2041 (1000 - 3040)
FPS (min | max | average): 4.456 | 115.5 | 67.87
Memory usage (phys | virt): 206 | 338 MiB
Re: HEVC/H.265 10-bit Support
Let's address performance later.
No, I can't be sure about the range. And the piece you gave me appears fine.
Suggestion: I need the whole 81GB stream. If I ship you a hard disk, can you put the stream on it and ship it back? If you can do this please send me an email with the shipping address. Alternatively put it on multiple bluray data disks and send to me. I will pay you back your expenses.
No, I can't be sure about the range. And the piece you gave me appears fine.
Suggestion: I need the whole 81GB stream. If I ship you a hard disk, can you put the stream on it and ship it back? If you can do this please send me an email with the shipping address. Alternatively put it on multiple bluray data disks and send to me. I will pay you back your expenses.
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
I can upload to an ftp server and PM you a download link, if that works better for you. RAR with rr3 split into multiple parts and should be uploaded within 8 hours. Shipping usually takes much longer time though.
Just FYI, tested with other (shorter) videos and no problems found so far. This is the only case that fails.
Just FYI, tested with other (shorter) videos and no problems found so far. This is the only case that fails.
Re: HEVC/H.265 10-bit Support
Sure, that would be great.
It's very strange. The POC jumps back to -2, -1, 0, for a while and then back to normal. That's guaranteed to screw up random access. With the full stream I'll be able to figure out why it's happening.
It's very strange. The POC jumps back to -2, -1, 0, for a while and then back to normal. That's guaranteed to screw up random access. With the full stream I'll be able to figure out why it's happening.
Re: HEVC/H.265 10-bit Support
I am downloading the 84GB stream. Thank you for providing it.
Meanwhile, I have found the reason for all those PPS's in the DGI file and fixed it so now only one is shown. I compare the PPS NALU to see if it changed from the last one. But the HEVC NALU header has a temporal ID which isn't present in AVC. So my comparison thought the PPS changed when its content really did not; only the NALU temporal ID changed. So I fixed the comparison to look only at the PPS semantic content.
Perhaps this affects our problem; I'm not sure. I will see when I complete downloading your stream.
Making progress, keep your chin up.
Meanwhile, I have found the reason for all those PPS's in the DGI file and fixed it so now only one is shown. I compare the PPS NALU to see if it changed from the last one. But the HEVC NALU header has a temporal ID which isn't present in AVC. So my comparison thought the PPS changed when its content really did not; only the NALU temporal ID changed. So I fixed the comparison to look only at the PPS semantic content.
Perhaps this affects our problem; I'm not sure. I will see when I complete downloading your stream.
Making progress, keep your chin up.
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
Good job!
(I was also wondering why there're so many PPSes, as I recalled to read about duplicate PPSes being filtered in the manual.)
(I was also wondering why there're so many PPSes, as I recalled to read about duplicate PPSes being filtered in the manual.)
Re: HEVC/H.265 10-bit Support
You read the manual? That's a first!
Given that, it's pretty easy to see why the multiple PPS's caught my attention. My startle reflex is easily triggered by stuff like this.
Given that, it's pretty easy to see why the multiple PPS's caught my attention. My startle reflex is easily triggered by stuff like this.
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
Yea that's the first step when I was trying to understand the DGI format. //
Re: HEVC/H.265 10-bit Support
I added a new smilie just for you:
Re: HEVC/H.265 10-bit Support
I just slipstreamed the PPS fix if you'd like to run with it.
I am slowly downloading the stream to avoid my ISP capping me out. Don't forget I am binge watching Breaking Bad at the same time. It's getting exciting; 5 episodes to go. No spoilers people, on pain of banning!
I am slowly downloading the stream to avoid my ISP capping me out. Don't forget I am binge watching Breaking Bad at the same time. It's getting exciting; 5 episodes to go. No spoilers people, on pain of banning!
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
admin wrote:I just slipstreamed the PPS fix if you'd like to run with it.
I am slowly downloading the stream to avoid my ISP capping me out. Don't forget I am binge watching Breaking Bad at the same time. It's getting exciting; 5 episodes to go. No spoilers people, on pain of banning!
Good, no more handwriting dgi.
Re: HEVC/H.265 10-bit Support
"Good, no more handwriting dgi."
Handwriting wasn't strictly necessary, but if the extra PPS's offended your sense of aesthetics, I can surely empathize with that. It offended mine too.
Nice graphics there!
Handwriting wasn't strictly necessary, but if the extra PPS's offended your sense of aesthetics, I can surely empathize with that. It offended mine too.
Nice graphics there!
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
Virgo -- A Perfectionist
Re: HEVC/H.265 10-bit Support
(Can't compete with your graphics.)
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
Nice. Thanks for the link!
Re: HEVC/H.265 10-bit Support
I finally finished the download and recreated the TS file. I indexed it and was able to recreate the problem. Whew!
Two more episodes of BB tonight and then tomorrow I will get cracking on this.
Feel free to delete the stream from your FTP. I have a backup just in case.
Two more episodes of BB tonight and then tomorrow I will get cracking on this.
Feel free to delete the stream from your FTP. I have a backup just in case.
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
Gotcha, enjoy your time!
Re: HEVC/H.265 10-bit Support
I got lucky and found the HEVC indexing problem pretty fast. Please re-download 2052 and give it a whirl.
When you give the AOK I'll update the binaries notification thread.
With the fix, I now support a maximum of 2000000 frames for HEVC (about 9 hours at 60fps). I will fix this for a future version. Previously my limit was 1000000 frames, and your stream had more than that.
When you give the AOK I'll update the binaries notification thread.
With the fix, I now support a maximum of 2000000 frames for HEVC (about 9 hours at 60fps). I will fix this for a future version. Previously my limit was 1000000 frames, and your stream had more than that.
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
That's what I thought. Usually this kind of thing indicates an overflow -- cut the stream = un-reproducible.admin wrote:Previously my limit was 1000000 frames, and your stream had more than that.
Re: HEVC/H.265 10-bit Support
Hindsight is 20-20.
Looking into performance issues with the info dialog now...
Looking into performance issues with the info dialog now...
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
I can test when I get home, but I should let you know that this is the only file that's such long -- if it works on your side, it must be good on my side.
(Also I'd still suggest you fix the FPS issue to 60000/1001. "FPS 210938 / 3520" is kinda annoying -- have to put assumefps each time or I get something wrong.)
(Also the #Coded and #Playback on the stats panel. I see it refresh every 1000 frames for AVC contents, but every single frame for HEVC contents. Did you forget to copy the code there?)
(Also I observed a crash when indexing a (small, don't panic ) stream. Will report back later.)
(Also I'd still suggest you fix the FPS issue to 60000/1001. "FPS 210938 / 3520" is kinda annoying -- have to put assumefps each time or I get something wrong.)
(Also the #Coded and #Playback on the stats panel. I see it refresh every 1000 frames for AVC contents, but every single frame for HEVC contents. Did you forget to copy the code there?)
(Also I observed a crash when indexing a (small, don't panic ) stream. Will report back later.)
- MeteorRain
- Posts: 130
- Joined: Fri Jul 25, 2014 4:04 pm
- Location: New Jersey
Re: HEVC/H.265 10-bit Support
OK I reproduced the issue.
Find any MP4 file (file format should not matter), and execute "dgindexnv -i x.mp4 -o b", guaranteed to crash.
Find any MP4 file (file format should not matter), and execute "dgindexnv -i x.mp4 -o b", guaranteed to crash.