Page 3 of 15

Re: CUDASynth

Posted: Mon Oct 08, 2018 5:46 pm
by admin
Thanks, guys, awesome!

DGDenoise and DGSharpen are both CUDASynth-enabled.

Meanwhile, there is another limitation I discovered. Some 3rd party players and encode apps open the script multiple times. That will not work with CUDASynth as currently designed because there can be only one pipeline. I think I can fix that up fairly easily by having only the first source filter set up the framework.

Also, I have CUDASynth-enabled DGPQtoHLG. I'll make a release tomorrow after some testing.

Re: CUDASynth

Posted: Tue Oct 09, 2018 12:33 am
by hydra3333
Extremely nice work, DG. Thank you.

edit:To allay my lack of clarity, in the context of the new pipeline enabled DGDecodeNV.dll and the aforementioned test scripts with like
(a)

Code: Select all

core.std.LoadPlugin("C:/Program Files (Portable)/dgdecnv/x64 Binaries/DGDecodeNV.dll")
clip = core.dgdecodenv.DGSource(r'I:\test.dgi', fieldop=0, fulldepth=True)
and
(b)

Code: Select all

core.avs.LoadPlugin(r'C:\322\x64\DGDecodeNV.dll')
clip = core.avs.DGSource(r'J:\Darling6\STREAM\EP16.dgi', fdst="gpu0")
clip = core.avs.DGDenoise(clip, fsrc="gpu0", fdst="gpu0")
edit: added LoadPlugin to snippet (b) for clarity

and per the CUDASynth.txt "* Vapoursynth is not yet supported", would be correct to say the original non-cudasynth DGDecodeNV.dll is used in snippet (a) with ".dgdecodenv." and cudasynth DGDecodeNV.dll in snippet (b) with ".avs." ?

Hmm, I must not have caught up with the latest as my (long not updated) scripts have continued to use "core.avs.LoadPlugin" and "core.avs.DGSource" rather than "core.std.LoadPlugin" and "core.dgdecodenv.DGSource" ... damn, get I must get in from the scrub outa the midday sun. https://www.youtube.com/embed/z2YvYiWto ... &version=3

Re: CUDASynth

Posted: Tue Oct 09, 2018 5:30 am
by Guest
and per the CUDASynth.txt "* Vapoursynth is not yet supported", would be correct to say the original non-cudasynth DGDecodeNV.dll is used in snippet (a) with ".dgdecodenv." and cudasynth DGDecodeNV.dll in snippet (b) with ".avs." ?
Yes

Re: CUDASynth

Posted: Tue Oct 09, 2018 9:28 am
by admin
and per the CUDASynth.txt "* Vapoursynth is not yet supported", would be correct to say the original non-cudasynth DGDecodeNV.dll is used in snippet (a) with ".dgdecodenv." and cudasynth DGDecodeNV.dll in snippet (b) with ".avs." ?
No. The dgdecodenv versus avs decides whether the referenced DLL is invoked natively or via the avscompat layer. Either way, you would still load the same DLL. However, the CUDASynth DLL can only be loaded with avscompat at this time. If you omit the load plugin call then you could pick up something from autoloading. I recommend always using explicit loading.

Re: CUDASynth

Posted: Tue Oct 09, 2018 10:05 am
by Guest
Snippet (a) is the one I used in the benchmarking you asked for, and it uses to original non-cudasynth dll
Snippet (b) is the one from DJATOM's testing of the cudasynth dll

Re: CUDASynth

Posted: Tue Oct 09, 2018 10:19 am
by admin
I don't see a loadplugin call in snippet b so it's ambiguous. Also, snippet b leaves the output on the GPU. The last filter should output it to the CPU.

To get precise answers, one needs to ask precise questions. ;)

Re: CUDASynth

Posted: Tue Oct 09, 2018 11:08 am
by admin
CUDASynth 0.2:

* Added CUDASynth-enabled DGPQtoHLG.

* Revised the user manual: explain meaning of gpu0/1 (not different cards!),
added note that Vapoursynth can be used in avscompat mode, and mention
limitation of some players and third-party apps.

http://rationalqm.us/misc/CUDASynth_0.2.rar

Re: CUDASynth

Posted: Tue Oct 09, 2018 4:38 pm
by admin
Regarding the test results you guys gave, I'm having a little trouble digesting it as you have included CUDASynth results when I specifically asked you to exclude it. Also, there seems to be some confusion about native versus avscompat, etc. Finally, we want the prefetch() call for Avisynth+, otherwise we throw away some performance. Tell you what, I'll do some testing and post full results with full scripts and we can go from there.

One of my motivations here is to know whether using the asvcompat layer for Vapoursynth loses performance versus native. To be honest, I'd like to know why I should bother with the PITA of duplicating code to have native Vapoursynth if avscompat performs the same. Even if I have to release an avscompat.dll that's way easier than writing Vapoursynth native code for everything. Any thoughts?

Re: CUDASynth

Posted: Tue Oct 09, 2018 5:56 pm
by DJATOM
Yeah, it's possible to make autoloading with hand-written python module (as I did before native DGSource version came out), but it's, say, wasting a time to type another line in the script. So I'd like to have native versions if possible. I almost don't use avs+ nowadays, moved to VS about 1 year ago :lol:

Re: CUDASynth

Posted: Tue Oct 09, 2018 6:25 pm
by hydra3333
admin wrote:
Tue Oct 09, 2018 4:38 pm
Tell you what, I'll do some testing and post full results with full scripts and we can go from there.
Beaut ! :hat:
admin wrote:
Tue Oct 09, 2018 4:38 pm
One of my motivations here is to know whether using the asvcompat layer for Vapoursynth loses performance versus native. To be honest, I'd like to know why I should bother with the PITA of duplicating code to have native Vapoursynth if avscompat performs the same. Even if I have to release an avscompat.dll that's way easier than writing Vapoursynth native code for everything. Any thoughts?
An eminently reasonable line of reasoning :) Maybe also a question over at the other site as to what may or may not be be foregone if using the asvcompat layer for Vapoursynth versus native ? With any luck the VS author may provide some insight.

Re: CUDASynth

Posted: Tue Oct 09, 2018 6:31 pm
by hydra3333
DJATOM wrote:
Tue Oct 09, 2018 5:56 pm
Yeah, it's possible to make autoloading with hand-written python module (as I did before native DGSource version came out), but it's, say, wasting a time to type another line in the script. So I'd like to have native versions if possible. I almost don't use avs+ nowadays, moved to VS about 1 year ago :lol:
Being a control freak from way back (too many systems went belly up if decent control was omitted during development) I always manually load everything and don't begrudge a line or 20 of code :) Personal preference.

rar ? google tells me
What does RAR stand for in finance?
Abbr. Meaning
RAR Revenue Agent Report (US IRS)
RAR Refund-Anticipated Return
RAR Run At Risk
RAR Regulatory Asset Ratio (finance)
3rd seems about right given the vsrepo experience with 7z :D

Re: CUDASynth

Posted: Tue Oct 09, 2018 8:11 pm
by Guest
If you go this route all I really need to do is change my templates to be avs compatible.
So, all is good
Now that I think about it, the only reason I moved to vs was the lack of high bit depth support in the avisynth chain (NVEncC)
That has been corrected though

Re: CUDASynth

Posted: Tue Oct 09, 2018 8:22 pm
by admin
Good points, guys, thanks.

I have found a simple script that runs perfect in Avisynth+ but runs at half speed and then stops completely in Vapoursynth native (no CUDASynth for both). I want to check a few things first and then I'll give you the script to see if you can replicate it. Then we'll have to try to figure out what is going wrong.

Re: CUDASynth

Posted: Wed Oct 10, 2018 4:32 pm
by admin
I found the cause of the Vapoursynth slowdown and stoppage. DGHDRtoSDR was missing a freeFrame(src) call (affecting only the Vapoursynth code) and so memory was being exhausted. I'll release a fix later today and then get back to proper benchmarking.

Re: CUDASynth

Posted: Thu Oct 11, 2018 7:23 pm
by Guest
Good to hear you are making headway

Re: CUDASynth

Posted: Thu Oct 11, 2018 7:50 pm
by admin
Yup. I also got things going with my test script in avscompat mode. I had an earlier version of Vapoursynth and when I upgraded to R44 everything started working.

Re: CUDASynth

Posted: Fri Oct 12, 2018 11:22 am
by admin
Following are performance results with a simple script with just DGSource() followed by DGHDRtoSDR() for 3840x2160. I won't give the exact scripts right now as I need to give you a revised DGHDRtoSDR.dll and a revised AvsCompat.dll to enable you to duplicate my results. I'll give you those things in a while. Benchmarked with AVSMeter and VSEdit.

The change made to AvsCompat.dll for the results below was to add PREFETCHR1(DGHDRtoSDR). DGHDRtoSDR() is not temporal but the prefetching helps Vapoursynth to parallelize things.

Native Avisynth+: 80.4 fps / 14% CPU
Native Avisynth+ with pipeline: 181.7 / 8% CPU

Native Vapoursynth: 79.8 fps
AvsCompat Vapoursynth: 80.2 fps
AvsCompat Vapoursynth with pipeline: 181.7 fps

These results support my proposed plan to not make Vapoursynth native versions but rather to ship an optimized AvsCompat.dll instead. I'm also thinking of revising AvsCompat.dll to be able to read from a file of prefetch values, so users can tweak things. Or, maybe better, add a prefetch parameter to the filter itself for use by AvsCompat.dll. Always thinking outside the box. :twisted:

Re: CUDASynth

Posted: Fri Oct 12, 2018 4:03 pm
by Guest
Or, maybe better, add a prefetch parameter to the filter itself for use by AvsCompat.dll.
This sounds like a great idea.
Allows to tweak the performance by filter instead of entire script

Re: CUDASynth

Posted: Sat Oct 13, 2018 9:15 pm
by hydra3333
Very nice, yes.
I wonder, the vs author may accept a patch :) https://github.com/vapoursynth/vapoursynth

Re: CUDASynth

Posted: Wed Oct 17, 2018 4:43 pm
by admin
Just thought to let you guys know I managed to place an order for a 2080 Ti Founders Edition with the nVidia store. It's estimated to ship between 10/19/2018 and 10/26/2018. It's financed from donations so thank you to my users! :salute: You know I will use it to make DG tools greater than ever before for all of us.

https://www.nowinstock.net/computers/vi ... rtx2080ti/

Meanwhile, on the CUDASynth front, I have discovered some very interesting things focused around what Prefetch() does in Avisynth+, and what the PREFETCH macro does in Vapoursynth, and how they interact with CUDASynth. It opens a possible avenue for further performance gains. I'll write a post about it when I get an energy burst. Right now I am working on DGIndex MKV support. I have decoded and displayed a frame from an MKV but have loads of things to do to complete MKV support. Fortunately, most of it can be pulled from DGDecNV.

@hydra3333

A patch would likely not be accepted as similar ideas have been rejected. No problem; it's easy to replace AvisynthCompat.dll.

Re: CUDASynth

Posted: Thu Oct 18, 2018 8:34 pm
by admin
My 2080 Ti shipped today and will arrive Saturday. :D

Re: CUDASynth

Posted: Fri Oct 19, 2018 9:30 pm
by hydra3333
My goodness, to afford that you won the lottery ? :D
Nice.

Re: CUDASynth

Posted: Fri Oct 19, 2018 9:35 pm
by admin
Financed by my users. Thank you!

Re: CUDASynth

Posted: Sat Oct 20, 2018 5:21 pm
by Guest
admin wrote:
Thu Oct 18, 2018 8:34 pm
My 2080 Ti shipped today and will arrive Saturday. :D
Did it arrive yet?

Re: CUDASynth

Posted: Sat Oct 20, 2018 7:30 pm
by admin
I stepped out for an unavoidable coaching session, and 7 minutes after I drove away the FedEx guy arrived. Murphy's Law. They retry tomorrow and I'll be home all day. I am excited about the tensor cores.