VRK - a virtual reality enabled kneeboard with touch and ink support and it works flawlessly with Aerofly FS2

Chiefkoch · April 4, 2020 at 1:09 PM

Hi guys,

I found a super cool tool, which is called VRK (stands for Virtual kneeboard) and I wanted to share the information with you.

With this program you can use your own PDF's or JPEG'S for Checklists or Navigational Charts or you combine it with a pen tablet (like I did) and you can make notes directly on the virtual kneeboard during flight in VR.

The software ist free (but you can give the author a little donation for it and I would suggest it, because it is really worth it). I tested VRK in combination with my HP Reverb and Aerofly FS2 and it works like charm on my system (no noticable impact on performance or any instabilities). I can highly recommend it.

The download is available from this website:

https://www.amvi.it/download429-vr-kneeboard.html

For further information it put the following description/explanation from a thread at the DCS-Forum where I found it:

https://forums.eagle.ru/showthread.php?t=246970

Quote

What is VRK?
Given the latest improvements of VR hardware, the most limiting factor for VR flight simulation in VR is the inability to access the documents and taking notes.
So, the name says it all: VRK or VR Kneeboard is a kneeboard application for flight simulators. It designed to be used in the VR environment where accessing paper and taking notes is annoying to impossible.
How does it work?
The application generates an overlay in the VR world that can be placed and sized at will. When focused (looked at) the kneeboard can change its transparency and size to increase readability.
The kneeboard is divided in tabs that can be created at will. Each tab can contain either:
An imported PDF (useful for charts, frequency tables, briefings, etc.).

An empty Notes tab, single or multiple pages per tab is supported.

PDF and Notes can be used with a pen (digitizer or pen tablet) to take notes either on existing documents or on the bank sheet.
Scrolling and zooming are controlled by gestures or physical tablet buttons.
Starting from 1.3 client/server mode has been remove from the application. Users that need to use client/server should stay with 1.2 that will be supported with the current 1.2 feature set.
Supported tablets are:
Wacom (all Intuos line is expected to work in WinTab mode)
Huion (using the custom driver, see Appendix A of the Quick start guide provided with the installer)
Reported working models:
Wacom: Intuos S, Intuos M (both BT and USB version)
Huion: HS64, H640P, H950P
XP-Pen devices are not working with VRK.
What else?
Here are some plans for this tool for the future:
Use the tool during my squadron activities [Blocked Image: https://forums.eagle.ru/images/smilies/pilotfly.gif]

Fix bugs!

Kneeboard graphics (borders)

OpenGL support for OculusVR (experimental)

Supported platforms
The tool is compatible with both OpenVR(a.k.a. SteamVR) and OculusVR. Beacuse OpenVR is the only platform supporting external program overlays "out of the box", OculusVR requires some configuration black magic.
VRK tries to simplify the process to the maximum extent, but some user patience is required to survive the initial impact.
Most non Oculus HMDs are expected to work in SteamVR mode. Pimax 5k, HTC Vive, Valve Index have been tested by users. All the other models of their families are expected to work as well.

Display More

I hope you have fun with it and stay healthy,

All the best,

Thomas

pmb · April 4, 2020 at 1:26 PM

Thanks for the headup.

Can this be used to import a Moving Map Program like FSWidgets' GMapHD into the cockpit?

Thanks and kind regards, Michael

Spit40 · April 4, 2020 at 1:33 PM

I am going to try this right now. I’ve been waiting for this for so long!

Spit40 · April 4, 2020 at 4:08 PM

Yep, it works. Not too fiddly to set up. I even had an old wacom pen tablet lying around. I haven’t worked out yet whether I can load in a notepad TXT file which would be quite handy.

edit: No option yet on the TXT file import. I am very tempted to get a Bluetooth pen tablet now to strap to my knee,. Found this useful video.

External Content youtu.be

Content embedded from external sources will not be displayed without your consent.

Through the activation of external content, you agree that personal data may be transferred to third party platforms. We have provided more information on this in our privacy policy.

Spit40 · April 4, 2020 at 9:29 PM

OK, I've spent a bit of time with this app and it really does provide what we need in VR. Using the buttons at the top can be a bit confusing at first. What I find works best is to make a folder on your desktop where you'll store everything you need for a flight. You might have the following:

Approach plate/airport chart for destination airport
A txt file holding any notes you have made printed to PDF
Some screengrabs from skyvector saved as JPGs

Then in VRK hit this button and all the files will be loaded as pages into a tab and you can step back and forth through the pages of this tab. I think with this method you just get page 1 of the PDF, but for multiple page PDFs use a 2nd tab loaded in with the PDF icon. I now plan to buy a Wacom Intuos S (bluetooth) so I can use finger gestures to zoom in on the charts while in flight. Edit: Intuos S does not support ‘multi-touch’ needed for two finger zoom/pan but you can do the same with the pen.

slipstream · April 5, 2020 at 5:32 AM

Can you insert a moving map into this? I could really do with one in VR.

Spit40 · April 5, 2020 at 10:15 AM

Its all static. You’d need ovrdrop or something similar. The problem I find with those apps is a clash between control inputs. The mouse being confused about interacting with FS2 or the app. Here the tablet talks directly to the app bypassing mouse interaction. The developer is very active there and I could see it being extended to add more functionality.

Maybe @Jet-Pack pack could get involved here. Jan, you have been saying for about two years that PDF rendering is a problem. This guy has cracked it and maybe he would work with/for iPACS to integrate his technology fully into the sim and add more features.

Chiefkoch · April 5, 2020 at 10:50 AM

Michael and Slipstream

I can second that, what Phil says. I use DailyOVR for example, but it is extremly fiddeling to setup and use. With this app I mirror my foreflight-app on the ipad into aerofly.

Especially the interaction in VR is a problem.

Spit40 · April 5, 2020 at 11:59 AM

Quote from slipstream

Can you insert a moving map into this? I could really do with one in VR.

i’ve just been on Discord with the developer. He said:

Quote

Ah well FYI mirroring an app is something is something that is the TODO, I just have to be sure that I can emulate the mouse with the pen passing through VRK

slipstream · April 6, 2020 at 3:13 AM

Thanks but have no idea what that’s means. I take it is NO?

Spit40 · April 6, 2020 at 9:06 AM

Essentially yes. The clever trick behind this guy’s approach is to use a pen tablet as the interface for the kneeboard. This avoids the conflict of a mouse getting confused with whether it is interacting with the sim or the kneeboard app. So, he is saying that he needs to make the kneeboard pen drive the app - moving map, 3rd party, whatever.

paranovski · April 8, 2020 at 4:24 PM

Hallo,

Ich habe mir soeben auch ein Wacom Intuos S gekauft!

Und als kleine Ergänzung noch: https://www.amazon.de/dp/B07VY2HKFZ/…1_t1_B07RY144FX

jpx · April 9, 2020 at 4:58 PM

Hi everybody,

Excellent, I will buy one asap.

Does the "Wacom One Small" version work too with VRK ? It seems there is same surface for the pen for a smaller total size.

Are the left buttons on the intuos S version mandatory for VRK ?

Thanks in advance,

Cheers,

JPX

Spit40 · April 9, 2020 at 5:12 PM

You'll want the buttons - I've dug out a very old wacom (which does work - needs the driver installed) and not having the buttons is a pain for stepping through different pages. I'm now loading in airport charts, snips from skyvector, screengrabs from google maps.... You can click some nav buttons with the pen but I'd rather not use(drop) the pen unless I need to draw

jpx · April 9, 2020 at 5:44 PM

So it should work too with the one small.

Thanks for your interesting advice Phil I do'nt know if I will keep the pen in my hand or not right now specially if I invest too in the leapmotion (supported by aerofly? )...

Does the bluetooth work so well than is usb mode ?

Cheers

Spit40 · April 9, 2020 at 6:01 PM

Quote from jpx

So it should work too with the one small.
Thanks for your interesting advice Phil I do'nt know if I will keep the pen in my hand or not right now specially if I invest too in the leapmotion...
Does the bluetooth work so well than is usb mode ?
Cheers

Even if you don't write notes on the tablet with a pen you'll probably need the pen to control zoom & pan.

USBvBT: I'm waiting for my Intuos S, so my only experience is with the USB tablet. Hey let me know how you get on with leapmotion - I'd really like to get controller-less hand interaction working.

For those who don't have or want to get a pen tablet, you don't actually need one. You can still see the kneeboard but your options for interacting with it are reduced. You can still page through the content by mapping joystick buttons to page up/down but for the authentic and tactile feel of interacting with a kneeboard I think its a great solution and having the buttons on the kneepad itself makes a lot of sense. The one thing I really wish it had was multi-touch for zoom and pan the way and ipad/android tablet does with your fingers. The developer initially started with that in mind but it became too technically complex and he reverted to using the pen tablet as a more basic input controller, like a type of mouse really.

jpx · April 9, 2020 at 6:45 PM

Not sure that Aerofly support knuckles skeletal tracking yet. It seems to be mandatory for leapmotion integration ?!

But perhaps this leapmotion controler emulator can do the job like with DCS : https://forums.eagle.ru/showthread.php?t=250038

jpx · April 9, 2020 at 7:34 PM

Quote from Spit40

Even if you don't write notes on the tablet with a pen you'll probably need the pen to control zoom & pan.
USBvBT: I'm waiting for my Intuos S, so my only experience is with the USB tablet. Hey let me know how you get on with leapmotion - I'd really like to get controller-less hand interaction working.
For those who don't have or want to get a pen tablet, you don't actually need one. You can still see the kneeboard but your options for interacting with it are reduced. You can still page through the content by mapping joystick buttons to page up/down but for the authentic and tactile feel of interacting with a kneeboard I think its a great solution and having the buttons on the kneepad itself makes a lot of sense. The one thing I really wish it had was multi-touch for zoom and pan the way and ipad/android tablet does with your fingers. The developer initially started with that in mind but it became too technically complex and he reverted to using the pen tablet as a more basic input controller, like a type of mouse really.

Phil,

I just read that the "wacom one" version doesn't have the multi touch, but it seems not be used by VRK right know. so ...

Spit40 · April 9, 2020 at 8:08 PM

I have discussed this at length with the developer. The only wacom these days that has multitouch is that Intuos M. It is expensive though and the developer hasn’t tested it

Spit40 · April 9, 2020 at 8:11 PM

Quote from jpx

Not sure that Aerofly support knuckles skeletal tracking yet. It seems to be mandatory for leapmotion integration ?!
But perhaps this leapmotion controler emulator can do the job like with DCS : https://forums.eagle.ru/showthread.php?t=250038

you have seen that the VRK download includes a leap motion integration i presume?