Does hand tracking support fingertip rigidbody collision detect?

Development & Help
1

I want to use fingertip from hand tracking, for pressing in-game buttons, instead of raycast from smartphone controller.
But I don’t know how to make since I have little experience with NRSDK.
Which script does include code about the topic I’m interested?(specifically fingertip rigid body)

Also, I used this code for detecting collision with ray and it works with smartphone control, but it doesn’t work when I convert to the hand tracking mode.
Are they using different ray?

if (Physics.Raycast(new Ray(laserAnchor.transform.position, laserAnchor.transform.forward), out hitResult, layerMask))
        {
            if (hitResult.collider.gameObject != null && hitResult.collider.gameObject.GetComponent<Renderer>() != null)
            {
2

Everything you need is in the hand tracking section:
https://nrealsdkdoc.readthedocs.io/en/v1.7.0/Docs/Unity_EN/Develop/Hand%20Tracking.html

Unfortunately you only get the Pose (contains position and rotation) of the individual joints, including the finger tips. You’ll have to get the Pose and use the values to check for collision.

As for the laser raycast, the controller laser and hand laser are 2 separate objects in unity. Make sure you’re using the correct one :+1:

2 Likes
3

Hi，please just check the link what Fareplay sent. And there is an script you can take for reference, the HandTrackingExample.cs

1 Like