Adding/Using other camera inputs for XREAL Air 2 Ultra Development

Development & Help
, , ,
1

I want to develop a platform that uses a camera’s RGB input to segment and analyze elements of a user’s FOV to interact with a conversational assistant.

I understand the Air 2 Ultra glasses are black and white and have limited camera access. Has anyone successfully used other camera inputs in a development application that sends data to the Air 2 Ultra?

My plan is to mount a small camera on the glasses, link it to a computer, and then connect the computer to the glasses. This way, the computer acts as a medium for information.

Where should I start with this, using XREAL dev tools or Unity?

Thanks

2

the xReal SDK is essentially a plugin to Unity. So if I were trying to do this, I’d interface with the external camera via Unity and then try to figure out how to sync those images with some event going on with the glasses, perhaps using a controller trigger or a hand tracking gesture.

1 Like