NRGlassesControlStart fails with NR_RESULT_GLASSES_DISCONNECTED

I am developing native app and directly calling nr_api’s C apis and NRGlassesControlStart is failing with NR_RESULT_GLASSES_DISCONNECTED code. Glasses are connected to the device. All calls prior to this have succeeded. I have access to your native sample and I have copied all the permissions and settings from AndroidManifest. I am sure I am missing something, but cannot figure out what.

So far, this is the sequence of calls I have made:

NRSDKInitSetAndroidActivity
NRGlassesControlCreate
NRGlassesControlSetGlassesWearingCallback
NRGlassesControlSetNotifyQuitAppCallback
NRGlassesControlStart

thanks