Skip to main content
Bird’s live agent mode is voice-driven, but what you can ask for depends on the device’s capabilities. A phone has a touchscreen, the Meta Ray-Bans have no screen at all, and the VITURE Luma Ultra glasses put a heads-up display and your hands into the mix. This page is the quick reference for which commands work where. You don’t need to memorise exact phrases — Bird understands intent, so paraphrases of the examples below work too. The phrases are just reliable starting points.

​
At a glance

What you want to doMobile / DesktopMeta Ray-BanVITURE Luma Ultra
Run a protocol & step through it by voice✓✓✓
Ask questions, talk through your work✓✓✓
Start / stop recording a clip✓—✓
Take a snapshot / create a note✓✓ (spoken confirmation)✓
Show an image or reference video on screen✓ (overlay)— (no screen)✓ (in-world panel)
Jump a reference video to a step✓—✓
Reposition / resize the on-screen display——✓
Put the display to sleep / quit hands-free——✓
The differences are about capability, not preference — the Ray-Bans have no screen, so “show me the gel photo” has nowhere to appear. Commands that need a display only exist on devices that have one.
Jumping to a specific step is confirmed first. On any device, when you ask to jump to a named or numbered step — “skip to step 3”, “go to the vortex step” — Bird reads the step’s title back (“Jump to ‘Vortex the sample’ — that right?”) and waits for a “yes” before moving. Marking a step done, skipping, and going back stay instant. See execution mode for details.

​
Commands by device

The richest surface: a heads-up protocol card, an in-world image/video panel, hand gestures, and voice. Everything below is hands-free.Run and step through a protocol
  • “Run the DNA extraction protocol” / “Start the execution”
  • “Next step” · “Mark this done” · “Go back” · “Repeat that”
  • “Skip to step 3” · “Show me the vortex step”
Show a reference video or image
  • “Show me the video for this protocol” — plays the bound step-video in the panel
  • “Show me the gel photo” (or any saved image)
  • “Skip to step 2” — seeks the video to that step’s chapter
Control the media panel (once it’s showing)
  • Pause / resume: “Pause the video” · “Keep playing”
  • “Restart this step’s video”
  • Close it: “Close the video” · “Stop the video” · “That’s enough” · “Get rid of it”
  • Or reach out and hold your fingertip on the × button in the corner of the panel
  • Or pinch with both hands and move them together / apart to resize it
Move the heads-up card
  • “Pin it here” (leave it fixed in space) · “Follow me” (re-dock to your view)
  • “Move it up” · “Bring it closer” · “Move it left/right/down/farther”
  • Or pinch with both hands to resize the card
Sleep, record, and quit
  • “Go to standby” / “Wake up” (or tap the standby pill to wake)
  • “Start recording” / “Stop recording”
  • “Quit Bower” — the glasses ask you to confirm on-screen before exiting
If a command that controls the display (“close the video”, “pin it here”) ever isn’t understood, make sure you said the display word — e.g. “close the video” rather than just “stop”. Bird needs to know you mean the on-screen panel, not the recording or the protocol.