Modules
Surveys
Voice Assistant

Voice Assistant

The Voice Assistant enables hands-free survey completion through natural conversation with an AI. Speak your data, and the AI extracts and validates values automatically - no typing required.

When to Use Voice Mode

Voice mode is ideal when:

  • Your hands are occupied (tools, equipment, climbing)
  • You're wearing gloves
  • Typing is impractical (tight spaces, outdoor conditions)
  • You need to move quickly through a survey

Starting a Voice Survey

  1. Open a survey session
  2. Tap the microphone button to enter voice mode
  3. The AI will greet you and ask for the first field
  4. Speak your response naturally
  5. Continue until all fields are complete

The Voice Interface

Recording Button

  • Tap to start recording - button turns red
  • Speak your response - your words appear as a transcript
  • Stop speaking - the system automatically detects when you finish
  • An audio beep confirms your speech was captured

Chat Display

  • Your speech appears in the transcript area
  • AI responses are displayed and spoken aloud
  • The conversation history scrolls as you progress

Progress Sidebar

  • Shows completion percentage
  • Lists all fields with their status
  • Tap a field to jump directly to it

Speaking Naturally

You don't need to use rigid commands. The AI understands natural language:

What You SayWhat Gets Captured
"The serial number is ABC dash 123"Serial Number: ABC-123
"Temperature is 75 degrees Fahrenheit"Temperature: 75 °F
"It's in good condition"Condition: Good
"Skip this one"Field skipped

Multi-Field Input

Provide multiple values in one utterance:

"The width is 1200 millimeters and the height is 800 millimeters"

The AI will capture both the width and height fields.

Voice Shortcuts

For fields with long option names, use common abbreviations:

  • "Arc weld" instead of "Electric Fusion (Arc) Weld / Spiral Weld (0.8)"
  • "ERW" instead of "Electric Resistance Weld (1.0)"
  • "Yes" or "No" for boolean fields

The AI matches your shorthand to the correct formal option.

Reference Images

When relevant, the AI can display reference images to help you:

  • Equipment nameplates showing where to find serial numbers
  • Condition examples (Good, Fair, Poor)
  • Installation diagrams

Ask the AI:

"Show me the nameplate"

The AI will display the relevant reference image inline in the chat.

Navigating the Survey

Moving Between Fields

  • The AI automatically moves to the next field
  • Say "go back" to return to the previous field
  • Say "skip" to move on without providing a value

Jumping to Specific Fields

"Go to the equipment type field"

Checking Progress

"What's left to complete?"

The AI will summarize remaining required fields.

Switching to Form Mode

If voice isn't working well in your environment:

  1. Tap the Form button in the header
  2. Complete fields using the on-screen form
  3. Switch back to voice mode anytime

Both modes share the same data - progress is preserved.

Tips for Field Conditions

Noisy Environments

  • Speak clearly and slightly louder than normal
  • Use a headset if available for better audio input
  • Wait for quieter moments to speak

Windy Conditions

  • Shield the microphone with your hand or body
  • Consider using form mode temporarily

Multiple Values at Once

When recording measurements of similar items:

"Window one is 1200 by 800, window two is 900 by 1400"

Confirmation of Critical Data

For serial numbers and important values, the AI will read back what it captured:

AI: "I captured serial number ABC-123. Is that correct?"

Say "yes" to confirm or "no" to re-enter.

Audio Feedback

The system provides audio cues:

  • Beep when your speech is captured
  • AI voice reads back responses and asks questions
  • Progress summary announced after completing sections

Adjusting Voice Settings

On mobile devices:

  • Headset Mode - Enable when using headphones for instant barge-in (interrupt the AI while it's speaking)
  • Speaker Mode - Default mode, mic pauses while AI speaks

Tap the headphone icon in the header to toggle headset mode.

Completing the Survey

When all required fields are complete:

  1. The AI will notify you that the survey is ready to submit
  2. Say "complete the survey" or tap the Complete button
  3. Review the summary
  4. Confirm to mark the session as complete

Common Voice Commands

CommandAction
"Next" / "Continue"Move to next field
"Go back" / "Previous"Return to previous field
"Skip" / "Skip this one"Skip current field
"Go to [field name]"Jump to specific field
"What's left?"Get summary of remaining fields
"Show me the [image caption]"Display reference image
"Complete the survey"Finish and submit

Troubleshooting

Voice not being captured:

  • Check that the microphone button is active (red)
  • Ensure the app has microphone permission
  • Move to a quieter location

AI not understanding responses:

  • Speak more slowly and clearly
  • Use the exact option names or known shortcuts
  • Try spelling out difficult words

Feedback loop (hearing yourself):

  • Enable Headset Mode if using headphones
  • Lower the device volume
  • Position the phone away from your face

Survey stuck:

  • Tap the progress sidebar to manually select a field
  • Switch to form mode to troubleshoot
  • Check your internet connection