Voice Assistant
The Voice Assistant enables hands-free survey completion through natural conversation with an AI. Speak your data, and the AI extracts and validates values automatically - no typing required.
When to Use Voice Mode
Voice mode is ideal when:
- Your hands are occupied (tools, equipment, climbing)
- You're wearing gloves
- Typing is impractical (tight spaces, outdoor conditions)
- You need to move quickly through a survey
Starting a Voice Survey
- Open a survey session
- Tap the microphone button to enter voice mode
- The AI will greet you and ask for the first field
- Speak your response naturally
- Continue until all fields are complete
The Voice Interface
Recording Button
- Tap to start recording - button turns red
- Speak your response - your words appear as a transcript
- Stop speaking - the system automatically detects when you finish
- An audio beep confirms your speech was captured
Chat Display
- Your speech appears in the transcript area
- AI responses are displayed and spoken aloud
- The conversation history scrolls as you progress
Progress Sidebar
- Shows completion percentage
- Lists all fields with their status
- Tap a field to jump directly to it
Speaking Naturally
You don't need to use rigid commands. The AI understands natural language:
| What You Say | What Gets Captured |
|---|---|
| "The serial number is ABC dash 123" | Serial Number: ABC-123 |
| "Temperature is 75 degrees Fahrenheit" | Temperature: 75 °F |
| "It's in good condition" | Condition: Good |
| "Skip this one" | Field skipped |
Multi-Field Input
Provide multiple values in one utterance:
"The width is 1200 millimeters and the height is 800 millimeters"
The AI will capture both the width and height fields.
Voice Shortcuts
For fields with long option names, use common abbreviations:
- "Arc weld" instead of "Electric Fusion (Arc) Weld / Spiral Weld (0.8)"
- "ERW" instead of "Electric Resistance Weld (1.0)"
- "Yes" or "No" for boolean fields
The AI matches your shorthand to the correct formal option.
Reference Images
When relevant, the AI can display reference images to help you:
- Equipment nameplates showing where to find serial numbers
- Condition examples (Good, Fair, Poor)
- Installation diagrams
Ask the AI:
"Show me the nameplate"
The AI will display the relevant reference image inline in the chat.
Navigating the Survey
Moving Between Fields
- The AI automatically moves to the next field
- Say "go back" to return to the previous field
- Say "skip" to move on without providing a value
Jumping to Specific Fields
"Go to the equipment type field"
Checking Progress
"What's left to complete?"
The AI will summarize remaining required fields.
Switching to Form Mode
If voice isn't working well in your environment:
- Tap the Form button in the header
- Complete fields using the on-screen form
- Switch back to voice mode anytime
Both modes share the same data - progress is preserved.
Tips for Field Conditions
Noisy Environments
- Speak clearly and slightly louder than normal
- Use a headset if available for better audio input
- Wait for quieter moments to speak
Windy Conditions
- Shield the microphone with your hand or body
- Consider using form mode temporarily
Multiple Values at Once
When recording measurements of similar items:
"Window one is 1200 by 800, window two is 900 by 1400"
Confirmation of Critical Data
For serial numbers and important values, the AI will read back what it captured:
AI: "I captured serial number ABC-123. Is that correct?"
Say "yes" to confirm or "no" to re-enter.
Audio Feedback
The system provides audio cues:
- Beep when your speech is captured
- AI voice reads back responses and asks questions
- Progress summary announced after completing sections
Adjusting Voice Settings
On mobile devices:
- Headset Mode - Enable when using headphones for instant barge-in (interrupt the AI while it's speaking)
- Speaker Mode - Default mode, mic pauses while AI speaks
Tap the headphone icon in the header to toggle headset mode.
Completing the Survey
When all required fields are complete:
- The AI will notify you that the survey is ready to submit
- Say "complete the survey" or tap the Complete button
- Review the summary
- Confirm to mark the session as complete
Common Voice Commands
| Command | Action |
|---|---|
| "Next" / "Continue" | Move to next field |
| "Go back" / "Previous" | Return to previous field |
| "Skip" / "Skip this one" | Skip current field |
| "Go to [field name]" | Jump to specific field |
| "What's left?" | Get summary of remaining fields |
| "Show me the [image caption]" | Display reference image |
| "Complete the survey" | Finish and submit |
Troubleshooting
Voice not being captured:
- Check that the microphone button is active (red)
- Ensure the app has microphone permission
- Move to a quieter location
AI not understanding responses:
- Speak more slowly and clearly
- Use the exact option names or known shortcuts
- Try spelling out difficult words
Feedback loop (hearing yourself):
- Enable Headset Mode if using headphones
- Lower the device volume
- Position the phone away from your face
Survey stuck:
- Tap the progress sidebar to manually select a field
- Switch to form mode to troubleshoot
- Check your internet connection