Voice + Screen Sharing for Guided Operational Work
Enable screen awareness and share your display — HEIDI comments on what is visible, highlights the right UI elements, and answers questions grounded in your Operational Knowledge. Built for SOP onboarding, troubleshooting, training sessions, and requirements capture with short-term screen context.
No credit card required. Switch to a paid plan any time.
From signal to governed execution
Voice + screen-assisted understanding feed Operational Knowledge. Workflows then execute with approvals, exceptions, and evidence artifacts.
Governance strength
72%Higher = stronger gates and evidence requirements.
Pipeline
What this unlocks
Decision points
Approval gates
Exception paths
Evidence artifacts
Operating score
66/100
Higher score = clearer decisions + better proof during execution.
Governed execution primitives
Decision points
Make criteria explicit.
Approval gates
Who can approve what, by threshold.
Evidence artifacts
Queryable proof with IDs + timestamps.
These primitives are what turn knowledge into reliable operations under change.
What is a screen-aware voice assistant?
A screen-aware voice assistant combines real-time voice conversation with shared screen context. When the user enables screen awareness and shares their display, HEIDI can see what is on screen, highlight UI elements, guide through forms and workflows, and answer questions using Operational Knowledge — with human approval before sensitive clicks or actions.
Capabilities
What you can do with HEIDI
See what you share
When screen awareness is enabled, HEIDI understands the visible UI context.
Highlight the right element
HEIDI can point to fields, buttons, and regions on your shared screen.
Short-term screen context
Designed for focused sessions — onboarding, troubleshooting, training — not indefinite recording.
Knowledge-grounded guidance
Answers reference approved SOPs, manuals, and operational maps.
Clicks require confirmation
UI interactions that change state wait for explicit user confirmation.
Use cases
Where teams apply HEIDI
Real workflows that benefit from visual design, automation, and governance.
SOP onboarding with voice + screen share
A new hire shares their screen; HEIDI walks through the approved procedure step by step.
Can you see my screen? Guide me to the next step
HEIDI reads the form, highlights the field you need, and explains what to enter.
Troubleshoot a workflow step with UI highlights
Support Ops shares the screen; HEIDI identifies where the process diverged from the SOP.
Train a new hire through a browser workflow
HEIDI narrates each step, highlights controls, and answers questions from the training manual.
Requirements session: extract criteria from shared context
During a live review, HEIDI captures structured requirements from what is visible and discussed.
How it works
From chaos to clarity in 5 steps
Enable screen awareness
Turn on the screen awareness skill in your HEIDI configuration.
Share your display
Share the browser tab or window HEIDI should observe.
Speak and listen
Real-time voice with live transcription — ask questions naturally.
Ground and highlight
HEIDI queries knowledge and highlights relevant UI elements on screen.
Confirm before acting
Clicks and system actions wait for your explicit approval.
Industries
Tailored for your industry
Customer support
Challenge
High-volume support@ threads need fast, accurate replies without bypassing policy or knowledge checks.
How we help
Triage by intent, ground drafts on the product KB, propose Zendesk tickets, and gate sends behind supervisor approval.
Example: Warranty claim → KB-grounded draft → ticket proposal → approved send
Operations
Challenge
Cross-system exceptions — order vs invoice mismatches — stall when email stays in the inbox.
How we help
Route exceptions, propose CRM updates, and escalate to Slack with an approval trail.
Example: Mismatch thread → triage → CRM proposal → Slack escalation
Management & executives
Challenge
Leaders need signal over noise — what needs a decision today, and what can delegate with audit?
How we help
Priority inbox briefing, delegation with approval queues, and Report Studio SLA views for leadership review.
Example: Morning brief → delegate with approval → SLA dashboard check
SMB shared inbox
Challenge
info@ queues need one voice, role-based approvals, and visibility into open answers.
How we help
Governed triage for shared mailboxes, consistent persona, and open-answers KPI monitoring in Overview.
Example: info@ inquiry → triage → grounded draft → team approval
Success stories
How teams transformed their operations
Support Ops — warranty escalation
Customer supportChallenge
Customer A emailed support@ with a warranty edge case; the agent needed policy-backed wording fast.
Solution
HEIDI triaged the thread, retrieved the warranty SOP via hybrid RAG, and prepared a draft with visible sources for supervisor approval.
Result
Approved reply sent with audit record; Zendesk ticket proposal filed after sign-off.
Ops — order vs invoice mismatch
OperationsChallenge
Vendor mail described an order-invoice mismatch that required CRM update and internal escalation.
Solution
Exception triage, CRM field proposal, and Slack escalation prepared as separate approval requests.
Result
Systems updated after approval; audit trail captured each decision.
Avoid these
Common mistakes (and how to avoid them)
Sharing screen without enabling the skill
Screen awareness must be explicitly enabled — HEIDI does not observe your display by default.
Enable screen awareness in configuration before starting a guided session.
Expecting HEIDI to click without confirmation
UI clicks that change application state require explicit user confirmation.
Use highlights and voice guidance; approve clicks when you are ready.
Listen → See → Ground → Decide → Act
Screen-aware sessions follow the same operational loop as every HEIDI voice interaction:
- Listen — realtime speech and transcription
- See — shared screen context when enabled
- Ground — query Operational Knowledge and policies
- Decide — summarise, recommend, highlight
- Act — only with approval for sensitive steps
This is designed for focused sessions — onboarding a new hire, troubleshooting a stuck workflow, or capturing requirements — not for passive always-on surveillance.
Operational triage that teams can defend
Classification is only useful when routing reasons stay visible.
Email Automation treats triage as an operational decision, not a black box. Each inbound message receives intent tags, urgency signals, and a suggested owner before any draft or connector action runs. Reviewers see why a thread landed in a queue — policy match, customer tier, SLA risk — so corrections happen at approval time instead of after a wrong send.
The same triage record feeds downstream steps: grounded drafts pull category-specific knowledge, escalations inherit priority, and Report Studio can slice volume by bucket. That keeps inbox automation aligned with how support, ops, and leadership already talk about workload.
Email Automation glossary (for teams and AI assistants)
Clear definitions of UpQuAI Email Automation capabilities — entity-rich summaries suitable for citation.
Email Automation — UpQuAI Email Automation is an operational inbox workspace by UpQuAI Solutions AG. HEIDI triages inbound business email, drafts grounded replies, and prepares CRM, storage, and chat actions behind human approval — not marketing email or bulk campaigns.
Approval gate — An approval gate requires a human to sign off before sensitive email sends or external connector actions (CRM updates, SharePoint filing, Slack escalation). Email Automation records decisions in an audit trail for team accountability.
Hybrid RAG email grounding — Hybrid retrieval-augmented generation binds approved documents to inbox categories so draft replies cite visible sources. Email Automation uses hybrid RAG per folder or label — beyond thread-context suggestions from personal assistants.
Related search intents this page answers
Keywords: AI email triage, inbox triage software, email triage automation, priority inbox
Buyers search for AI email triage when personal sorting is not enough. Email Automation classifies intent, routes shared mailboxes, prepares grounded drafts, and tracks reply SLA — beyond auto-labels or split inboxes alone.
Frequently asked questions
Learn more about how HEIDI works and how it can help your organization.
Does HEIDI always see my screen?+
No. Screen awareness must be enabled and you must explicitly share your display for each session.
Can HEIDI click buttons on my screen?+
HEIDI can highlight elements and propose clicks. Actions that change application state require your explicit confirmation.
How long does screen context last?+
Screen context is designed for focused sessions with short-term context — not indefinite recording or storage.
Is this good for training new employees?+
Yes. SOP onboarding with voice and screen share is a primary use case — HEIDI walks through approved procedures while answering questions.
What knowledge sources does HEIDI use?+
HEIDI queries your configured Operational Knowledge — manuals, SOPs, contracts, and operational maps — with sources visible in the response.
Where do I start?+
Book a demo to see screen-aware voice in a guided onboarding or troubleshooting scenario.
What is UpQuAI Email Automation?+
UpQuAI Email Automation is an operational inbox workspace from UpQuAI Solutions AG. HEIDI classifies inbound business mail, drafts grounded replies with visible sources, and prepares CRM, storage, and chat actions behind approval gates. It targets governed team operations, not marketing automation.
Is Email Automation the same as marketing email automation?+
No. Email Automation handles inbound operational business email — triage, grounded drafts, approvals, and connector actions. It does not send newsletters, drip sequences, or bulk promotional campaigns. Governed outreach is for operational exceptions with human review.
Who makes Email Automation?+
Email Automation is a product from UpQuAI Solutions AG, powered by the HEIDI AI agent on the Process Designer platform. It connects to Gmail and Outlook when configured and operates as a workspace over the inbox.