GRADUATION PROJECT

| 2024 · TU/e × ACCENTURE INDUSTRY X

AI Repair Assistant

AI-Guided Troubleshooting

Guiding novice users from ambiguous symptoms to grounded diagnosis and step-by-step physical repair.

20

study participants

Completed a diagnosis-to-repair scenario.

87/100

System Usability Scale

Grade A usability.

20/20

scenario completion

All participants completed the guided repair task.

01

Overview

Designing a grounded AI workflow for complex product repair

AI Repair Assistant explored how conversational AI could support novice users through complex product troubleshooting without relying on plausible-sounding but unverified answers.

Using a VanMoof S3 boost-button failure as the repair scenario, I designed an end-to-end workflow connecting incident reporting, grounded diagnosis, interactive troubleshooting, and step-by-step physical repair guidance.

Rather than treating AI as an open-ended support chatbot, the concept positioned it as a structured repair companion—helping users understand what was happening, why a diagnosis was being proposed, and what action to take next.

This project resulted in one first-authored publication: IASDR 2025

Project introduction video.

Role

Product Designer & Researcher

Project / Industry Collaboration

TU/e graduation project in collaboration with Accenture Industry X and VanBerlo

Scope

Product discovery, UX research, Human–AI interaction strategy, conversational UX, interaction design, physical–digital prototyping, usability validation

Tools & Technology

Figma, Voiceflow, HTML/CSS/JavaScript, LLM / retrieval-augmented prototyping, Raspberry Pi / Arduino

Project Status

Validated graduation prototype · subsequently showcased and published

02

Product Problem

Why repair needed a different kind of AI

The challenge was not simply a lack of information. Complex repair combined proprietary product logic, overlapping symptoms, and fragmented support resources. Traditional troubleshooting trees were often too rigid, while generic AI chat risked sounding helpful without being reliable enough for hands-on repair.

Research therefore focused on where novice users lost confidence, how repair knowledge was distributed, and which repair scenario could meaningfully test a guided AI workflow.

Research Evidence

Survey findings and expert input helped identify the boost-button failure as a suitable scenario for testing diagnosis, troubleshooting, and physical repair within one workflow.

03

Product Strategy

From open-ended chat to a grounded repair workflow

A conventional chatbot could answer repair questions, but repair could not depend on plausible guesses. The product challenge was therefore to turn conversational AI into a guided troubleshooting workflow that reduced uncertainty, preserved context, and helped users act safely step by step.

Three product principles

04

Design Evolution

From conversational assistant to a contextual repair workspace

Early concepts explored different ways of combining physical product context with conversational support. Across the iterations, the same issue emerged: users needed one coherent workspace that could preserve progress, surface relevant evidence, and support dialogue without forcing them to mentally reconstruct the repair state.

This shifted the design away from a generic chat interface toward a contextual repair hub.

Iteration 01 — Spatial Mapping

Centered the product itself as the navigation surface. It improved physical orientation but provided weak support for open-ended troubleshooting.

Iteration 02 — Split View

Introduced persistent progress tracking and conversational assistance, but still separated guidance across competing visual surfaces.

Final Direction — Contextual Hub

Combined progress tracking, contextual evidence, and AI dialogue within one workspace so users could understand both where they were and what to do next.

Design decision: Keep progress, evidence, and conversation visible within one continuous repair context.

05

Guided Repair Journey

A four-stage journey from incident to repair

The final experience transformed the assistant from a question-answer interface into a guided repair workflow. Each stage reduced uncertainty while preserving enough context for users to understand what the system was doing and why.

Incident Reporting

01

Users describe what happened in natural language without needing technical terminology. The assistant helps translate an ambiguous incident into a structured repair problem.

Root-Cause Diagnosis

02

The assistant summarises the issue, manages expectations, and presents likely causes grounded in verified repair knowledge.

Interactive Troubleshooting

03

Targeted checks help users systematically eliminate possible causes instead of jumping between unrelated possibilities.

Guided Solution

04

Once the root cause is confirmed, the assistant provides multimedia, step-by-step guidance for physical execution.

Interaction model: Report → diagnose → verify → repair.

06

Physical Validation

Validating a human–AI–physical repair loop

To test whether the assistant could support not only diagnosis but real repair behaviour, I built a functional prototype that connected conversational guidance to a physical boost-button replacement task.

Twenty participants completed a scenario spanning issue diagnosis, troubleshooting, and hands-on repair, allowing the concept to be evaluated as a complete human–AI–physical interaction rather than a screen-only interface.

Validation Setup

Outcomes

The evaluation indicated that participants could move through a technically complex repair scenario while maintaining high usability and manageable perceived workload.

07

Recognition & Reach

From validated prototype to wider industry and research discussion

The project continued beyond the graduation study as a demonstrator of how grounded conversational AI could support complex service and repair contexts.

Its later presentation across academic and industry settings extended the work from a single prototype into a broader discussion around trustworthy AI, repair, and human-centred service design.

08

Reflection & Implications

Designing AI for trust, uncertainty, and physical action

The project reinforced that AI assistance becomes most valuable in complex tasks when it helps users understand uncertainty and move forward—not when it simply produces more confident answers.

Designing for repair therefore required treating grounding, transparency, progression, and physical action as parts of the interaction model rather than backend technical concerns.

01 — Trust over Intelligence

In high-stakes repair, understandable and grounded guidance mattered more than apparently “smart” responses. Confidence depended on the system exposing enough reasoning and evidence to make recommendations credible.

02 — Design Explicitly for Uncertainty

Repair assistants need safe interaction states for moments when evidence is incomplete or confidence is low. Future versions should escalate uncertainty rather than disguise it.

03 — Connect AI Guidance to Real-World Action

The project showed how conversational AI can extend beyond information delivery into structured support for physical tasks, where progress, evidence, and action need to remain connected.

Industry Perspective

“David (Poyang) was instrumental in defining how interfaces for LLM repair agents should look. His insights and creativity in this area are highly valued.”

— Elco Wiechert, Accenture Industry X

LET'S BUILD WHAT'S NEXT

2026 © Poyang Huang All Rights Reserved.