Back to portfolio

HCI · Accessibility · Co-design · Semiotics

A shared visual language for mixed-ability co-creation.

Semio is a research prototype exploring how AI-mediated visual symbols could help people with intellectual and communication disabilities express intentions and co-create with non-disabled partners — a system to be shaped through participatory design with the communities it aims to serve. AI acts as an interpreter that bridges understanding, not a voice that speaks for anyone.

How the demo works
1

Compose with symbols

Drag shapes, colours, objects and emotions onto a shared canvas.

2

Read the interpretation

The system proposes a possible meaning, plus alternative readings.

3

Confirm or correct

Tap one of the suggested readings to confirm or refine the interpretation.

An early demonstration prototype for a research project. The readings shown are pre-scripted demo text for illustration only — they carry no real semantic analysis, and everything runs in your browser with no model, no server and no data collected. Best viewed on desktop.