← Back to work

Designing a seamless multi-display experience for the next-generation cockpit

Tata Sierra introduced a premium dual-display cockpit where the central infotainment and dedicated passenger display had to behave as one intelligent system — sharing audio, safety constraints, and real-time state while serving two occupants with different priorities.

Product
Tata Motors
Industry
Automotive HMI
Team size
Product, engineering, QA, and brand stakeholders
Timeline
1 year
Tata Sierra HMI

Goal

Create a premium connected cockpit where driver and passenger interact independently while the system intelligently manages shared audio, safety constraints, and display synchronization.

Challenge

Two active users, one audio pipeline, strict safety regulations, and zero tolerance for confusing popups — designing how two displays behave as one intelligent system, not two independent screens.

Outcome

A production-ready dual-display experience with defined audio concurrency rules, Relax Mode, JBL listening modes, FOTA journeys, and comprehensive UX specifications — reducing driver distraction while delivering passenger independence.

3

Connected displays

1 yr

Project duration

E2E

UX ownership

Phase 1 Research & Discovery

Understanding a shared cockpit ecosystem

Before designing screens, I mapped how two displays, one audio pipeline, and multiple vehicle states had to coexist.

The Challenge

Design multi-display audio concurrency inside a shared vehicle ecosystem — two active users, conflicting priorities, one audio pipeline.
Driver prioritizes safety, navigation, and calls
Passenger wants independent entertainment and comfort
Audio ownership must stay predictable when both act at once
Conflicts should resolve automatically — not through popups

Business & User Goals

Business Goals

  • Create a premium connected cockpit experience
  • Differentiate Sierra through passenger-focused features
  • Reduce driver distraction
  • Deliver production-ready UX within a tight timeline
  • Ensure seamless integration with Android-based vehicle software

User Goals

  • Enjoy entertainment independently
  • Control media without asking the driver
  • Experience premium audio features
  • Relax during long journeys
  • Receive clear, predictable system feedback

Design Thinking Process

01

Empathise

Understanding the users

  • Research methodologies
  • Affinity mapping

02

Define

Identifying needs and challenges

  • User persona
  • Customer journey map

03

Ideate

Generating innovative ideas

  • Ideation methodologies

04

Prototype

Building solutions

  • User flow
  • Mid-fi prototypes

05

Test

Validating solutions

  • Task scenarios
  • Analysis and insights
  • Persist or pivot

Research Approach

Discovery methods across the project:
  • · User interviews
  • · Stakeholder workshops
  • · Competitive benchmarking
  • · HMI analysis
  • · Engineering reviews
  • · Requirements review
  • · Design iterations

Competitive Research

Benchmarked how premium brands handle passenger displays, media ownership, audio, wellness, and OTA experiences.
Mercedes EQS

Mercedes EQS

AI personalization, camera-based driver distraction blocking, widget shortcuts

Porsche Taycan

Porsche Taycan

Cockpit mirroring, passenger seatbelt gating, customizable My Screen

Jeep Grand Wagoneer

Jeep Grand Wagoneer

Simplicity-first passenger entertainment and clear ownership

Li Xiang L9

Li Xiang L9

Multi-screen cabin entertainment density and family-oriented media

Competitive Analysis

  • Mercedes EQS

    Mercedes-Benz EQS

    Features in PID

    • Navigation
    • Phone
    • Radio
    • Media
    • Apps
    • Comfort
    • Settings
    • Information
    • Search
    • EQ
    • Share Content
    • Shortcuts
    • Climate Control
    • Air Quality
    • Voice Control
    • Connect Headphones
    • Car Loudspeakers

    Anything unique

    • Uses AI to display personalized suggestions and adapt completely to the user’s needs.
    • Camera-based blocking logic so that the driver does not get distracted.
    • Profiles
    • Widget Shortcuts
    Simplicity
    3/5
    Usability
    4/5
    Intuitiveness
    4/5
  • Porsche Taycan

    Porsche Taycan

    Features in PID

    • Navigation
    • Phone
    • Cockpit
    • Media
    • Devices
    • Sports Chrono
    • Weather
    • Instructions
    • Information
    • Search
    • Widgets
    • Custom Layout
    • Share Content
    • Settings

    Anything unique

    • Cockpit option to view the IC
    • Customization of My Screen
    • Only work while driving when somebody is in the passenger seat with their seat belts on.
    Simplicity
    4/5
    Usability
    4/5
    Intuitiveness
    3/5
  • JEEP

    Jeep Grand Wagoneer

    Jeep Grand Wagoneer

    Features in PID

    • Audio
    • Video
    • HDMI
    • U Connect
    • Navigation
    • Devices
    • Cameras
    • Notifications
    • Control Rear Screens
    • Search
    • Apps
    • Climate
    • USB
    • Share Content
    • Controls
    • Settings

    Anything unique

    • Can play content through HDMI, USB and Other sources.
    • UConnect — Rear seat Entertainment control.
    • FireStick and Fire TV.
    • View Vehicle Camera Apps.
    Simplicity
    5/5
    Usability
    4/5
    Intuitiveness
    4/5
  • Li Xiang L9

    Li Xiang L9

    Features in PID

    • Devices
    • Nap Mode
    • Pre-Installed Apps
    • iQIYI
    • Bilibili
    • iff
    • Quanmin
    • Quanmin
    • Ximalaya
    • QQ Music
    • Migu Videos

    Anything unique

    • Entertainment heavy screen.
    • Personalized content suggestion.
    • Nap mode.
    • Preinstalled Apps.
    Simplicity
    1/5
    Usability
    2/5
    Intuitiveness
    1/5

Key takeaway

Jeep Grand Wagoneer leads in simplicity, while Mercedes EQS excels in intelligent personalization. There is a clear opportunity to combine personalization, safety, and entertainment control in a balanced way.

Excellent (5)
Very Good (4)
Good (3)
Fair (2)
Poor (1)

Opportunity

Create a system that offers intelligent personalization and passenger entertainment control while maintaining driver focus and simplicity.

Key Research Insights

Drivers prioritize safety

Reduce cognitive load and interruptions

Passengers want independent entertainment

Provide dedicated passenger controls

Audio ownership creates confusion

Design clear concurrency rules

Long journeys increase fatigue

Create Relax Mode experiences

Premium buyers expect immersion

Elevate cabin experience through JBL & Dolby

Users dislike excessive popups

Prefer intelligent automatic resolution where possible

The hardest part of this project was not designing a passenger screen — it was designing how the entire cockpit should behave when two people interact with one shared audio ecosystem at the same time.

Phase 2 Define

Defining the Problem Space

Understanding the Ecosystem

Unlike traditional infotainment systems, Tata Sierra introduces a dual-display cockpit where both the driver and passenger can actively interact with the vehicle's digital ecosystem.

Rather than functioning as two independent screens, both displays operate as a connected system that shares hardware resources, vehicle states, and a common audio pipeline.

This introduced an entirely new UX challenge:

How do two users interact independently while sharing a single system without creating confusion or compromising safety?

The Connected Cockpit Ecosystem

Key Observation

Although users perceived two separate displays, the system behaved as one connected experience.

Every interaction on one display had the potential to influence the other.

Understanding the Stakeholders

Multiple stakeholders whose needs often conflicted.

StakeholderPrimary GoalUX Consideration
DriverSafety and focusLowest possible distraction
PassengerEntertainment and comfortIndependent interaction
Product TeamPremium experienceCompetitive differentiation
EngineeringTechnical feasibilityStable implementation
QAPredictable behaviourEdge case coverage
BrandLuxury perceptionPremium animations and interactions

Problem Statement

Business Perspective

Tata Motors needed a premium digital cockpit that differentiated Sierra — the passenger display unlocked richer entertainment and harder interaction challenges.

User Perspective

Drivers wanted focus. Passengers wanted freedom. Both expected one system to just work — with a single shared audio output.

Technical Perspective

Safety rules, vehicle states, shared audio hardware, Android limits, latency, and real-time sync shaped every design decision.

Design Objectives

Six guiding objectives established for the project.

01

Driver First

Every interaction prioritizes driver safety over entertainment — navigation prompts, phone calls, media interruptions, and Relax Mode restrictions.

02

Passenger Independence

Passengers enjoy entertainment without depending on the driver.

  • Media browsing
  • Video playback
  • Relax Mode
  • JBL Modes & Dolby Atmos
  • Audio settings
03

Intelligent Conflict Resolution

The system resolves conflicts automatically instead of asking users through popups.

  • Media ownership transfer
  • Audio interruptions
  • Source switching
  • Call prioritization
04

System Transparency

Whenever the system changes behaviour automatically, users understand why — e.g., 'Relax Mode exited because the vehicle is in motion.'

05

Consistency

Both displays always reflect the current system state.

  • Current media
  • Active source
  • Playback state
  • Audio ownership
06

Premium Experience

Every interaction reinforces the Sierra's premium identity through motion, transitions, and emotional experiences like Relax Mode.

Design Principles

01

Safety before Convenience

Entertainment should never compromise driver awareness.

02

One System, Two Displays

Users experience one connected ecosystem, not two screens.

03

Minimize Cognitive Load

The system makes intelligent decisions instead of forcing manual conflict resolution.

04

Predictability Builds Trust

Users always understand why the system behaves the way it does.

05

Invisible Complexity

Complex concurrency logic hides behind simple interactions.

06

Emotion Matters

Relax Mode and startup animations create emotional engagement beyond functionality.

Opportunity Areas

OpportunityWhy it matteredFinal Feature
Independent passenger entertainmentReduce dependency on the driverPassenger Display
Shared audio managementPrevent conflicting mediaAudio Concurrency
Premium cabin experienceDifferentiate SierraJBL Listening Modes
Emotional well-beingReduce travel fatigueRelax Mode
Delight during startupImprove first impressionBoot-up Strategy & Startup Animation
Build trust during updatesReduce uncertaintyFOTA Experience

Success Criteria

Success was measured by behaviour — not feature count alone.
Independent passenger use without added driver distraction
Shared audio resolved with minimal manual intervention
Predictable conflicts handled without confirmation dialogs
Synchronized state across both displays
Clear communication when safety rules change behaviour
Premium, intuitive experience aligned with Sierra

Phase 3 Research Synthesis

From interviews to systems mapping

Synthesizing research into empathy maps, journey maps, and dependency models before defining system behaviour.

Research Methodology

Primary Research

  • Interviews with drivers and passengers
  • Long-distance travel observation
  • Stakeholder workshops
  • Engineering capability reviews

Secondary Research

  • Premium automotive HMI analysis
  • Android Automotive patterns
  • Tata Motors HMI guidelines
  • Driver distraction research

Research Participants

Three user groups consistently emerged during research.

User GroupAgeDriving PatternPrimary Needs
Daily Commuters28–45City + HighwayNavigation, calls, media
Long-distance Travellers30–55Weekend tripsComfort, entertainment
Family Users35–50Multi-passenger travelShared media, children's entertainment

Key Research Findings

Synthesized from interviews and observations.

01

Drivers avoid frequent interactions

Drivers expected the system to automate routine decisions.

Minimize dialogs; prioritize intelligent automation.

02

Passengers seek independence

Passengers wanted entertainment without asking the driver.

Build a dedicated passenger experience.

03

Audio ownership was unclear

Simultaneous controls made it unclear who owned the output.

Define predictable concurrency rules with clear feedback.

04

Excessive popups cause frustration

Repeated confirmations broke trust during testing.

Resolve expected conflicts automatically.

05

Long drives create fatigue

Passengers cycled media without finding engaging comfort.

Introduce immersive experiences like Relax Mode.

Empathy Map

Experience Journey Map

Journey stage
Vehicle Entry
Boot-up
Media Selection
Long Journey
Incoming Call
Navigation Prompt
Destination Reached
Driver emotion
Happy
Slightly Happy
Slightly Happy
Neutral
Neutral
Slightly Happy
Happy
Passenger emotion
Happy
Slightly Happy
Neutral
Bored / Sleepy
Concerned
Neutral
Happy
Opportunity

Premium startup

Delight users with a beautiful, engaging welcome experience.

Fast system readiness

Get systems ready quickly to build trust and reduce wait time.

Independent passenger controls

Give the passenger full control without interrupting the driver.

Relax Mode

Reduce fatigue and enhance comfort with immersive relaxation features.

Audio concurrency

Handle calls smartly without disrupting the ongoing media experience.

Intelligent audio ducking

Lower media intelligently during navigation for better clarity.

Seamless session recovery

Resume media and settings smoothly where users left off.

Emotional journey (trend)
Driver emotionPassenger emotion

Seven stages from vehicle entry to destination — tracking driver and passenger emotion, design opportunities, and the emotional trend across the shared cockpit journey.

Systems Thinking

The project was about designing relationships — every interaction rippled across displays, audio, and vehicle state.

A Connected Ecosystem

Every component influences and is influenced.

USER INTERACTION(Any Action)Every action triggers achain reaction across the system.1DRIVERIntent, attention,context.2INFOTAINMENTUI output &feedback.3AUDIO ENGINEProcessing, mixing,zone management.4PASSENGER DISPLAYIndependententertainment.5VEHICLE STATESpeed, gear, mode,sensors.6ANDROID PLATFORMServices,permissions, APIs.7MEDIA SOURCESLocal, USB,online streaming.8BLUETOOTHPhones, earbuds,wearables.9CALLSIncoming, ongoing,priority handling.

System Dependency Map

Phase 4 System Architecture

From insights to behaviour matrices

Designing two displays wasn't the challenge. Designing how two displays behave as one intelligent system was.

System Architecture

Tata Sierra Cockpit

Driver Display

Instrument Cluster

Speed, range, navigation prompts, safety-critical status

Infotainment Display

Central Touchscreen

Navigation, media, phone, climate, vehicle settings

Passenger Display

Entertainment & Controls

Independent media, video, games, apps, headphones

Android System Layer

Android Automotive OS

Audio Engine

Processing & management

  • · Playback control
  • · Mixing & routing
  • · Volume & zones
  • · Concurrency rules

Bluetooth Manager

Connectivity

  • · Pairing
  • · Device management
  • · Audio streaming
  • · Call handling

Vehicle APIs

Data & controls

  • · Vehicle state
  • · Speed & gear
  • · Climate
  • · Safety signals

Media Services

Content & sources

  • · Local / USB
  • · Streaming
  • · Radio & podcasts
  • · Video services

Shared Resources

Audio outputMicrophonesNetworkStorageSystem memoryPower management

Every action on one display could influence the other — shared resources tied both experiences together.

Vehicle State Matrix

FeatureParkDriveReverseIgnition off
Video playbackAvailableDriver no / Passenger yesNot availableNot available
Relax ModeAvailableNot availableNot availableNot available
JBL ModesAvailableAvailableAvailableNot available
Dolby Atmos demoAvailableAvailableAvailableNot available
Passenger displayAvailableAvailableAvailableMinimal mode
OTA installationAvailableDeferred when safeNot availableAvailable

Features respond to vehicle status — not static app states.

Ownership Matrix

FeatureDriverPassengerNotes
Music controlFull controlFull controlBoth can play, pause, skip, and browse.
Video playbackNot while drivingFull accessDriver video restricted in Drive.
NavigationFull accessView onlyPassenger can view route and ETA only.
Relax ModeInitiate when parkedParticipateDriver starts it; passenger controls experiences.
JBL ModesShared cabinShared cabinMode change applies to all speakers.
Bluetooth headphonesRestrictedIndependentPassenger can continue privately during calls.
CallsHighest prioritySecondaryDriver calls override media first.

Predictable feature ownership across users and scenarios.

Audio Ownership Matrix

ScenarioAudio outputUX behaviour
Driver starts musicCar speakers (driver source)Driver owns playback with full media control.
Passenger starts music laterCar speakers (passenger source)Latest interaction becomes the active source.
Driver receives callDriver call (highest priority)Passenger music pauses; headphones suggested.
Passenger call during driver callDriver call remains priorityPassenger prompted to take call on phone/headphones.
Navigation promptCar speakers (navigation)Media ducks temporarily, then restores.
Relax ModeShared speakers (all zones)Available only while stationary.

Key principle: Audio focus always respects context, priority, and user intention.

Audio source resolved automatically by timing and safety priority — not popups.

UX Behaviour Scenarios

Features always explained why they were unavailable — never silently disabled.

ScenarioUX Behaviour
Vehicle begins moving during Relax ModeExit driver experience and inform user
Driver receives callPassenger media pauses
Video requested while drivingRestrict driver playback
Reverse gear engagedSafety-critical UI takes precedence
OTA installation while drivingDeferred until safe conditions

Audio Concurrency Diagram

Highest priorityLowest priority

1

Emergency alerts

Critical safety warnings override all other audio.

2

Driver phone call

Incoming or active driver calls take priority.

3

Driver navigation

Navigation prompts and alerts for the driver.

4

Driver media

Media playback controlled by the driver.

5

Passenger call

Routed to phone / Bluetooth headphones.

6

Passenger media

Media playback controlled by the passenger.

7

Relax Mode

Ambient experiential audio when stationary.

8

Ambient sounds

Background ambient sounds and UI tones.

Design principle: Driver safety always takes precedence over passenger entertainment. Conflicts resolve automatically with minimal intervention.

Concurrency Decision Tree

Defines how the system handles concurrent interaction across users, resources, and safety events — without asking users to resolve conflicts manually.
Concurrency handling flow: user action through shared resource and safety checks, apply priority, higher priority resolution or allow and continue, synchronize displays, and notify user if needed.
Left-to-right decision path for prioritizing actions and keeping displays synchronized.

Interaction Flows

Task flow

Audio concurrency

  1. 01 · Start

    Passenger or driver starts media

  2. 02 · Action

    Audio engine assigns active source

  3. 03 · Interrupt

    Higher-priority event arrives

    Priority event

  4. 04 · Action

    Current media pauses or ducks

  5. 05 · End

    Displays sync the new state

Latest valid interaction owns the shared speakers until a higher priority interrupts.

Task flow

Relax Mode transitions

  1. 01 · Start

    Vehicle is parked

  2. 02 · Action

    Driver initiates Relax Mode

  3. 03 · Action

    Ambient themes sync across displays

  4. 04 · Interrupt

    Vehicle begins moving

    Priority event

  5. 05 · End

    Driver experience exits with clear feedback

Immersive cabin experiences only while stationary — and exit safely when motion begins.

Task flow

Passenger media control

  1. 01 · Start

    Passenger opens media on PID

  2. 02 · Action

    Playback starts on shared speakers

  3. 03 · Interrupt

    Driver call or navigation interrupts

    Priority event

  4. 04 · Action

    Passenger is guided to headphones

  5. 05 · End

    Media resumes when safe

Passengers get independence without forcing the driver to manage conflicts.

Task flow

FOTA update journey

  1. 01 · Start

    Update available

  2. 02 · Decision

    System checks vehicle state

  3. 03 · Action

    Install offered when parked

  4. 04 · Interrupt

    Deferred automatically while driving

    Priority event

  5. 05 · End

    Completion confirmed after restart

Over-the-air installs never compete with driving attention.

Task flow

Boot-up sequence

  1. 01 · Start

    Ignition on

  2. 02 · Action

    Safety-critical UI loads

  3. 03 · Action

    Cluster and CID initialize

  4. 04 · Action

    Passenger display follows

  5. 05 · End

    Media and apps become available

Critical systems come up first; entertainment waits for readiness.

Task flow

Play action priority checks

  1. 01 · Start

    Passenger presses Play

  2. 02 · Action

    Audio engine receives command

  3. 03 · Decision

    Check if driver media is playing

  4. 04 · Interrupt

    Apply priority rules if needed

    Priority event

  5. 05 · End

    Start playback or prompt headphones

Every play request is evaluated against shared resources and safety context.

End-to-end flows documenting decision points across both displays.

Phase 5 Design

Production-ready UI screens

Final cockpit screens spanning call handling, headphone routing, and the Sierra slab display.

UI Screens — Call Handling

Call flows that prioritize driver safety while keeping both displays synchronized and predictable.

Incoming call — Accept on Phone action

  • Prioritizes driver safety with uninterrupted driver communication.
  • Adapts contextually based on the active system state.
  • Reduces cognitive load through a clear "Accept on Phone" action.
  • Ensures a seamless multi-display experience with predictable system behaviour.

Call in progress — Connect Headphones prompt

  • Prioritizes driver calls to ensure safe and uninterrupted communication.
  • Pauses passenger media and suggests connecting headphones.
  • Communicates system status through a clear contextual message.
  • Maintains a seamless, safety-first multi-display experience.

Slab display luxury experience

Dual-display home experience

UI Screens — Headphone Experience

Quick audio switching between car speakers and Bluetooth headphones. Dedicated JBL sound modes for private listening without interrupting the driver.

Headphone audio routing UI

Audio modes for headset & earphones

Other UI Screens

Sierra HMI screen 1

Passenger display home screen

Sierra HMI screen 2

Audio modes

Sierra HMI screen 3

Center infotainment home screen

Sierra HMI screen 4

App drawer

Sierra HMI screen 5

Quick access drawer

Sierra HMI screen 6

Phone app

Most selling relax mode experience

The Tata Sierra's Relax Mode is a specialized cabin-relaxation feature that orchestrates ambient lighting, climate control, and the infotainment screens to create a peaceful, meditative environment.

  • Audio & Visual Themes: It features a 3-audio and visual experience with three distinct theme options: water, fire, and space.
  • Integration: The graphics blend across the passenger and infotainment displays, accompanied by relaxing ambient sounds.
  • Operation: Because of the multi-screen setup, the relax graphics can run on the co-passenger or passenger display while the driver’s screen and central systems continue handling functions like navigation or reverse camera feeds.
  • Usage: It is designed to offer a calming experience during pauses in your journey, such as when you are parked or charging the vehicle.
Sierra slab display with three connected screens
Tata Sierra cockpit interior with digital slab display

One cockpit, three displays, shared resources

What this project taught me

Lesson 01

Systems over screens

The most valuable artifacts weren't UI mockups — they were behaviour matrices, decision trees, and concurrency rules that gave engineering and QA a shared language for edge cases.

Lesson 02

Invisible complexity builds trust

Users don't want to manage audio ownership. They want the system to resolve conflicts predictably and explain safety-driven changes only when necessary.

Lesson 03

Two displays, one ecosystem

The challenge was never designing a passenger screen — it was designing how two active displays behave as one intelligent system under shared constraints.

Check out similar work

In-Vehicle Experience

Making low-battery moments less stressful for EV drivers

Check out all work →