Loading...
hidden

View Mobile version

Meta navigation

Startseite – Hochschule Luzern

Language selection and important links

  • Contents
  • Contact
  • Login
  • De
  • En
Search

Main navigation

School navigation

  • Engineering and Architecture
  • Business
  • Computer Science
  • Social Work
  • Art and Design
  • Music

Sub-navigation

  • Degree Programmes
  • Continuing Education
  • Research
  • International
  • Campus
  • About us
  • News

Sub-navigation

Breadcrumbs

  1. Research Research
  2. AI Supported MultiTouch for Range Images AI Supported MultiTouch for Range Images

AI Supported MultiTouch for Range Images

ABUSIZZ enhances eye-to-eye communication using interactive projection. The current human machineinterface solution shall evolve to a powerful touch engine by learning to recognize gestures using machine learning.

Brief information

School:

Computer Science and Information Technology

Status:

Completed

Period:

01.03.2020 - 31.12.2022

Overview

With smart phones and tablets touch interactions have become common and users are accustomed to
them. ABUSIZZ wants to bring touch interactions to the table without having to resort to expensive
hardware build into the table surface, but rather project the display from an overhead projector built into a
lamp together with sensors and computing to recognise hands and gestures and interact with the user.
This is technically demanding, as range sensors have limited spatial and depth resolution making it difficult
to achieve a natural interaction with the user. Preliminary work has demonstrated, that it is possible to track
hand movement and recognise when a user performs a finger movement to click using classic image
processing techniques. We aim to expand this first work by making the solution more robust and more
natural and add more gestures for controlling the interface such as zoom and scroll. We will address these issues by using a machine learning approach. In a training app, we will ask
people to perform certain tasks like selecting a GUI element on the image, moving an object or zooming in
and out, and so get labelled interaction data for deep learning approaches.

The second part of the project aims to observe the interaction between two people, for example in a sales
conversation and automatically provide a summary of it, as well as to recognize some typical behaviours.

hidden

Facts

Type of project

Forschung

Internal organisations involved
  • Algorithmic Business F&E
Funding
  • Innosuisse - HSLU als Hauptforschungspartnerin (Main Research Partner)
hidden

Persons involved: internal

Project manager
  • Thomas Koller
Member of project team
  • Adrian Aebi
  • Melissa Beck
  • Marc Bravin
  • Rosina Brosi
  • Andrin Bürli
  • Donnacha Daly
  • Esther Galliker
  • Guang Lu
  • Marcel Uhr
  • Pascal Wullschleger

Brief information

School:

Computer Science and Information Technology

Status:

Completed

Period:

03/01/2020 - 12/31/2022

Project Head

Prof. Dr. Thomas Koller

Head of the Master's Program in Engineering

+41 41 757 68 32

Show email

Footer(s)

FH Zentralschweiz

Social media links

  •  Facebook
  •  Instagram
  •  Twitter
  •  LinkedIn
  •  YouTube
  •  Flickr

Contact

Logo Lucerne University of Applied Sciences and Arts

Lucerne University of Applied Sciences and Arts


Werftestrasse 4
CH- 6002 Luzern

+41 41 228 42 42

info@hslu.ch

Direct entry

  • A bachelor's degree –
  • A master's degree –
  • Prospective Students (Continuing & Executive Programmes)
  • Unternehmen & Institutionen
  • Media Relations
  • For Students
  • For Members of Staff

Quick link

  • People Finder
  • University Buildings & Campus Locations
  • News
  • Libraries
  • Events
  • Jobs & Karriere
  • Home
  • Hiring Rooms

Static links

  • Newsletter
  • Data protection notice
  • Publishing Acknowledgements
Logo Swissuniversities

QrCode

QrCode
We use cookies on this site to give you the best browsing experience. By continuing to navigate this site or closing this banner you accept this use of cookies. For more information please visit our privacy policy.
OK