English English | 中文 中文

Recent Virtual Reality & Intelligent Hardware Articles

Recently published articles from Virtual Reality & Intelligent Hardware.

Multi-scale discrepancy adversarial network for crosscorpus speech emotion recognition

February 2021
Wanlu Zheng | Wenming Zheng | Yuan Zong

One of the most critical issues in human-computer interaction applications is recognizing human emotions based on speech. In recent years, the challenging problem of cross-corpus speech emotion recognition...

Learning long-term temporal contexts using skip RNN for continuous emotion recognition

February 2021
Jian Huang | Bin Liu | Jianhua Tao

One of the most critical issues in human-computer interaction applications is recognizing human emotions based on speech. In recent years, the challenging problem of cross-corpus speech emotion recognition...

Emotional dialog generation via multiple classifiers based on a generative adversarial network

February 2021
Wei Chen | Xinmiao Chen | Xiao Sun

Human-machine dialog generation is an essential topic of research in the field of natural language processing. Generating high-quality, diverse, fluent, and emotional conversation is a challenging task....

NAS-HR: Neural architecture search for heart rate estimation from face videos

February 2021
Hao Lu | Hu Han

In anticipation of its great potential application to natural human-computer interaction and health monitoring, heart-rate (HR) estimation based on remote photoplethysmography has recently attracted...

Review of micro-expression spotting and recognition in video sequences

February 2021
Hang Pan | Lun Xie | Zhiliang Wang | Bin Liu | Minghao Yang | Jianhua Tao

Facial micro-expressions are short and imperceptible expressions that involuntarily reveal the true emotions that a person may be attempting to suppress, hide, disguise, or conceal. Such expressions...

Frustration recognition from speech during game interaction using wide residual networks

February 2021
Meishu Song | Adria Mallol-Ragolta | Emilia Parada-Cabaleiro | Zijiang Yang | Shuo Liu | Zhao Ren | Ziping Zhao | Björn W. Schuller

Although frustration is a common emotional reaction while playing games, an excessive level of frustration can negatively impact a user's experience, discouraging them from further game interactions....

Self-attention transfer networks for speech emotion recognition

February 2021
Ziping Zhao | Zhongtian Bao | Zixing Zhang | Nicholas Cummins | Shihuang Sun | Haishuai Wang | Jianhua Tao | Björn W. Schuller

A crucial element of human–machine interaction, the automatic detection of emotional states from human speech has long been regarded as a challenging task for machine learning models. One vital challenge...

Effects of Virtual-real fusion on immersion, presence, and learning performance in laboratory education

December 2020
Jingcheng Qian | Yancong Ma | Zhigeng Pan | Xubo Yang

Virtual-reality (VR) fusion techniques have become increasingly popular in recent years, and several previous studies have applied them to laboratory education. However, without a basis for evaluating...

Object registration using an RGB-D camera for complex product augmented assembly guidance

December 2020
Kangkang Yang | Yu Guo | Pengzhou Tang | Haopeng Zhang | Han Li

Augmented assembly guidance aims to help users complete assembly operations more efficiently and quickly through augmented reality technology, breaking the limitations of traditional assembly guidance...

A multichannel human-swarm robot interaction system in augmented reality

December 2020
Mingxuan Chen | Ping Zhang | Zebo Wu | Xiaodan Chen

A large number of robots have put forward the new requirements for humanrobot interaction. One of the problems in human-swarm robot interaction is how to naturally achieve an efficient and accurate...

Affine transformation of virtual 3D object using 2D localization of fingertips

December 2020
Mohammad Mahmudul Alam | S.M. Mahbubur Rahman

Interactions with virtual 3D objects in the virtual reality (VR) environment using the gesture of fingers captured in a wearable 2D camera have emerging applications in real-life....

Virtual 3D environment for exploring the spatial ability of students

December 2020
Yingqian Li | Yang Yang | Zhengwei Yao | Guangtao Xu

Spatial ability is an unique type of intelligence; it can be distinguished from other forms of intelligence and plays an essential role in an individual's success in many academic fields, particular...

A survey on monocular 3D human pose estimation

December 2020
Xiaopeng Ji | Qi Fang | Junting Dong | Qing Shuai | Wen Jiang | Xiaowei Zhou

Recovering human pose from RGB images and videos has drawn increasing attention in recent years owing to minimum sensor requirements and applicability in diverse fields such as human-computer interaction,...

VEGO: A novel design towards customizable and adjustable head-mounted display for VR

October 2020
Jia Ming Lee | Xinxing Xia | Clemen OW | Felix Chua | Yunqing Guan

Virtual Reality (VR) technologies have advanced fast and have been applied to a wide spectrum of sectors in the past few years. VR can provide an immersive experience to users by generating virtual...

Development of augmented reality serious games with a vibrotactile feedback jacket

October 2020
Lingfei Zhu | Qi Cao | Yiyu Cai

In the past few years, augmented reality (AR) has rapidly advanced and has been applied in different fields. One of the successful AR applications is the immersive and interactive serious games, which...

Multimodal teaching, learning and training in virtual reality: a review and case study

October 2020
Stéphanie Philippe | Alexis D. Souchet | Petros Lameras | Panagiotis Petridis | Julien Caporal | Gildas Coldeboeuf | Hadrien Duzan

It is becoming increasingly prevalent in digital learning research to encompass an array of different meanings, spaces, processes, and teaching strategies for discerning a global perspective on constructing...

VR industrial applications―A singapore perspective

October 2020
Athirah Syamimi | Yiwei Gong | Ryan Liew

Virtual Reality (VR) has been around for a long time but has come into the spotlight only recently. From an industrial perspective, this article serves as a proverbial scalpel to dissect the different...

VR and AR in human performance research―An NUS experience

October 2020
Jun-Hao Yin | Chin-Boon Chng | Pooi-Mun Wong | Nicholas Ho | Matthew Chua | Chee-Kong Chui

With the mindset of constant improvement in efficiency and safety in the workspace and training in Singapore, there is a need to explore varying technologies and their capabilities to fulfil this need....

Virtual reality research and development in NTU

October 2020
Lihui Huang | Siti Faatihah Binte Mohd Taib | Ryan Aung | Zhe An Goh | Mengshan XU

In 1981, Nanyang Technological Institute was established in Singapore to train engineers and accountants to keep up with the fast-growing economy of the country. In 1991, the institute was upgraded...

Multimodal interaction design and application in augmented reality for chemical experiment

August 2020
Mengting Xiao | Zhiquan Feng | Xiaohui Yang | Tao Xu | Qingbei Guo

Augmented reality classrooms have become an interesting research topic in the field of education, but there are some limitations. Firstly, most researchers use cards to operate experiments, and a large...

Virtual simulation experiment of the design and manufacture of a beer bottle-defect detection system.

August 2020
Yuxiang Zhao | Xiaowei An | Nongliang Sun

Machine learning-based beer bottle-defect detection is a complex technology that runs automatically; however, it consumes considerable memory, is expensive, and poses a certain danger when training...

Thermal perception method of virtual chemistry experiments

August 2020
Hengwei Xu | Siru Li | Wenpeng Song | Jiajun Sun | Xinli Wu | Xiaoqi Wang | Wenzhen Yang | Zhigeng Pan

With the aim of addressing the difficulty in identifying temperatures in virtual chemistry experiments, we propose a temperature-sensing simulation method of virtual chemistry experiments....

Cloud-to-end Rendering and Storage Management for Virtual Reality in Experimental Education

August 2020
Hongxin Zhang | Jin Zhang | Xue Yin | Kan Zhou | Zhigeng Pan

Real-time 3D rendering and interaction is important for virtual reality (VR) experimental education. Unfortunately, standard end-computing methods prohibitively escalate computational costs. Thus, reducing...

Virtual & augmented reality for biological microscope in experiment education

August 2020
Xiang Zhou | Liyu Tang | Ding Lin | Wei Han

BackgroundMixed-reality technologies, including virtual reality (VR) and augmented reality (AR) , are considered to be promising potential tools for science teaching and learning processes that could...

Interaction design for paediatric emergency VR training

August 2020
Tj Matthews | Feng Tian | Tom Dolby

Virtual reality (VR) in healthcare training has increased adoption and support, but efforts are still required to mitigate usability concerns....

An intelligent navigation experimental system based on multi-mode fusion

August 2020
Rui Han | ZhiQuan Feng | JingLan Tian | Xue Fan | XiaoHui Yang | QingBei Guo

At present, most experimental teaching systems lack guidance of an operator, and thus users often do not know what to do during an experiment. The user load is therefore increased, and the learning...

Interactive free-viewpoint video generation

June 2020
Yanru Wang | Zhihao Huang | Hao Zhu | Wei Li | Xun Cao | Ruigang Yang

Free-viewpoint video (FVV) is processed video content in which viewers can freely select the viewing position and angle. FVV delivers an improved visual experience and can also help synthesize special...

Visual perception driven 3D building structure representation from airborne laser scanning point cloud

June 2020
Pingbo Hu | Bisheng Yang

Three-dimensional (3D) building models with unambiguous roof plane geometry parameters, roof structure units, and linked topology are essential data for many applications related to human activities...

Deep learning based point cloud registration: an overview

June 2020
Zhiyuan Zhang | Yuchao Dai | Jiadai Sun

Point cloud registration aims at finding a rigid transformation to align one point cloud to another one. It is a fundamental problem in computer vision and robotics, which has been widely used in various...

Neural Hand Reconstruction Using A Single RGB Image

June 2020
Mengcheng Li | Liang An | Tao Yu | Yangang Wang | Feng Chen | Yebin Liu

We present a neural hand reconstruction method for monocular 3D hand pose and shape estimation in this paper. Instead of directly representing hand with 3D data, a novel UV position map is introduced...

Summary study of data-driven photometric stereo methods

June 2020
Qian Zheng | Boxin Shi | Gang Pan

A photometric stereo method aims to recover the surface normal of a 3D object observed under varying light directions. It is an ill-defined problem because the general reflectance properties of the...

Urban 3D modeling with mobile laser scanning: a review

June 2020
Cheng Wang | Chenglu Wen | Yudi Dai | Shangshu Yu | Minghao Liu

Mobile laser scanning (MLS) systems mainly comprise laser scanners and mobile mapping platforms. Typical MLS systems are able to acquire three-dimensional point clouds with 1-10 centimeter point spacing...

Laser Scanned Real Environment for Intelligent Virtualization of Crane Lifting

April 2020
Lihui Huang | Souravik Dutta | Yiyu Cai

This paper presents a Tower Crane Intelligent Lifting Path Planner (TCILP) for the lifting task in the environments which are highly complex. The environment can be old industrial plants existing over...

Two-phase real-time rendering method for realistic water refraction

April 2020
Hongli Liu | Honglei Han | Guangzheng Fei

Realistic rendering has been an important goal of several interactive applications, which requires an efficient virtual simulation of many special effects that are common in the real world. However,...

On attaining user-friendly hand gesture interfaces to control existing GUIs

April 2020
Egemen Ertugrul | Ping Li | Bin Sheng

Hand gesture interfaces are dedicated programs that principally perform hand tracking and hand gesture prediction to provide alternative controls and interaction methods. They take advantage of one...

COMTIS: Customizable touchless interaction system for large screen visualization

April 2020
Jiaxin Liu | Hongxin Zhang | Chuankang Li

Large screen visualization systems have been widely utilized in many industries. Such systems can help illustrate the working states of different production systems. However, efficient interaction with...

Temporal continuity of visual attention for future gaze prediction in immersive virtual reality

April 2020
Zhiming Hu | Sheng Li | Meng Gai

Eye tracking technology is receiving increased attention in the field of virtual reality. Specifically, future gaze prediction is crucial in pre-computation for many applications such as gaze-contingent...

End-to-End Spatial Transform Face Detection and Recognition

April 2020
Hongxin Zhang | Liying Chi

Plenty of face detection and recognition methods have been proposed and got excellent results in decades. Common face recognition pipeline consists of: 1) face detection, 2) face alignment, 3) feature...

Personalized cardiovascular intervention simulation system

April 2020
Aimin Hao | Jiahao Cui | Shuai Li | Qinping Zhao

This study proposes a series of geometry and physics modeling methods for personalized cardiovascular intervention procedures, which can be applied to a virtual endovascular simulator....

Co-axial depth sensor with an extended depth range for AR/VR applications

February 2020
Mohan Xu | Hong Hua

Depth sensor is an essential element in virtual and augmented reality devices to digitalize users' environment in real time. The current popular technologies include the stereo, structured light, and...

View Synthesis from multi-view RGB data using multilayered representation and volumetric estimation

February 2020
Zhaoqi Su | Tiansong Zhou | Kun Li | David Brady | Yebin Liu

Aiming at free-view exploration of complicated scenes, this paper presents a method for interpolating views among multi RGB cameras....

Study on the adaptability of augmented reality smartglasses for astigmatism based on holographic waveguide grating

February 2020
Shenze Wang | Kaikai Du | Ningfang Song | Dongfeng Zhao | Di Feng | Zhengqian Tu

Augmented reality (AR) smartglasses are considered as the next generation of smart devices to replace mobile phones, and are widely concerned. But at present, AR smartglasses are usually designed according...

A smart assistance system for cable assembly by combining wearable augmented reality with portable visual inspection

February 2020
Lianyu Zheng | Xinyuliu Liu | Zewu An | Shufei Li | Renjie Zhang

Assembly guided by paper documents is the most widespread type used in the process of aircraft cable assembly. This process is very complicated and requires assembly workers with high-level skills....

Virtual assembly framework for performance analysis of large optics

February 2020
Jinli Zhang | Hui Wang | Bowu Liu | Dongya Chu | Xu Xu | Guoqing Pei

A longstanding technological challenge exists regarding the precise assembly design and performance optimization of large optics in high power laser facilities, comprising a combination of many complex...

Survey on path and view planning for UAVs

February 2020
Xiaohui Zhou | Zimu Yi | Yilin Liu | Kai Huang | Hui Huang

In recent decades, unmanned aerial vehicles (UAVs) have developed rapidly and been widely applied in many domains, including photography, reconstruction, monitoring, and search and rescue. In such applications,...

Share this page: