English English | 中文 中文


Recent Virtual Reality & Intelligent Hardware Articles

Recently published articles from Virtual Reality & Intelligent Hardware.

Survey on depth and RGB image-based 3D hand shape and pose estimation

June 2021
Lin Huang | Boshen Zhang | Zhilin Guo | Yang Xiao | Zhiguo Cao | Junsong Yuan

The field of vision-based human hand three-dimensional (3D) shape and pose estimation has attracted significant attention recently owing to its key role in various applications, such as natural humancomputer...

Adaptive cross-fusion learning for multi-modal gesture recognition

June 2021
Benjia Zhou | Jun Wan | Yanyan Liang | Guodong Guo

Gesture recognition has attracted significant attention because of its wide range of potential applications. Although multi-modal gesture recognition has made significant progress in recent years, a...

Teaching Chinese Sign Language with a Smartphone

June 2021
Yanxiao Zhang | Yuecong Min | Xilin Chen

There is a large group of deaf-mutes in the world, and sign language is their major communication tool. Therefore, it’s necessary for the deaf-mutes to communicate with hearing-speech people and the...

Review of dynamic gesture recognition

June 2021
Yuanyuan SHI | Yunan LI | Xiaolong FU | M.I.A.O. Kaibin | M.I.A.O. Qiguang

In recent years, gesture recognition has been widely used in the fields of intelligent driving, virtual reality, and human-computer interaction. With the development of artificial intelligence, deep...

Cumulus cloud modeling from images based on VAE-GAN

April 2021
Zili Zhang | Yunchi Cen | Fan Zhang | Xiaohui Liang

Cumulus clouds are important elements in creating virtual outdoor scenes. Modeling cumulus clouds that have a specific shape is difficult owing to the fluid nature of the cloud. Image-based modeling...

Stains on imperfect textile

April 2021
Yi Zheng | Xiaoyu Chi | Yanyun Chen | Enhua Wu

The imperfect material effect is one of the most important themes to obtain photo-realistic results in rendering. Textile material rendering has always been a key area in the field of computer graphics....

Data-driven simulation in fluids animation: A survey

April 2021
Qian Chen | Yue Wang | Hui Wang | Xubo Yang

The field of fluid simulation is developing rapidly, and data-driven methods provide many frameworks and techniques for fluid simulation. This paper presents a survey of data-driven methods used in...

A homogenization method for nonlinear inhomogeneous elastic materials

April 2021
Jing Zhao | Fei Zhu | Liyou Xu | Yong Tang | Sheng Li

Fast simulation techniques are strongly favored in computer graphics, especially for the nonlinear inhomogeneous elastic materials. The homogenization theory is a perfect match to simulate inhomogeneous...

Helmholtz decomposition-based SPH

April 2021
Zhongyao Yang | Maolin Wu | Shiguang liu

SPH method has been widely used in the simulation of water scenes. As a numerical method of partial differential equations, SPH can easily deal with the distorted and complex boundary. In addition,...

Adaptive smoothing length method based on weighted average of neighboring particle density for SPH fluid simulation

April 2021
Rongda Zeng | Zihao Wu | Shengbang Deng | Jian Zhu | Xiaoyu Chi

In the smoothed particle hydrodynamics (SPH) fluid simulation method, thesmoothing length affects not only the process of neighbor search but also the calculation accuracy of the pressure solver. Therefore,...

Affine particle-in-cell method for two-phase liquid simulation

April 2021
Luan Lyu | Wei Cao | Enhua Wu | Zhixin Yang

The interaction of gas and liquid can produce many interesting phenomena, such as bubbles rising from the bottom of the liquid. The simulation of two-phase fluids is a challenging topic in computer...

Multi-scale discrepancy adversarial network for crosscorpus speech emotion recognition

February 2021
Wanlu Zheng | Wenming Zheng | Yuan Zong

One of the most critical issues in human-computer interaction applications is recognizing human emotions based on speech. In recent years, the challenging problem of cross-corpus speech emotion recognition...

Learning long-term temporal contexts using skip RNN for continuous emotion recognition

February 2021
Jian Huang | Bin Liu | Jianhua Tao

One of the most critical issues in human-computer interaction applications is recognizing human emotions based on speech. In recent years, the challenging problem of cross-corpus speech emotion recognition...

Emotional dialog generation via multiple classifiers based on a generative adversarial network

February 2021
Wei Chen | Xinmiao Chen | Xiao Sun

Human-machine dialog generation is an essential topic of research in the field of natural language processing. Generating high-quality, diverse, fluent, and emotional conversation is a challenging task....

NAS-HR: Neural architecture search for heart rate estimation from face videos

February 2021
Hao Lu | Hu Han

In anticipation of its great potential application to natural human-computer interaction and health monitoring, heart-rate (HR) estimation based on remote photoplethysmography has recently attracted...

Review of micro-expression spotting and recognition in video sequences

February 2021
Hang Pan | Lun Xie | Zhiliang Wang | Bin Liu | Minghao Yang | Jianhua Tao

Facial micro-expressions are short and imperceptible expressions that involuntarily reveal the true emotions that a person may be attempting to suppress, hide, disguise, or conceal. Such expressions...

Frustration recognition from speech during game interaction using wide residual networks

February 2021
Meishu Song | Adria Mallol-Ragolta | Emilia Parada-Cabaleiro | Zijiang Yang | Shuo Liu | Zhao Ren | Ziping Zhao | Björn W. Schuller

Although frustration is a common emotional reaction while playing games, an excessive level of frustration can negatively impact a user's experience, discouraging them from further game interactions....

Self-attention transfer networks for speech emotion recognition

February 2021
Ziping Zhao | Zhongtian Bao | Zixing Zhang | Nicholas Cummins | Shihuang Sun | Haishuai Wang | Jianhua Tao | Björn W. Schuller

A crucial element of human–machine interaction, the automatic detection of emotional states from human speech has long been regarded as a challenging task for machine learning models. One vital challenge...

Effects of Virtual-real fusion on immersion, presence, and learning performance in laboratory education

December 2020
Jingcheng Qian | Yancong Ma | Zhigeng Pan | Xubo Yang

Virtual-reality (VR) fusion techniques have become increasingly popular in recent years, and several previous studies have applied them to laboratory education. However, without a basis for evaluating...

Object registration using an RGB-D camera for complex product augmented assembly guidance

December 2020
Kangkang Yang | Yu Guo | Pengzhou Tang | Haopeng Zhang | Han Li

Augmented assembly guidance aims to help users complete assembly operations more efficiently and quickly through augmented reality technology, breaking the limitations of traditional assembly guidance...

A multichannel human-swarm robot interaction system in augmented reality

December 2020
Mingxuan Chen | Ping Zhang | Zebo Wu | Xiaodan Chen

A large number of robots have put forward the new requirements for humanrobot interaction. One of the problems in human-swarm robot interaction is how to naturally achieve an efficient and accurate...

Affine transformation of virtual 3D object using 2D localization of fingertips

December 2020
Mohammad Mahmudul Alam | S.M. Mahbubur Rahman

Interactions with virtual 3D objects in the virtual reality (VR) environment using the gesture of fingers captured in a wearable 2D camera have emerging applications in real-life....

Virtual 3D environment for exploring the spatial ability of students

December 2020
Yingqian Li | Yang Yang | Zhengwei Yao | Guangtao Xu

Spatial ability is an unique type of intelligence; it can be distinguished from other forms of intelligence and plays an essential role in an individual's success in many academic fields, particular...

A survey on monocular 3D human pose estimation

December 2020
Xiaopeng Ji | Qi Fang | Junting Dong | Qing Shuai | Wen Jiang | Xiaowei Zhou

Recovering human pose from RGB images and videos has drawn increasing attention in recent years owing to minimum sensor requirements and applicability in diverse fields such as human-computer interaction,...

VEGO: A novel design towards customizable and adjustable head-mounted display for VR

October 2020
Jia Ming Lee | Xinxing Xia | Clemen OW | Felix Chua | Yunqing Guan

Virtual Reality (VR) technologies have advanced fast and have been applied to a wide spectrum of sectors in the past few years. VR can provide an immersive experience to users by generating virtual...

Development of augmented reality serious games with a vibrotactile feedback jacket

October 2020
Lingfei Zhu | Qi Cao | Yiyu Cai

In the past few years, augmented reality (AR) has rapidly advanced and has been applied in different fields. One of the successful AR applications is the immersive and interactive serious games, which...

Multimodal teaching, learning and training in virtual reality: a review and case study

October 2020
Stéphanie Philippe | Alexis D. Souchet | Petros Lameras | Panagiotis Petridis | Julien Caporal | Gildas Coldeboeuf | Hadrien Duzan

It is becoming increasingly prevalent in digital learning research to encompass an array of different meanings, spaces, processes, and teaching strategies for discerning a global perspective on constructing...

VR industrial applications―A singapore perspective

October 2020
Athirah Syamimi | Yiwei Gong | Ryan Liew

Virtual Reality (VR) has been around for a long time but has come into the spotlight only recently. From an industrial perspective, this article serves as a proverbial scalpel to dissect the different...

VR and AR in human performance research―An NUS experience

October 2020
Jun-Hao Yin | Chin-Boon Chng | Pooi-Mun Wong | Nicholas Ho | Matthew Chua | Chee-Kong Chui

With the mindset of constant improvement in efficiency and safety in the workspace and training in Singapore, there is a need to explore varying technologies and their capabilities to fulfil this need....

Virtual reality research and development in NTU

October 2020
Lihui Huang | Siti Faatihah Binte Mohd Taib | Ryan Aung | Zhe An Goh | Mengshan XU

In 1981, Nanyang Technological Institute was established in Singapore to train engineers and accountants to keep up with the fast-growing economy of the country. In 1991, the institute was upgraded...

Multimodal interaction design and application in augmented reality for chemical experiment

August 2020
Mengting Xiao | Zhiquan Feng | Xiaohui Yang | Tao Xu | Qingbei Guo

Augmented reality classrooms have become an interesting research topic in the field of education, but there are some limitations. Firstly, most researchers use cards to operate experiments, and a large...

Virtual simulation experiment of the design and manufacture of a beer bottle-defect detection system.

August 2020
Yuxiang Zhao | Xiaowei An | Nongliang Sun

Machine learning-based beer bottle-defect detection is a complex technology that runs automatically; however, it consumes considerable memory, is expensive, and poses a certain danger when training...

Thermal perception method of virtual chemistry experiments

August 2020
Hengwei Xu | Siru Li | Wenpeng Song | Jiajun Sun | Xinli Wu | Xiaoqi Wang | Wenzhen Yang | Zhigeng Pan

With the aim of addressing the difficulty in identifying temperatures in virtual chemistry experiments, we propose a temperature-sensing simulation method of virtual chemistry experiments....

Cloud-to-end Rendering and Storage Management for Virtual Reality in Experimental Education

August 2020
Hongxin Zhang | Jin Zhang | Xue Yin | Kan Zhou | Zhigeng Pan

Real-time 3D rendering and interaction is important for virtual reality (VR) experimental education. Unfortunately, standard end-computing methods prohibitively escalate computational costs. Thus, reducing...

Virtual & augmented reality for biological microscope in experiment education

August 2020
Xiang Zhou | Liyu Tang | Ding Lin | Wei Han

BackgroundMixed-reality technologies, including virtual reality (VR) and augmented reality (AR) , are considered to be promising potential tools for science teaching and learning processes that could...

Interaction design for paediatric emergency VR training

August 2020
Tj Matthews | Feng Tian | Tom Dolby

Virtual reality (VR) in healthcare training has increased adoption and support, but efforts are still required to mitigate usability concerns....

An intelligent navigation experimental system based on multi-mode fusion

August 2020
Rui Han | ZhiQuan Feng | JingLan Tian | Xue Fan | XiaoHui Yang | QingBei Guo

At present, most experimental teaching systems lack guidance of an operator, and thus users often do not know what to do during an experiment. The user load is therefore increased, and the learning...

Interactive free-viewpoint video generation

June 2020
Yanru Wang | Zhihao Huang | Hao Zhu | Wei Li | Xun Cao | Ruigang Yang

Free-viewpoint video (FVV) is processed video content in which viewers can freely select the viewing position and angle. FVV delivers an improved visual experience and can also help synthesize special...

Visual perception driven 3D building structure representation from airborne laser scanning point cloud

June 2020
Pingbo Hu | Bisheng Yang

Three-dimensional (3D) building models with unambiguous roof plane geometry parameters, roof structure units, and linked topology are essential data for many applications related to human activities...

Deep learning based point cloud registration: an overview

June 2020
Zhiyuan Zhang | Yuchao Dai | Jiadai Sun

Point cloud registration aims at finding a rigid transformation to align one point cloud to another one. It is a fundamental problem in computer vision and robotics, which has been widely used in various...

Neural Hand Reconstruction Using A Single RGB Image

June 2020
Mengcheng Li | Liang An | Tao Yu | Yangang Wang | Feng Chen | Yebin Liu

We present a neural hand reconstruction method for monocular 3D hand pose and shape estimation in this paper. Instead of directly representing hand with 3D data, a novel UV position map is introduced...

Summary study of data-driven photometric stereo methods

June 2020
Qian Zheng | Boxin Shi | Gang Pan

A photometric stereo method aims to recover the surface normal of a 3D object observed under varying light directions. It is an ill-defined problem because the general reflectance properties of the...

Urban 3D modeling with mobile laser scanning: a review

June 2020
Cheng Wang | Chenglu Wen | Yudi Dai | Shangshu Yu | Minghao Liu

Mobile laser scanning (MLS) systems mainly comprise laser scanners and mobile mapping platforms. Typical MLS systems are able to acquire three-dimensional point clouds with 1-10 centimeter point spacing...

Share this page: