Graph neural networks: A review of methods and applications
2020
Lots of learning tasks require dealing with graph data which contains rich relation information among elements. Modeling physics systems, learning molecular fingerprints, predicting protein interface,...
Share article
A survey of transformers
2022
Transformers have achieved great success in many artificial intelligence fields, such as natural language processing, computer vision, and audio processing. Therefore, it is natural to attract lots...
Share article
Large language models in law: A survey
2024
The advent of artificial intelligence (AI) has significantly impacted the traditional judicial industry. Moreover, recently, with the development of AI-generated content (AIGC), AI and law have found...
Share article
Pre-trained models: Past, present and future
2021
Large-scale pre-trained models (PTMs) such as BERT and GPT have recently achieved great success and become a milestone in the field of artificial intelligence (AI). Owing to sophisticated pre-training...
Share article
GPT understands, too
2024
Prompting a pretrained language model with natural language patterns has been proved effective for natural language understanding (NLU). However, our preliminary study reveals that manual discrete prompts...
Share article
Neural machine translation: A review of methods, resources, and tools
2020
Machine translation (MT) is an important sub-field of natural language processing that aims to translate natural languages using computers. In recent years, end-to-end neural machine translation (NMT)...
Share article
Deep learning for fake news detection: A comprehensive survey
2022
The information age enables people to obtain news online through various channels, yet in the meanwhile making false news spread at unprecedented speed. Fake news exerts detrimental effects for it impairs...
Share article
Data augmentation approaches in natural language processing: A survey
2022
As an effective strategy, data augmentation (DA) alleviates data scarcity scenarios where deep learning techniques may fail. It is widely applied in computer vision then introduced to natural language...
Share article
Multimodal marvels of deep learning in medical diagnosis using image, speech, and text: A comprehensive review of COVID-19 detection
2025
This study presents a comprehensive review of the potential of multimodal deep learning (DL) in medical diagnosis, using COVID-19 as a case example. Motivated by the success of artificial intelligence...
Share article
Sarcasm detection using news headlines dataset
2023
Sarcasm has been an elusive concept for humans. Due to interesting linguistic properties, sarcasm detection has gained traction of the Natural Language Processing (NLP) research community in the past...
Share article
Optimal RoPE extension via Bayesian Optimization for training-free length generalization
2025
Transformers are designed to process input of variable length without resource constraints. However, their performance significantly deteriorates when the input surpasses a threshold slightly larger...
Share article
ChatLLM network: More brains, more intelligence
2025
Dialogue-based language models mark a huge milestone in the field of artificial intelligence, by their impressive ability to interact with users, as well as a series of challenging tasks prompted by...
Share article
A comprehensive review on resolving ambiguities in natural language processing
2021
Natural language processing is a known technology behind the development of some widely known AI assistants such as: SIRI, Natasha, and Watson. However, NLP is a diverse technology used for numerous...
Share article
Advances and challenges in conversational recommender systems: A survey
2021
Recommender systems exploit interaction history to estimate user preference, having been heavily used in a wide range of industry applications. However, static recommendation models are difficult to...
Share article
Neural, symbolic and neural-symbolic reasoning on knowledge graphs
2021
Knowledge graph reasoning is the fundamental component to support machine learning applications such as information extraction, information retrieval, and recommendation. Since knowledge graphs can...
Share article
Lawformer: A pre-trained language model for Chinese legal long documents
2021
Legal artificial intelligence (LegalAI) aims to benefit legal systems with the technology of artificial intelligence, especially natural language processing (NLP). Recently, inspired by the success...
Share article
How to generate popular post headlines on social media?
2024
Posts, as important containers of user-generated-content on social media, are of tremendous social influence and commercial value. As an integral component of post, headline has decisive influence on...
Share article
Enhancing neural network classification using fractional-order activation functions
2024
In this paper, a series of novel activation functions is presented, which is derived using the improved Riemann–Liouville conformable fractional derivative (RLCFD). This study investigates the use of...
Share article
A comprehensive survey of entity alignment for knowledge graphs
2021
Knowledge Graphs (KGs), as a structured human knowledge, manage data in an ease-of-store, recognizable, and understandable way for machines and provide a rich knowledge base for different artificial...
Share article
CPT: Colorful Prompt Tuning for pre-trained vision-language models
2024
Vision-Language Pre-training (VLP) models have shown promising capabilities in grounding natural language in image data, facilitating a broad range of cross-modal tasks. However, we note that there...
Share article
CPM: A large-scale generative Chinese Pre-trained language model
2021
Pre-trained Language Models (PLMs) have proven to be beneficial for various downstream NLP tasks. Recently, GPT-3, with 175 billion parameters and 570 GB training data, drew a lot of attention due to...
Share article
FedGPA: Federated Learning with Global Personalized Aggregation
2025
A significant challenge in Federated Learning (FL) is addressing the heterogeneity of local data distribution across clients. Personalized Federated Learning (PFL), an emerging method aimed at overcoming...
Share article
Methodologies and their comparison in complex compound aspect-based sentiment analysis: A survey
2025
Sentiment analysis as a part of natural language processing (NLP) has received much attention following the demand to understand people’s opinions. Aspect-based sentiment analysis (ABSA) is a fine-grained...
Share article
