Lookahead Analysis and Discussion of Research Hotspots in Artificial Intelligence from 2021 to 2023

Wei Zishu; Han Yue; Liu Sihao; Zhang Shengyu; Wu Fei

doi:10.7544/issn1000-1239.202440063

Journal of Computer Research and Development > 2024 > 61(5): 1261-1275. > DOI: 10.7544/issn1000-1239.202440063 CSTR: 32373.14.issn1000-1239.202440063

Wei Zishu, Han Yue, Liu Sihao, Zhang Shengyu, Wu Fei. Lookahead Analysis and Discussion of Research Hotspots in Artificial Intelligence from 2021 to 2023[J]. Journal of Computer Research and Development, 2024, 61(5): 1261-1275. DOI: 10.7544/issn1000-1239.202440063

Citation:

PDF (1258 KB)

Lookahead Analysis and Discussion of Research Hotspots in Artificial Intelligence from 2021 to 2023

College of Computer Science and Technology，Zhejiang University, Hangzhou 310013

More Information

Author Bio:
Wei Zishu: born in 2002. Undergraduate. His main research interest includes large-small models’ synergy

Han Yue: born in 2004. Undergraduate. Her main research interest includes AI agent. (zjhanyue@zju.edu.cn)

Liu Sihao: born in 2001. Undergraduate. His main research interest includes graph network. ( illyasviel123@qq.com)

Zhang Shengyu: born in 1997. PhD, assistant professor. Member of CCF. His main research interests include device-cloud and large-small models’ synergy computing, and multimedia computing and recommendation systems. (sy_zhang@zju.edu.cn)

Wu Fei: born in 1973. PhD, professor. Senior member of CCF. His main research interests include artificial intelligence, cross-media computing, and multimedia analysis and retrieval
Received Date: January 28, 2024
Revised Date: March 28, 2024
Available Online: April 07, 2024

Graphical Abstract

Abstract

Abstract

In current era, marked by advancements and achievements made in digital and intelligent fields, artificial intelligence (AI) has emerged as a pivotal engine driving technological innovation, which indicates encapsulating and examining the latest trends and future trajectories in AI research makes sense on the development of future AI research. This can be implemented by collecting the research outcomes during recent three years from top-tier international conferences and journals in the field of AI that are recommended by the China Computer Federation (CCF-A category), introducing keyword-centric analyses based on a bibliometric methodologies, and analyzing research hotspots based on high-frequency keywords, discerning emerging trends through newly-added keywords, identifying high-impact studies using citation-weighted keyword analysis. The result of these analyses, which contains significant information about trends in AI research, can enable the principal directions of AI research to be delineated and the interconnections and integrative fusion within mainstream AI research directions to be unveiled. Moreover, an in-depth exploration of the current hot topics, such as large language models (LLMs), AI-driven scientific research (AI for Science) and visual generation technologies, would help us reveal the underlying scientific theories and application prospects behind these technological innovations, thereby the latest trends and future trajectories in AI field get demonstrated more adequately and concretely.
- artificial intelligence,
- research hotspots,
- keyword,
- statistical analysis,
- data mining

FullText(HTML)

References (38)

References

[1]	Niu Shuteng, Liu M, Liu Yongxin, et al. Distant domain transfer learning for medical imaging[J]. IEEE Journal of Biomedical and Health Informatics, 2021, 25(10): 3784−3793 doi: 10.1109/JBHI.2021.3051470
[2]	Abbas A, Jain S, Gour M, et al. Tomato plant disease detection using transfer learning with C-GAN synthetic images[J]. Computers and Electronics in Agriculture, 2021, 187: 106279 doi: 10.1016/j.compag.2021.106279
[3]	Xu Runxin, Luo Fuli, Zhang Zhiyuan, et al. Raise a child in large language model: Towards effective and generalizable fine-tuning [C] //Proc of the 2021 Conf on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2021: 9514−9528
[4]	Lester B, Al-Rfou R, Constant N. The power of scale for parameter-efficient prompt tuning [C] //Proc of the 2021 Conf on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2021: 3045−3059
[5]	Gutiérrez O, López-Neri E. Cognitive computing: A brief survey and open research challenges [C] //Proc of the 3rd Int Conf on Applied Computing and Information Technology/2nd Int Conf on Computational Science and Intelligence. Piscataway, NJ: IEEE, 2015: 328−333
[6]	Kumar P, Chandra R, Bansal C, et al. Micro-climate prediction-multi scale encoder-decoder based deep learning framework [C] //Proc of the 27th ACM SIGKDD Conf on Knowledge Discovery & Data Mining. New York: ACM, 2021: 3128−3138
[7]	Ji Shaoxiong, Pan Shirui, Cambria E, et al. A survey on knowledge graphs: Representation, acquisition, and applications[J]. IEEE Transactions on Neural Networks and Learning Systems, 2020, 33(2): 494−514
[8]	Galushka M, Swain C, Browne F, et al. Prediction of chemical compounds properties using a deep learning model[J]. Neural Computing and Applications, 2021, 33(20): 13345−13366 doi: 10.1007/s00521-021-05961-4
[9]	Ata S K, Wu Min, Fang Yuan, et al. Recent advances in network-based methods for disease gene prediction[J]. Briefings in Bioinformatics, 2021, 22(4): bbaa303 doi: 10.1093/bib/bbaa303
[10]	Wang C Y, Bochkovskiy A, Liao H Y M. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors [C] // Proc of IEEE/CVF Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2023: 7464−7475
[11]	Huang C W, Lim J H, Courville A C. A variational perspective on diffusion-based generative models and score matching [C/OL]// Advances in Neural Information Processing Systems. 2021: 21696−21707. [2023-11-20]. https://arxiv.org/pdf/2106.02808.pdf
[12]	Hariri R H, Fredericks E M, Bowers K M. Uncertainty in big data analytics: Survey, opportunities, and challenges[J]. Journal of Big Data, 2019, 6: 1−16 doi: 10.1186/s40537-018-0162-3
[13]	Wang Yuntao, Su Zhou, Zhang Ning, et al. A survey on metaverse: Fundamentals, security and privacy[J]. IEEE Communications Surveys and Tutorials, 2023, 25(1): 319−352 doi: 10.1109/COMST.2022.3202047
[14]	Nour M, Cömert Z, Polat K. A novel medical diagnosis model for COVID-19 infection detection based on deep features and Bayesian optimization [J]. Applied Soft Computing, 2020, 97(Part A): 106580
[15]	Gao Yue, Cai Guangyao, Fang Wei, et al. Machine learning based early warning system enables accurate mortality risk prediction for COVID-19[J/OL]. Nature Communications, 2020, 11(1): 5033. [2023-10-29]. https://www.nature.com/articles/s41467-020-18684-2
[16]	Kaur H, Ashaan S U, Alankar B, et al. A proposed sentiment analysis deep learning algorithm for analyzing COVID-19 tweets[J]. Information Systems Frontiers, 2021, 23(6): 1417−1429 doi: 10.1007/s10796-021-10135-7
[17]	Minaee S, Cambria E, Gao Jianfeng, et al. Deep learning--based text classification: A comprehensive review [J]. ACM Computing Surveys, 2021, 54(3): 1−40
[18]	Tian Yingjie, Zhang Yuqi. A comprehensive survey of regularization strategies in machine learning[J]. Information Fusion, 2022, 80: 146−166 doi: 10.1016/j.inffus.2021.11.005
[19]	Jeon J, Lee S, Choe H. Beyond ChatGPT: A conceptual framework and systematic review of speech-recognition chatbots for language learning[J]. Computers & Education, 2023, 206: 104898
[20]	Sweller J, van Merriënboer J V, Paas F. Cognitive architecture and instructional design: 20 years later[J]. Educational Psychology Review, 2019, 31: 261−292 doi: 10.1007/s10648-019-09465-5
[21]	Kotseruba I, Tsotsos J K. 40 years of cognitive architectures: Core cognitive abilities and practical applications[J]. Artificial Intelligence Review, 2020, 53(1): 17−94 doi: 10.1007/s10462-018-9646-y
[22]	Rai A. Explainable AI: From black box to glass box[J]. Journal of the Academy of Marketing Science, 2019, 48: 137−141
[23]	Hofmann P, Samp C, Urbach N. Robotic process automation [J]. Electronic Markets: 2020, 30: 99−106
[24]	Sreedevi A G, Harshitha T, Sugumaran V, et al. Application of cognitive computing in healthcare, cybersecurity, big data and IoT: A literature review[J]. Information Processing & Management, 2022, 59: 102888
[25]	Niu Zhaoyang, Zhong Guoqiang, Yu Hui. A review on the attention mechanism of deep learning [J]. Neurocomputing, 2021, 45: 48−62
[26]	Touvron H, Lavril T, Lample G, et al. LLaMA: Open and efficient foundation language models [J]. arXiv preprint, arXiv: 2302.13971, 2023
[27]	Varádi M, Anyango S, Izacard G, et al. AlphaFold protein structure database: Massively expanding the structural coverage of protein-sequence space with high-accuracy models[J]. Nucleic Acids Research, 2021, 50: D439−D444
[28]	Mahajan P. Applications of pattern recognition algorithm in health and medicine: A review [J/OL]. International Journal of Engineering and Computer Science, 2016. [2023-11-06]. https://doi.org/10.18535/IJECS%2FV5I5.41
[29]	Li Weihua, Huang Ruyi, Li Jipu, et al. A perspective survey on deep transfer learning for fault diagnosis in industrial scenarios: Theories, applications and challenges [J]. Mechanical Systems and Signal Processing: 2022, 167: 1084−1087
[30]	Maghdid H S, Asaad A T, Ghafoor K, et al. Diagnosing COVID-19 pneumonia from X-ray and CT images using deep learning and transfer learning algorithms [C/OL] // Proc of Multimodal Image Exploitation and Learning. [2023-10-29]. https://arxiv.org/ftp/arxiv/papers/2004/2004.00038.pdf
[31]	Wang Haochun, Liu Chiliang, Xi Nuwa, et al. Huatuo: Tuning LLaMA model with chinese medical knowledge [J]. arXiv preprint, arXiv: 2304.06975, 2023
[32]	Bi Zhen, Zhang Ningyu, Xue Yida, et al. OceanGPT: A large language model for ocean science tasks [J]. arXiv preprint, arXiv: 2310.02031, 2023
[33]	Sohn K, Lee H, Yan Xinchen. Learning structured output representation using deep conditional generative models [C] // Proc of Annual Conf on Nerual Information Processing Systems. Quebec, Canada: NIPS, 2015: 3483−3491
[34]	Mirza M, Osindero S. Conditional generative adversarial nets [J]. arXiv preprint, arXiv: 1411.1784, 2014
[35]	Karras T, Laine S, Aittala M, et al. Analyzing and improving the image quality of StyleGAN [C] // Proc of 2020 IEEE/CVF Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2020: 8107−8116
[36]	Mescheder L, Nowozin S, Geiger A. Adversarial variational Bayes: Unifying variational autoencoders and generative adversarial networks [C] // Proc of the 34th Int Conf on Machine Learning. Sydney: ICML, 2017: 2391−2400
[37]	Rombach R, Blattmann A, Lorenz D, et al. High-resolution image synthesis with latent diffusion models [C]//Proc of the IEEE/CVF Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2022: 10674−10685
[38]	Memarian B, Doleck T. Embodied AI in education: A review on the body, environment, and mind [J]. Education and Information Technologies, 2023, 29: 895−916

[1]	Jiang Tao, Li Zhanhuai. A Survey on Local Pattern Mining in Gene Expression Data[J]. Journal of Computer Research and Development, 2018, 55(11): 2343-2360. DOI: 10.7544/issn1000-1239.2018.20170629
[2]	Wang Yuanzhuo, Jia Yantao, Liu Dawei, Jin Xiaolong, Cheng Xueqi. Open Web Knowledge Aided Information Search and Data Mining[J]. Journal of Computer Research and Development, 2015, 52(2): 456-474. DOI: 10.7544/issn1000-1239.2015.20131342
[3]	Ding Zhaoyun, Jia Yan, Zhou Bin. Survey of Data Mining for Microblogs[J]. Journal of Computer Research and Development, 2014, 51(4): 691-706.
[4]	Lei Xiangxin, Yang Zhiying, Huang Shaoyin, Hu Yunfa. Mining Frequent Subtree on Paging XML Data Stream[J]. Journal of Computer Research and Development, 2012, 49(9): 1926-1936.
[5]	Zhu Ranwei, Wang Peng, and Liu Majin. Algorithm Based on Counting for Mining Frequent Items over Data Stream[J]. Journal of Computer Research and Development, 2011, 48(10): 1803-1811.
[6]	Hu Wenyu, Sun Zhihui, Wu Yingjie. Study of Sampling Methods on Data Mining and Stream Mining[J]. Journal of Computer Research and Development, 2011, 48(1): 45-54.
[7]	Yang Bei, Huang Houkuan. Mining Top-K Significant Itemsets in Landmark Windows over Data Streams[J]. Journal of Computer Research and Development, 2010, 47(3): 463-473.
[8]	Ding Zhiming, Han Jingyu, Li Man, and Yu Bo. Network-Constrained Moving Objects Database Based Traffic Flow Statistical Analysis Model[J]. Journal of Computer Research and Development, 2008, 45(4): 646-655.
[9]	Yang Bingru, Gao Jing, and Song Wei. Application Research of Cognitive Physics in Data Mining[J]. Journal of Computer Research and Development, 2006, 43(8): 1432-1438.
[10]	Chen Geng, Zhu Yuquan, Yang Hebiao, Lu Jieping, Song Yuqing, Sun Zhihui. Study of Some Key Techniques in Mining Association Rule[J]. Journal of Computer Research and Development, 2005, 42(10): 1785-1789.