Abstract:
Accurate prediction of ocean factors (e.g., temperature and salinity) is crucial for plenty of applications, including weather forecasting, storm tracking, and ecosystem ...Show MoreMetadata
Abstract:
Accurate prediction of ocean factors (e.g., temperature and salinity) is crucial for plenty of applications, including weather forecasting, storm tracking, and ecosystem protection. Meanwhile, it is well-known that the ocean is a unified system and various ocean factors usually influence each other. For example, the changes in temperature would affect the distribution of salinity in ocean. However, the existing studies for ocean factor prediction mainly focus on designing individual models for predicting specific factors and ignore the correlations between different factors, thus having potentials to be further improved. Therefore, we propose a unified framework UniOcean to predict multiple ocean factors simultaneously, and capture the correlations between them to improve the prediction accuracy. First, considering that ocean factors are usually collected with different temporal scales, we develop the fine-grained multiscale data fusion module to integrate multiple ocean factors with different temporal scales, and effectively learn their hierarchical patterns at different levels. Then, since the correlations between ocean factors may vary across different time periods, the multifactor correlation learning module is constructed to adaptively learn the dynamic correlations between different factors. Finally, we utilize the factor-specific towers to predict multiple ocean factors simultaneously. Experimental results on five real-world remote sensing datasets demonstrate that UniOcean significantly improves the prediction accuracy by 11%–53% in terms of MSD for different ocean factors.
Published in: IEEE Transactions on Geoscience and Remote Sensing ( Volume: 62)
Funding Agency:

Department of Computer Science and Technology, Tongji University, Shanghai, China
Department of Computing, The Hong Kong Polytechnic University, Hong Kong, China
Hanchen Yang received the bachelor’s degree from Beijing Jiaotong University, Beijing, China, in 2020. He is currently the pursuing the dual Ph.D. degree with the Department of Computer Science and Technology, Tongji University, Shanghai, China, and The Hong Kong Polytechnic University, Hong Kong, China.
His research interests include spatial-temporal data mining, graph neural networks, and deep learning.
Hanchen Yang received the bachelor’s degree from Beijing Jiaotong University, Beijing, China, in 2020. He is currently the pursuing the dual Ph.D. degree with the Department of Computer Science and Technology, Tongji University, Shanghai, China, and The Hong Kong Polytechnic University, Hong Kong, China.
His research interests include spatial-temporal data mining, graph neural networks, and deep learning.View more

Department of Computer Science and Technology, Tongji University, Shanghai, China
Yuwei Chen is currently pursuing the bachelor’s degree in data science with Tongji University, Shanghai, China, and the master’s degree in computer science with the Department of Computer Science and Technology, Tongji University.
Her research interests include spatiotemporal data analysis and deep learning.
Yuwei Chen is currently pursuing the bachelor’s degree in data science with Tongji University, Shanghai, China, and the master’s degree in computer science with the Department of Computer Science and Technology, Tongji University.
Her research interests include spatiotemporal data analysis and deep learning.View more

Department of Computing, The Hong Kong Polytechnic University, Hong Kong, China
Jiannong Cao (Fellow, IEEE) received the B.Sc. degree in computer science from Nanjing University, China, in 1982, and the M.Sc. and Ph.D. degrees in computer science from Washington State University, Pullman, WA, USA, in 1986 and 1990, respectively.
He was the founding Director and now the Associate Director of PolyU’s University’s Research Facility in Big Data Analytics (UBDA). He was the Department Head from 2011 to 201...Show More
Jiannong Cao (Fellow, IEEE) received the B.Sc. degree in computer science from Nanjing University, China, in 1982, and the M.Sc. and Ph.D. degrees in computer science from Washington State University, Pullman, WA, USA, in 1986 and 1990, respectively.
He was the founding Director and now the Associate Director of PolyU’s University’s Research Facility in Big Data Analytics (UBDA). He was the Department Head from 2011 to 201...View more

Department of Computer Science and Technology, Tongji University, Shanghai, China
Wengen Li (Member, IEEE) received the B.Eng. and Ph.D. degrees in computer science from Tongji University, Shanghai, China, in 2011 and 2017, respectively, and the dual Ph.D. degree in computer science from The Hong Kong Polytechnic University, Hong Kong, in 2018.
He is currently an Associate Professor with the Department of Computer Science and Technology, Tongji University. His research interests include multimodal data ...Show More
Wengen Li (Member, IEEE) received the B.Eng. and Ph.D. degrees in computer science from Tongji University, Shanghai, China, in 2011 and 2017, respectively, and the dual Ph.D. degree in computer science from The Hong Kong Polytechnic University, Hong Kong, in 2018.
He is currently an Associate Professor with the Department of Computer Science and Technology, Tongji University. His research interests include multimodal data ...View more

Center for Learning, Teaching, and Technology, The Education University of Hong Kong, Hong Kong, China
Yu Yang received the B.Eng. degree in computer science from Xi’an University of Science and Technology, Xi’an, China, in 2012, the M.Eng. degree in pattern recognition and intelligence systems from Shenzhen University, Shenzhen, China, in 2015, and the Ph.D. degree in computer science from The Hong Kong Polytechnic University, Hong Kong, in 2021.
He is currently an Assistant Professor with the Centre for Learning, Teaching...Show More
Yu Yang received the B.Eng. degree in computer science from Xi’an University of Science and Technology, Xi’an, China, in 2012, the M.Eng. degree in pattern recognition and intelligence systems from Shenzhen University, Shenzhen, China, in 2015, and the Ph.D. degree in computer science from The Hong Kong Polytechnic University, Hong Kong, in 2021.
He is currently an Assistant Professor with the Centre for Learning, Teaching...View more

Department of Computer Science and Technology, Tongji University, Shanghai, China
Shuyu Wang received the master’s degree in computer science and technology from China University of Petroleum, Shandong, China, in 2021. She is currently pursuing the Ph.D. degree with the Department of Computer Science and Technology, Tongji University, Shanghai, China.
Her research interests include remote sensing data processing, spatial-temporal data imputation, and deep learning.
Shuyu Wang received the master’s degree in computer science and technology from China University of Petroleum, Shandong, China, in 2021. She is currently pursuing the Ph.D. degree with the Department of Computer Science and Technology, Tongji University, Shanghai, China.
Her research interests include remote sensing data processing, spatial-temporal data imputation, and deep learning.View more

Department of Computer Science and Technology, Tongji University, Shanghai, China
Jihong Guan received the bachelor’s degree from Huazhong Normal University, Wuhan, China, in 1991, the master’s degree from Wuhan Technical University of Surveying and Mapping (merged into Wuhan University since 2000), Wuhan, in 1998, and the Ph.D. degree from Wuhan University, Wuhan, in 2002.
She is currently a Professor with the Department of Computer Science and Technology, Tongji University, Shanghai, China. Before joi...Show More
Jihong Guan received the bachelor’s degree from Huazhong Normal University, Wuhan, China, in 1991, the master’s degree from Wuhan Technical University of Surveying and Mapping (merged into Wuhan University since 2000), Wuhan, in 1998, and the Ph.D. degree from Wuhan University, Wuhan, in 2002.
She is currently a Professor with the Department of Computer Science and Technology, Tongji University, Shanghai, China. Before joi...View more

School of Ocean and Earth Science, Tongji University, Shanghai, China
Rufu Qin received the bachelor’s degree in applied geophysics and the Ph.D. degree in geoexploration and information technology from Jilin University, Changchun, China, in 2001 and 2006, respectively.
He is currently an Associate Professor with the School of Ocean and Earth Science, Tongji University, Shanghai, China. His research interests include geographic information systems, remote sensing, and data mining.
Rufu Qin received the bachelor’s degree in applied geophysics and the Ph.D. degree in geoexploration and information technology from Jilin University, Changchun, China, in 2001 and 2006, respectively.
He is currently an Associate Professor with the School of Ocean and Earth Science, Tongji University, Shanghai, China. His research interests include geographic information systems, remote sensing, and data mining.View more

School of Computer Science, Fudan University, Shanghai, China
Shuigeng Zhou (Senior Member, IEEE) received the bachelor’s degree from Huazhong University of Science and Technology (HUST), Wuhan, China, in 1988, the master’s degree from the University of Electronic Science and Technology of China (UESTC), Chengdu, China, in 1991, and the Ph.D. degree in computer science from Fudan University, Shanghai, China, in 2000.
He served at Shanghai Academy of Spaceflight Technology, Shanghai, ...Show More
Shuigeng Zhou (Senior Member, IEEE) received the bachelor’s degree from Huazhong University of Science and Technology (HUST), Wuhan, China, in 1988, the master’s degree from the University of Electronic Science and Technology of China (UESTC), Chengdu, China, in 1991, and the Ph.D. degree in computer science from Fudan University, Shanghai, China, in 2000.
He served at Shanghai Academy of Spaceflight Technology, Shanghai, ...View more

Department of Computer Science and Technology, Tongji University, Shanghai, China
Department of Computing, The Hong Kong Polytechnic University, Hong Kong, China
Hanchen Yang received the bachelor’s degree from Beijing Jiaotong University, Beijing, China, in 2020. He is currently the pursuing the dual Ph.D. degree with the Department of Computer Science and Technology, Tongji University, Shanghai, China, and The Hong Kong Polytechnic University, Hong Kong, China.
His research interests include spatial-temporal data mining, graph neural networks, and deep learning.
Hanchen Yang received the bachelor’s degree from Beijing Jiaotong University, Beijing, China, in 2020. He is currently the pursuing the dual Ph.D. degree with the Department of Computer Science and Technology, Tongji University, Shanghai, China, and The Hong Kong Polytechnic University, Hong Kong, China.
His research interests include spatial-temporal data mining, graph neural networks, and deep learning.View more

Department of Computer Science and Technology, Tongji University, Shanghai, China
Yuwei Chen is currently pursuing the bachelor’s degree in data science with Tongji University, Shanghai, China, and the master’s degree in computer science with the Department of Computer Science and Technology, Tongji University.
Her research interests include spatiotemporal data analysis and deep learning.
Yuwei Chen is currently pursuing the bachelor’s degree in data science with Tongji University, Shanghai, China, and the master’s degree in computer science with the Department of Computer Science and Technology, Tongji University.
Her research interests include spatiotemporal data analysis and deep learning.View more

Department of Computing, The Hong Kong Polytechnic University, Hong Kong, China
Jiannong Cao (Fellow, IEEE) received the B.Sc. degree in computer science from Nanjing University, China, in 1982, and the M.Sc. and Ph.D. degrees in computer science from Washington State University, Pullman, WA, USA, in 1986 and 1990, respectively.
He was the founding Director and now the Associate Director of PolyU’s University’s Research Facility in Big Data Analytics (UBDA). He was the Department Head from 2011 to 2017. He is currently the Otto Poon Charitable Foundation Professor in data science and the Chair Professor of distributed and mobile computing with the Department of Computing, The Hong Kong Polytechnic University (PolyU), Hong Kong. He is also the Dean of Graduate School, the Director of the Research Institute for Artificial Intelligence of Things (RIAIoT), PolyU, and the Director of the Internet and Mobile Computing Laboratory (IMCL). His research interests include big data analytics, edge intelligence, and mobile computing.
Dr. Cao is a member of Academia Europaea and an ACM Distinguished Member. He is also a Distinguished Member of China Computer Federation (CCF).
Jiannong Cao (Fellow, IEEE) received the B.Sc. degree in computer science from Nanjing University, China, in 1982, and the M.Sc. and Ph.D. degrees in computer science from Washington State University, Pullman, WA, USA, in 1986 and 1990, respectively.
He was the founding Director and now the Associate Director of PolyU’s University’s Research Facility in Big Data Analytics (UBDA). He was the Department Head from 2011 to 2017. He is currently the Otto Poon Charitable Foundation Professor in data science and the Chair Professor of distributed and mobile computing with the Department of Computing, The Hong Kong Polytechnic University (PolyU), Hong Kong. He is also the Dean of Graduate School, the Director of the Research Institute for Artificial Intelligence of Things (RIAIoT), PolyU, and the Director of the Internet and Mobile Computing Laboratory (IMCL). His research interests include big data analytics, edge intelligence, and mobile computing.
Dr. Cao is a member of Academia Europaea and an ACM Distinguished Member. He is also a Distinguished Member of China Computer Federation (CCF).View more

Department of Computer Science and Technology, Tongji University, Shanghai, China
Wengen Li (Member, IEEE) received the B.Eng. and Ph.D. degrees in computer science from Tongji University, Shanghai, China, in 2011 and 2017, respectively, and the dual Ph.D. degree in computer science from The Hong Kong Polytechnic University, Hong Kong, in 2018.
He is currently an Associate Professor with the Department of Computer Science and Technology, Tongji University. His research interests include multimodal data analytics, and spatiotemporal data analytics for urban computing and ocean computing.
Dr. Li is a member of China Computer Federation (CCF) and ACM.
Wengen Li (Member, IEEE) received the B.Eng. and Ph.D. degrees in computer science from Tongji University, Shanghai, China, in 2011 and 2017, respectively, and the dual Ph.D. degree in computer science from The Hong Kong Polytechnic University, Hong Kong, in 2018.
He is currently an Associate Professor with the Department of Computer Science and Technology, Tongji University. His research interests include multimodal data analytics, and spatiotemporal data analytics for urban computing and ocean computing.
Dr. Li is a member of China Computer Federation (CCF) and ACM.View more

Center for Learning, Teaching, and Technology, The Education University of Hong Kong, Hong Kong, China
Yu Yang received the B.Eng. degree in computer science from Xi’an University of Science and Technology, Xi’an, China, in 2012, the M.Eng. degree in pattern recognition and intelligence systems from Shenzhen University, Shenzhen, China, in 2015, and the Ph.D. degree in computer science from The Hong Kong Polytechnic University, Hong Kong, in 2021.
He is currently an Assistant Professor with the Centre for Learning, Teaching, and Technology (LTTC) at The Education University of Hong Kong (EdUHK). His research interests include graph representation learning, spatiotemporal data analysis, urban computing, and learning analytics.
Dr. Yang served as a reviewer and program committee member for many international journals and conferences like IEEE Transactions on Knowledge and Data Engineering, IEEE Transactions on Information System, SIGKDD, TheWebConf, AAAI, NeurIPS, and ICML.
Yu Yang received the B.Eng. degree in computer science from Xi’an University of Science and Technology, Xi’an, China, in 2012, the M.Eng. degree in pattern recognition and intelligence systems from Shenzhen University, Shenzhen, China, in 2015, and the Ph.D. degree in computer science from The Hong Kong Polytechnic University, Hong Kong, in 2021.
He is currently an Assistant Professor with the Centre for Learning, Teaching, and Technology (LTTC) at The Education University of Hong Kong (EdUHK). His research interests include graph representation learning, spatiotemporal data analysis, urban computing, and learning analytics.
Dr. Yang served as a reviewer and program committee member for many international journals and conferences like IEEE Transactions on Knowledge and Data Engineering, IEEE Transactions on Information System, SIGKDD, TheWebConf, AAAI, NeurIPS, and ICML.View more

Department of Computer Science and Technology, Tongji University, Shanghai, China
Shuyu Wang received the master’s degree in computer science and technology from China University of Petroleum, Shandong, China, in 2021. She is currently pursuing the Ph.D. degree with the Department of Computer Science and Technology, Tongji University, Shanghai, China.
Her research interests include remote sensing data processing, spatial-temporal data imputation, and deep learning.
Shuyu Wang received the master’s degree in computer science and technology from China University of Petroleum, Shandong, China, in 2021. She is currently pursuing the Ph.D. degree with the Department of Computer Science and Technology, Tongji University, Shanghai, China.
Her research interests include remote sensing data processing, spatial-temporal data imputation, and deep learning.View more

Department of Computer Science and Technology, Tongji University, Shanghai, China
Jihong Guan received the bachelor’s degree from Huazhong Normal University, Wuhan, China, in 1991, the master’s degree from Wuhan Technical University of Surveying and Mapping (merged into Wuhan University since 2000), Wuhan, in 1998, and the Ph.D. degree from Wuhan University, Wuhan, in 2002.
She is currently a Professor with the Department of Computer Science and Technology, Tongji University, Shanghai, China. Before joining Tongji University, she served with the Department of Computer, Wuhan Technical University of Surveying and Mapping from 1991 to 1997, as an Assistant Professor and an Associate Professor (since August 2000), respectively. She was an Associate Professor (2000-2003) and a Professor (Since 2003) with the School of Computer, Wuhan University. Her research interests include databases, data mining, distributed computing, bioinformatics, and geographic information systems (GIS).
Jihong Guan received the bachelor’s degree from Huazhong Normal University, Wuhan, China, in 1991, the master’s degree from Wuhan Technical University of Surveying and Mapping (merged into Wuhan University since 2000), Wuhan, in 1998, and the Ph.D. degree from Wuhan University, Wuhan, in 2002.
She is currently a Professor with the Department of Computer Science and Technology, Tongji University, Shanghai, China. Before joining Tongji University, she served with the Department of Computer, Wuhan Technical University of Surveying and Mapping from 1991 to 1997, as an Assistant Professor and an Associate Professor (since August 2000), respectively. She was an Associate Professor (2000-2003) and a Professor (Since 2003) with the School of Computer, Wuhan University. Her research interests include databases, data mining, distributed computing, bioinformatics, and geographic information systems (GIS).View more

School of Ocean and Earth Science, Tongji University, Shanghai, China
Rufu Qin received the bachelor’s degree in applied geophysics and the Ph.D. degree in geoexploration and information technology from Jilin University, Changchun, China, in 2001 and 2006, respectively.
He is currently an Associate Professor with the School of Ocean and Earth Science, Tongji University, Shanghai, China. His research interests include geographic information systems, remote sensing, and data mining.
Rufu Qin received the bachelor’s degree in applied geophysics and the Ph.D. degree in geoexploration and information technology from Jilin University, Changchun, China, in 2001 and 2006, respectively.
He is currently an Associate Professor with the School of Ocean and Earth Science, Tongji University, Shanghai, China. His research interests include geographic information systems, remote sensing, and data mining.View more

School of Computer Science, Fudan University, Shanghai, China
Shuigeng Zhou (Senior Member, IEEE) received the bachelor’s degree from Huazhong University of Science and Technology (HUST), Wuhan, China, in 1988, the master’s degree from the University of Electronic Science and Technology of China (UESTC), Chengdu, China, in 1991, and the Ph.D. degree in computer science from Fudan University, Shanghai, China, in 2000.
He served at Shanghai Academy of Spaceflight Technology, Shanghai, from 1991 to 1997, as an Engineer and a Senior Engineer, since August 1995, respectively. He was a Post-Doctoral Researcher with the State Key Laboratory of Software Engineering, Wuhan University, Wuhan, from 2000 to 2002. He is currently a Professor with the School of Computer Science, Fudan University. He has published more than 200 papers in domestic and international journals (including ACM TITS, IEEE Transactions on Knowledge and Data Engineering, IEEE Transactions on Parallel and Distributed Systems, Very Large Data Bases (VLDB) Journal, IEEE/ACM Transactions on Computational Biology and Bioinformatics, and Bioinformatics) and conferences [including Special Interest Group on Management of Data (SIGMOD), VLDB, IEEE International Conference on Data Engineering (ICDE), ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD), ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), Association for the Advancement of Artificial Intelligence (AAAI), International Joint Conference on Artificial Intelligence (IJCAI), IEEE International Conference on Computer Vision (ICCV), IEEE Conference on Computer Vision and Pattern Recognition (CVPR), ACM-SIAM Symposium on Discrete Algorithms (SODA), Intelligent Systems for Molecular Biology (ISMB), and Research in Computational Molecular Biology Conference (RECOMB)]. His research interests include big data management and analysis, artificial intelligence, and bioinformatics.
Dr. Zhou is a member of ACM.
Shuigeng Zhou (Senior Member, IEEE) received the bachelor’s degree from Huazhong University of Science and Technology (HUST), Wuhan, China, in 1988, the master’s degree from the University of Electronic Science and Technology of China (UESTC), Chengdu, China, in 1991, and the Ph.D. degree in computer science from Fudan University, Shanghai, China, in 2000.
He served at Shanghai Academy of Spaceflight Technology, Shanghai, from 1991 to 1997, as an Engineer and a Senior Engineer, since August 1995, respectively. He was a Post-Doctoral Researcher with the State Key Laboratory of Software Engineering, Wuhan University, Wuhan, from 2000 to 2002. He is currently a Professor with the School of Computer Science, Fudan University. He has published more than 200 papers in domestic and international journals (including ACM TITS, IEEE Transactions on Knowledge and Data Engineering, IEEE Transactions on Parallel and Distributed Systems, Very Large Data Bases (VLDB) Journal, IEEE/ACM Transactions on Computational Biology and Bioinformatics, and Bioinformatics) and conferences [including Special Interest Group on Management of Data (SIGMOD), VLDB, IEEE International Conference on Data Engineering (ICDE), ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (SIGKDD), ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), Association for the Advancement of Artificial Intelligence (AAAI), International Joint Conference on Artificial Intelligence (IJCAI), IEEE International Conference on Computer Vision (ICCV), IEEE Conference on Computer Vision and Pattern Recognition (CVPR), ACM-SIAM Symposium on Discrete Algorithms (SODA), Intelligent Systems for Molecular Biology (ISMB), and Research in Computational Molecular Biology Conference (RECOMB)]. His research interests include big data management and analysis, artificial intelligence, and bioinformatics.
Dr. Zhou is a member of ACM.View more