Deployment and Testing of Pulsar Data Processing Software Based on Container

Subjects: Astronomy >> Astrophysical processes submitted time 2023-01-18 Cooperative journals: 《天文研究与技术》

Xinchen Ye Hailong Zhang Jie Wang Meng Zhang Yazhou Zhang Wanqiong Wang Jia Li Xu Du

Abstract： With the rapid development of astronomical observation technology, astronomical data processing software has become increasingly complex, and it is challenging to deploy the software environment. Container technology was used for packaging the pulsar data processing environment to images by applying hierarchical encapsulation. According to the data processing requirements, a private library of images has been established, and the users can select the images according to the data processing mode. The hardware environment, the traditional virtual machine environment, and the container environment performed coherent dedispersion for pulsar baseband data. The resource utilization and data processing efficiency of different platforms are compared. Experimental results show that the performance of the container is similar to the physical machine. In multi-threaded parallel processing, the resource allocation of the container is more reasonable and can improve the efficiency of service resource utilization. Implemented container-based data processing architecture deployment on Xinjiang Astronomical Observatory pulsar data processing server, designed and developed the container management graphical user interfaces. Through optimizing functions such as multi-user login, authentication, and data volume mount to improve the efficiency of astronomical data processing using container technology.

 Hits 6089  Downloads 520  Comment