Skip to main content

2024 | OriginalPaper | Buchkapitel

The Running Time Prediction of Spacecraft Simulation Job Based on HC-LSTM

verfasst von : Zhou An, Yi Yuan, Xun Zhou, Qi Miao, Wenlong Song, Huifang Pan

Erschienen in: Signal and Information Processing, Networking and Computers

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the increasing scale of spacecraft, the demand for simulation computing continues to increase, and the requirements for high-performance computing (HPC) resources for simulation jobs are gradually increasing. For the spacecraft designers, the estimation of computing resources and running time required by simulation computing jobs is not accurate enough. Accurate prediction of the running time of spacecraft simulation job is helpful to the effective operation of Backfilling scheduling strategy and further improves the utilization rate of resources. In this paper, according to the characteristics of spacecraft simulation computing jobs, the historical logs and simulation application parameters are analyzed, and key operation characteristics are extracted. At the same time, considering the time sequence correlation of computing jobs, we propose a running time prediction algorithm based on hierarchical clustering and LSTM. Through the comparative analysis of experiments, it is verified that the algorithm has high accuracy in predicting the running time of spacecraft simulation operation, and the prediction effect is better than other related machine learning algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zheng, K., Xiang, Y.C., Rao, W., et al.: Design and verification of thermal control system for Tianwen-1 Mars entry capsule. Chin. Space Sci. Technol. 42(5), 108–116 (2022). (in Chinese) Zheng, K., Xiang, Y.C., Rao, W., et al.: Design and verification of thermal control system for Tianwen-1 Mars entry capsule. Chin. Space Sci. Technol. 42(5), 108–116 (2022). (in Chinese)
2.
Zurück zum Zitat Lamar, K., Goponenko, A., Peterson, C., Allan, B.A., Brandt, J. M., Dechev, D.: Backfilling HPC jobs with a multimodal-aware predictor. In: 2021 IEEE International Conference on Cluster Computing (CLUSTER), Portland, OR, USA, 2021, pp. 618–622 Lamar, K., Goponenko, A., Peterson, C., Allan, B.A., Brandt, J. M., Dechev, D.: Backfilling HPC jobs with a multimodal-aware predictor. In: 2021 IEEE International Conference on Cluster Computing (CLUSTER), Portland, OR, USA, 2021, pp. 618–622
3.
Zurück zum Zitat Fan, Y., Rich, P., Allcock, W.E., Papka, M.E., Lan, Z.: Trade-off between prediction accuracy and underestimation rate in job runtime estimates. In: 2017 IEEE International Conference on Cluster Computing (CLUSTER), Honolulu, HI, USA, pp. 530–540 (2017) Fan, Y., Rich, P., Allcock, W.E., Papka, M.E., Lan, Z.: Trade-off between prediction accuracy and underestimation rate in job runtime estimates. In: 2017 IEEE International Conference on Cluster Computing (CLUSTER), Honolulu, HI, USA, pp. 530–540 (2017)
4.
Zurück zum Zitat Srinivasan, S., Kettimuthu, R., Subramani, V., Sadayappan, P.: Characterization of backfilling strategies for parallel job scheduling. In: Proceedings. International Conference on Parallel Processing Workshop, Vancouver, BC, Canada, pp. 514–519(2002) Srinivasan, S., Kettimuthu, R., Subramani, V., Sadayappan, P.: Characterization of backfilling strategies for parallel job scheduling. In: Proceedings. International Conference on Parallel Processing Workshop, Vancouver, BC, Canada, pp. 514–519(2002)
5.
Zurück zum Zitat Yoon, J., Hong, T., Park, C., Noh, S.-Y., Yu, H.: Log analysis-based resource and execution time improvement in HPC: a case study. Appl. Sci. 10(7), 2634 (2020)CrossRef Yoon, J., Hong, T., Park, C., Noh, S.-Y., Yu, H.: Log analysis-based resource and execution time improvement in HPC: a case study. Appl. Sci. 10(7), 2634 (2020)CrossRef
6.
Zurück zum Zitat Zrigui, S., de Camargo, R.Y., Legrand, A., Trystram, D.: Improving the performance of batch schedulers using online job runtime classification. J. Parallel Dist. Comput. 164, 83–95 (2022)CrossRef Zrigui, S., de Camargo, R.Y., Legrand, A., Trystram, D.: Improving the performance of batch schedulers using online job runtime classification. J. Parallel Dist. Comput. 164, 83–95 (2022)CrossRef
7.
Zurück zum Zitat Tanash, M., Dunn, B., Andresen, D., et al.: Improving HPC system performance by predicting job resources via supervised machine learning. In: Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning) (PEARC 2019) , New York, NY, USA, Article 69, pp. 1–8. Association for Computing Machinery (2019) Tanash, M., Dunn, B., Andresen, D., et al.: Improving HPC system performance by predicting job resources via supervised machine learning. In: Proceedings of the Practice and Experience in Advanced Research Computing on Rise of the Machines (learning) (PEARC 2019) , New York, NY, USA, Article 69, pp. 1–8. Association for Computing Machinery (2019)
8.
Zurück zum Zitat Chen, X., Lu, C.-D., Pattabiraman, K., et al.: Predicting job completion times using system logs in supercomputing clusters. In: 2013 43rd Annual IEEE/IFIP Conference on Dependable Systems and Networks Workshop (DSN-W), Budapest, Hungary, pp. 1–8 (2013) Chen, X., Lu, C.-D., Pattabiraman, K., et al.: Predicting job completion times using system logs in supercomputing clusters. In: 2013 43rd Annual IEEE/IFIP Conference on Dependable Systems and Networks Workshop (DSN-W), Budapest, Hungary, pp. 1–8 (2013)
9.
Zurück zum Zitat Wen, R., Fan, C., Ma, Y., Wang, Z., Xiang, G., Fu, Z.: SlurmX: a task scheduling system refactored from Slurm using object oriented methodology. Comput. Eng. Sci. 44(09), 1532–1541 (2022) Wen, R., Fan, C., Ma, Y., Wang, Z., Xiang, G., Fu, Z.: SlurmX: a task scheduling system refactored from Slurm using object oriented methodology. Comput. Eng. Sci. 44(09), 1532–1541 (2022)
10.
Zurück zum Zitat Staudemeyer, R.C., Rothstein Morris, E.: Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks. arXiv e-prints (2019) Staudemeyer, R.C., Rothstein Morris, E.: Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks. arXiv e-prints (2019)
11.
Zurück zum Zitat Cohen-addad, V., Kanade, V., Mallmann-trenn, F., Mathieu, C.: Hierarchical Clustering: Objective Functions and Algorithms. J. ACM 66, 4 (2019), Article 26, 42 pages Cohen-addad, V., Kanade, V., Mallmann-trenn, F., Mathieu, C.: Hierarchical Clustering: Objective Functions and Algorithms. J. ACM 66, 4 (2019), Article 26, 42 pages
Metadaten
Titel
The Running Time Prediction of Spacecraft Simulation Job Based on HC-LSTM
verfasst von
Zhou An
Yi Yuan
Xun Zhou
Qi Miao
Wenlong Song
Huifang Pan
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2116-0_59