N-S-C Orchestration System and Edge Computing Technology Development
Objective
- Developing a high-performance network environment through the design and construction of the N-S-C orchestrator for integrating Networking (N), Storage (S), and Computing (C) resources, resulting in the creation of the N-S-C integrated resource control system for the scientific research network
- Creating an environment that enables researchers and users of research institutions (national research institutes, universities, etc.) to store, exchange, distribute, and process large volumes of scientific data from supercomputers, particle accelerators, and radio telescopes using edge computing technology
Duration
January 2022 – December 2023
Funding
KISTI Main Projects, KREONET
Key Aspects
- Kubernetes/container-based storage and computing resource management technology
- Networking resource management technology through SDN-based Virtual Dedicated Network (VDN) integration
- Globus Online integration for high-speed scientific data transfer and management
- Distributed storage integration and management, including allocation and synchronization of edge storage resources
- Integration and connection of heterogeneous storage systems (Ceph, MiniO, Rustre, etc.)
- System monitoring with the web-oriented graphical user interfaces based on the integrated resource management environment
Anticipated Outcomes
- Resolving the shortage of storage capacity for large-scale scientific data collected from major experimental equipment in the scientific community
- Ensuring the network transfer speed required for scientific big data processing by linking and utilizing virtual dedicated network technologies
- Developing various software technologies and features that enable researchers to store and share data at the edge layer using edge computing
- mplementing and applying an automated/intelligent user interface for users to efficiently access, manage and utilize integrated resources in networking, computing, and storage
Expected Benefits
- Enhancing research productivity by advancing the converged infrastructure environment for data transfer and sharing between domestic and international research institutions
- Providing stable, high-speed, and distributed storage and high-bandwidth guaranteed virtual dedicated networks for the scientific community, enabling high-performance data transfer and sharing among researchers and institutions
- Overcoming limitations for big data researchers through efficient integration of computing, storage, and networking resources and the provision of converged and shared infrastructure services
- Creating an efficient distributed storage environment for collaborative research in various fields based on the edge-computing-based integrated resource management system, fostering research and development synergies
[Development of N-S-C Orchestration Technology Based on KREONET/KREONET-S]