๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

๋ถ„๋ฅ˜ ์ „์ฒด๋ณด๊ธฐ159

Singularity ์ด์ „ ๋ฒ„์ „ Old version ์‚ญ์ œ remove Singularity ๋ฒ„์ „ ์—…๊ทธ๋ ˆ์ด๋“œ๋‚˜ ๋ฒ„์ „ ๋ณ€๊ฒฝ์„ ์œ„ํ•ด์„œ ์ „์ฒด๋ฅผ ์‚ญ์ œํ•˜๋Š” ๊ฒฝ์šฐ ์•„๋ž˜์˜ ๋ช…๋ น์–ด๋กœ ์‚ญ์ œํ•˜๋ฉด ๋œ๋‹ค. sudo rm -rf \ /usr/local/libexec/singularity \ /usr/local/var/singularity \ /usr/local/etc/singularity \ /usr/local/bin/singularity \ /usr/local/bin/run-singularity \ /usr/local/etc/bash_completion.d/singularity ๊น”๋”. ์‹œ์›. 2021. 10. 5.
Singularity - cached file hash and expected hash does not match ๋ฌธ์ œ ํ•ด๊ฒฐ singularity pull library://lolcow ์œ„์˜ ๋ช…๋ น์–ด๋ฅผ ์ž…๋ ฅํ–ˆ์„ ๋•Œ ์•„๋ž˜์™€ ๊ฐ™์ด ์—๋Ÿฌ๊ฐ€ ๋ฐœ์ƒํ–ˆ๋‹ค. error fetching image๋กœ ์‹œ์ž‘ํ•˜๋Š” ๋ถ€๋ถ„์ด๋‹ค. cached file hash and expected hash does not match๋ผ๊ณ  ์—๋Ÿฌ๊ฐ€ ๋ฐœ์ƒํ•˜๊ณ  ์žˆ๋‹ค. INFO: Downloading library image 639.0b / ??? [===================================================] 927.9 KiB/s FATAL: While pulling library image: error fetching image: cached file hash(sha256.74c12dc5a0e309a82b73ac30eeedfb9f9af2c43c3.. 2021. 10. 3.
๋ฆฌ๋ˆ…์Šค(Linux) ์šฐ๋ถ„ํˆฌ(Ubuntu) Singularity ์„ค์น˜ ๋ฐฉ๋ฒ• Singularity๋Š” ๋„์ปค(Docker)์™€ ์œ ์‚ฌํ•œ ์ปจํ…Œ์ด๋„ˆ(Container) ์‹œ์Šคํ…œ์œผ๋กœ ๋„์ปค์˜ ๋‘๊ฐ€์ง€ ๋‹จ์ (ํŒŒ์ผ ์‹œ์Šคํ…œ ๊ฒฉ๋ฆฌ, ์‚ฌ์šฉ์ž ID ๋ฌธ์ œ)์„ ํ•ด๊ฒฐํ•œ ์‹œ์Šคํ…œ์œผ๋กœ ๋ฐฐ์น˜ ๋ฐ์ดํ„ฐ ์ฒ˜๋ฆฌ ๋“ฑ์˜ ๋‹ค๋ฃจ๋Š” ๋ฌธ์ œ์— ๋”ฐ๋ผ ๋„์ปค๋ฅผ ๋Œ€์ฒดํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋‹ค๋งŒ, ๋„์ปค์˜ ์ƒํƒœ๊ณ„๊ฐ€ ํ›จ์”ฌ ํฌ๊ณ  ๊ฐ€์žฅ ๋Œ€์„ธ๋กœ ๊ตฌ์ถ•๋˜์–ด์žˆ๊ธฐ ๋•Œ๋ฌธ์— ์ผ๋ฐ˜์ ์ธ ์ปจํ…Œ์ด๋„ˆ ์‹œ์Šคํ…œ์„ ์ด์šฉํ•˜๊ณ ์ž ํ•˜๋Š” ๊ฒฝ์šฐ ๋„์ปค๋ฅผ ์‚ฌ์šฉํ•˜๋Š” ๊ฒƒ์ด ์—ฌ๋Ÿฌ๋ชจ๋กœ ๋ฐ”๋žŒ์งํ•  ๊ฒƒ์ž…๋‹ˆ๋‹ค. โ€ปSingularity๊ฐ€ ๋„์ปค์˜ ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•œ ๋ฐฉ๋ฒ• ์ปจํ…Œ์ด๋„ˆ๋Š” ํ˜ธ์ŠคํŠธ ํŒŒ์ผ ์‹œ์Šคํ…œ์— ์ž๋™์œผ๋กœ ์•ก์„ธ์Šคํ•  ์ˆ˜ ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค( $HOME, $PWD, ๋ฐ /tmp์ž๋™์œผ๋กœ ๋งˆ์šดํŠธ๋จ). ์ปจํ…Œ์ด๋„ˆ๋Š” ํ˜„์žฌ ์‚ฌ์šฉ์ž๋กœ ์ž๋™์œผ๋กœ ์‹คํ–‰๋ฉ๋‹ˆ๋‹ค. ๋ณธ ํฌ์ŠคํŒ…์—์„œ๋Š” ์ด๋Ÿฌํ•œ ์ปจํ…Œ์ด๋„ˆ ์‹œ์Šคํ…œ์ธ Singularity์˜ ์„ค์น˜ ๋ฐฉ๋ฒ•์„ ์•Œ์•„๋ณด๊ฒ ์Šต.. 2021. 10. 2.
๋ฆฌ๋ˆ…์Šค(Linux) ์šฐ๋ถ„ํˆฌ(Ubuntu) ํ•˜๋“œ๋””์Šคํฌ ์ƒˆ ํŒŒํ‹ฐ์…˜ ํ™ˆ(home) ๋””๋ ‰ํ† ๋ฆฌ ๋งˆ์šดํŠธ(mount) ํ•˜๋Š” ๋ฐฉ๋ฒ• ์šฐ์„  ํŒŒํ‹ฐ์…˜๊นŒ์ง€๋Š” ๋‚˜๋ˆ„์–ด ๋†“์•˜๋‹ค๊ณ  ๊ฐ€์ •ํ•˜๊ฒ ๋‹ค. ์ด๋ฏธ ํŒŒํ‹ฐ์…˜ ์ž‘์—…์ด ๋๋‚œ ๋’ค์— ํฌ์ŠคํŒ… ํ•˜๋Š” ๊ธ€์ด๋ผ ๋งˆ์šดํŠธ ๋ถ€๋ถ„๋งŒ์„ ๋‹ค๋ฃจ๋„๋ก ํ•˜๊ฒ ๋‹ค. 1. ํŒŒํ‹ฐ์…˜ ํ™•์ธ ์ด ๋•Œ ํŒŒํ‹ฐ์…˜์„ ํ™•์ธํ•˜๊ธฐ ์œ„ํ•œ ๋ช…๋ น์–ด๋Š” ์•„๋ž˜์™€ ๊ฐ™๋‹ค. sudo fdisk -l ๋‚ด ๊ฒฝ์šฐ๋Š” ๋Œ€๋žต ์•„๋ž˜์™€ ๊ฐ™์ด ๋ณด์˜€๋‹ค. Disk /dev/sda: 2.75 TiB, 3000592982016 bytes, 5860533168 sectors Disk model: WDC WD3003FZEX-0 Units: sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disklabel t.. 2021. 10. 1.
์šฐ๋ถ„ํˆฌ(Ubuntu)์—์„œ OpenBLAS ์„ค์น˜ํ•˜๋Š” ๋ฐฉ๋ฒ• OpenBLAS๋Š” Ubuntu์— ๊ธฐ๋ณธ์œผ๋กœ ์„ค์น˜๋œ BLAS(Basic Linear Algebra Subprograms)๋Š” ์†๋„๊ฐ€ ๋Š๋ฆฌ๊ธฐ ๋•Œ๋ฌธ์— ๋Œ€์šฉํ’ˆ์œผ๋กœ ์ฃผ๋กœ ์‚ฌ์šฉ๋œ๋‹ค. OpenBLAS๋ฅผ ์ปดํŒŒ์ผํ•˜๊ธฐ ์œ„ํ•ด์„œ๋Š” fortran ์ปดํŒŒ์ผ๋Ÿฌ์ธ gfortran์ด ํ•„์š”ํ•˜๊ธฐ ๋•Œ๋ฌธ์— ์•„๋ž˜์™€ ๊ฐ™์ด ์„ค์น˜ ๋ช…๋ น์–ด๋ฅผ ์ž…๋ ฅํ•œ๋‹ค. Ubuntu 20.04 LTS ํ™˜๊ฒฝ์—์„œ ์‹คํ–‰ํ•˜์˜€๋‹ค. sudo apt-get install gfortran ์•„๋ž˜์˜ ๋ช…๋ น์–ด๋กœ GitHub์—์„œ ์ €์žฅ์†Œ๋ฅผ ๋ณต์ œํ•˜์—ฌ ๊ฐ€์ ธ์˜จ๋‹ค. git clone https://github.com/xianyi/OpenBLAS.git ์•„๋ž˜์˜ ๋ช…๋ น์–ด๋กœ ๋ฐ›์•„์˜จ ์ €์žฅ์†Œ์˜ ์œ„์น˜๋กœ ์ด๋™ํ•œ๋‹ค. cd OpenBLAS ๋‚ด ๊ฒฝ์šฐ๋Š” cp2k๋ผ๋Š” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ์„ค์น˜ํ•˜๊ธฐ ์œ„ํ•ด์„œ OpenBLAS๊ฐ€ ํ•„์š”ํ–ˆ๊ธฐ ๋•Œ๋ฌธ์—.. 2021. 9. 30.
์šฐ๋ถ„ํˆฌ(Ubuntu) OpenMPI ์„ค์น˜ํ•˜๊ธฐ ๋ฐฉ๋ฒ• ๋ณ‘๋ ฌ์—ฐ์‚ฐ์˜ ๋Œ€ํ‘œ์  ๊ธฐ์ˆ ์ธ MPI(Message Passing Interface) ๊ธฐ๋ฐ˜์˜ ์˜คํ”ˆ์†Œ์Šค ํ”„๋กœ์ ํŠธ์ธ OpenMPI ์„ค์น˜ํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์•Œ์•„๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. ์„ค์น˜ ํ™˜๊ฒฝ์€ ์šฐ๋ถ„ํˆฌ LTS(Long Term Support) ๋ฒ„์ „์˜ ์ตœ์‹ ๋ฒ„์ „์ธ 20.04์—์„œ ์„ค์น˜ํ•˜์˜€์Šต๋‹ˆ๋‹ค. ์„ค์น˜ ๋ฐฉ๋ฒ• 1. OpenMPI ํŒŒ์ผ์„ ๋‹ค์šด๋กœ๋“œ https://download.open-mpi.org/release/open-mpi/v4.1/openmpi-4.1.1.tar.gz 2. ๋‹ค์šด๋กœ๋“œ ๋ฐ›์€ ํŒŒ์ผ ์••์ถ• ํ•ด์ œ tar -xvf openmpi-4.1.1.tar.gz 3. ์••์ถ• ํ•ด์ œํ•œ ํด๋”๋กœ ์ด๋™ํ•˜์—ฌ ํ™˜๊ฒฝ ์„ค์ • cd openmpi-4.1.1 ./configure --prefix=/usr/local ์—ฌ๊ธฐ๊นŒ์ง€ ์™„๋ฃŒ ๋˜๋ฉด ๊ธด output ๋ฉ”์‹œ์ง€๊ฐ€ ์ถœ๋ ฅ๋˜.. 2021. 9. 17.
๋„ค์ด๋ฒ„ ๋ธ”๋กœ๊ทธ ๋ฐฉ๋ฌธ์ž์ˆ˜ ํ™•์ธ ํ•˜๋Š” 2๊ฐ€์ง€ ๋ฐฉ๋ฒ•(์ „์ฒด ๋ฐฉ๋ฌธ์ž, ํˆฌ๋ฐ์ด ์นด์šดํ„ฐ ํฌํ•จ) ์•ˆ๋…•ํ•˜์„ธ์š”. ์‚ต์ž…๋‹ˆ๋‹ค. ์ด ๊ธ€์€ ๋„ค์ด๋ฒ„๊ฐ€ ๊ทธ๋‹ค์ง€ ์ข‹์•„ํ•˜์ง€ ์•Š์„ ์ˆ˜๋„ ์žˆ์„ ๊ฒƒ ๊ฐ™์•„, ํ‹ฐ์Šคํ† ๋ฆฌ ๋ธ”๋กœ๊ทธ์—์„œ ํฌ์ŠคํŒ…ํ•˜๊ฒŒ ๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ์ œ๊ฐ€ ์ข…์ข… ์“ฐ๋Š” ๊ธฐ๋Šฅ์ด๊ณ , ๋‚˜๋ฆ„ ๊ฟ€ํŒ์ด๋ผ ์ƒ๊ฐํ•˜์—ฌ ์ •๋ฆฌํ•ด๋ด…๋‹ˆ๋‹ค. 1. ๋ชจ๋ฐ”์ผ ๋ฒ„์ „์œผ๋กœ ๋ฐฉ๋ฌธ์ž์ˆ˜ ํ™•์ธํ•˜๊ธฐ ํ…Œ์ŠคํŠธ๋Š” ๋„ค์ด๋ฒ„ ๋ธ”๋กœ๊ทธํŒ€ ๊ณต์‹ ๋ธ”๋กœ๊ทธ๋ฅผ ํ™œ์šฉํ•˜์—ฌ ํ…Œ์ŠคํŠธ๋ฅผ ์ง„ํ–‰ํ•ด๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. ๋„ค์ด๋ฒ„ ๋ธ”๋กœ๊ทธํŒ€ ๊ณต์‹ ๋ธ”๋กœ๊ทธ ์ฃผ์†Œ: https://blog.naver.com/blogpeople ๋„ค์ด๋ฒ„ ๋ธ”๋กœ๊ทธํŒ€ ๊ณต์‹๋ธ”๋กœ๊ทธ : ๋„ค์ด๋ฒ„ ๋ธ”๋กœ๊ทธ ๋„ค์ด๋ฒ„ ๋ธ”๋กœ๊ทธํŒ€์ž…๋‹ˆ๋‹ค. ์—ฌ๋Ÿฌ๋ถ„์˜ ์‚ฌ๋ž‘๊ณผ ๊ด€์‹ฌ์œผ๋กœ ์„œ๋กœ์ด์›ƒ์ด ๊ฐ€๋“ ์ฐผ์Šต๋‹ˆ๋‹ค. ์ด์›ƒ์œผ๋กœ ์ถ”๊ฐ€ํ•ด์ฃผ์„ธ์š”. blog.naver.com PC์—์„œ ๋„ค์ด๋ฒ„ ๋ธ”๋กœ๊ทธํŒ€ ๊ณต์‹ ํ™ˆํŽ˜์ด์ง€๋ฅผ ๋“ค์–ด๊ฐ€๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. ์• ์ดˆ์— ์ด๊ณณ์—๋Š” ํˆฌ๋ฐ์ด ์นด์šดํ„ฐ๊ฐ€ ๋‹ฌ๋ ค์žˆ์Šต๋‹ˆ๋‹ค. ์‚ฌ์‹ค ๊ทธ๋ž˜์„œ ๊ตณ์ด ์ด ๊ธฐ๋Šฅ์„ ํ™•์ธํ• .. 2021. 8. 17.
Nvidia GPU ๊ทธ๋ž˜ํ”ฝ ์นด๋“œ ํŒฌ ์†๋„ ์˜ค๋ฒ„ํด๋Ÿญ ์˜ต์…˜ ์ผœ๊ธฐ(nvidia-settings) nvidia ๊ทธ๋ž˜ํ”ฝ ์นด๋“œ ์„ค์ •์€ Linux ์šด์˜์ฒด์ œ์˜ ๊ฒฝ์šฐ(์ œ ๊ฒฝ์šฐ Ubuntu18.04์™€ Ubuntu20.04) ์•„๋ž˜์˜ ์ฃผ์†Œ์— ์žˆ์Šต๋‹ˆ๋‹ค. Nvidia ๊ทธ๋ž˜ํ”ฝ ์นด๋“œ ์„ค์ • ํŒŒ์ผ ์œ„์น˜ /etc/X11/xorg.conf nvidia-settings์˜ ์ถ”๊ฐ€ ์˜ต์…˜ ํ™œ์„ฑํ™” ๋ฐฉ๋ฒ• ๋ฆฌ๋ˆ…์Šค ํ„ฐ๋ฏธ๋„์˜ ๊ฒฝ์šฐ๋Š” ๊ฐ„๋‹จํ•˜๊ฒŒ ์•„๋ž˜์˜ ๋ช…๋ น์–ด๋งŒ ์ž…๋ ฅํ•ด์ฃผ๊ณ  ์žฌ๋ถ€ํŒ…์„ ํ•ด์ฃผ๋ฉด ๋ฐ”๋กœ ๊ทธ๋ž˜ํ”ฝ ์นด๋“œ ํŒฌ ์†๋„ ์˜ต์…˜๊ณผ ์˜ค๋ฒ„ํด๋Ÿญ ์˜ต์…˜์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. nvidia-xconfig --cool-bits=28 ์•„๋‹ˆ๋ฉด ์•„๋ž˜์˜ ๋ช…๋ น์–ด๋ฅผ ํ†ตํ•ด ์ง์ ‘ cool-bits๋ฅผ ๋ณ€๊ฒฝํ•ด์ฃผ๋ฉด ๋˜๋Š”๋ฐ ๋‹ค์Œ ์ฑ•ํ„ฐ๋ฅผ ์ฐธ๊ณ ํ•˜์‹œ๊ธฐ ๋ฐ”๋ž๋‹ˆ๋‹ค. sudo vi /etc/X11/xorg.conf ์žฌ๋ถ€ํŒ…์„ ์™„๋ฃŒํ–ˆ๋‹ค๋ฉด ํ„ฐ๋ฏธ๋„์—์„œ nvidia-settings ๋ช…๋ น์–ด๋ฅผ ์ž…๋ ฅํ•˜๊ฑฐ๋‚˜ ๋‹ค๋ฅธ ์šด์˜์ฒด.. 2021. 7. 22.
์—๋ฒ„๋…ธํŠธ ๋‚ ์งœ ์‹œ๊ฐ„ ๋‹จ์ถ•ํ‚ค ์ž…๋ ฅํ•˜๋Š” ๋ฐฉ๋ฒ• ์—๋ฒ„๋…ธํŠธ์—์„œ ๋‚ ์งœ๋‚˜ ์‹œ๊ฐ„์„ ๋‹จ์ถ•ํ‚ค๋กœ ์ž…๋ ฅํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์•Œ๋ ค๋“œ๋ฆฌ๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค. ํ•ด๋‹น ๊ธฐ๋Šฅ Evernote์˜ ๋‹จ์ถ•ํ‚ค๋Š” ์•„๋ž˜์™€ ๊ฐ™์ฃ . ๋‚ ์งœ : Shift + Alt + D ์‹œ๊ฐ„ : Shift + Ctrl + D ๋‚ ์งœ: ์ œ๋ชฉ์ด๋“  ๋‚ด์šฉ์—์„œ๋“ , Shift+Alt+D ๋ฅผ ๋ˆ„๋ฅด๋ฉด ๋ฉ๋‹ˆ๋‹ค. ์‹œ๊ฐ„: ์ œ๋ชฉ์ด๋“  ๋‚ด์šฉ์—์„œ๋“ , Shift+Ctrl+D ๋ฅผ ๋ˆ„๋ฅด๋ฉด ๋ฉ๋‹ˆ๋‹ค. Alt์™€ Ctrl์ด ์ฐจ์ด์ž…๋‹ˆ๋‹ค. ์ตœ์‹  ๋ฒ„์ „์—์„œ๋Š” ๊ณผ๊ฑฐ Date์ „์ฒด๋ฅผ ์ž…๋ ฅํ•ด์ฃผ๋˜ Ctrl + ; ์ด ๋จนํžˆ์ง€๋ฅผ ์•Š์•„์„œ ์ด๋ ‡๊ฒŒ ์“ฐ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. (ํŽธํ–ˆ๋Š”๋ฐ...) ๋„์›€์ด ๋˜์…จ๊ธฐ๋ฅผ ๋ฐ”๋ผ๋ฉฐ. 2021. 7. 8.