Potato
์•ˆ๋…•ํ•˜์„ธ์š”, ๊ฐ์žก๋‹ˆ๋‹ค?๐Ÿฅ” ^___^ ๐Ÿ˜บ github ๋ฐ”๋กœ๊ฐ€๊ธฐ ๐Ÿ‘‰๐Ÿป
๋ฐ˜์‘ํ˜•

AI study/์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (NLP) 14

[NLP] seq2seq๋กœ ๋ฒˆ์—ญ๊ธฐ ๊ตฌํ˜„ํ•˜๊ธฐ (feat.๋”ฅ๋Ÿฌ๋‹์„ ์ด์šฉํ•œ ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ ์ž…๋ฌธ)

-- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์™€ ๋”ฅ๋Ÿฌ๋‹์„ ์ด์šฉํ•œ ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ ์ž…๋ฌธ(์œ„ํ‚ค๋…์Šค) ์ €์„œ๋ฅผ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. 1. Sequence-to-Sequence (seq2seq) ๋ฒˆ์—ญ๊ธฐ์—์„œ ๋Œ€ํ‘œ์ ์œผ๋กœ ์‚ฌ์šฉ๋˜๋Š” ๋ชจ๋ธ ์ธ์ฝ”๋”์™€ ๋””์ฝ”๋”๋กœ ๊ตฌ์„ฑ๋œ ์ธ์ฝ”๋” - ๋””์ฝ”๋” ๋ชจ๋ธ์˜ ์ผ์ข… ์กฐ๊ฑด๋ถ€ ์ƒ์„ฑ ๋ชจ๋ธ (conditioned generation model)์˜ ์ผ์ข…์ด๊ธฐ๋„ ํ•จ ์กฐ๊ฑด๋ถ€ ์ƒ์„ฑ ๋ชจ๋ธ์ด๋ž€? ์ž…๋ ฅํ‘œํ˜„ ๋Œ€์‹  ์ผ๋ฐ˜์ ์ธ ์กฐ๊ฑด ๋ฌธ๋งฅ์„ ํ™œ์šฉํ•˜์—ฌ ๋””์ฝ”๋”๊ฐ€ ์ถœ๋ ฅ์„ ๋งŒ๋“œ๋Š” ๋ชจ๋ธ 1.1 seq2seq ๋ชจ๋ธ์˜ ๊ตฌ์„ฑ ์ธ์ฝ”๋”๋Š” ์ž…๋ ฅ ๋ฌธ์žฅ์˜ ๋ชจ๋“  ๋‹จ์–ด๋ฅผ ์ˆœ์ฐจ์ ์œผ๋กœ ์ž…๋ ฅ๋ฐ›์€ ๋’ค์— ๋งˆ์ง€๋ง‰์— ๋ชจ๋“  ๋‹จ์–ด์˜ ์ •๋ณด๋ฅผ ์••์ถ•ํ•ด์„œ ํ•˜๋‚˜์˜ ๋ฒกํ„ฐ๋กœ ๋งŒ๋“ค์–ด์คŒ (์ฆ‰, context vector๋ฅผ ์ƒ์„ฑ) context ๋ฒกํ„ฐ๋กœ ๋ชจ๋‘ ๋ฌธ์žฅ์˜..

[NLP] ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ ์‹œํ€€์Šค ๋ชจ๋ธ๋ง (Attention, ์–ดํ…์…˜ ๋ฉ”์ปค๋‹ˆ์ฆ˜)

-- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์ฑ…์„ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. -- ์†Œ์Šค์ฝ”๋“œ๋Š” ์—ฌ๊ธฐ 1. ์–ดํ…์…˜ (Attention) 1.1 ์–ดํ…์…˜ ๋“ฑ์žฅ ๋ฐฐ๊ฒฝ ์•ž์„œ ์–ธ๊ธ‰ํ•œ seq2seq ๋ชจ๋ธ์€ '์ „์ฒด ์ž…๋ ฅ ๋ฌธ์žฅ'์„ ํ•˜๋‚˜์˜ ๋ฒกํ„ฐ๋กœ ์ธ์ฝ”๋”ฉํ•˜๊ธฐ์—, ์งง์€ ๋ฌธ์žฅ์—๋งŒ ์ ํ•ฉํ•˜๊ณ  ๊ธด ๋ฌธ์žฅ์—์„œ๋Š” ์ „์ฒด ์ž…๋ ฅ ์ •๋ณด๋ฅผ ์ œ๋Œ€๋กœ ๊ฐ์ง€ํ•˜์ง€ ๋ชปํ•œ๋‹ค๋Š” ๋ฌธ์ œ์  ๋ฐœ์ƒ ์ฆ‰, ํ•˜๋‚˜์˜ ๊ณ ์ •๋œ ํฌ๊ธฐ์˜ ๋ฒกํ„ฐ์— ๋ชจ๋“  ์ •๋ณด๋ฅผ ๋‹ด๋‹ค๋ณด๋‹ˆ ์ •๋ณด ์†์‹ค์ด ๋ฐœ์ƒํ•œ๋‹ค. RNN์˜ ๊ณ ์งˆ์ ์ธ ๋ฌธ์ œ์ธ ๊ธฐ์šธ๊ธฐ ์†Œ์‹ค ๋ฌธ์ œ (Vanishing Gradient)๊ฐ€ ์กด์žฌํ•œ๋‹ค. โ–ถ ์ด๋Ÿฐ RNN์— ๊ธฐ๋ฐ˜ํ•œ sequence๋ชจ๋ธ์˜ ๋ฌธ์ œ๋“ค์€ ๊ธฐ๊ณ„ ๋ฒˆ์—ญ ๋ถ„์•ผ์—์„œ ์ž…๋ ฅ ๋ฌธ์žฅ์ด ๊ธธ๋ฉด ํ’ˆ์งˆ์ด ๋–จ์–ด์ง€๋Š” ์น˜๋ช…์ ์ธ ๋‹จ์ ์œผ๋กœ ์ž‘์šฉ โ–ถ ๋”ฐ๋ผ์„œ ์ด๋ฅผ ์œ„ํ•œ ๋Œ€์•ˆ์œผ๋กœ ์ž…๋ ฅ ์‹œํ€€์Šค๊ฐ€ ๊ธธ์–ด์ง€๋ฉด ์ถœ..

[NLP] ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ ์‹œํ€€์Šค ๋ชจ๋ธ๋ง (์‹œํ€€์Šค์™€ RNN)

-- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์ฑ…์„ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. -- ์†Œ์Šค์ฝ”๋“œ๋Š” ์—ฌ๊ธฐ 1. NLP์—์„œ์˜ ์‹œํ€€์Šค 1.1 ์‹œํ€€์Šค๋ž€ ์ˆœ์„œ๊ฐ€ ์žˆ๋Š” ํ•ญ๋ชฉ์˜ ๋ชจ์Œ ์ˆœ์ฐจ ๋ฐ์ดํ„ฐ โ–ถ ์˜ˆ์‹œ The book is on the table. The boos are on the table. ์œ„ ๋‘๊ฐœ์˜ ๋ฌธ์žฅ์€ ์˜์–ด์—์„œ ๋‹ค์ˆ˜์ธ์ง€ ๋ณต์ˆ˜์ธ์ง€์— ๋”ฐ๋ผ ๋™์‚ฌ๊ฐ€ ๋‹ฌ๋ผ์ง„๋‹ค. ์ด๋Ÿฐ ๋ฌธ์žฅ์€ ์•„๋ž˜์™€ ๊ฐ™์ด ๋ฌธ์žฅ์ด ๊ธธ์–ด์งˆ ์ˆ˜๋ก ์˜์กด์„ฑ์ด ๋” ๋†’์•„์งˆ ์ˆ˜ ์žˆ๋‹ค. The book that I got yesterday is on the table. The books read by the second=grade children are shelved in the lower rack. ๋”ฅ๋Ÿฌ๋‹์—์„œ์˜ ์‹œํ€€์Šค ๋ชจ๋ธ๋ง์€ ์ˆจ๊ฒจ์ง„ '์ƒํƒœ ์ •๋ณด(์€..

[NLP] Pytorch๋ฅผ ํ™œ์šฉํ•˜์—ฌ CBOW ์ž„๋ฒ ๋”ฉ ํ•™์Šตํ•˜๊ธฐ (2)๋ชจ๋ธ ํ›ˆ๋ จ

-- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์ฑ…์„ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. -- ์†Œ์Šค์ฝ”๋“œ๋Š” ์—ฌ๊ธฐ [NLP] Pytorch๋ฅผ ํ™œ์šฉํ•˜์—ฌ CBOW ์ž„๋ฒ ๋”ฉ ํ•™์Šตํ•˜๊ธฐ (1) -- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์ฑ…์„ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. -- ์†Œ์Šค์ฝ”๋“œ๋Š” ์—ฌ๊ธฐ 1. CBOW ๋ž€ Word2Vec CBOW ๋ชจ๋ธ ๋‹ค์ค‘ ๋ถ„๋ฅ˜ ์ž‘์—… ๋‹จ์–ด๋ฅผ ์Šค์บ”ํ•˜์—ฌ ๋‹จ์–ด์˜ ๋ฌธ๋งฅ Window๋ฅผ didu-story.tistory.com 1. ๋ชจ๋ธ ์ƒ์„ฑ embedding์ธต์„ ์‚ฌ์šฉํ•˜์—ฌ ๋ฌธ๋งฅ์˜ ๋‹จ์–ด๋ฅผ ๋‚˜ํƒ€๋‚ด๋Š” ์ธ๋ฑ์Šค๋ฅผ ๊ฐ ๋‹จ์–ด์— ๋Œ€ํ•œ ๋ฒกํ„ฐ๋กœ ๋งŒ๋“ ๋‹ค. ์ „๋ฐ˜์ ์ธ ๋ฌธ๋งฅ์„ ๊ฐ์ง€ํ•˜๋„๋ก ๋ฒกํ„ฐ๋ฅผ ๊ฒฐํ•ฉํ•œ๋‹ค. Linear ์ธต์—์„œ ๋ฌธ๋งฅ ๋ฒกํ„ฐ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์˜ˆ์ธก ๋ฒกํ„ฐ๋ฅผ ๊ณ„์‚ฐํ•œ๋‹ค. ์ด ์˜ˆ์ธก๋ฒกํ„ฐ๋Š” ์ „์ฒด ์–ดํœ˜ ์‚ฌ์ „์— ๋Œ€ํ•œ ํ™•๋ฅ  ..

[NLP] Pytorch๋ฅผ ํ™œ์šฉํ•˜์—ฌ CBOW ์ž„๋ฒ ๋”ฉ ํ•™์Šตํ•˜๊ธฐ (1)๋ฐ์ดํ„ฐ์…‹ ์ƒ์„ฑ

-- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์ฑ…์„ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. -- ์†Œ์Šค์ฝ”๋“œ๋Š” ์—ฌ๊ธฐ 1. CBOW ๋ž€ Word2Vec CBOW ๋ชจ๋ธ ๋‹ค์ค‘ ๋ถ„๋ฅ˜ ์ž‘์—… ๋‹จ์–ด๋ฅผ ์Šค์บ”ํ•˜์—ฌ ๋‹จ์–ด์˜ ๋ฌธ๋งฅ Window๋ฅผ ๋งŒ๋“  ํ›„ ๋ฌธ๋งฅ Window์—์„œ ์ค‘์•™์˜ ๋‹จ์–ด๋ฅผ ์ œ๊ฑฐํ•˜๊ณ  ๋ฌธ๋งฅ WIndow๋ฅผ ํ™œ์šฉํ•˜์—ฌ ๋ˆ„๋ฝ ๋‹จ์–ด๋ฅผ ์˜ˆ์ธกํ•˜๋Š” ๋ชจ๋ธ ๋‹จ์–ด๊ฐ€ ๋ˆ„๋ฝ๋œ ๋ฌธ์žฅ์—์„œ ๋ˆ„๋ฝ ๋‹จ์–ด๊ฐ€ ๋ฌด์—‡์ธ์ง€ ํŒŒ์•…ํ•˜๋Š” ์—ญํ• ์„ ์ˆ˜ํ–‰ 2. ํ™œ์šฉ ๋ฐ์ดํ„ฐ http://bit.ly/2T5iU8J ์—์„œ ๋ฉ”๋ฆฌ ์…ธ๋ฆฌ์˜ ์†Œ์„ค [ํ”„๋ž‘์ผ„์Šˆํƒ€์ธ]์˜ ๋””์ง€ํ„ธ ๋ฒ„์ „์„ ๋ฐ›์•„ ๊ตฌ์ถ•ํ•œ ํ…์ŠคํŠธ ๋ฐ์ดํ„ฐ์…‹ ํ™œ์šฉ ํŒŒ์ดํ† ์น˜์˜ Dataset ํด๋ž˜์Šค๋ฅผ ๋งŒ๋“ค๊ณ  ๋งˆ์ง€๋ง‰์— ๋ฐ์ดํ„ฐ๋ฅผ ํ›ˆ๋ จ, ๊ฒ€์ฆ, ํ…Œ์ŠคํŠธ ์„ธํŠธ๋กœ ๋ถ„ํ• ํ•˜์—ฌ ์‚ฌ์šฉ 3. ๋ฐ์ดํ„ฐ ์ „์ฒ˜๋ฆฌ 3.1 ํ…์ŠคํŠธ๋ฅผ ๊ฐœ๋ณ„ ๋ฌธ์žฅ์œผ๋กœ ๋ถ„ํ•  # Spl..

[NLP] ๋‹จ์–ด ์ž„๋ฒ ๋”ฉ (Embedding)

-- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์ฑ…์„ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. -- ์†Œ์Šค์ฝ”๋“œ๋Š” ์—ฌ๊ธฐ 1. ์ž„๋ฒ ๋”ฉ(Embedding) ์ด๋ž€? ์ด์‚ฐ ํƒ€์ž…์˜ Word ๋ฐ์ดํ„ฐ๋ฅผ ๋ฐ€์ง‘ ๋ฒกํ„ฐ ํ‘œํ˜„์œผ๋กœ ๋ฐ”๊ฟ”์ฃผ๋Š” ๋ฐฉ๋ฒ•์„ ๋‹จ์–ด ์ž„๋ฒ ๋”ฉ์ด๋ผ๊ณ  ํ•จ ์ด์‚ฐํƒ€์ž…? ๋ฌธ์ž, ๊ฐœ์ฒด๋ช…, ์–ดํœ˜์‚ฌ์ „ ๋“ฑ ์œ ํ•œํ•œ ์ง‘ํ•ฉ์—์„œ ์–ป์€ ๋ชจ๋“  ์ž…๋ ฅ ํŠน์„ฑ์„ ์ด์‚ฐํƒ€์ž…์ด๋ผ๊ณ  ํ•œ๋‹ค. ์ž์—ฐ์–ด๋ฅผ ๊ธฐ๊ณ„๊ฐ€ ์ดํ•ดํ•  ์ˆ˜ ์žˆ๋Š” ์ˆซ์žํ˜•ํƒœ์ธ ๋ฒกํ„ฐ๋กœ ๋ฐ”๊พผ ๊ฒฐ๊ณผ ํ˜น์€ ๊ทธ ์ผ๋ จ์˜ ๊ณผ์ • ์ „์ฒด๋ฅผ ์ž„๋ฒ ๋”ฉ์ด๋ผ๊ณ  ํ•จ ๋Œ€ํ‘œ์ ์œผ๋กœ ์›ํ•ซ์ธ์ฝ”๋”ฉ, TF-IDF ๋ฐฉ๋ฒ•์ด ์žˆ๋‹ค. 2. ์ž„๋ฒ ๋”ฉ ๊ธฐ๋ฒ•์˜ ํ๋ฆ„์™€ ์ข…๋ฅ˜ ์ ์ฐจ ํ†ต๊ณ„๊ธฐ๋ฐ˜์˜ ๊ธฐ๋ฒ•์—์„œ Neural Network ๊ธฐ๋ฒ•์œผ๋กœ ํ†ต๊ณ„๊ธฐ๋ฐ˜์˜ ๊ธฐ๋ฒ• ์ž ์žฌ์˜๋ฏธ๋ถ„์„ : ๋‹จ์–ด์˜ ์‚ฌ์šฉ ๋นˆ๋„ ๋“ฑ Corpus์˜ ํ†ต๊ณ„๋Ÿ‰ ์ •๋ณด๊ฐ€ ๋“ค์–ด์žˆ๋Š” ํ–‰๋ ฌ์— ํŠน์ด๊ฐ’ ๋ถ„ํ•ด ๋“ฑ ์ˆ˜ํ•™์ ..

[NLP] MLP๋กœ ์„ฑ์”จ ๋ถ„๋ฅ˜ํ•˜๊ธฐ (1) (feat.ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด์ฒ˜๋ฆฌ)

-- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์ฑ…์„ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. -- ์†Œ์Šค์ฝ”๋“œ ) https://github.com/rickiepark/nlp-with-pytorch GitHub - rickiepark/nlp-with-pytorch: (ํ•œ๋น›๋ฏธ๋””์–ด, 2021)์˜ ์†Œ์Šค ์ฝ”๋“œ๋ฅผ (ํ•œ๋น›๋ฏธ๋””์–ด, 2021)์˜ ์†Œ์Šค ์ฝ”๋“œ๋ฅผ ์œ„ํ•œ ์ €์žฅ์†Œ์ž…๋‹ˆ๋‹ค. - GitHub - rickiepark/nlp-with-pytorch: (ํ•œ๋น›๋ฏธ๋””์–ด, 2021)์˜ ์†Œ์Šค ์ฝ”๋“œ๋ฅผ ์œ„ํ•œ ์ €์žฅ github.com 1. ์„ฑ์”จ ๋ฐ์ดํ„ฐ์…‹ 18๊ฐœ ๊ตญ์ ์˜ ์„ฑ์”จ 10,000๊ฐœ๋ฅผ ๋ชจ์€ ์„ฑ์”จ ๋ฐ์ดํ„ฐ์…‹ ๋งค์šธ ๋ถˆ๊ท ํ˜•ํ•จ ์ตœ์ƒ์œ„ ํด๋ž˜์Šค 3๊ฐœ๊ฐ€ ๋ฐ์ดํ„ฐ์˜ 60%๋ฅผ ์ฐจ์ง€ 27%๊ฐ€ ์˜์–ด, 21%๊ฐ€ ๋Ÿฌ์‹œ์•„์–ด, 14%๊ฐ€ ์•„๋ž์–ด ๋‚˜๋จธ์ง€ 15๊ฐœ๊ตญ์˜ ๋นˆ๋„..

[NLP] ๋ ˆ์Šคํ† ๋ž‘ ๋ฆฌ๋ทฐ ๊ฐ์„ฑ ๋ถ„๋ฅ˜ํ•˜๊ธฐ (3) (feat.ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ) - ํ›ˆ๋ จ ๋ฐ ํ‰๊ฐ€, ์ถ”๋ก , ๋ถ„์„

-- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์ฑ…์„ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. -- ์†Œ์Šค์ฝ”๋“œ ) https://github.com/rickiepark/nlp-with-pytorch GitHub - rickiepark/nlp-with-pytorch: (ํ•œ๋น›๋ฏธ๋””์–ด, 2021)์˜ ์†Œ์Šค ์ฝ”๋“œ๋ฅผ (ํ•œ๋น›๋ฏธ๋””์–ด, 2021)์˜ ์†Œ์Šค ์ฝ”๋“œ๋ฅผ ์œ„ํ•œ ์ €์žฅ์†Œ์ž…๋‹ˆ๋‹ค. - GitHub - rickiepark/nlp-with-pytorch: (ํ•œ๋น›๋ฏธ๋””์–ด, 2021)์˜ ์†Œ์Šค ์ฝ”๋“œ๋ฅผ ์œ„ํ•œ ์ €์žฅ github.com https://didu-story.tistory.com/83?category=952805 [NLP] ๋ ˆ์Šคํ† ๋ž‘ ๋ฆฌ๋ทฐ ๊ฐ์„ฑ ๋ถ„๋ฅ˜ํ•˜๊ธฐ (1) (feat.ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ) -- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ..

[NLP] ๋ ˆ์Šคํ† ๋ž‘ ๋ฆฌ๋ทฐ ๊ฐ์„ฑ ๋ถ„๋ฅ˜ํ•˜๊ธฐ (2) (feat.ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ) - ๋ฐ์ดํ„ฐ ์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ ํด๋ž˜์Šค ์‚ดํŽด๋ณด๊ธฐ

-- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์ฑ…์„ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. -- ์†Œ์Šค์ฝ”๋“œ ) https://github.com/rickiepark/nlp-with-pytorch rickiepark/nlp-with-pytorch (ํ•œ๋น›๋ฏธ๋””์–ด, 2021)์˜ ์†Œ์Šค ์ฝ”๋“œ๋ฅผ ์œ„ํ•œ ์ €์žฅ์†Œ์ž…๋‹ˆ๋‹ค. - rickiepark/nlp-with-pytorch github.com โ–ถ ๋ ˆ์Šคํ† ๋ž‘ ๋ฆฌ๋ทฐ ๊ฐ์„ฑ ๋ถ„๋ฅ˜ํ•˜๊ธฐ ์•„๋ž˜ ํฌ์ŠคํŒ…์—์„œ ์–ด๋–ป๊ฒŒ ์ „์ฒ˜๋ฆฌ๋œ ๋ฐ์ดํ„ฐ๋ฅผ ์‚ฌ์šฉํ•˜๊ฒŒ ๋๋Š”์ง€ ๋ฏธ๋ฆฌ ํ•™์Šตํ•˜๋ฉด ์ข‹์„ ๊ฒƒ์ด๋‹ค. ํ•˜์ง€๋งŒ ํ•ด๋‹น ์ฝ”๋“œ์—์„œ๋Š” '์ „์ฒ˜๋ฆฌ ๊ณผ์ •'์ด ์ƒ๋žต๋œ '์ „์ฒ˜๋ฆฌ ๋˜์–ด์ง„ ๋ฐ์ดํ„ฐ'๋ฅผ ํ™œ์šฉํ•˜๊ณ  ์žˆ๋‹ค๋Š” ๊ฒƒ๋งŒ ์•Œ์•„๋‘์ž. https://didu-story.tistory.com/83 [NLP] ๋ ˆ์Šคํ† ๋ž‘ ๋ฆฌ๋ทฐ ๊ฐ์„ฑ ๋ถ„๋ฅ˜ํ•˜๊ธฐ (1) ..

[NLP] ๋ ˆ์Šคํ† ๋ž‘ ๋ฆฌ๋ทฐ ๊ฐ์„ฑ ๋ถ„๋ฅ˜ํ•˜๊ธฐ (1) (feat.ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ)

-- ๋ณธ ํฌ์ŠคํŒ…์€ ํŒŒ์ดํ† ์น˜๋กœ ๋ฐฐ์šฐ๋Š” ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ (ํ•œ๋น›๋ฏธ๋””์–ด) ์ฑ…์„ ์ฐธ๊ณ ํ•ด์„œ ์ž‘์„ฑ๋œ ๊ธ€์ž…๋‹ˆ๋‹ค. -- ์†Œ์Šค์ฝ”๋“œ ) https://github.com/rickiepark/nlp-with-pytorch rickiepark/nlp-with-pytorch (ํ•œ๋น›๋ฏธ๋””์–ด, 2021)์˜ ์†Œ์Šค ์ฝ”๋“œ๋ฅผ ์œ„ํ•œ ์ €์žฅ์†Œ์ž…๋‹ˆ๋‹ค. - rickiepark/nlp-with-pytorch github.com โ–ถ ๋ ˆ์Šคํ† ๋ž‘ ๋ฆฌ๋ทฐ ๊ฐ์„ฑ ๋ถ„๋ฅ˜ํ•˜๊ธฐ ์ด์ „ ํฌ์ŠคํŒ…์—์„œ ๋ฐฐ์šด ํผ์…‰ํŠธ๋ก ๊ณผ ์ง€๋„ ํ•™์Šต ํ›ˆ๋ จ ๋ฐฉ๋ฒ•์„ ์‚ฌ์šฉํ•˜์—ฌ ์˜ํ”„(Yelp)์˜ ๋ ˆ์Šคํ† ๋ž‘ ๋ฆฌ๋ทฐ๊ฐ€ ๊ธ์ •์ ์ธ์ง€๋ถ€์ •์ ์ธ์ง€ ๋ถ„๋ฅ˜ํ•˜๋Š” ์ž‘์—…์„ ์ง„ํ–‰ํ•ด ๋ณด์ž. ํ•ด๋‹น ํ”„๋กœ์ ํŠธ๋Š” ๋ฆฌ๋ทฐ์™€ ๊ฐ์„ฑ๋ ˆ์ด๋ธ”(๊ธ์ •or๋ถ€์ •)์ด ์Œ์„ ์ด๋ฃจ๋Š” ์˜ํ”„ ๋ฐ์ดํ„ฐ์…‹์„ ์‚ฌ์šฉํ•œ๋‹ค. ๋ฐ์ดํ„ฐ๋ฅผ ์ •์ œํ•˜๊ณ , ํ›ˆ๋ จ, ๊ฒ€์ฆ, ํ…Œ์ŠคํŠธ์„ธํŠธ๋กœ ๋‚˜๋ˆ„๋Š” ์ „์ฒ˜๋ฆฌ ๋‹จ..

๋ฐ˜์‘ํ˜•