๊ฒฐ๋ก ๋ถ€ํ„ฐ ๋งํ•˜์ž๋ฉด, coqui tts - xtts๋Š” ์ง€๋‚œ 2024๋…„ 1์›” 3์ผ๋ถ€๋กœ shutdown ๋˜์—ˆ๋‹ค.
https://twitter.com/_josh_meyer_/status/1742522906041635166
 

X์˜ Josh Meyer๋‹˜(@_josh_meyer_)

Coqui is shutting down. It's sad news to start the new year, but I want to take a minute to recognize everything we accomplished and thank the great people who made it possible. First things first: the Team I'm honored to have worked with such brilliant, d

twitter.com

 

* ๋™๊ธฐ

๋‚ด๊ฐ€ ์›ํ•˜๋Š” ๋ชฉ์†Œ๋ฆฌ๋กœ ๋ฌด์ œํ•œ ์ƒ์„ฑ๊ฐ€๋Šฅํ•œ ๋ฌด๋ฃŒ tts๊ฐ€ ํ•„์š”ํ•˜๋‹ค.

 

* ๊ณผ์ •

1. ์—ฌ๋Ÿฌ ํ…Œ์ŠคํŠธ ๊ฒฐ๊ณผ, openVoice v2์™€ coqui-tts(xtts) v2๊ฐ€ ๊ฐ€์žฅ ํ›Œ๋ฅญํ–ˆ๋‹ค.

2. ์ด ๊ณผ์ •์—์„œ ์ผ๋ž˜๋ธ๋žฉ์Šค https://elevenlabs.io/ ์˜ ๋†€๋ผ์šด ๋ฐœ์ „ ์†๋„์— ์˜คํ”ˆ์†Œ์Šค๋“ค์ด ๋” ์ด์ƒ ๋”ฐ๋ผ๊ฐ€์ง€ ๋ชปํ•จ์„ ์•Œ๊ฒŒ ๋˜์—ˆ๋‹ค.

3. ์‹ค์ œ๋กœ ๋Œ๋ ค๋ณด๋‹ˆ ๊ทธ ์ˆ˜์ค€์ฐจ์ด๊ฐ€ ์ปธ๋‹ค. ์ด์ œ ์ผ๋ž˜๋ธ๋žฉ์Šค์˜ ๊ฒฝ์Ÿ์ƒ๋Œ€๋Š” ์˜คํ”ˆ์†Œ์Šค ์ง„ํ˜•์ด ์•„๋‹ˆ๋ผ openAI๋กœ ๋ณด์ธ๋‹ค. ์‹ฌ์ง€์–ด xtts๋Š” ์ด๋ฏธ 1์›”์ดˆ์— ๋ฌธ์„ ๋‹ซ์•˜๋‹ค.

4. chatGPT 4o์™€ ์ผ๋ž˜๋ธ๋žฉ์Šค์˜ ํ’ˆ์งˆ์„ ๋ณด๋ฉด ์ด์ œ ์˜คํ”ˆ์†Œ์Šค ์ง„ํ˜•์— ๊ทธ๊ฐ„์˜ ๋…ธ๋ ฅ๋“ค์€ ๋ฌผ๊ฑฐํ’ˆ์ด ๋ ๊ฑฐ ๊ฐ™์€ ๋Š๋‚Œ์ด ๋“ ๋‹ค. stable diffusion์˜ ๊นƒํ—™๋งŒ ๋ณด์•„๋„ ๋งˆ์ง€๋ง‰ commit์ด 2๋…„์ „์ด๋‹ค. ์ด์ œ ์ƒํƒœ๊ณ„๋Š” stable diffusion์ด ์•„๋‹ˆ๋ผ stable diffusion webUI๋ฅผ ์ค‘์‹ฌ์œผ๋กœ ๋Œ์•„๊ฐ„๋‹ค. ํ•˜์ง€๋งŒ stable diffusion 3๋Š” 3๋‹ฌ์ „์— ์ด๋ฏธ ๋‚˜์™”๋‹ค. ๊ณต๊ฐœ๊ฐ€ ๋˜์ง€ ์•Š์•˜์„ ๋ฟ์ด๋‹ค.

5. ์ด์ œ ๋‚จ์€๊ฑด meta ๋ฟ์œผ๋กœ ๋ณด์ธ๋‹ค. (์ œ๋ฐœ grok์ด ํž˜์„ ๋‚ด์ฃผ๊ธธ)

6. ๊ทธ๋Ÿผ์—๋„ '๋ฌด์ œํ•œ'๊ณผ '๋ฌด๋ฃŒ'๋ผ๋Š” ์žฅ์ ์€ '์‚ฌ์šฉ์˜ ๋ถˆํŽธํ•จ'๊ณผ 'ํ’ˆ์งˆ์˜ ๋–จ์–ด์ง'์ด๋ผ๋Š” ๊ฐ•๋ ฅํ•œ ๋‹จ์ ์—๋„ ์–ด๋Š ๋ถ€๋ถ„ ๋Œ€ํ•ญ๊ฐ€๋Šฅํ•œ ๋Œ€๊ฒฐ์ธ์ž๋กœ ๋ณด์˜€๋‹ค.

 

* xtts ์‚ฌ์šฉํ›„ ๋Š๋‚€ ์ 

์žฅ์  - ๊ฝค ์ž์—ฐ์Šค๋Ÿฌ์šด tts๊ฐ€ ๊ฐ€๋Šฅํ•˜๋‹ค.

๋‹จ์  - ko๋ชจ๋ธ์˜ ๊ฒฝ์šฐ ์˜์–ด๋ฅผ ์ „ํ˜€ ์ฝ์ง€ ๋ชปํ•œ๋‹ค. g2pk2 ๋ชจ๋“ˆ์„ ์ด์šฉํ•ด๋„ ๋งŽ์ด ๋ถ€์กฑํ•˜๋‹ค. ์˜์–ด๋ถ€๋ถ„์—์„œ ๋ฐœ์Œ์ด ์™„์ „ ๋ญ‰๊ฐœ์ง€๋ฉฐ ๊ธฐ๊ณ„์Œ์ด ๋‚˜์˜จ๋‹ค. ์ด๊ฒƒ์ด ๋„ˆ๋ฌด๋‚˜ ์น˜๋ช…์ ์ด๋‹ค. en๋ชจ๋ธ์€ ์˜ค์ง ์˜์–ด๋งŒ ์ฝ์„ ์ˆ˜ ์žˆ๊ณ  ko๋ชจ๋ธ์€ ์˜ค์ง ํ•œ๊ตญ์–ด๋งŒ ์ฝ์„ ์ˆ˜ ์žˆ๋‹ค.

 

 

 

* ์ตœ์ข… ๊ฒฐ๋ก 

๋‹ค์‹œ open voice v2๋กœ ๋Œ์•„์™”๋‹ค. ์ž์—ฐ์Šค๋Ÿฝ์ง€๋Š” ๋ชปํ•ด๋„ ์•ˆ์ •์ ์œผ๋กœ ๊ธด ๊ธ€์„ ์ฝ์–ด์ค€๋‹ค. ์˜์–ด์™€ ํ•œ๊ธ€์ด ์„ž์—ฌ ์žˆ์–ด๋„ ๋ฌธ์ œ์—†๋‹ค. xtts์™€ ๋‹ฌ๋ฆฌ ๊ณ„์† ์—…๋ฐ์ดํŠธ ๋  ๊ฒƒ ๊ฐ™๋‹ค. ์„ค์น˜ ํ™˜๊ฒฝ ์กฐ์„ฑ์ด ์–ด๋ ต์ง€๋งŒ ์‹คํ–‰๋งŒ ๋œ๋‹ค๋ฉด ์†๋„๊ฐ€ ๋น ๋ฅด๋‹ค. ๊ทธ๋ž˜์„œ, open voice v2๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ์Œ์„ฑ์˜ ํ’ˆ์งˆ์„ ๋†’์ด๋Š” (rvc๋กœ ํ›„์ฒ˜๋ฆฌํ•˜๋Š” ๋“ฑ์˜) ๋ฐฉํ–ฅ์„ ๊ณ ๋ฏผํ•ด๋ณด๋ คํ•œ๋‹ค.

+ Recent posts