Welcome to Coqui-AI TTS Discussions!

[erogol]

🐸 COQUI Discussions

👋 Welcome!

We’re using Discussions as a place to connect with other members of our community. We hope that you ask questions you’re wondering about.

• Share ideas.
• Engage with other community members.
• Welcome others and are open-minded. Remember that this is a community we
  build together 💪.

Feel free to comment below with an introduction of yourself and tell us about what you do with this community.

[erogol]

ignore (move the thread up again)

[hamxa678]

Can i have hindi accent voice cloning here?

[Fulanito0]

@erogol
greetings,
why isn't there a tutorial to run google colab in detail ?
can you make a video tutorial and share it please ?
(https://colab.research.google.com/drive/1NC4eQJFvVEqD8L4Rd8CVK25_Z-ypaBHD?usp=sharing)

[thorstenMueller]

What would you expect from a video about this notebook? Just executing it, the way it is or modifying it in some way (other dataset, other model/vocoder, ...).

[Fulanito0]

@thorstenMueller

Days ago I was on your youtube channel looking for a tutorial since I saw, that you are the only one talking about coqui tts I started watching your videos, but I did not find a tutorial running google notebook, and I wonder, what is the reason why you have not made the tutorial or there are more people talking about coqui tts ?

[Fulanito0]

Good morning, For now I just want to run google colab. You see, I'm interested because I saw a voice cloning project that a guy did his college thesis on. I was very interested to see how amazing it was to clone the voice and be able to make scripts to create content or big projects from a few seconds of my voice supplied. The problem with that cloning project is that it didn't work very well and the guy can't maintain it because he is always working. What the guy did was to recommend your clone project, which is better structured and better maintained. The thing is that I was very surprised with what artificial intelligence can do and I decided to learn about it. Now I'm learning English and looking for articles about artificial intelligence, while I study other interesting projects. I want to know how to run this colab to see what it is capable of and maybe be able to do things I couldn't do with the other github project. That's why I ask you to please make a tutorial to test the colab and study it deeper. I only ask that until I can handle English much better and learn how to solve the problems I will encounter when I try to run another colab. El El sáb, abr. 16, 2022 a la(s) 7:29 a.m., Thorsten Müller < ***@***.***> escribió:

…

What would you expect from a video about this notebook? Just executing it, the way it is or modifying it in some way (other dataset, other model/vocoder, ...). — Reply to this email directly, view it on GitHub <#8 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/APILD2NONCFBQEIAYLCV2R3VFKP7ZANCNFSM4YTIW5MQ> . You are receiving this because you commented.Message ID: ***@***.***>

[Fulanito0]

I can't install almost anything on my laptop because it is old and I can only run the colab.

[p0p4k]

This video might be helpful.

[Fulanito0]

@p0p4k

It's great everything, but can you make a video with the notebook that is in this link ?

https://colab.research.google.com/drive/1NC4eQJFvVEqD8L4Rd8CVK25_Z-ypaBHD?usp=sharing

[p0p4k]

@Fulanito0 the notebook is using outdated repo. Please read the documentation and try to mimic that in a new colab notebook. It will help you understand the project better.
Also, for voice cloning this is a 🐸-TTS model with a working colab notebook.

[xianxiaoyuehub]

What would be appropriate for the loss of loss_align and total loss about the fast_pitch model trained on vctk dataset

[BasToTheMax]

What is the fastest way to train my own TTS model?

[TaterTotX]

I've been trying to download TTS on my M1 Mac for three days and finally succeeded. However, I keep getting an error message saying '[!] Model file not found in the output path.' Could someone please help me? Thank you very much.

from TTS.api import TTS

List available 🐸TTS models and choose the first one

model_name = TTS.list_models()[0]

Init TTS

tts = TTS(model_name)

Run TTS

❗ Since this model is multi-speaker and multi-lingual, we must set the target speaker and the language

Text to speech with a numpy output

wav = tts.tts("This is a test! This is also a test!!", speaker=tts.speakers[0], language=tts.languages[0])

Text to speech to a file

tts.tts_to_file(text="Hello world!", speaker=tts.speakers[0], language=tts.languages[0], file_path="output.wav")

raise ValueError(" [!] Model file not found in the output path")
ValueError: [!] Model file not found in the output path

tts_models/multilingual/multi-dataset/your_tts is already downloaded.

[Ruebezahl11]

Hi, I am trying to use coqui to speak german texts. There is a problem with numbers. Suppose the phrase is "findet am 28. August statt". tts will split the input into what it thinks are sentences, and detect a break sentence break at 28. Is there a way to mask the period? Replacing t with 28ten or something like that is not an option, because I would need to understand the entire phrase in order to know the right genus

[p0p4k]

see the code and comment out the pybsd segmenting stuff.

[Ruebezahl11]

Hi, thanks for pointing at the segmenting stuff. It turns out that the script is hardcoded for english; I justhadto change it to german.
Unfortunately the number with dot is still not pronounced as an ordinal number
Aside question: can tts speak phonetic (IPA) codes?

[p0p4k]

If the model was trained on IPA, it can speak that; else not.

[Ruebezahl11]

@thorstenMueller
Hi, can your voices speak phonetic?

[thorstenMueller]

Sorry for late response. You mean input phonemes instead of actual text string?

[Ruebezahl11]

Hi Thorsten, something like that. In the meantime I have seen your video about adding to espeak dicts, but I originally had the idea to create a list of proper names and their IPA pronounciations.
BTW: I am still trying to set up coqui tts with your voices. The vits works fine, but in tacotron all umlaut and ß are missing. Do you have an idea what could be wrong?
One more question: is there a processing step that could be made to read "Am 3. Oktober" or "der 4. Juli" correctly

[thorstenMueller]

Hi @Ruebezahl11 , are you using Windows? I encountered problems with german Umlauts on Windows using eSpeak-ng. These were gone after using eSpeak, the classical without -ng. Could you try this?
I have written some tips on this page under my Windows tutorial video.
https://www.thorsten-voice.de/einfach-loslegen/

And about the date problem, the model will consider a dot as end of sentence, but you can try this as text cleaner before running TTS. It will create a "am dritten Oktober".
https://github.com/repodiac/german_transliterate

[JahangirMoro]

I want to train my tts on new language( urdu ) can you plese help how can i do it with couqi tts ...

[Mushtaq25]

Create the dataset like ljspeech format (given on the docs) and use phonemes= True, set phonemes_language="", inside config.json, Rest mentioned in the docs( https://docs.coqui.ai/en/latest/tutorial_for_nervous_beginners.html)

[Mushtaq25]

Hi I am little bit confused about the train.py file( https://docs.coqui.ai/en/latest/tutorial_for_nervous_beginners.html ) while training, it is also generating audio file i can check in the wandb, so my question is it is not neccesary to train the vocoder.py, or it is must to train both glow-tss and vocoder for inference.

[Alekh-sinha]

Can it generate speech with accent? I am trying to generate text in SRK voice (Indian film star). It is picking up the voice but not the accent. Can anybody help me in this?

[Tpyter]

Traceback (most recent call last):
File "D:\COTTS\myenvtts\lib\site-packages\urllib3\response.py", line 748, in _error_catcher
yield
File "D:\COTTS\myenvtts\lib\site-packages\urllib3\response.py", line 873, in _raw_read
data = self._fp_read(amt, read1=read1) if not fp_closed else b""
File "D:\COTTS\myenvtts\lib\site-packages\urllib3\response.py", line 856, in _fp_read
return self._fp.read(amt) if amt is not None else self._fp.read()
File "D:\python\lib\http\client.py", line 463, in read
n = self.readinto(b)
File "D:\python\lib\http\client.py", line 507, in readinto
n = self.fp.readinto(b)
File "D:\python\lib\socket.py", line 704, in readinto
return self._sock.recv_into(b)
File "D:\python\lib\ssl.py", line 1241, in recv_into
return self.read(nbytes, buffer)
File "D:\python\lib\ssl.py", line 1099, in read
return self._sslobj.read(len, buffer)
socket.timeout: The read operation timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "D:\COTTS\myenvtts\lib\site-packages\requests\models.py", line 820, in generate
yield from self.raw.stream(chunk_size, decode_content=True)
File "D:\COTTS\myenvtts\lib\site-packages\urllib3\response.py", line 1060, in stream
data = self.read(amt=amt, decode_content=decode_content)
File "D:\COTTS\myenvtts\lib\site-packages\urllib3\response.py", line 949, in read
data = self._raw_read(amt)
File "D:\COTTS\myenvtts\lib\site-packages\urllib3\response.py", line 902, in _raw_read
self._fp.close()
File "D:\python\lib\contextlib.py", line 137, in exit
self.gen.throw(typ, value, traceback)
File "D:\COTTS\myenvtts\lib\site-packages\urllib3\response.py", line 753, in _error_catcher
raise ReadTimeoutError(self._pool, None, "Read timed out.") from e # type: ignore[arg-type]
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='user-images.githubusercontent.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "D:\COTTS\TTS\recipes\ljspeech\glow_tts\train_glowtts.py", line 79, in
trainer = Trainer(
File "D:\COTTS\myenvtts\lib\site-packages\trainer\trainer.py", line 583, in init
ping_training_run()
File "D:\COTTS\myenvtts\lib\site-packages\trainer\analytics.py", line 12, in ping_training_run
_ = requests.get(URL, timeout=5)
File "D:\COTTS\myenvtts\lib\site-packages\requests\api.py", line 73, in get
return request("get", url, params=params, **kwargs)
File "D:\COTTS\myenvtts\lib\site-packages\requests\api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
File "D:\COTTS\myenvtts\lib\site-packages\requests\sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "D:\COTTS\myenvtts\lib\site-packages\requests\sessions.py", line 724, in send
history = [resp for resp in gen]
File "D:\COTTS\myenvtts\lib\site-packages\requests\sessions.py", line 724, in
history = [resp for resp in gen]
File "D:\COTTS\myenvtts\lib\site-packages\requests\sessions.py", line 265, in resolve_redirects
resp = self.send(
File "D:\COTTS\myenvtts\lib\site-packages\requests\sessions.py", line 746, in send
r.content
File "D:\COTTS\myenvtts\lib\site-packages\requests\models.py", line 902, in content
self._content = b"".join(self.iter_content(CONTENT_CHUNK_SIZE)) or b""
File "D:\COTTS\myenvtts\lib\site-packages\requests\models.py", line 826, in generate
raise ConnectionError(e)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='user-images.githubusercontent.com', port=443): Read timed out.
How can we solve this kind of problem?

[eginhard]

This is probably just a temporary connection error. However, feel free to use our fork (available via pip install coqui-tts), which removed the telemetry in the Trainer and should avoid this in the future.

[Tpyter]

Hello, I would like to run a project on Windows. Could you provide me with specific training instructions? Also, I have a GPU and I hope to run the project on the GPU on Windows.

[Tpyter]

D:\AAAAA\myenv\Scripts\python.exe D:/AAAAA/coqui-ai-TTS/recipes/ljspeech/glow_tts/train_glowtts.py

Training Environment:
| > Backend: Torch
| > Mixed precision: True
| > Precision: fp16
| > Num. of CPUs: 12
| > Num. of Torch Threads: 1
| > Torch seed: 54321
| > Torch CUDNN: True
| > Torch CUDNN deterministic: False
| > Torch CUDNN benchmark: False
| > Torch TF32 MatMul: False
Start Tensorboard: tensorboard --logdir=D:\AAAAA\coqui-ai-TTS\recipes\ljspeech\glow_tts\run-August-16-2024_06+12PM-204588f7

Model has 28610257 parameters

EPOCH: 0/1000
--> D:\AAAAA\coqui-ai-TTS\recipes\ljspeech\glow_tts\run-August-16-2024_06+12PM-204588f7
0%| | 2/12969 [00:00<45:33, 4.74it/s] ɪnstɛd əv weɪtɪŋ ðɛɹ, ɔzwɔld əpɛɹəntli wɛnt æz fɑɹ əweɪ æz hi kʊd ænd bɔɹdɪd ðə fɚst oʊk klɪf bʌs wɪt͡ʃ keɪm əlɔŋ
Character '͡' not found in the vocabulary. Discarding it.
16%|█▌ | 2054/12969 [01:53<11:13, 16.21it/s]ɪntu ðə “kɹeɪtɚ” dʌɡ aʊt ɪn ðə mɪdəl, pɔɹ ðə spʌnd͡ʒ, wɔɹm wɔtɚ, ðə məlæsɪz, ænd soʊdə dɪzɑlvd ɪn hɑt wɔtɚ.
Character '“' not found in the vocabulary. Discarding it.
ɪntu ðə “kɹeɪtɚ” dʌɡ aʊt ɪn ðə mɪdəl, pɔɹ ðə spʌnd͡ʒ, wɔɹm wɔtɚ, ðə məlæsɪz, ænd soʊdə dɪzɑlvd ɪn hɑt wɔtɚ.
Character '”' not found in the vocabulary. Discarding it.
100%|██████████| 12969/12969 [08:57<00:00, 24.12it/s]

TRAINING (2024-08-16 18:21:51)
Training Environment:
| > Backend: Torch
| > Mixed precision: True
| > Precision: fp16
| > Num. of CPUs: 12
| > Num. of Torch Threads: 1
| > Torch seed: 54321
| > Torch CUDNN: True
| > Torch CUDNN deterministic: False
| > Torch CUDNN benchmark: False
| > Torch TF32 MatMul: False
Start Tensorboard: tensorboard --logdir=D:\AAAAA\coqui-ai-TTS\recipes\ljspeech\glow_tts\run-August-16-2024_06+21PM-204588f7

Model has 28610257 parameters

EPOCH: 0/1000
--> D:\AAAAA\coqui-ai-TTS\recipes\ljspeech\glow_tts\run-August-16-2024_06+21PM-204588f7

TRAINING (2024-08-16 18:22:04)
Traceback (most recent call last):
File "D:\AAAAA\myenv\lib\site-packages\trainer\trainer.py", line 1605, in fit
self._fit()
File "D:\AAAAA\myenv\lib\site-packages\trainer\trainer.py", line 1557, in _fit
self.train_epoch()
File "D:\AAAAA\myenv\lib\site-packages\trainer\trainer.py", line 1272, in train_epoch
for cur_step, batch in enumerate(self.train_loader):
File "D:\AAAAA\myenv\lib\site-packages\torch\utils\data\dataloader.py", line 440, in iter
return self._get_iterator()
File "D:\AAAAA\myenv\lib\site-packages\torch\utils\data\dataloader.py", line 388, in _get_iterator
return _MultiProcessingDataLoaderIter(self)
File "D:\AAAAA\myenv\lib\site-packages\torch\utils\data\dataloader.py", line 1038, in init
w.start()
File "D:\python\lib\multiprocessing\process.py", line 121, in start
self._popen = self._Popen(self)
File "D:\python\lib\multiprocessing\context.py", line 224, in _Popen
return _default_context.get_context().Process._Popen(process_obj)
File "D:\python\lib\multiprocessing\context.py", line 327, in _Popen
return Popen(process_obj)
File "D:\python\lib\multiprocessing\popen_spawn_win32.py", line 45, in init
prep_data = spawn.get_preparation_data(process_obj._name)
File "D:\python\lib\multiprocessing\spawn.py", line 154, in get_preparation_data
_check_not_importing_main()
File "D:\python\lib\multiprocessing\spawn.py", line 134, in _check_not_importing_main
raise RuntimeError('''
RuntimeError:
An attempt has been made to start a new process before the
current process has finished its bootstrapping phase.

    This probably means that you are not using fork to start your
    child processes and you have forgotten to use the proper idiom
    in the main module:

        if __name__ == '__main__':
            freeze_support()
            ...

    The "freeze_support()" line can be omitted if the program
    is not going to be frozen to produce an executable.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "", line 1, in
File "D:\python\lib\multiprocessing\spawn.py", line 116, in spawn_main
exitcode = _main(fd, parent_sentinel)
File "D:\python\lib\multiprocessing\spawn.py", line 125, in _main
prepare(preparation_data)
File "D:\python\lib\multiprocessing\spawn.py", line 236, in prepare
_fixup_main_from_path(data['init_main_from_path'])
File "D:\python\lib\multiprocessing\spawn.py", line 287, in _fixup_main_from_path
main_content = runpy.run_path(main_path,
File "D:\python\lib\runpy.py", line 268, in run_path
return _run_module_code(code, init_globals, run_name,
File "D:\python\lib\runpy.py", line 97, in _run_module_code
_run_code(code, mod_globals, init_globals,
File "D:\python\lib\runpy.py", line 87, in _run_code
exec(code, run_globals)
File "D:\AAAAA\coqui-ai-TTS\recipes\ljspeech\glow_tts\train_glowtts.py", line 84, in
trainer.fit()
File "D:\AAAAA\myenv\lib\site-packages\trainer\trainer.py", line 1632, in fit
remove_experiment_folder(self.output_path)
File "D:\AAAAA\myenv\lib\site-packages\trainer\generic_utils.py", line 78, in remove_experiment_folder
fs.rm(experiment_path, recursive=True)
File "D:\AAAAA\myenv\lib\site-packages\fsspec\implementations\local.py", line 179, in rm
shutil.rmtree(p)
File "D:\python\lib\shutil.py", line 757, in rmtree
return _rmtree_unsafe(path, onerror)
File "D:\python\lib\shutil.py", line 627, in _rmtree_unsafe
onerror(os.unlink, fullname, sys.exc_info())
File "D:\python\lib\shutil.py", line 625, in _rmtree_unsafe
os.unlink(fullname)
PermissionError: [WinError 32] 另一个程序正在使用此文件，进程无法访问。: 'D:/AAAAA/coqui-ai-TTS/recipes/ljspeech/glow_tts/run-August-16-2024_06+21PM-204588f7\trainer_0_log.txt'
Hello, I'm encountering an error when trying to train the train_glowtts.py file using the LJ dataset. Could you please help me resolve this issue?