口播神器,基于Edge,微软TTS(text-to-speech)文字转语音免费开源库edge-tts实践(Python3.10)

神器,基于,edge,微软,tts,text,to,speech,文字,语音,免费,开源,实践,python3 · 浏览次数 : 6119

小编点评

**代码摘要:** 该代码展示了使用 Python 和 edge-tts 库在 Python 脚本中生成语音并添加字幕的功能。 **主要代码功能:** 1. 使用 edge-tts 库与微软 Azure 语音合成库的 API 进行语音合成。 2. 支持调整语音速率和音量。 3. 使用 VoicesManager 库从语音管理库中选择语言。 4. 通过异步模式生成音频并写入 mp3 文件。 5. 使用 edge_tts.SubMaker 生成字幕并写入 vtt 文件。 6. 可以通过 ffmpeg 将字幕文件与视频文件合并。 **使用方法:** 1. 安装必要的库:edge-tts、VoicesManager 和 ffmpeg。 2. 获取语音识别模型的 ID。 3. 创建一个 Python 脚本并运行。 4. 设置语音识别模型的 ID。 5. 使用 script 变量定义要生成的语言。 6. 运行脚本。 **注意:** * 由于 edge-tts 库是开源的,但它可能需要一些技术技能才能编译和运行。 * 该代码需要在运行时安装 Microsoft Azure 语音合成库。 * 可以通过调整 `VOICE` 和 `TEXT` 变量来调整语音识别参数。

正文

不能否认,微软Azure在TTS(text-to-speech文字转语音)这个人工智能细分领域的影响力是统治级的,一如ChatGPT在NLP领域的随心所欲,予取予求。君不见几乎所有的抖音营销号口播均采用微软的语音合成技术,其影响力由此可见一斑,仅有的白璧微瑕之处就是价格略高,虽然国内也可以使用科大讯飞语音合成进行平替,但我们只想要最好的那一个,本次我们使用免费的开源库edge-tts来实现文本转语音操作,薅微软edge的羊毛。

TTS文本转语音基础使用方式

首先安装edge-tts库:

pip3 install edge-tts

安装成功后,直接在终端运行edge-tts命令:

edge-tts

显示帮助菜单即代表安装成功:

➜  Downloads edge-tts  
usage: edge-tts [-h] [-t TEXT] [-f FILE] [-v VOICE] [-l] [--rate RATE] [--volume VOLUME] [-O OVERLAPPING]  
                [--write-media WRITE_MEDIA] [--write-subtitles WRITE_SUBTITLES] [--proxy PROXY]

随后输入命令:

edge-tts --list-voices

该命令可以将Edge浏览器中,内置的语言角色列表列出来:

Name: af-ZA-AdriNeural  
Gender: Female  
  
Name: af-ZA-WillemNeural  
Gender: Male  
  
Name: am-ET-AmehaNeural  
Gender: Male  
  
Name: am-ET-MekdesNeural  
Gender: Female  
  
Name: ar-AE-FatimaNeural  
Gender: Female  
  
Name: ar-AE-HamdanNeural  
Gender: Male  
  
Name: ar-BH-AliNeural  
Gender: Male  
  
Name: ar-BH-LailaNeural  
Gender: Female  
  
Name: ar-DZ-AminaNeural  
Gender: Female  
  
Name: ar-DZ-IsmaelNeural  
Gender: Male  
  
Name: ar-EG-SalmaNeural  
Gender: Female  
  
Name: ar-EG-ShakirNeural  
Gender: Male  
  
Name: ar-IQ-BasselNeural  
Gender: Male  
  
Name: ar-IQ-RanaNeural  
Gender: Female  
  
Name: ar-JO-SanaNeural  
Gender: Female  
  
Name: ar-JO-TaimNeural  
Gender: Male  
  
Name: ar-KW-FahedNeural  
Gender: Male  
  
Name: ar-KW-NouraNeural  
Gender: Female  
  
Name: ar-LB-LaylaNeural  
Gender: Female  
  
Name: ar-LB-RamiNeural  
Gender: Male  
  
Name: ar-LY-ImanNeural  
Gender: Female  
  
Name: ar-LY-OmarNeural  
Gender: Male  
  
Name: ar-MA-JamalNeural  
Gender: Male  
  
Name: ar-MA-MounaNeural  
Gender: Female  
  
Name: ar-OM-AbdullahNeural  
Gender: Male  
  
Name: ar-OM-AyshaNeural  
Gender: Female  
  
Name: ar-QA-AmalNeural  
Gender: Female  
  
Name: ar-QA-MoazNeural  
Gender: Male  
  
Name: ar-SA-HamedNeural  
Gender: Male  
  
Name: ar-SA-ZariyahNeural  
Gender: Female  
  
Name: ar-SY-AmanyNeural  
Gender: Female  
  
Name: ar-SY-LaithNeural  
Gender: Male  
  
Name: ar-TN-HediNeural  
Gender: Male  
  
Name: ar-TN-ReemNeural  
Gender: Female  
  
Name: ar-YE-MaryamNeural  
Gender: Female  
  
Name: ar-YE-SalehNeural  
Gender: Male  
  
Name: az-AZ-BabekNeural  
Gender: Male  
  
Name: az-AZ-BanuNeural  
Gender: Female  
  
Name: bg-BG-BorislavNeural  
Gender: Male  
  
Name: bg-BG-KalinaNeural  
Gender: Female  
  
Name: bn-BD-NabanitaNeural  
Gender: Female  
  
Name: bn-BD-PradeepNeural  
Gender: Male  
  
Name: bn-IN-BashkarNeural  
Gender: Male  
  
Name: bn-IN-TanishaaNeural  
Gender: Female  
  
Name: bs-BA-GoranNeural  
Gender: Male  
  
Name: bs-BA-VesnaNeural  
Gender: Female  
  
Name: ca-ES-EnricNeural  
Gender: Male  
  
Name: ca-ES-JoanaNeural  
Gender: Female  
  
Name: cs-CZ-AntoninNeural  
Gender: Male  
  
Name: cs-CZ-VlastaNeural  
Gender: Female  
  
Name: cy-GB-AledNeural  
Gender: Male  
  
Name: cy-GB-NiaNeural  
Gender: Female  
  
Name: da-DK-ChristelNeural  
Gender: Female  
  
Name: da-DK-JeppeNeural  
Gender: Male  
  
Name: de-AT-IngridNeural  
Gender: Female  
  
Name: de-AT-JonasNeural  
Gender: Male  
  
Name: de-CH-JanNeural  
Gender: Male  
  
Name: de-CH-LeniNeural  
Gender: Female  
  
Name: de-DE-AmalaNeural  
Gender: Female  
  
Name: de-DE-ConradNeural  
Gender: Male  
  
Name: de-DE-KatjaNeural  
Gender: Female  
  
Name: de-DE-KillianNeural  
Gender: Male  
  
Name: el-GR-AthinaNeural  
Gender: Female  
  
Name: el-GR-NestorasNeural  
Gender: Male  
  
Name: en-AU-NatashaNeural  
Gender: Female  
  
Name: en-AU-WilliamNeural  
Gender: Male  
  
Name: en-CA-ClaraNeural  
Gender: Female  
  
Name: en-CA-LiamNeural  
Gender: Male  
  
Name: en-GB-LibbyNeural  
Gender: Female  
  
Name: en-GB-MaisieNeural  
Gender: Female  
  
Name: en-GB-RyanNeural  
Gender: Male  
  
Name: en-GB-SoniaNeural  
Gender: Female  
  
Name: en-GB-ThomasNeural  
Gender: Male  
  
Name: en-HK-SamNeural  
Gender: Male  
  
Name: en-HK-YanNeural  
Gender: Female  
  
Name: en-IE-ConnorNeural  
Gender: Male  
  
Name: en-IE-EmilyNeural  
Gender: Female  
  
Name: en-IN-NeerjaExpressiveNeural  
Gender: Female  
  
Name: en-IN-NeerjaNeural  
Gender: Female  
  
Name: en-IN-PrabhatNeural  
Gender: Male  
  
Name: en-KE-AsiliaNeural  
Gender: Female  
  
Name: en-KE-ChilembaNeural  
Gender: Male  
  
Name: en-NG-AbeoNeural  
Gender: Male  
  
Name: en-NG-EzinneNeural  
Gender: Female  
  
Name: en-NZ-MitchellNeural  
Gender: Male  
  
Name: en-NZ-MollyNeural  
Gender: Female  
  
Name: en-PH-JamesNeural  
Gender: Male  
  
Name: en-PH-RosaNeural  
Gender: Female  
  
Name: en-SG-LunaNeural  
Gender: Female  
  
Name: en-SG-WayneNeural  
Gender: Male  
  
Name: en-TZ-ElimuNeural  
Gender: Male  
  
Name: en-TZ-ImaniNeural  
Gender: Female  
  
Name: en-US-AnaNeural  
Gender: Female  
  
Name: en-US-AriaNeural  
Gender: Female  
  
Name: en-US-ChristopherNeural  
Gender: Male  
  
Name: en-US-EricNeural  
Gender: Male  
  
Name: en-US-GuyNeural  
Gender: Male  
  
Name: en-US-JennyNeural  
Gender: Female  
  
Name: en-US-MichelleNeural  
Gender: Female  
  
Name: en-US-RogerNeural  
Gender: Male  
  
Name: en-US-SteffanNeural  
Gender: Male  
  
Name: en-ZA-LeahNeural  
Gender: Female  
  
Name: en-ZA-LukeNeural  
Gender: Male  
  
Name: es-AR-ElenaNeural  
Gender: Female  
  
Name: es-AR-TomasNeural  
Gender: Male  
  
Name: es-BO-MarceloNeural  
Gender: Male  
  
Name: es-BO-SofiaNeural  
Gender: Female  
  
Name: es-CL-CatalinaNeural  
Gender: Female  
  
Name: es-CL-LorenzoNeural  
Gender: Male  
  
Name: es-CO-GonzaloNeural  
Gender: Male  
  
Name: es-CO-SalomeNeural  
Gender: Female  
  
Name: es-CR-JuanNeural  
Gender: Male  
  
Name: es-CR-MariaNeural  
Gender: Female  
  
Name: es-CU-BelkysNeural  
Gender: Female  
  
Name: es-CU-ManuelNeural  
Gender: Male  
  
Name: es-DO-EmilioNeural  
Gender: Male  
  
Name: es-DO-RamonaNeural  
Gender: Female  
  
Name: es-EC-AndreaNeural  
Gender: Female  
  
Name: es-EC-LuisNeural  
Gender: Male  
  
Name: es-ES-AlvaroNeural  
Gender: Male  
  
Name: es-ES-ElviraNeural  
Gender: Female  
  
Name: es-ES-ManuelEsCUNeural  
Gender: Male  
  
Name: es-GQ-JavierNeural  
Gender: Male  
  
Name: es-GQ-TeresaNeural  
Gender: Female  
  
Name: es-GT-AndresNeural  
Gender: Male  
  
Name: es-GT-MartaNeural  
Gender: Female  
  
Name: es-HN-CarlosNeural  
Gender: Male  
  
Name: es-HN-KarlaNeural  
Gender: Female  
  
Name: es-MX-DaliaNeural  
Gender: Female  
  
Name: es-MX-JorgeNeural  
Gender: Male  
  
Name: es-MX-LorenzoEsCLNeural  
Gender: Male  
  
Name: es-NI-FedericoNeural  
Gender: Male  
  
Name: es-NI-YolandaNeural  
Gender: Female  
  
Name: es-PA-MargaritaNeural  
Gender: Female  
  
Name: es-PA-RobertoNeural  
Gender: Male  
  
Name: es-PE-AlexNeural  
Gender: Male  
  
Name: es-PE-CamilaNeural  
Gender: Female  
  
Name: es-PR-KarinaNeural  
Gender: Female  
  
Name: es-PR-VictorNeural  
Gender: Male  
  
Name: es-PY-MarioNeural  
Gender: Male  
  
Name: es-PY-TaniaNeural  
Gender: Female  
  
Name: es-SV-LorenaNeural  
Gender: Female  
  
Name: es-SV-RodrigoNeural  
Gender: Male  
  
Name: es-US-AlonsoNeural  
Gender: Male  
  
Name: es-US-PalomaNeural  
Gender: Female  
  
Name: es-UY-MateoNeural  
Gender: Male  
  
Name: es-UY-ValentinaNeural  
Gender: Female  
  
Name: es-VE-PaolaNeural  
Gender: Female  
  
Name: es-VE-SebastianNeural  
Gender: Male  
  
Name: et-EE-AnuNeural  
Gender: Female  
  
Name: et-EE-KertNeural  
Gender: Male  
  
Name: fa-IR-DilaraNeural  
Gender: Female  
  
Name: fa-IR-FaridNeural  
Gender: Male  
  
Name: fi-FI-HarriNeural  
Gender: Male  
  
Name: fi-FI-NooraNeural  
Gender: Female  
  
Name: fil-PH-AngeloNeural  
Gender: Male  
  
Name: fil-PH-BlessicaNeural  
Gender: Female  
  
Name: fr-BE-CharlineNeural  
Gender: Female  
  
Name: fr-BE-GerardNeural  
Gender: Male  
  
Name: fr-CA-AntoineNeural  
Gender: Male  
  
Name: fr-CA-JeanNeural  
Gender: Male  
  
Name: fr-CA-SylvieNeural  
Gender: Female  
  
Name: fr-CH-ArianeNeural  
Gender: Female  
  
Name: fr-CH-FabriceNeural  
Gender: Male  
  
Name: fr-FR-DeniseNeural  
Gender: Female  
  
Name: fr-FR-EloiseNeural  
Gender: Female  
  
Name: fr-FR-HenriNeural  
Gender: Male  
  
Name: ga-IE-ColmNeural  
Gender: Male  
  
Name: ga-IE-OrlaNeural  
Gender: Female  
  
Name: gl-ES-RoiNeural  
Gender: Male  
  
Name: gl-ES-SabelaNeural  
Gender: Female  
  
Name: gu-IN-DhwaniNeural  
Gender: Female  
  
Name: gu-IN-NiranjanNeural  
Gender: Male  
  
Name: he-IL-AvriNeural  
Gender: Male  
  
Name: he-IL-HilaNeural  
Gender: Female  
  
Name: hi-IN-MadhurNeural  
Gender: Male  
  
Name: hi-IN-SwaraNeural  
Gender: Female  
  
Name: hr-HR-GabrijelaNeural  
Gender: Female  
  
Name: hr-HR-SreckoNeural  
Gender: Male  
  
Name: hu-HU-NoemiNeural  
Gender: Female  
  
Name: hu-HU-TamasNeural  
Gender: Male  
  
Name: id-ID-ArdiNeural  
Gender: Male  
  
Name: id-ID-GadisNeural  
Gender: Female  
  
Name: is-IS-GudrunNeural  
Gender: Female  
  
Name: is-IS-GunnarNeural  
Gender: Male  
  
Name: it-IT-DiegoNeural  
Gender: Male  
  
Name: it-IT-ElsaNeural  
Gender: Female  
  
Name: it-IT-IsabellaNeural  
Gender: Female  
  
Name: ja-JP-KeitaNeural  
Gender: Male  
  
Name: ja-JP-NanamiNeural  
Gender: Female  
  
Name: jv-ID-DimasNeural  
Gender: Male  
  
Name: jv-ID-SitiNeural  
Gender: Female  
  
Name: ka-GE-EkaNeural  
Gender: Female  
  
Name: ka-GE-GiorgiNeural  
Gender: Male  
  
Name: kk-KZ-AigulNeural  
Gender: Female  
  
Name: kk-KZ-DauletNeural  
Gender: Male  
  
Name: km-KH-PisethNeural  
Gender: Male  
  
Name: km-KH-SreymomNeural  
Gender: Female  
  
Name: kn-IN-GaganNeural  
Gender: Male  
  
Name: kn-IN-SapnaNeural  
Gender: Female  
  
Name: ko-KR-InJoonNeural  
Gender: Male  
  
Name: ko-KR-SunHiNeural  
Gender: Female  
  
Name: lo-LA-ChanthavongNeural  
Gender: Male  
  
Name: lo-LA-KeomanyNeural  
Gender: Female  
  
Name: lt-LT-LeonasNeural  
Gender: Male  
  
Name: lt-LT-OnaNeural  
Gender: Female  
  
Name: lv-LV-EveritaNeural  
Gender: Female  
  
Name: lv-LV-NilsNeural  
Gender: Male  
  
Name: mk-MK-AleksandarNeural  
Gender: Male  
  
Name: mk-MK-MarijaNeural  
Gender: Female  
  
Name: ml-IN-MidhunNeural  
Gender: Male  
  
Name: ml-IN-SobhanaNeural  
Gender: Female  
  
Name: mn-MN-BataaNeural  
Gender: Male  
  
Name: mn-MN-YesuiNeural  
Gender: Female  
  
Name: mr-IN-AarohiNeural  
Gender: Female  
  
Name: mr-IN-ManoharNeural  
Gender: Male  
  
Name: ms-MY-OsmanNeural  
Gender: Male  
  
Name: ms-MY-YasminNeural  
Gender: Female  
  
Name: mt-MT-GraceNeural  
Gender: Female  
  
Name: mt-MT-JosephNeural  
Gender: Male  
  
Name: my-MM-NilarNeural  
Gender: Female  
  
Name: my-MM-ThihaNeural  
Gender: Male  
  
Name: nb-NO-FinnNeural  
Gender: Male  
  
Name: nb-NO-PernilleNeural  
Gender: Female  
  
Name: ne-NP-HemkalaNeural  
Gender: Female  
  
Name: ne-NP-SagarNeural  
Gender: Male  
  
Name: nl-BE-ArnaudNeural  
Gender: Male  
  
Name: nl-BE-DenaNeural  
Gender: Female  
  
Name: nl-NL-ColetteNeural  
Gender: Female  
  
Name: nl-NL-FennaNeural  
Gender: Female  
  
Name: nl-NL-MaartenNeural  
Gender: Male  
  
Name: pl-PL-MarekNeural  
Gender: Male  
  
Name: pl-PL-ZofiaNeural  
Gender: Female  
  
Name: ps-AF-GulNawazNeural  
Gender: Male  
  
Name: ps-AF-LatifaNeural  
Gender: Female  
  
Name: pt-BR-AntonioNeural  
Gender: Male  
  
Name: pt-BR-FranciscaNeural  
Gender: Female  
  
Name: pt-PT-DuarteNeural  
Gender: Male  
  
Name: pt-PT-RaquelNeural  
Gender: Female  
  
Name: ro-RO-AlinaNeural  
Gender: Female  
  
Name: ro-RO-EmilNeural  
Gender: Male  
  
Name: ru-RU-DmitryNeural  
Gender: Male  
  
Name: ru-RU-SvetlanaNeural  
Gender: Female  
  
Name: si-LK-SameeraNeural  
Gender: Male  
  
Name: si-LK-ThiliniNeural  
Gender: Female  
  
Name: sk-SK-LukasNeural  
Gender: Male  
  
Name: sk-SK-ViktoriaNeural  
Gender: Female  
  
Name: sl-SI-PetraNeural  
Gender: Female  
  
Name: sl-SI-RokNeural  
Gender: Male  
  
Name: so-SO-MuuseNeural  
Gender: Male  
  
Name: so-SO-UbaxNeural  
Gender: Female  
  
Name: sq-AL-AnilaNeural  
Gender: Female  
  
Name: sq-AL-IlirNeural  
Gender: Male  
  
Name: sr-RS-NicholasNeural  
Gender: Male  
  
Name: sr-RS-SophieNeural  
Gender: Female  
  
Name: su-ID-JajangNeural  
Gender: Male  
  
Name: su-ID-TutiNeural  
Gender: Female  
  
Name: sv-SE-MattiasNeural  
Gender: Male  
  
Name: sv-SE-SofieNeural  
Gender: Female  
  
Name: sw-KE-RafikiNeural  
Gender: Male  
  
Name: sw-KE-ZuriNeural  
Gender: Female  
  
Name: sw-TZ-DaudiNeural  
Gender: Male  
  
Name: sw-TZ-RehemaNeural  
Gender: Female  
  
Name: ta-IN-PallaviNeural  
Gender: Female  
  
Name: ta-IN-ValluvarNeural  
Gender: Male  
  
Name: ta-LK-KumarNeural  
Gender: Male  
  
Name: ta-LK-SaranyaNeural  
Gender: Female  
  
Name: ta-MY-KaniNeural  
Gender: Female  
  
Name: ta-MY-SuryaNeural  
Gender: Male  
  
Name: ta-SG-AnbuNeural  
Gender: Male  
  
Name: ta-SG-VenbaNeural  
Gender: Female  
  
Name: te-IN-MohanNeural  
Gender: Male  
  
Name: te-IN-ShrutiNeural  
Gender: Female  
  
Name: th-TH-NiwatNeural  
Gender: Male  
  
Name: th-TH-PremwadeeNeural  
Gender: Female  
  
Name: tr-TR-AhmetNeural  
Gender: Male  
  
Name: tr-TR-EmelNeural  
Gender: Female  
  
Name: uk-UA-OstapNeural  
Gender: Male  
  
Name: uk-UA-PolinaNeural  
Gender: Female  
  
Name: ur-IN-GulNeural  
Gender: Female  
  
Name: ur-IN-SalmanNeural  
Gender: Male  
  
Name: ur-PK-AsadNeural  
Gender: Male  
  
Name: ur-PK-UzmaNeural  
Gender: Female  
  
Name: uz-UZ-MadinaNeural  
Gender: Female  
  
Name: uz-UZ-SardorNeural  
Gender: Male  
  
Name: vi-VN-HoaiMyNeural  
Gender: Female  
  
Name: vi-VN-NamMinhNeural  
Gender: Male  
  
Name: zh-CN-XiaoxiaoNeural  
Gender: Female  
  
Name: zh-CN-XiaoyiNeural  
Gender: Female  
  
Name: zh-CN-YunjianNeural  
Gender: Male  
  
Name: zh-CN-YunxiNeural  
Gender: Male  
  
Name: zh-CN-YunxiaNeural  
Gender: Male  
  
Name: zh-CN-YunyangNeural  
Gender: Male  
  
Name: zh-CN-liaoning-XiaobeiNeural  
Gender: Female  
  
Name: zh-CN-shaanxi-XiaoniNeural  
Gender: Female  
  
Name: zh-HK-HiuGaaiNeural  
Gender: Female  
  
Name: zh-HK-HiuMaanNeural  
Gender: Female  
  
Name: zh-HK-WanLungNeural  
Gender: Male  
  
Name: zh-TW-HsiaoChenNeural  
Gender: Female  
  
Name: zh-TW-HsiaoYuNeural  
Gender: Female  
  
Name: zh-TW-YunJheNeural  
Gender: Male  
  
Name: zu-ZA-ThandoNeural  
Gender: Female  
  
Name: zu-ZA-ThembaNeural  
Gender: Male

一望而知,几乎支持所有主流的通用语,Gender字段为合成语音的性别,Male代表男性,Female代表女性,zh开头的就是中文语音角色,这里以微软的小伊为例子:

edge-tts --voice zh-CN-XiaoyiNeural --text "你好啊,我是智能语音助手" --write-media hello_in_cn.mp3

该命令含义是通过zh-CN-XiaoyiNeural角色合成语音:"你好啊,我是智能语音助手"的内容,随后将音频流写入hello_in_cn.mp3文件。

程序返回:

Downloads edge-tts --voice zh-CN-XiaoyiNeural --text "你好啊,我是智能语音助手" --write-media hello_in_cn.mp3  
WEBVTT  
  
00:00:00.100 --> 00:00:00.525  
你好  
  
00:00:00.525 --> 00:00:00.912  
啊  
  
00:00:01.050 --> 00:00:01.238  
我  
  
00:00:01.238 --> 00:00:01.375  
是  
  
00:00:01.387 --> 00:00:01.700  
智能  
  
00:00:01.700 --> 00:00:02.050  
语音  
  
00:00:02.062 --> 00:00:02.550  
助手

程序会自动将时间轴和语音文本匹配输出,如此一来,连字幕文件也有了,可谓是一举两得,一箭双雕。

与此同时,我们也可以调整合成语音的语速:

edge-tts --rate=-50% --voice zh-CN-XiaoyiNeural --text "你好啊,我是智能语音助手" --write-media hello_in_cn.mp3

--rate参数可以通过加号或者减号同步加快或者减慢合成语音的语速。

亦或者,调整合成语音的音量:

edge-tts --volume=-50%  --voice zh-CN-XiaoyiNeural --text "你好啊,我是智能语音助手" --write-media hello_in_cn.mp3

--volume参数可以调整语音的音量。

遗憾的是,和微软Azure官方的语音合成库相比,开源的语音合成库并不支持基于标记语言 (SSML)的语音调优,比如语调、情绪的调整,但这毕竟是免费的,要求也不能太高了。

Python脚本语音合成

除了通过命令进行语音合成,edge-tts也支持在Python脚本,编辑test.py文件:

import asyncio  
  
import edge_tts  
  
TEXT = "你好哟,我是智能语音助手,小伊"  
VOICE = "zh-CN-XiaoyiNeural"  
OUTPUT_FILE = "/Users/liuyue/Downloads/test.mp3"  
  
  
async def _main() -> None:  
    communicate = edge_tts.Communicate(TEXT, VOICE)  
    await communicate.save(OUTPUT_FILE)  
  
  
if __name__ == "__main__":  
    asyncio.run(_main())

这里我们直接通过异步模式调用communicate实例的save方法,就可以并发异步生成语音合成的音频文件,非常方便。

也可以通过语音管理库来自动寻找我们需要的语言:

import asyncio  
import random  
  
import edge_tts  
from edge_tts import VoicesManager  
  
TEXT = "中文语音测试"  
OUTPUT_FILE ="china.mp3"  
  
  
async def _main() -> None:  
    voices = await VoicesManager.create()  
    voice = voices.find(Gender="Female", Language="zh")  
  
    communicate = edge_tts.Communicate(TEXT, random.choice(voice)["Name"])  
    await communicate.save(OUTPUT_FILE)  
  
  
if __name__ == "__main__":  
    asyncio.run(_main())

这里通过内置的VoicesManager库来随机挑选中文语音角色完成语音合成操作。

除此之外,也可以通过脚本将语音流和字母同步进行生成:

import asyncio  
  
import edge_tts  
  
TEXT = "这里是语音流测试"  
VOICE = "zh-CN-XiaoyiNeural"  
OUTPUT_FILE = "test.mp3"  
WEBVTT_FILE = "test.vtt"  
  
  
async def _main() -> None:  
    communicate = edge_tts.Communicate(TEXT, VOICE)  
    submaker = edge_tts.SubMaker()  
    with open(OUTPUT_FILE, "wb") as file:  
        async for chunk in communicate.stream():  
            if chunk["type"] == "audio":  
                file.write(chunk["data"])  
            elif chunk["type"] == "WordBoundary":  
                submaker.create_sub((chunk["offset"], chunk["duration"]), chunk["text"])  
  
    with open(WEBVTT_FILE, "w", encoding="utf-8") as file:  
        file.write(submaker.generate_subs())  
  
  
if __name__ == "__main__":  
    asyncio.run(_main())

这里异步调用之后,音频会写入test.mp3,而字幕文件则会写入test.vtt。后续则可以通过ffmpeg将生成的字幕文件叠加到视频中即可,请参见:基于Python3(Autosub)以及Ffmpeg配合GoogleTranslation(谷歌翻译)为你的影片实现双语版字幕(逐字稿)

结语

开源语音合成edge-tts库可以提高语音合成效率,并且极大地降低了语音合成门槛,为自动化视频剪辑铺平了道路,未来结合基于Stable-Diffusion算法的AI绘图框架,人工智能AI一键式绘制、配音、上字幕的一条龙服务指日可待。

与口播神器,基于Edge,微软TTS(text-to-speech)文字转语音免费开源库edge-tts实践(Python3.10)相似的内容:

口播神器,基于Edge,微软TTS(text-to-speech)文字转语音免费开源库edge-tts实践(Python3.10)

不能否认,微软Azure在TTS(text-to-speech文字转语音)这个人工智能细分领域的影响力是统治级的,一如ChatGPT在NLP领域的随心所欲,予取予求。君不见几乎所有的抖音营销号口播均采用微软的语音合成技术,其影响力由此可见一斑,仅有的白璧微瑕之处就是价格略高,虽然国内也可以使用科大讯

[转帖]电口与光口的区别

一. 光口 光口是服务器和网络中对各种光纤端口的统称,它是以光作为信息的承载介质。光口可能包含有从ST到SFF(小型化光纤连接器,以 MTRJ和LC为主)的各种光纤接口,因此在布线施工后期配备光纤跳线时,需要核实光口的光纤接口种类,以免在布线配置时假定的光纤跳线种类与实际使用的 要求不匹。 光纤接口

zip-zip(子函数调用)

题目 监听服务器端口,得到题目如下: 源码解析 主函数 主函数中是题目界面的逻辑,对应于用户的选择做出相应的操作,其中需要注意的是选项2,解压操作需要获得root权限(uid==0). 选项1,2:文件压缩和解压缩,是常规的文件压缩代码,不做解释。 选项3:buy操作,buy()函数调用了加密函数e

想看源码但是无从下口怎么办?

相信不少同学都有欧阳这种情况,年初的时候给自己制定了一份关于学习英语和源码的详细年度计划。但是到了实际执行的时候因为各种情况制定的计划基本都没有完成,年底回顾时发现年初制定的计划基本都没完成。痛定思痛,第二年年初决定再次制定一份学习英语和源码的详细年度计划,毫无疑问又失败了。

硬件开发笔记(十七):RK3568底板电路串口、485、usb原理图详解

前言 原理图有一些常用电路。 本篇就将集中常用电路分析完,如uart口,涉及usart串口、rs485、usb口。 串口 串行接口简称串口,也称串行通信接口或串行通讯接口(通常指COM接口),是采用串行通信方式的扩展接口。串行接口(Serial Interface)是指数据一位一位地顺序传送。其特点

初探富文本之基于虚拟滚动的大型文档性能优化方案

初探富文本之基于虚拟滚动的大型文档性能优化方案 虚拟滚动是一种优化长列表性能的技术,其通过按需渲染列表项来提高浏览器运行效率。具体来说,虚拟滚动只渲染用户浏览器视口部分的文档数据,而不是整个文档结构,其核心实现根据可见区域高度和容器的滚动位置计算出需要渲染的列表项,同时不渲染额外的视图内容。虚拟滚动

NET工控,上位机,Modbus485网口/串口通讯(鸣志步进电机,鸣志伺服电机,松下伺服电机,华庆军继电器模块)

先上两个通用Modbus帮助类,下面这个是多线程不安全版,在多线程多电机同一端口通信下,可能造成步进电机丢步或者输出口无响应等,还有个多线程安全版,只是基于这个不安全版加上了LOCK,THIS using Modbus.Device; using Sunny.UI; using System; us

当 xxl-job 遇上 docker → 它晕了,但我不能乱!

开心一刻 某次住酒店,晚上十点多叫了个外卖 过了一阵儿,外卖到了 因为酒店电梯要刷卡,所以我下楼去接 到了电梯口看到个模样不错的妹纸 我:是你么? 妹纸愣了下:嗯! 于是拉上进电梯回房间,正准备开始呢 我俩的电话同时响了 按下接听键,一男一女同时问:我到电梯口了,你人呢? 尴尬了,取错外卖了 然后一

[转帖]Linux网络命令之 `brctl`

文章目录 1 网桥的概念2 管理网桥的命令3 举例 1 网桥的概念 摘自百度百科: 网桥(Bridge)是早期的两端口二层网络设备,用来连接不同网段。 网桥是一种对帧进行转发的技术,根据 MAC 分区块,可隔离碰撞。网桥将网络的多个网段在数据链路层连接起来。 网桥也叫桥接器,是连接两个局域网的一种存

[转帖]nginx的luajit安装luarocks并安装luafilesystem

nginx的luajit安装luarocks并安装luafilesystem by admin on 2015-07-11 08:05:23 in , 69次 标题有点绕口。我尽量把关键词都贴进去。之前因为自己的nginx安装了ngx_lua模块,但是又需要引入 但是安装luafilesystem又