UBot Network

Build Bots That Talk Like Humans – Speech Synthesis UBot Studio

Today we’re diving into the new speech synthesis commands in UBot Studio Enterprise Edition.

We have integrated Eleven Labs, which is, at the time of writing, generally considered to be the highest quality speech synthesis ever created. Let’s find out if it lives up to the hype!

To start, I used some random inspirational text generated by chat GPT. After hitting ‘generate’, the synthesized speech was impressively human-like. If I didn’t know better, it would be pretty hard to differentiate it from a real human voice.

Now, let’s get into the nitty-gritty of how to use this feature in UBot Studio.

After opening UBot Studio and navigating to the public bot bank, select ‘speech synthesis’. Start with the ‘connect to speech synthesis’ command and enter your API key (you can find this on the 11 Labs website under your profile).

Once connected, we can start playing around with the various commands.

The ‘start playing speech’ command allows you to input text and listen to the synthesized speech. To ensure the script doesn’t continue playing while speaking, don’t forget to include the ‘wait for speech’ command.

You may notice a slight lag between hitting run and the start of the speech. However, the second time you hit run, the speech begins instantly. This is because the system generates the audio and saves it to the hard drive. If you play the same bit of speech again, it simply plays the already saved file.

If you want to regenerate the audio file each time, you can set the ‘refresh’ parameter to true. This means each time you run the command, the speech will sound slightly different as it generates a new file.

If you want to generate the files without playing them immediately, use the ‘generate speech’ command. This is particularly useful if you have a large amount of text to generate and want to play it in real time later.

You can also save the audio to a file using the ‘save to speech file’ command. Lastly, the ‘voice’ parameter allows you to select from a dropdown of default 11 Labs voices or manually enter the name of any voice set up in your account.

The new generation of speech synthesis in UBot Studio Enterprise Edition is a significant leap forward. It offers computer voices that sound strikingly like real people. So go ahead, explore and enjoy this new feature.

See you next time!

Here’s the code:

connect to speech synthesis("your eleven labs key")
start playing speech("Imagine a world where you\'re not bound by the limitations of time and manual labor. A world where you can automate repetitive tasks, freeing up your time to focus on what truly matters. That\'s the world Ubot Studio opens up for you. It\'s a world where efficiency meets creativity, where technology serves humanity, and where the only limit is your imagination.","Rachel","False")
wait for speech

Building An AI Bot That Can Write and Draw Comics

Let the language of wit become universal, for laughter transcends borders

Get UBot Studio Enterprise Here!

Hey there, botmasters! Today, we’re once again pushing the envelope of what’s possible with cutting edge generative AI. In particular, we’ll be creating a bot that generates single panel comics using ChatGPT and Stable Diffusion! So, let’s embark on yet another artistic adventure, and bring laughter and joy to our followers as we explore the vast potential of AI-generated humor.

First things first, let’s use ui console view to open our console to log the comic creations of our AI.

We will also connect to dreambooth using our API key.

Now, let’s set up some crucial paths for our images. We’ll set the #image path and the #comic path for where they’ll be generated.

We’re also going to set a #context to help our AI understand its role as a comic creator.

Time to create the chat GPT agent! We’ll name it “ComicGPT” and feed it the #context we’ve set:

Now, we can ask ComicGPT to provide us with a hilarious scene description! We’ll take its response and set it as the #scene variable:

And we’ll log the scene to the console using the log command:

Next, we’ll request the caption for the comic and set it as the #caption variable:

Don’t forget to log the caption, so we can see what our AI has in store for us:

Here comes the fun part – generating the image! We’ll use the generate dreambooth image command, passing in our #image path and #scene:

Then we can take a look at the generated image with log image command:

Now, we need to create some space for the caption by using pad image on our initial image:

Again, we’ll use log image to see the modified image.

Alright, it’s time to fit our funny text onto the image! We’ll do this using the fit text to image command:

And, of course, we’ll use log image to admire our AI’s masterpiece.

And there you have it, intrepid Bot masters! Our UBot Studio script is now fully equipped to generate ingenious comics. With each delightful comic, we not only showcase the astounding capabilities of artificial intelligence but also bring smiles to countless faces. So, let’s celebrate our accomplishment and revel in the boundless possibilities of AI-driven creativity. Here’s to transforming the world, one laughter-filled comic at a time!

Get UBot Studio Enterprise Here!

ui console view
config openai("YOUR_API_KEY")
connect to dreambooth("YOUR_API_KEY")
set(#image path,"C:\\Documents\\UBot Studio\\Workspace\\image.png","Local")
set(#comic path,"C:\\Documents\\UBot Studio\\Workspace\\comic.png","Local")
set(#context,"you are comicGPT, an ai that conceptualizes and writes single-panel comics. given a topic, you\'ll first describe the scene that\'s happening in the comic, and then provide a caption. Your description will be given to an image generator like dall-e, so make the scene description as visually simple as possible. I want to emphasize again that the scene should be simple. the most important thing is that the comic is funny, insightful, profound, or otherwise emotionally evocative.","Local")
create chat gpt agent("ComicGPT",#context,"gpt-4")
set(#scene,$chat gpt response("Give me just the scene description for a single-panel comic. Make it really funny.","ComicGPT"),"Local")
log(#scene)
set(#caption,$chat gpt response("Give me just the caption for the comic. Make it really funny.","ComicGPT"),"Local")
log(#caption)
generate dreambooth image(#image path,#scene,"Stable Diffusion XL Beta v2.2.2",512,384)
log image(#image path,50)
pad image(#image path,#comic path,0,0,100,0,"white")
log image(#comic path,50)
fit text to image(#image path,#caption,#comic path,"top",90,392,20,20,20,"Comic Neue","black","False","black",50,"True")
log image(#comic path,50)

Use Your Installed Chrome in UBot Studio Version 6.7.17

We are thrilled to announce that UBot Studio’s new version is now available, and it comes with a major update – we have switched to using your installed version of Chrome, instead of the internal UBot Studio browser.

So, what does this mean for you? Let’s dive into the details!

Benefits of Using Installed Chrome

The Installed Chrome browser option is now functional, and there are numerous benefits to using it:

• Always use the latest version of Chrome
• Compatible with the latest web standards
• You can now log into your Google account, including GMail and YouTube (this was previously blocked with the internal browser)
• Cookies and Cache persist between sessions
• You can use the extensions!
• You can use web3 websites!

Log Images in the Console View

In addition to the Chrome update, we have also added a new feature – log images. You can now add images into the console view, making it easier to track and review your bot’s progress when working with images.

How to Get It

If you have UBot Studio already installed, and you’re subscribed to updates or to Enterprise Edition, simply update when prompted the next time you open UBot Studio.

If you’re not subscribed to either our Update Subscription or Enterprise Edition, subscribe to Enterprise edition here:

How to Switch to the Installed Chrome Browser

Switching to the Installed Chrome browser is easy:

1. From the main screen in UBot Studio, click the Tools menu, and select Options.
2. Under General Options, click the drop-down labeled “Browser.”
3. Select “Installed Chrome.”
4. Click OK.
5. Restart UBot Studio.

Conclusion

We are excited to bring you this major update, and we hope it will make your bot-building experience even better. If you have any questions or feedback, please don’t hesitate to contact us. Happy botting!