AnyText - Easy Text Generation Using Stable Diffusion!

AnyText: Multilingual Visual Text Generation And Editing is here!
AnyText comprises a diffusion pipeline with two primary elements: an auxiliary latent module and a text embedding module. The former uses inputs like text glyph, position, and a masked image to generate latent features for text generation or editing.
The latter employs an OCR model for encoding stroke data as embeddings, which blend with image caption embeddings from the tokenizer to generate text that seamlessly integrates with the background. The result is much better text in your AI generations - for free! :)
AnyText - github.com/tyxsspa/AnyText
== More Stable Diffusion Stuff! ==
* Faster Stable Diffusions with the LCM LoRA - • LCM LoRA = Speedy Stab...
* How do I create an animated SD avatar? - • Create your own animat...
* Installing Anaconda for MS Windows Beginners - • Anaconda - Python Inst...
* Add anything to your AI art in seconds - • 3 Amazing and Fun Upda...
* Video-to-Video AI using AnimateDiff - • How To Use AnimateDiff...
* One image Gets You a Consistent Character in ANY pose - • Reposer = Consistent S...
Want to support the channel?
/ nerdyrodent

[@dzyanw]

Ooh, hope this will come to Automatic 1111 soon ✨

[@fredmcveigh9877]

Agreed. I don't like comfy with all the noodles.

[@IzeIzeBaby]

This is definately better than generating hundreds of images hoping it would spell out what someone wants... not that i've ever done that... multiple times... for hours :D

[@NerdyRodent]

😆

[@Beedji]

Haven't we all ? lol

[@blacksage81]

I feel you, I put upwards of a hour trying something similar

[@makers_lab]

This is great. I've been adding text fairly successfully using an external image with the text loaded into controlnet, but this is much more convenient and better overall.

[@hleet]

Nice one, can't wait to have the comfyui version ready :)

[@kenmillionx]

Looking forward to seeing more great content like this one ❤❤❤

[@LIMBICNATIONARTIST]

Absolutely fantastic!

[@jairuskersey8311]

OMG, this is effing amazing!!!! Thanks for sharing!

[@swannschilling474]

Thanks for this Nerdy poetry!! 😊

[@KinAchillies]

nice work !!

[@OrangeJu1cee]

Amazing stuff

[@serta5727]

Thanks I love it ❤

[@Chad-xd3vr]

Thank you for your videos

[@sb6934]

Thanks!

[@southcoastinventors6583]

Thought we wouldn't see decent text for open source for a month. Will wait till it comes out for comfyui hope it will be able to Japanese as well. Catching up quickly to Dalle-3, going to be a great year for open source.

[@elgodric]

is it possible to use this model with A11111?

[@branchtell]

Is it available for a1111? I installed it but the panel doesn't appear anywhere

[@ahmetab06]

is it works with comfyui ?

[@obscuremusictabs5927]

Wil this work on Mac?

[@NerdyRodent]

Not that I’m aware of as it needs Nvidia stuff

[@vintagegenious]

Noice

[@hamtsammich]

I haven't been able to download their provided model. Quite annoying.

[@NerdyRodent]

The model should download automatically?

[@hamtsammich]

@@NerdyRodent It's trying to, but simply refuses to complete.

[@NerdyRodent]

@@hamtsammich very strange! so many possibilities with what it could be though… (network, firewall, disk space, etc)

[@hamtsammich]

What can I say? Some people just have all the luck. I'll keep trying.
@@NerdyRodent

[@georgematsos4416]

Is there a newbie guide how to install this ?

[@NerdyRodent]

You can just do each of the steps in the video to install 😀

[@Sandy5of5]

🎂🍰🍶🐹

[@kenmillionx]

Looking forward to seeing more great content like this one ❤❤❤

[@NerdyRodent]

More to come!