English | 2025 | ISBN: 1633435423 | 362 pages | True PDF | 19.92 MB
This book takes you step-by-step through creating your own AI models that can generate images from text. You'll explore two methods of image generation-vision transformers and diffusion models-and learn vital AI development techniques as you go.
Dive into the powerful models behind AI image generators. The best way to learn is to build something from scratch, and in this book you'll build your very own diffusion model and vision transformer. As you work through each stage of development, you'll develop an understanding of how these models can be customized, applied, and integrated for impressive multimodal AI.
Build a Text-to-Image Generator (from Scratch) teaches you how to
• Build and train models to generate high resolution images based on text descriptions
• Edit an existing image based on text prompts
• Build and train a model to add captions to images
• Build and train a vision transformer to classify images
• Fine-tune LLMs for downstream tasks such as classification, text or image generation
• Better differentiate real images from deepfakes
About the technology
AI-generated images appear everywhere from high-end advertising to casual social media feeds. Text-to-image tools like Dall-e, Midjourney, and Flux make it easy to create AI art, but how do they work? In this book, you'll find out by building your own text-to-image generator!
About the book
Build a Text-to-Image Generator (from Scratch) explores both transformer-based image generation and diffusion models. You'll work hands-on to build a pair of simple generation models that can classify images, automatically add captions, reconstruct images, and enhance existing graphics. Author Mark Liu guides you every step of the way with clear explanations, informative diagrams, and eye-opening examples you can build on your own laptop.
What's inside
• Build a vision transformer to classify images
• Edit images using text prompts
• Fine-tune image models
About the reader
Requires basic knowledge of generative AI models and intermediate Python skills.
About the author
Mark Liu is the founding director of the Master of Science in Finance program at the University of Kentucky. He is also the author of Learn Generative AI with PyTorch.
Build A Text-To-Image Generator (from Scratch): With Transformers And Diffusions
