Introduction to Multimodal Prompting for Generative AI

Learn how you can leverage modern AI systems that utilize multimodality.

Introduction

• GenAI with multimodal prompts

1. Multimodality

• What is multimodality?
• Visual modality
• Textual and auditory modality

2. GPT-4

• GPT-4 and 4o
• Text to image in GPT-4
• GPT-4 API with various input types
• Challenge: Drawing to code
• Solution: Drawing to code

3. Gemini

• What is Gemini?
• Images in Gemini
• Gemini video inputs
• Challenge: Video narration
• Solution: Video narration

4. Auditory Modalities

• Audio in generative AI
• Prompt and audio
• Generating music
• Challenge: Soundtrack creation
• Solution: Soundtrack creation

Conclusion

• Next steps