[CVPR 2024] Intelligent Grimm - Open-ended Visual Storytelling via Latent Diffusion Models

Code for the ACL paper "No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling"

A Training-free Iterative Framework for Long Story Visualization

Implementation of seq2seq model for Visual Storytelling Challenge (VIST) http://visionandlanguage.net/VIST/index.html

An implementation of the paper "Contextualize, Show and Tell: A Neural Visual Storyteller." presented at the Storytelling Workshop, co-located with NAACL 2018.

A list of research papers on knowledge-enhanced multimodal learning

Visual Storytelling with Cross-Modal Rules

We designed an end-to-end framework that encourage interactive narrative experience based on keyword control and image generation.

DATA-X: m130 - Introduction to Visual Principles Using Matplotlib and Seaborn. Provides users with the necessary foundations for building and understanding current state of the art visualizations. An additional aim is to provide users with an understanding of both the theory and techniques of various visualization paradigms. Finally, this series…

PyTorch code for Automatic generation of comic dialogues. The purpose of this project is to generate subsequent dialogues given a multimodal context.

Graph convolution-based visual storytelling

GROOViST: A Metric for Grounding Objects in Visual Storytelling – EMNLP 2023

Part of ther @SketchTheDocs family of projects. A visual puzzle game to test your tech IQ. Featured segment on #HelloWorld (on Microsoft LearnTV) every Thursday @1:30pm EST.

Parse a narrative XML from draw.io through R to ink

In our "Introduction to Machine Learning" assignment, we have undertaken a comprehensive examination of the fundamental aspects of ML. This exploration spans the foundational principles of probability, advanced data wrangling techniques, the art of visual storytelling, methodologies in clustering and topic modeling, and the neural networks.

Official Codebase for "Kahani: Culturally Nuanced Visual Storytelling Pipeline for Non-Western Cultures"

[Course] Inteligencia Artificial en la Universidad Nacional de Colombia - Sede La Paz

Not (yet) the whole story: Evaluating Visual Storytelling Requires More than Measuring Coherence, Grounding, and Repetition – EMNLP 2024 (Findings)

Imagine you're playing with your favorite toy set, placing characters around, and creating fun stories with them. That's exactly what VXLverse does, but in a digital world.