I received my Master degree in Computer Science at VRVC Lab, School of Information Science and Technology (SIST), ShanghaiTech University (supervised by Prof. Lan Xu and Ph.D. Li-ao Wang), and will soon begin my Ph.D. in Computer Science at Fudan Generative Vision Lab (Fusion Lab), College of Computer Science and Artificial Intelligence, Fudan University (supervised by Prof. Siyu Zhu).

My research interests focus on AI+Art, including Image/Video/3D/4D AIGC, World Model, Computer Vision, Computer Graphics, Digital Media, Computational Photography, and Neuroscience. Currently, I primarily work on narrative filmmaking and neural signal-guided visual reconstruction, leading the AIGC Research｜AI for Creativity (AI4C) Team . AI4C Team aims to empower AI-driven design, enhance artistic creation with AI-tech, and explore the nature of human creativity.

I am running a WeChat Official Account, called AIGC Research, dedicated to comprehensively tracking academic frontiers in AIGC through the PaperDaily series. As of 2026.03.04, it has attracted more than 7,000 followers and maintained a rising trend, welcome your follow and support!

🔥我正在寻找视频生成与世界模型方向的工业界实习机会（我有足够前沿的创新点，以及丰富的工程经验），如果您欣赏我并愿意与我合作，欢迎随时通过电子邮件与我联系！

🔥I am currently seeking an industry internship in video generation and world models (I possess sufficiently advanced and innovative ideas, as well as extensive engineering experience). If you are interested in my work and would like to collaborate, please feel free to contact me via email!

AIGC Research｜AI4C Team

Welcome to AIGC Research (AI4C Team) Homepage for more details.

Team Members: Cailin Zhuang (庄才林) (FDU), Yaoqi Hu (胡耀淇), Zheng Dong (董政), Yiming Guo (郭一铭) (SHU).

Team Mentors: Wei Cheng (程巍) (Stepfun), Qingling Xia (夏清玲) (CQUT), Siyu Zhu (朱思语) (FDU & SII), Mengtian Li (李梦甜) (Shanghai Film Academy, SHU).

Internships Experience:

2026-now｜｜Shanghai Academy of AI for Science

Research Intern in Video World Model

Mentor: ; Team Lead: Siyu Zhu (朱思语).

2025-2026｜｜China Telecom, TeleAI

Research Intern in Video Generation (Multi-Shot Filmmaking)

Mentor: Shiwen Zhang (张诗文); Team Lead: Haibin Huang (黄海斌).

2025｜｜StepFun

Research Intern in Image Generation (Story Visualization)

Mentor: Wei Cheng (程巍); Collaborators: Ailin Huang (黄艾琳), Zhewei Huang (黄哲威), Xuanyang Zhang (张选扬); Team Lead: Gang Yu (俞刚).

Publications

SIGGRAPH Asia 2026｜Act2Cut: Continuous Multi-Shot Video Narrative Match xxx

Fudan University｜China Telecom, TeleAI

Cailin Zhuang*, Yaoqi Hu*, Zheng Dong, Shiwen Zhang, Haibin Huang†, Chi Zhang, Xuelong Li‡

Continuous Multi-Shot Video Narrative

CVPR 2026｜ViStoryBench: Comprehensive Benchmark Suite for Story Visualization

ShanghaiTech University｜StepFun

Cailin Zhuang*, Ailin Huang*†, Yaoqi Hu*, Jingwei Wu, Wei Cheng†, Jiaqi Liao, Hongyuan Wang, Xinyao Liao, Weiwei Cai, Hengyuan Xu, Xuanyang Zhang, Xianfang Zeng, Zhewei Huang‡, Gang Yu‡, Chi Zhang‡

Story visualization aims to generate coherent image sequences that faithfully represent a narrative and match given character references. Despite progress in generative models, existing benchmarks remain narrow in scope, often limited to short prompts, lacking character references, or single-image cases, failing to reflect real-world narrative complexity and obscuring true model performance. We introduce ViStoryBench, a comprehensive benchmark designed to evaluate story visualization models across varied narrative structures, visual styles, and character settings. It features richly annotated multi-shot scripts derived from curated stories spanning literature, film, and folklore. Large language models assist in story summarization and script generation, with all outputs verified by humans for coherence and fidelity. Character references are carefully curated to maintain consistency across different artistic styles.
ViStoryBench proposes a suite of multi-dimensional automated metrics to evaluate character consistency, style similarity, prompt alignment, aesthetic quality, and artifacts like copy-paste behavior. These metrics are validated through human studies and used to assess a broad range of open-source and commercial models, enabling systematic analysis and encouraging advances in visual storytelling.

ArXiv 2025｜StyleMe3D: Stylization with Disentangled Priors by Multiple Encoders on 3D Gaussians

ShanghaiTech University｜Guangming Lab｜StepFun

Cailin Zhuang, Yaoqi Hu, Xuanyang Zhang†, Wei Cheng, Jiacheng Bao, Shengqi Liu, Yiying Yang, Xianfang Zeng, Gang Yu, Ming Li‡

Current 3D Gaussian Splatting stylization approaches are limited in their ability to represent diverse artistic styles, frequently defaulting to low-level texture replacement or yielding semantically inconsistent outputs. In this paper, we introduce StyleMe3D, a novel hierarchical framework that achieves comprehensive, high-fidelity stylization by disentangling multi-level style representations while preserving geometric fidelity. The cornerstone of StyleMe3D is Dynamic Style Score Distillation (DSSD), which harnesses latent priors from a style-aware diffusion model to provide high-level semantic guidance, ensuring robust and expressive style transfer. To further refine this distillation process, we propose a multi-modal alignment strategy using the CLIP latent space: a CLIP-based style stream evaluator (Contrastive Style Descriptor) that enforces middle-level stylistic similarity, and a CLIP-based content stream evaluator (3D Gaussian Quality Assessment) that acts as a global regularizer to mitigate typical GS quality degradation. Finally, a VGG-based Simultaneously Optimized Scale module is integrated to refine fine-grained texture details at the low-level. Extensive experiments demonstrate that our method consistently preserves intricate geometric details and achieves coherent stylistic effects across entire scenes, significantly surpassing state-of-the-art baselines in both qualitative and quantitative evaluations.

Ongoing Work

(On Going) CVPR 2027｜Video World Model

FDU｜SAIS｜SII

Cailin Zhuang, Yaoqi Hu, Siyu Zhu‡

Video World Model

(On Going) CVPR 2027｜fMRI-guided Video Reconstruction

CQUT｜FDU

Xinqian Zhang*, Cailin Zhuang*†, Yaoqi Hu, Qingling Xia‡

fMRI-guided Video Reconstruction