Live
Black Hat USADark ReadingBlack Hat AsiaAI Business跳出幸存者偏差,从结构性资源分配解析财富真相Dev.to AIOpenClaw vs Cloud AI: Which One Actually Gives Businesses More Control?Medium AI“In a World of AI Content, Being Human Is Your Superpower”Medium AIHow AI is Transforming the Role of a CFO in 2026.Medium AIHow to Build Self-Running AI Tasks with TypeScript (No Cron Jobs Needed)Dev.to AIFaked Fire Drill!Medium AIThe Sentinel: AI-Powered Zero-Touch Insurance for Gig WorkersDev.to AIDecision Trees from Data: Building Context-Aware ModelsDev.to AIFrom Crisis to Clinic: How AI Automates Drug Shortage ResolutionDev.to AIThe Hidden Cost of ChatGPT: Your Assignments Have a Carbon FootprintMedium AIOllama vs OpenAI API: A TypeScript Developer's Honest ComparisonDev.to AIAI in Telehealth & Telemedicine Market Size, Share, Growth 2034 - Fortune Business InsightsGoogle News: Machine LearningBlack Hat USADark ReadingBlack Hat AsiaAI Business跳出幸存者偏差,从结构性资源分配解析财富真相Dev.to AIOpenClaw vs Cloud AI: Which One Actually Gives Businesses More Control?Medium AI“In a World of AI Content, Being Human Is Your Superpower”Medium AIHow AI is Transforming the Role of a CFO in 2026.Medium AIHow to Build Self-Running AI Tasks with TypeScript (No Cron Jobs Needed)Dev.to AIFaked Fire Drill!Medium AIThe Sentinel: AI-Powered Zero-Touch Insurance for Gig WorkersDev.to AIDecision Trees from Data: Building Context-Aware ModelsDev.to AIFrom Crisis to Clinic: How AI Automates Drug Shortage ResolutionDev.to AIThe Hidden Cost of ChatGPT: Your Assignments Have a Carbon FootprintMedium AIOllama vs OpenAI API: A TypeScript Developer's Honest ComparisonDev.to AIAI in Telehealth & Telemedicine Market Size, Share, Growth 2034 - Fortune Business InsightsGoogle News: Machine Learning
AI NEWS HUBbyEIGENVECTOREigenvector

Relightable Holoported Characters: Capturing and Relighting Dynamic Human Performance from Sparse Views

arXivMarch 31, 20262 min read0 views
Source Quiz

arXiv:2512.00255v2 Announce Type: replace Abstract: We present Relightable Holoported Characters (RHC), a novel person-specific method for free-view rendering and relighting of full-body and highly dynamic humans solely observed from sparse-view RGB videos at inference. In contrast to classical one-light-at-a-time (OLAT)-based human relighting, our transformer-based RelightNet predicts relit appearance within a single network pass, avoiding costly OLAT-basis capture and generation. For training such a model, we introduce a new capture strategy and dataset recorded in a multi-view lightstage, w — Kunwar Maheep Singh, Jianchun Chen, Vladislav Golyanik, Stephan J. Garbin, Thabo Beeler, Rishabh Dabral, Marc Habermann, Christian Theobalt

View PDF HTML (experimental)

Abstract:We present Relightable Holoported Characters (RHC), a novel person-specific method for free-view rendering and relighting of full-body and highly dynamic humans solely observed from sparse-view RGB videos at inference. In contrast to classical one-light-at-a-time (OLAT)-based human relighting, our transformer-based RelightNet predicts relit appearance within a single network pass, avoiding costly OLAT-basis capture and generation. For training such a model, we introduce a new capture strategy and dataset recorded in a multi-view lightstage, where we alternate frames lit by random environment maps with uniformly lit tracking frames, simultaneously enabling accurate motion tracking and diverse illumination as well as dynamics coverage. Inspired by the rendering equation, we derive physics-informed features that encode geometry, albedo, shading, and the virtual camera view from a coarse human mesh proxy and the input views. Our RelightNet then takes these features as input and cross-attends them with a novel lighting condition, and regresses the relit appearance in the form of texel-aligned 3D Gaussian splats attached to the coarse mesh proxy. Consequently, our RelightNet implicitly learns to efficiently compute the rendering equation for novel lighting conditions within a single feed-forward pass. Experiments demonstrate our method's superior visual fidelity and lighting reproduction compared to state-of-the-art approaches. Project page: this https URL

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2512.00255 [cs.CV]

(or arXiv:2512.00255v2 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2512.00255

arXiv-issued DOI via DataCite

Submission history

From: Kunwar Maheep Singh [view email] [v1] Sat, 29 Nov 2025 00:17:34 UTC (13,865 KB) [v2] Mon, 30 Mar 2026 13:16:23 UTC (14,229 KB)

Was this article helpful?

Sign in to highlight and annotate this article

AI
Ask AI about this article
Powered by Eigenvector · full article context loaded
Ready

Conversation starters

Ask anything about this article…

Daily AI Digest

Get the top 5 AI stories delivered to your inbox every morning.

More about

researchpaperarxiv

Knowledge Map

Knowledge Map
TopicsEntitiesSource
Relightable…researchpaperarxivcomputer-vi…image-recog…arXiv

Connected Articles — Knowledge Graph

This article is connected to other articles through shared AI topics and tags.

Knowledge Graph100 articles · 221 connections
Scroll to zoom · drag to pan · click to open

Discussion

Sign in to join the discussion

No comments yet — be the first to share your thoughts!

More in Research Papers