Startup NetworxMountain West
DirectoryPeoplePatentsClinical TrialsRFPs & GrantsAnalysisSignal
Sign In
Startup Networx

A commons for deep tech in the Mountain West. Built and maintained by the community it serves. Open data, CC-BY.

© 2026 Startup Networx
Discover
DirectoryOpen RFPsEvents
Community
NewsResourcesDashboard
Contribute
Add an orgSuggest an editClaim an org
About
Embed widgetsModerationPrivacySign in
← News
News

GIF: Agentic Generation of Interactive and Functional Object Compositions for Robot Learning

Robot manipulation foundation models require scalable evaluation and data generation across diverse scenarios, with simulation providing an environment for both. Automated scene generation offers a promising path, yet prior work has largely emphasized

robotics
Read on arxiv.orgvia RSS

From the feed

Robot manipulation foundation models require scalable evaluation and data generation across diverse scenarios, with simulation providing an environment for both. Automated scene generation offers a promising path, yet prior work has largely emphasized coarse-grained scene layouts rather than fine-grained functional object compositions. Motivated by this gap, we present GIF, an agentic Generation framework for Interactive and Functional object compositions. In this framework, we recast this problem as disentangled reconstruction followed by relative pose recovery. CoGen produces instance-disentangled meshes with coarse initial poses leveraging complementary strengths of 2D and 3D generative models. GPRM refines the relative pose under joint geometric and physical guidance, and a VLM verifier selects the candidate that best matches the structured specification. We further construct a benchmark spanning eight representative contact-geometry classes and compare with state-of-the-art generators; GIF improves both asset quality and relation matching, while reducing collision rate to below 1%. Finally, we synthesize data for policy learning, revealing diversity scaling in both simulation and real-world deployment.

Continue reading on arxiv.org