Research Platform

Lingjing

A city-scale platform for heterogeneous embodied intelligence.

Lingjing connects simulators, agents, shared world state and evaluation for open-ended urban missions. PhysX-CoT and AnyScene expand the platform with asset and scene intelligence.

Platform Overview

One platform, three research efforts

Core Platform

Lingjing

Multi-engine simulation, shared world state, heterogeneous agent coordination, and evaluation at city scale.

UAV + Vehicle + Quadruped + VesselAirSim · CARLA · MuJoCo · Cesium
View details →
Asset Intelligence

PhysX-CoT

Converts images into structured, simulator-ready physical objects with geometry, parts, and articulation.

GLB · OBJ · URDF · MJCF
View details →
Scene Intelligence

AnyScene

Turns real-world places and mission contracts into validated, executable task environments.

Fire Response · Navigation
View details →
Lingjing Platform Architecture
Lingjing Platform Architecture Open PDF
Core Platform

Embodied Intelligence System

Lingjing

A shared world for heterogeneous agents and open-ended missions.

Lingjing: A Simulation Testbed for Multi-Agent Embodied Tasks in Open-Ended Cities

EmbodimentsUAV · Vehicle · Quadruped · Vessel
EnginesAirSim · CARLA · MuJoCo · Cesium
MissionsNatural-language single & multi-agent tasks

System-level result

Execution from the Lingjing testbed

Agents perceive, decide, communicate and act in a shared city-scale world.

Download MP4
Pipeline inspection Pipeline target

Guidance & Execution

UAV-guided pipeline inspection

Aerial agent observes infrastructure and exposes a grounded target for the ground robot.

UAV + Quadruped
Fire response Fire response action

Emergency Response

Multi-robot fire response

Ground robots share an industrial scene while inspection and response roles execute.

Quadruped Team
Traffic coordination Traffic route

City Mobility

Traffic observation & route planning

Aerial view exposes congestion; the road agent plans a route over shared city state.

UAV + Vehicle
Sea search Sea pickup

Search & Rescue

Sea search with vessel pickup

Airborne search and maritime response represented in one mission-level environment.

UAV + Vessel
Enabling Module

Asset Intelligence

PhysX-CoT

Supplies reusable physical objects to the Lingjing world.

PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets

RoleAsset acquisition for the platform
OutputGLB · OBJ · URDF · MJCF
ApproachExplicit structured physical reasoning

When Lingjing needs a physical object, PhysX-CoT converts an image into structured geometry, part semantics, material and articulation information, plus engine-ready files.

Loading model...

Articulated Asset

Headphones

Seven recovered part groups with textured surfaces and revolute joint metadata.

Download GLB
Loading model...

Articulated Asset

Office Chair

Part decomposition preserves seat, back, base and supports for manipulation.

Download GLB

Object-level · 12s

Robot Interaction

The generated object is located and lifted inside simulation.

Scene-level · 11s

Physical Response

Multiple generated assets respond together to a scene-level force.

Enabling Module

Scene Intelligence

Lingjing-AnyScene

Supplies validated task environments to the Lingjing runtime.

RoleTask-scene construction
EvidenceFire response · Visual navigation
ScopeScene validity, not policy success

AnyScene observes a real-world substrate, acquires task-local assets, writes placements, runs physics and visual audits, then exports a portable scene package that Lingjing can execute.

Case 01 · Fire Response

Emergency equipment staged on a Melbourne road slice

Acquires 6 task-specific categories, places 14 instances, passes physical and guide checks.

6/6categories
14/14stable
0violations
Perceived substrate
Perceived
Validated placement
Validated

Case 02 · Visual Navigation

Checkpoints and charging return for a quadruped

Converts a navigation contract into beacons, barriers, signs and support equipment.

6/6categories
14/14stable
VDNcontract
Perceived substrate
Perceived
Validated placement
Validated

Selected Task-Local Assets

Fire extinguisher ref Fire extinguisher QC Fire extinguisher
Hose reel ref Hose reel QC Hose reel
Traffic cone ref Traffic cone QC Traffic cone
Waypoint beacon ref Waypoint beacon QC Waypoint beacon
Barrier ref Barrier QC Barrier panel
Charging dock ref Charging dock QC Charging dock

Papers & Resources

Publications and code

Core Platform

Lingjing

Lingjing: A Simulation Testbed for Multi-Agent Embodied Tasks in Open-Ended Cities

Asset Intelligence

PhysX-CoT

PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets

Scene Intelligence

Lingjing-AnyScene

Mission-conditioned task scene construction

Questions? Contact the research team.

Contact us