SimplerEnv-SOFAR

The SoFar manipulation evaluation for Simpler_Env.

Installation

Create an anaconda environment:

conda create -n simpler_env python=3.10 (any version above 3.10 should be fine)
conda activate simpler_env

Clone this repo:

git clone https://github.com/Zhangwenyao1/SimplerEnv-SOFAR

This repository's code is based in the SimplerEnv and the ManiSkill2 based ManiSkill2 from JiayuanGU for the Open-Loop control.

Install SimplerEnv:

see SimplerEnv for installation instructions.

Install GSNET:

see [GSNET/READNE.md]

This code is based on graspnet-baseline, you can use the code to predict the grasp.

Install Motion Planning Moduel:

see [./plan/README.md]

You need modify the checkpoint or config path in following files in plan:

plan/src/utils/constants.py

(Acknowledge haoranliu for the code) !!! The motion planning module code is based in the ompl.

Install SoFar:

see SoFar for installation instructions.

Notion:

You have to install GroundingDINO for the evaluation.

You need modify the checkpoint or config path in following files in SoFar:

SoFar/depth/metric3dv2.py

SoFar/segmentation/grounding_dino.py

SoFar/segmentation/sam.py

SoFar/serve/pointso.py

Citation

If you find our ideas / environments helpful, please cite our work at

@article{qi2025sofar,
  author = {Qi, Zekun and Zhang, Wenyao and Ding, Yufei and Dong, Runpei and Yu, Xinqiang and Li, Jingwen and Xu, Lingyun and Li, Baoyu and He, Xialin and Fan, Guofan and Zhang, Jiazhao and He, Jiawei and Gu, Jiayuan and Jin, Xin and Ma, Kaisheng and Zhang, Zhizheng and Wang, He and Yi, Li},
  title = {SoFar: Language-Grounded Orientation Bridges Spatial Reasoning and Object Manipulation},
  journal = {arXiv preprint arXiv:2502.13143},
  year = {2025}
}