OpenHands: An Open Platform for AI Software Developers as Generalist Agents X Wang, B Li, Y Song, FF Xu, X Tang, M Zhuge, J Pan, Y Song, B Li, ... arXiv 2024, 2024 | 54* | 2024 |
Inversion-Free Image Editing with Natural Language S Xu*, Y Huang*, J Pan, Z Ma, J Chai CVPR 2024, 2023 | 39* | 2023 |
Autonomous Evaluation and Refinement of Digital Agents J Pan, Y Zhang, N Tomlin, Y Zhou, S Levine, A Suhr COLM 2024 | CVPR MAR Workshop (Best Paper) 2024, 2024 | 37 | 2024 |
Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning Y Zhai, H Bai*, Z Lin*, J Pan*, S Tong*, Y Zhou*, A Suhr, S Xie, Y LeCun, ... NeurIPS 2024, 2024 | 33 | 2024 |
Data-Efficient Learning of Natural Language to Linear Temporal Logic Translators for Robot Task Specification J Pan, G Chou, D Berenson ICRA 2023, 2023 | 32 | 2023 |
Fairedit: Preserving fairness in graph neural networks through greedy graph editing D Loveland, J Pan, AF Bhathena, Y Lu arXiv 2022, 2022 | 25 | 2022 |
ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL Y Zhou, A Zanette, J Pan, S Levine, A Kumar ICML 2024, 2024 | 23 | 2024 |
Digirl: Training in-the-wild device-control agents with autonomous reinforcement learning H Bai, Y Zhou, M Cemri, J Pan, A Suhr, S Levine, A Kumar NeurIPS 2024, 2024 | 20 | 2024 |
Grounding Visual Illusions in Language: Do Vision-Language Models Perceive Illusions Like Humans? Y Zhang, J Pan, Y Zhou, R Pan, J Chai EMNLP 2023, 2023 | 20 | 2023 |
Danli: Deliberative agent for following natural language instructions Y Zhang, J Yang, J Pan, S Storks, N Devraj, Z Ma, KP Yu, Y Bao, J Chai EMNLP (Oral) 2022, 2022 | 15 | 2022 |
World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models Z Ma*, J Pan*, J Chai ACL (Outstanding Paper Award) 2023, 2023 | 12 | 2023 |
SEAGULL: An Embodied Agent for Instruction Following through Situated Dialog Y Zhang, J Yang, K Yu, Y Dai, S Storks, Y Bao, J Pan, N Devraj, Z Ma, ... Alexa Prize SimBot Challenge Proceedings (Champion), 2023 | 3 | 2023 |
Training Software Engineering Agents and Verifiers with SWE-Gym J Pan, X Wang, G Neubig, N Jaitly, H Ji, A Suhr, Y Zhang arXiv 2024, 2024 | | 2024 |