Team

SciMDR: Advancing Scientific Multimodal Document Reasoning

• Ziyu Chen
• Yilun Zhao
• Chengye Wang
• Rilyn Han
• Manasi Patwardhan
• Arman Cohan

SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded Tasks

• Yilun Zhao
• Kaiyan Zhang
• Tiansheng Hu
• Sihong Wu
• Ronan Le Bras
• Charles McGrady
• Taira Anderson
• Jonathan Bragg
• Joseph Chee Chang
• Jesse Dodge
• Matt Latzke
• Yixin Liu
• Xiangru Tang
• Zihang Wang
• Chen Zhao
• Hannaneh Hajishirzi
• Doug Downey
• Arman Cohan

SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature

• David Wadden
• Kejian Shi
• Jacob Morrison
• Alan Li
• Aakanksha Naik
• Shruti Singh
• Nitzan Barzilay
• Kyle Lo
• Tom Hope
• Luca Soldaini
• Shannon Zejiang Shen
• Doug Downey
• Hannaneh Hajishirzi
• Arman Cohan

Can Multimodal Foundation Models Understand Schematic Diagrams? An Empirical Study on Information-Seeking QA over Scientific Papers

• Yilun Zhao
• Chengye Wang
• Chuhan Li
• Arman Cohan

IdeaAnchor: Teaching LLMs to Turn Literature into Research Ideas

• Ziyu Chen
• Yilun Zhao
• Jiashuo Sun
• Yiling Ma
• Manasi Patwardhan
• Arman Cohan

BackTrend: Evaluating Scientific Weak-Signal Prediction via Backward Reconstruction

• Xiao Zhou
• Yilun Zhao
• Owen Jiang
• Tiansheng Hu
• Cai Xu
• Manasi Patwardhan
• Arman Cohan

IdeaAMBIG: Benchmarking Implementation-Critical Gaps in Research-Idea Specifications

• Yiling Ma
• Yilun Zhao
• Sihong Wu
• Manasi Patwardhan
• Arman Cohan

Measuring the Gap Between Human and LLM Research Ideas

• Ziyu Chen
• Yilun Zhao
• Arman Cohan

AbGen: Evaluating Large Language Models in Ablation Study Design and Evaluation for Scientific Research

• Yilun Zhao
• Weiyuan Chen
• Zhijian Xu
• Manasi Patwardhan
• Chengye Wang
• Yixin Liu
• Lovekesh Vig
• Arman Cohan

Demystifying Scientific Problem-Solving in LLMs by Probing Knowledge and Reasoning

• Alan Li
• Yixin Liu
• Arpan Sarkar
• Doug Downey
• Arman Cohan

Physics: Benchmarking Foundation Models on University-Level Physics Problem Solving

• Kaiyue Feng
• Yilun Zhao
• Yixin Liu
• Tianyu Yang
• Chen Zhao
• John Sous
• Arman Cohan

ActReview: Rebuttal-Guided Training Data and Rubric Rewards for Actionable Peer Review Generation

• Yiling Ma
• Yilun Zhao
• Sihong Wu
• Ziyu Chen
• Manasi Patwardhan
• Arman Cohan

RbtAct: Rebuttal as Supervision for Actionable Review Feedback Generation

• Sihong Wu
• Yiling Ma
• Yilun Zhao
• Tiansheng Hu
• Owen Jiang
• Manasi Patwardhan
• Arman Cohan

Can LLMs Identify Critical Limitations within Scientific Research? A Systematic Evaluation on AI Research Papers

• Zhijian Xu
• Yilun Zhao
• Manasi Patwardhan
• Lovekesh Vig
• Arman Cohan

SciVer: Evaluating Foundation Models for Multimodal Scientific Claim Verification

• Chengye Wang
• Yifei Shen
• Zexi Kuang
• Arman Cohan
• Yilun Zhao

SciSketch: An Open-source Framework for Automated Schematic Diagram Generation in Scientific Papers

• Zihang Wang
• Yilun Zhao
• Kaiyan Zhang
• Chen Zhao
• Manasi Patwardhan
• Arman Cohan

A Survey on Evaluation of LLM-based Agents

• Asaf Yehudai
• Lilach Eden
• Alan Li
• Guy Uziel
• Yilun Zhao
• Roy Bar-Haim
• Arman Cohan
• Michal Shmueli-Scheuer