Title: Swe-lego: Pushing the limits of supervised fine-tuning for software issue resolving
Authors: Chaofan Tao, Jierun Chen, Yuxin Jiang, Kaiqi Kou, Shaowei Wang, Ruoyu Wang, Xiaohui Li, Sidi Yang, Yiming Du, Jianbo Dai, Zhiming Mao, Xinyu Wang, Lifeng Shang, Haoli Bai
Year: 2026
Venue: arXiv preprint arXiv:2601.01426
URL: arXiv:2601.01426
TL;DR (EN): SWE-Lego presents a strong SFT-only recipe (new dataset + curriculum/error masking) and studies verifier-based test-time scaling, pushing open 8B/32B models to SOTA on SWE-bench Verified.
TL;DR: SWE-Lego提出仅用监督微调的强配方（新数据集+课程学习/错误掩码），并研究基于验证器的测试时扩展，将开源8B/32B模型在SWE-bench Verified上推至SOTA。

Title: MMFormalizer: Multimodal Autoformalization in the Wild
Authors: Jing Xiong, Qi Han, Yunta Hsieh, Hui Shen, Huajian Xin, Chaofan Tao, Chenyang Zhao, Hengyuan Zhang, Taiqiang Wu, Zhen Zhang, Haochen Wang, Zhongwei Wan, Lingpeng Kong, Ngai Wong
Year: 2026
Venue: arXiv preprint arXiv:2601.03017
URL: arXiv:2601.03017
TL;DR (EN): MMFormalizer extends autoformalization to multimodal math/physics by grounding visual entities and recursively composing axioms, enabling formal statements for real-world problems (including classical mechanics) on the PhyX-AF benchmark.
TL;DR: MMFormalizer将自动形式化扩展到多模态数学/物理领域，通过将视觉实体落地并递归组合公理，在PhyX-AF基准上实现真实世界问题（包括经典力学）的形式化表述。

Title: SwingArena: Competitive Programming Arena for Long-context GitHub Issue Solving
Authors: Wendong Xu, Jing Xiong, Chenyang Zhao, Qiujiang Chen, Haoran Wang, Hui Shen, Zhongwei Wan, Jianbo Dai, Taiqiang Wu, He Xiao, Chaofan Tao, Z Morley Mao, Ying Sheng, Zhijiang Guo, Hongxia Yang, Bei Yu, Lingpeng Kong, Quanquan Gu, Ngai Wong
Year: 2026
Venue: International Conference on Learning Representations (oral)
URL: arXiv:2505.23932
TL;DR (EN): SwingArena is a CI-driven competitive framework where LLMs act as submitters and reviewers, paired with retrieval-augmented code generation to handle long-context, multi-language GitHub issue solving.
TL;DR: SwingArena是一个CI驱动的竞争框架，让大语言模型扮演提交者和审阅者角色，配合检索增强的代码生成来处理长上下文、多语言的GitHub问题解决。

Title: Mmsearch-plus: Benchmarking provenance-aware search for multimodal browsing agents
Authors: Xijia Tao, Yihua Teng, Xinxing Su, Xinyu Fu, Jihao Wu, Chaofan Tao, Ziru Liu, Haoli Bai, Rui Liu, Lingpeng Kong
Year: 2026
Venue: International Conference on Learning Representations
URL: arXiv:2508.21475
TL;DR (EN): MMSearch-Plus is a 311-task benchmark and agent framework with set-of-mark tools that require provenance-aware, vision-in-the-loop search and cross-validation under retrieval noise.
TL;DR: MMSearch-Plus是一个包含311个任务的基准和智能体框架，配备set-of-mark工具，要求在检索噪声下进行可追溯、视觉在环的搜索和交叉验证。

Title: OVD: On-policy Verbal Distillation
Authors: Jing Xiong, Hui Shen, Shansan Gong, Yuxin Cheng, Jianghan Shen, Chaofan Tao, Haochen Tan, Haoli Bai, Lifeng Shang, Ngai Wong
Year: 2026
Venue: arXiv preprint arXiv:2601.21968
URL: arXiv:2601.21968
TL;DR (EN): On-policy Verbal Distillation replaces token-level matching with trajectory-level distillation using discrete teacher scores, reducing memory and improving student performance on web QA and math reasoning.
TL;DR: On-policy Verbal Distillation用轨迹级蒸馏替代token级匹配，使用离散的教师评分，降低内存占用并在网络问答和数学推理上提升学生模型性能。

Title: From Verifiable Dot to Reward Chain: Harnessing Verifiable Reference-based Rewards for Reinforcement Learning of Open-ended Generation
Authors: Yuxin Jiang, Yufei Wang, Qiyuan Zhang, Xingshan Zeng, Liangyou Li, Jierun Chen, Chaofan Tao, Haoli Bai, Lifeng Shang
Year: 2026
Venue: International Conference on Learning Representations
URL: arXiv:2601.18533
TL;DR (EN): RLVRR turns single verifiable end rewards into ordered reference-derived reward chains (content + style) to make RL for open-ended generation more efficient and less prone to reward hacking.
TL;DR: RLVRR将单一的可验证终端奖励转化为有序的参考衍生奖励链（内容+风格），使开放式生成的强化学习更高效且更不易出现奖励破解。

Title: PhyX: Does Your Model Have the “Wits” for Physical Reasoning?
Authors: Hui Shen, Taiqiang Wu, Qi Han, Yunta Hsieh, Jizhou Wang, Yuyue Zhang, Yuxin Cheng, Zijian Hao, Yuansheng Ni, Xin Wang, Zhongwei Wan, Kai Zhang, Wendong Xu, Jing Xiong, Ping Luo, Wenhu Chen, Chaofan Tao, Zhuoqing Mao, Ngai Wong
Year: 2025
Venue: arXiv preprint arXiv:2505.15929
URL: arXiv:2505.15929
TL;DR (EN): PhyX introduces a 3K-question multimodal benchmark spanning six physics domains to test physics-grounded reasoning, revealing large gaps between top models and human experts.
TL;DR: PhyX引入一个包含3000个问题的多模态基准，覆盖六个物理领域，用于测试基于物理的推理，揭示了顶级模型与人类专家之间的巨大差距。

Title: Scaling laws with vocabulary: Larger models deserve larger vocabularies
Authors: Chaofan Tao, Qian Liu, Longxu Dou, Niklas Muennighoff, Zhongwei Wan, Ping Luo, Min Lin, Ngai Wong
Year: 2024
Venue: Advances in Neural Information Processing Systems (NeurIPS-2024)
URL: arXiv:2407.13623
TL;DR (EN): The paper derives compute-optimal vocabulary scaling laws and shows larger models benefit from larger vocabularies, improving downstream accuracy at fixed FLOPs.
TL;DR: 推导了计算最优的词表规模扩展规律，证明更大模型需要更大词表，在相同计算量下提升下游任务准确率。

Title: Autoregressive Models in Vision: A Survey
Authors: Jing Xiong, Gongye Liu, Lun Huang, Chengyue Wu, Taiqiang Wu, Yao Mu, Yuan Yao, Hui Shen, Zhongwei Wan, Jinfa Huang, Chaofan Tao, Shen Yan, Huaxiu Yao, Lingpeng Kong, Hongxia Yang, Mi Zhang, Guillermo Sapiro, Jiebo Luo, Ping Luo, Ngai Wong
Year: 2025
Venue: Transactions on Machine Learning Research (TMLR-2025)
URL: arXiv:2411.05902
TL;DR (EN): A comprehensive survey of visual autoregressive modeling, covering representation strategies and applications across image, video, 3D, and multimodal generation, plus open challenges.
TL;DR: 全面综述视觉自回归建模方法，涵盖表示策略及其在图像、视频、3D和多模态生成中的应用，并讨论开放挑战。

Title: Srpo: Enhancing multimodal llm reasoning via reflection-aware reinforcement learning
Authors: Zhongwei Wan, Zhihao Dou, Che Liu, Yu Zhang, Dongfei Cui, Qinjian Zhao, Hui Shen, Jing Xiong, Yi Xin, Yifan Jiang, Chaofan Tao, Yangfan He, Mi Zhang, Shen Yan
Year: 2025
Venue: arXiv preprint arXiv:2506.01713
URL: arXiv:2506.01713
TL;DR (EN): SRPO is a reflection-aware RL framework that teaches MLLMs self-reflection and then optimizes concise, meaningful reflections with GRPO-style rewards to improve multimodal reasoning.
TL;DR: SRPO是一个反思感知的强化学习框架，先训练多模态大模型学会自我反思，再用GRPO式奖励优化简洁有效的反思，从而提升多模态推理能力。

Title: The synergy dilemma of long-cot sft and rl: Investigating post-training techniques for reasoning vlms
Authors: Jierun Chen, Tiezheng Yu, Haoli Bai, Lewei Yao, Jiannan Wu, Kaican Li, Fei Mi, Chaofan Tao, Lei Zhu, Manyi Zhang, Xiaohui Li, Lu Hou, Lifeng Shang, Qun Liu
Year: 2025
Venue: arXiv preprint arXiv:2507.07562
URL: arXiv:2507.07562
TL;DR (EN): The study compares long-CoT SFT vs. RL for reasoning VLMs and finds their combination often fails to yield additive gains, instead trading off accuracy, verbosity, and style.
TL;DR: 比较长链思维监督微调与强化学习在视觉语言模型推理中的作用，发现两者组合往往无法带来叠加收益，而是在准确率、冗长程度和风格之间权衡。

Title: NAVERO: Unlocking Fine-Grained Semantics for Video-Language Compositionality
Authors: Chaofan Tao, Gukyeong Kwon, Varad Gunjal, Hao Yang, Zhaowei Cai, Yonatan Dukler, Ashwin Swaminathan, R Manmatha, Colin Jon Taylor, Stefano Soatto
Year: 2024
Venue: arXiv preprint arXiv:2408.09511
URL: arXiv:2408.09511
TL;DR (EN): NAVERO introduces the AARO benchmark and negative-text augmentation with a negative-augmented matching loss to improve video-language compositional understanding and retrieval.
TL;DR: NAVERO提出AARO基准，并通过负文本增强和负增强匹配损失，提升视频-语言模型对组合语义的理解和检索能力。

Title: ATTS: Asynchronous Test-Time Scaling via Conformal Prediction
Authors: Jing Xiong, Qiujiang Chen, Fanghua Ye, Zhongwei Wan, Chuanyang Zheng, Chenyang Zhao, Hui Shen, Alexander Hanbo Li, Chaofan Tao, Haochen Tan, Haoli Bai, Lifeng Shang, Lingpeng Kong, Ngai Wong
Year: 2026
Venue: International Conference on Learning Representations
URL: arXiv:2509.15148
TL;DR (EN): ATTS is an asynchronous, conformal-prediction-based test-time scaling method that cuts synchronization overhead and accelerates scaling with statistical guarantees and no accuracy loss.
TL;DR: ATTS是一种基于一致性预测的异步测试时扩展方法，减少同步开销，在统计保证和无准确率损失的情况下加速扩展。

Title: UNCOMP: Can Matrix Entropy Uncover Sparsity? - A Compressor Design from an Uncertainty-Aware Perspective
Authors: Jing Xiong, Jianghan Shen, Fanghua Ye, Chaofan Tao, Zhongwei Wan, Jianqiao Lu, Xun Wu, Chuanyang Zheng, Zhijiang Guo, Min Yang, Lingpeng Kong, Ngai Wong
Year: 2025
Venue: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
URL: DOI:10.48448/v1xq-f328
TL;DR (EN): UNComp uses uncertainty (via truncated matrix entropy) to uncover KV-cache sparsity and perform adaptive compression for long-context inference, greatly shrinking cache while boosting throughput.
TL;DR: UNComp使用不确定性（通过截断矩阵熵）来发现KV缓存的稀疏性，并对长上下文推理进行自适应压缩，大幅缩小缓存同时提升吞吐量。

Title: Find your optimal teacher: Personalized data synthesis via router-guided multi-teacher distillation
Authors: Hengyuan Zhang, Shiping Yang, Xiao Liang, Chenming Shang, Yuxuan Jiang, Chaofan Tao, Jing Xiong, Hayden Kwok-Hay So, Ruobing Xie, Angel X Chang, Ngai Wong
Year: 2025
Venue: arXiv preprint arXiv:2510.10925
URL: arXiv:2510.10925
TL;DR (EN): PerSyn “routes then generates” by assigning each prompt to its best teacher via a router that considers student learnability and teacher quality, improving synthetic-data distillation efficiency.
TL;DR: PerSyn采用”先路由后生成”策略，通过考虑学生学习能力和教师质量的路由器为每个提示分配最佳教师，提高合成数据蒸馏效率。

Title: AnchorTP: Resilient LLM Inference with State-Preserving Elastic Tensor Parallelism
Authors: Wendong Xu, Chujie Chen, He Xiao, Kuan Li, Jing Xiong, Chen Zhang, Wenyong Zhou, Chaofan Tao, Yang Bai, Bei Yu, Ngai Wong
Year: 2026
Venue: DATE
URL: arXiv:2511.11617
TL;DR (EN): AnchorTP provides state-preserving elastic tensor parallelism with a GPU-resident daemon and bandwidth-aware migration planning, enabling fast recovery from single-GPU failures.
TL;DR: AnchorTP提供状态保持的弹性张量并行，通过GPU常驻守护进程和带宽感知的迁移规划，实现从单GPU故障的快速恢复。

Title: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models
Authors: Zhongwei Wan, Xinjian Wu, Yu Zhang, Yi Xin, Chaofan Tao, Zhihong Zhu, Xin Wang, Siqi Luo, Jing Xiong, Longyue Wang, Mi Zhang
Year: 2024
Venue: The Thirteenth International Conference on Learning Representations
URL: arXiv:2406.13035
TL;DR (EN): D2O dynamically compresses KV cache at layer and token levels with allocation and recall/merge compensation, saving memory and improving long-context throughput without fine-tuning.
TL;DR: D2O在层和token级别动态压缩KV缓存，通过分配和召回/合并补偿，无需微调即可节省内存并提升长上下文吞吐量。

Title: Crossget: Cross-guided ensemble of tokens for accelerating vision-language transformers
Authors: Dachuan Shi, Chaofan Tao, Anyi Rao, Zhendong Yang, Chun Yuan, Jiaqi Wang
Year: 2024
Venue: International Conference on Machine Learning
URL: arXiv:2305.17455
TL;DR (EN): CrossGET accelerates vision-language Transformers by cross-modally matching and ensembling tokens with efficient soft matching, reducing compute with minimal accuracy loss.
TL;DR: CrossGET通过跨模态匹配和集成token，使用高效的相似token匹配加速视觉-语言Transformer，在最小准确率损失下减少计算量。

Title: Rethinking kullback-leibler divergence in knowledge distillation for large language models
Authors: Taiqiang Wu, Chaofan Tao, Jiahao Wang, Runming Yang, Zhe Zhao, Ngai Wong
Year: 2024
Venue: Proceedings of the 31st International Conference on Computational Linguistics
URL: arXiv:2404.02657
TL;DR (EN): It shows forward and reverse KL behave similarly in LLM distillation with enough training but emphasize head vs. tail early; Adaptive KL combines them to improve generation quality and diversity.
TL;DR: 研究表明在充分训练下，前向和反向KL在大语言模型蒸馏中表现相似，但早期分别关注分布头部和尾部；自适应KL结合两者以提升生成质量和多样性。

Title: Structured pruning for efficient generative pre-trained language models
Authors: Chaofan Tao, Lu Hou, Haoli Bai, Jiansheng Wei, Xin Jiang, Qun Liu, Ping Luo, Ngai Wong
Year: 2023
Venue: Findings of the Association for Computational Linguistics: ACL 2023
URL: DOI:10.18653/v1/2023.findings-acl.692
TL;DR (EN): It proposes structured pruning across multiple generative-PLM components using learnable masks and sparse training to extract size-flexible subnets with significant speedups.
TL;DR: 提出对生成式预训练语言模型多个组件的结构化剪枝，使用可学习掩码和稀疏训练提取尺寸灵活的子网络，实现显著加速。

Title: Compression of Generative Pre-trained Language Models via Quantization
Authors: Chaofan Tao, Lu Hou, Wei Zhang, Lifeng Shang, Xin Jiang, Qun Liu, Ping Luo, Ngai Wong
Year: 2022
Venue: ACL 2022 (outstanding)
URL: arXiv:2203.10705
TL;DR (EN): It adapts quantization to generative PLMs, addressing embedding homogenization with token-level contrastive distillation and module-wise dynamic scaling to achieve 13–14× compression at near full precision.
TL;DR: 将量化方法适配到生成式预训练语言模型，通过token级对比蒸馏解决嵌入同质化问题，并用模块级动态缩放实现接近全精度的13-14倍压缩。

Title: Upop: Unified and progressive pruning for compressing vision-language transformers
Authors: Dachuan Shi, Chaofan Tao, Ying Jin, Zhendong Yang, Chun Yuan, Jiaqi Wang
Year: 2023
Venue: International Conference on Machine Learning
URL: arXiv:2301.13741
TL;DR (EN): UPop is a unified progressive pruning framework that searches multimodal subnets in a continuous space and progressively retrains to achieve high compression for vision-language Transformers.
TL;DR: UPop是一个统一的渐进式剪枝框架，在连续空间中搜索多模态子网络并逐步重训练，实现视觉-语言Transformer的高压缩率。