a hidden state is worth a thousand words.

Welcome to my blog!

I am Bokai Xu (胥博凯), I received bachelor degree at CUHK Shenzhen. After that I work as an engineer at Modelbest Inc. My long-term passion is understanding the connection between deep neural networks and biological brain, and the nature of human conciousness. Currently, I do works in streaming multimodal language models.

Contact

Please feel free to get in touch via Email / WeChat.

News

• Feb 4, 2026: Our omni foundation model, MiniCPM-o-4.5 released, the world’s first omnimodal full-duplex model, where I co-designed omnimodal full-duplex architecture, and was responsible for speech capability.

• Jan 19, 2025: Our omni foundation model, MiniCPM-o-2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone released, where I contributed to end-to-end speech capability.

• Oct 14, 2024: Our paper, pure VLM-based RAG VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documents released, where I co-designed the architecture and implemented training and evaluation framework of VLM-based dense retrieval models.

• Sep 4, 2024: Our work, text dense retrieval model MiniCPM-Embedding released, contributed to contrastive learning train & eval framework.

• Aug 5, 2024: Our model MiniCPM-V-2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone released, where I contributed to enhanced OCR capability and multi-image understanding capability.

• July 1, 2024: Act as a machine learning engineer at Modelbest Inc, I work with Dr. Yuan Yao, Mr. Junbo Cui, and Mr. Weiyue Sun.

• Jan 9, 2024: Converted to Modelbest Inc. machine learning intern, my mentors are Dr. Huadong Wang and Mr. Shi Yu.

• May 23, 2023: Our paper UltraChat: Enhancing Chat Language Models by Scaling High-quality Instructional Conversations released.

• Apr 17 2023: Our paper Tool Learning with Foundation Models released.

• Apr 3, 2023: Joined ICBI@SIAT as a part-time research assistant. I work closely with Dr. Chaoyu Yang and Prof. Pengcheng Zhou on brain reconstruction.

• June 1, 2022: Joined THUNLP@THU as a part-time research assistant, my mentor is Dr. Huadong Wang.