Homepage
“Think big, act small, and move fast”
This webpage is last updated on 2024/03/18.
Để xem phiên bản tiếng Việt của trang này, vui lòng kéo xuống dưới hoặc nhấn vào đây
About me
Hi folks, welcome to my personal homepage! You can call me Quyet (or Quake or Quest or Quiet, don’t know which one is the most suitable, probably Quake). I’m a second year M.Phil student at the Hong Kong University of Science and Technology, under the supervision of Professor Yangqiu Song. Previously, I got my B.Sc in Data Science and Pure Math (Advanced Track) from HKUST in July 2022.
My primary research interests are centered around Natural Language Processing (NLP). Over the past two years, I have been actively engaged in the study of Commonsense Reasoning. Since the birth of ChatGPT, my perspective toward NLP has changed. After reading several posts and blogs of reputative CS professors discussing ChatGPT, I (am influenced by the idea that we) shouldn’t expect LMs to really understand language anymore because they will never understand, instead expect them to mimic human behaviors as realistic as possible. If we view LLMs as tools for industrial development, I think the current MLOps of LLMs is adequate. However, if we (want to) view LLMs as AGI, much more efforts need to be put into their development, as the two main problems with LLMs that I am concerned are efficient learning ability and generalized reasoning ability.
Therefore, for future research, I will focus on the following areas:
- Neuro-symbolic reasoning methods: I intend to investigate the utilization of external resources, specifically existing knowledge graphs, in order to facilitate the identification and rectification of erroneous beliefs within language models.
- Efficient (transfer) learning: I aspire to enable LMs to learn from very little supervision, which is a hallmark of human intelligence. I am particularly interested in how to discover and effectively finetune the most critical subnetworks of LMs w.r.t to each task.
- Basic learning ability: How to train and evaluate LLMs on such crucial skills (rule following (shift of distribution), new skill (soft rule))
About my personal life, I am a big fan of music. I consider myself as an amateur singer. Check this Youtube channel to hear my voice :D Besides, about my spiritual, I am hugely inspired by the Zen Master Thich Nhat Hanh. His Buddhism accounts for the major portion of my reasoning system. My favorite book, not surprisingly, is one of his books, Old Path White Cloud (en,vi). Also, in Feb 2023, I joined the organizing team of Vietnamese Students’ Association in HK as the Head of Event Organization.
My full academic profile can be found here. For (interesting) stories about my personal life, please check here.
Academic News
- [2024/01] My first first-author paper has been accepted to EACL’24!
- [2024/01] Finished my PhD application. I got 6 interviews from 4 universities :D But probably no more :/ Updated: two more interviews, one is from a university that I haven’t applied :D
- [2023/05] Our paper on Contextualized Commonsense Causal Reasoning has been accepted to ACL’23 Main Conference. Check it here
- [2023/04] Our paper on Commonsense Knowledge Base Population is archived. Check it here
- [2023/02] Our work on evaluating ChatGPT is out. Check this paper. Updated: it is accepted to AACL 2023 (Poster).
- [2022/11] Have a chat with Prof. Pascale. She is also interested in using commonsense knowledge to control the language model’s generation and support open-ended QA. Thus, I start working with her students :P. Updated: I am no longer a part of that group since July 2023. I feel in debt that I learned a lot from all people in the lab but only contributed a little :/
- [2022/10] My first paper has been accepted as Findings of EMNLP2022. Yeah!!!
- [2022/06] My first paper has been submitted to EMNLP2022. Let’s see if it’s accepted =)
- [2022/05] My application for M.Phil program to HKUST is accepted. I will remain in HK for two more years
Contact me!
Feel free to reach me at vqdo {at} connect [dot] ust (dot) hk.
Trang Chủ (phiên bản tiếng Việt cho trang này)
Chào mừng mọi người đến mới trang chủ của mình. Hiện tại mình đang theo học chương trình thạc sĩ nghiên cứu ở Hong Kong University of Science and Technology, dưới sự hướng dẫn của Giáo sư Yangqiu Song (Tống Dương Thu). Trước đó, mình nhận bằng Cử nhân ngành Data Science (Khoa học Dữ liệu) và Advanced Pure Math (Toán thuần túy nâng cao) vào tháng 7 năm 2022.
Nghiên cứu của mình tập trung vào ngành NLP (Xử lý Ngôn ngữ tự nhiên), Commonsense Reasoning, … gần đây còn có LLM nữa. Về cuộc sống, mình rất thích âm nhạc. Giọng hát mình khá ổn và đã đi trình diễn ở một số nơi. Nhấn vào kênh Youtube này để nghe một vài bài hát mình cover hoặc tự viết :D Về tinh thần, lối suy nghĩ của mình được ảnh hưởng lớn từ Thiền sư Thích Nhất Hạnh, đặc biệt là qua cuốn sách Đường Xưa Mây Trắng (en,vi). Bên cạnh đó, từ tháng 02/2023, mình tham gia Ban cán sự của Hội sinh viên VN tại HK với vai trò Trưởng ban tổ chức sự kiện.
Cuối cùng, bạn có thể xem những thông tin liên quan đến học thuật của mình tại đây, và những bài viết blog liên quan đến cuộc sống hàng ngày tại đây.