Home Publications Products Experience Teaching Service CV

Xin (Eric) Wang

Ph.D. candidate

UC Santa Barbara,
CA 93106, USA

Email: xwang [at] cs [dot] ucsb [dot] edu


I am a fourth-year PhD candidate majoring in computer science at UCSB. Currently I am working with Prof. William Yang Wang and Prof. Yuan-Fang Wang. Prior to UCSB, I received the B.S. degree of computer science from Zhejiang University in July 2015.

My research interests lie in natural language processing, computer vision, and machine learning. More specifically,


[08/2019] Our TIGEr paper for image caption evaluation is accepted to EMNLP-IJCNLP 2019.
[08/2019] VATEX Captioning Challenge 2019 has been launched here! Welcome to participate!
[07/2019] Our VATEX paper is accepted to ICCV 2019 as an Oral paper with three Strong Accepts. Check it out here!
[06/2019] Received CVPR 2019 Best Student Paper Award.
[06/2019] Co-organizing the ICCV 2019 Workshop on Closing the Loop Between Vision and Language.
[06/2019] Gave an invited talk at Facebook AI on "Language & Vision: Learning to Describe and Interact with the World".
[05/2019] Three papers accepted to ACL 2019.
[02/2019] Two papers accepted to CVPR 2019.
[02/2019] Our paper "Extract and Edit" for unsupervised NMT is accepted to NAACL 2019 as an oral paper.
[01/2019] Serve as a session chair for natural language processing (NLP) session, AAAI 2019.
[10/2018] Our paper on zero-shot video captioning is accepted to AAAI 2019 as an oral paper.
[08/2018] Our paper on cross-lingual neural beleif tracking is accepted to EMNLP 2018.
[07/2018] Our paper "Look Before You Leap" is accepted to ECCV 2018.
[07/2018] Our paper on activity detection in untrimmed videos is accepted to BMVC 2018 as an oral paper.
[06/25/2018] Start my internship at Microsoft Research AI.
[05/2018]   Our paper on Adversarial REward Learning (AREL) is accepted to ACL 2018 as a long oral paper.
[04/05/2018]   Passed my Major Area Exam and advanced to PhD candidacy. Thanks to my committee: Prof. William Wang (Co-Chair), Prof. Yuan-Fang Wang (Co-Chair), Prof. Matthew Turk, and Prof. Xifeng Yan.
[03/2018]   Our lab recieves the Adobe Research Award for language and vision research. Thanks Adobe!
[02/2018]   Our paper "Watch, Listen, and Describe" is accepted to NAACL-HLT 2018.
[02/2018]   Our paper "Video Captioning via Hierarchical Reinforcement Learning" is accepted to CVPR 2018.
[10/20/2017]   My Adobe mentor Geoff presented the work we did this summer ProjectClark at Adobe MAX last night.

[06/2017]   Start the summer internship at Adobe Research.
[04/2017]   Check out our fantastic app Artistic Eye!
[03/2017]   Our multimodal transfer paper is accepted to CVPR 2017.
[06/2016]   Intern at Adobe Research, San Francisco.


VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Research
Xin Wang*, Jiawei Wu*, Junkun Chen, Lei Li, Yuan-Fang Wang, William Yang Wang
ICCV 2019
Oral presentation (three Strong Accepts)

[arXiv] [Website] [bibtex]

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Wang, William Yang Wang, Lei Zhang
CVPR 2019
Best Student Paper (1/5160=0.02%)

[arXiv] [Code] [bibtex]

MAN: Moment Alignment Network for Natural Language Moment Retrieval via Iterative Graph Adjustment
Da Zhang, Xiyang Dai, Xin Wang, Yuan-Fang Wang, Larry S. Davis
CVPR 2019

[arXiv] [bibtex]

TIGEr: Text-to-Image Grounding for Image Caption Evaluation
Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao

[arXiv] [bibtex]

Self-Supervised Dialogue Learning
Jiawei Wu, Xin Wang, William Yang Wang
ACL 2019

[arXiv] [bibtex]

Self-Supervised Learning for Contextualized Extractive Summarization
Hong Wang, Xin Wang, Wenhan Xiong, Mo Yu, Xiaoxiao Guo, Shiyu Chang, William Yang Wang
ACL 2019

[arXiv] [Code] [bibtex]

Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin
ACL 2019

[arXiv] [bibtex]

Extract and Edit: An Alternative to Back-Translation for Unsupervised Neural Machine Translation
Jiawei Wu, Xin Wang, William Yang Wang
NAACL 2019
Oral presentation

[arXiv] [Code] [bibtex]

Learning to Compose Topic-Aware Mixture of Experts for Zero-Shot Video Captioning
Xin Wang, Jiawei Wu, Da Zhang, Yu Su, William Yang Wang
AAAI 2019
Oral presentation

[arXiv] [Code] [bibtex]

Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation
Xin Wang*, Wenhan Xiong*, Hongmin Wang, William Yang Wang
ECCV 2018

[arXiv] [bibtex]

XL-NBT: A Cross-lingual Neural Belief Tracking Framework
Wenhu Chen, Jianshu Chen, Yu Su, Xin Wang, Dong Yu, Xifeng Yan, William Yang Wang
EMNLP 2018

[arXiv] [Code] [bibtex]

No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling
Xin Wang*, Wenhu Chen*, Yuan-Fang Wang, William Yang Wang
ACL 2018
Oral presentation

[arXiv] [Code] [Video] [Slides (pptx)] [Slides (pdf)] [bibtex]

S3D: Single Shot multi-Span Detector via Fully 3D Convolutional Network
Da Zhang, Xiyang Dai, Xin Wang, Yuan-Fang Wang
BMVC 2018
Oral presentation

[arXiv] [Code] [Video] [Slides] [bibtex]

Video Captioning via Hierarchical Reinforcement Learning
Xin Wang, Wenhu Chen, Jiawei Wu, Yuan-Fang Wang, William Yang Wang
CVPR 2018

[arXiv] [Paper] [Supp] [Dataset] [bibtex]

Watch, Listen, and Describe: Globally and Locally Aligned Cross-Modal Attentions for Video Captioning
Xin Wang, Yuan-Fang Wang, William Yang Wang

[arXiv] [Paper] [bibtex]

Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer
Xin Wang, Geoffrey Oxholm, Da Zhang, Yuan-Fang Wang
CVPR 2017

[arXiv] [Paper] [Supp] [Images] [Code (Third-Party)] [bibtex]

Deep Reinforcement Learning for Visual Object Tracking in Videos
Da Zhang, Hamid Maei, Xin Wang, Yuan-Fang Wang
arXiv 2017

[arXiv] [Paper] [bibtex]

                                                                                    * indicates equal contributions.


ProjectCloak: Remove Unwanted Objects in Video
In collabration with Geoffrey Oxholm, Oliver Wang, Eli Shechtman, Mike Lukac
2017 MAX Sneak
2018 MAX Keynote
Featured in Adobe After Effects! Link

[Project] [Blog] [Video]

ArtisticEye: A Real-time Application for High-resolution Artistic Style Transfer
In collabration with Geoffrey Oxholm
Applied to the de Young Museum in San Francisco
Honored to present the product prototype to the Adobe CEO Shantanu Narayen face to face

[Blog] [Video]


Google AI, Mountain View, US

       Research Intern,   Summer 2019

       Mentor: Sujith Ravi

Facebook AI Research (FAIR), Menlo Park, US

       Graduate Researcher,   Spring 2019

       Mentors: Xinlei Chen, Marcus Rohrbach, Dhruv Batra

Microsoft Research AI, Redmond, US

       Research Intern,   Summer 2018

       Mentors: Lei Zhang, Jianfeng Gao, Asli Celikyilmaz, Qiuyuan Huang

Adobe Research, San Francisco, US

       Research Intern,   Summer 2017

       Mentors: Geoffrey Oxholm, Oliver Wang, Eli Shechtman, Mike Lukac

Adobe Research, San Francisco, US

       Research Intern,   Summer 2016

       Mentor: Geoffrey Oxholm

Exacloud Inc., Hangzhou, China

       Software Engineer Intern,   12. 2014 - 03. 2015

HCI, Graphics and Computer Vision Group, HKU

       Research Assistant,   07. 2014 - 09. 2014

       Advisor: Yizhou Yu


2018 Winter Guest Lecturer CS281b: Computer Vision and Image Analysis
2017 Winter Teaching Assistant CS190I: Introduction to Natual Language Processing
2016 Fall Teaching Assistant CS180: Computer Graphics
2016 Winter Teaching Assistant CS48: Computer Science Project
2015 Fall Teaching Assistant CS16: Problem Solving with C++


  • Organizer:
  • Session Chair:
    • Natural Language Processing (NLP), AAAI 2019
  • Program Committee / Reviewer: AAAI 2020,   CoRL 2019,   NeurIPS 2019,   EMNLP-IJCNLP 2019,   ICCV 2019,   CVPR 2019,   ACL 2019,   NAACL 2019,   SGRL 2019,   CoNLL 2019,   SpLU-RoboNLP 2019,   AAAI 2019,   EMNLP 2018,   SoCal NLP 2018