Biography

I received my B.S. & Ph.D. degree from the Electrical Engineering Department, Tsinghua University, Beijing, China. Currently, I’m working on a startup company in the field of energy management system. My research interests include machine learning especially reinforcement learning and their applications in the energy system, active distribution system operation and control, model-free control and other AI applications. I am also interested in modern programming languages and frameworks. In recent years, I have become a rookie of the open source society. As for sports, I’m a fan of basketball and swimming.

Interests
  • Reinforcement Learning
  • Power System
  • Artificial Intelligence
  • Model-free Control
Education

  • PhD in Electrical Engineering, 2023

    Tsinghua University

  • Minor in Technological innovation and Entrepreneurship, 2018

    Tsinghua University

  • Bachelor in Electrical Engineering, 2018

    Tsinghua University

Working Experience

 
 
 
 
 
Reinforcement Learning Intern
Bytedance Inc.
Jul 2020 – May 2021 Beijing

Responsibilities include:

  • Developed a method based on SOTA offline RL algorithms to optimize certain App’s interacting and improve incomes;
  • Built an offline training & online serving system based on RL algorithms;
  • Analysed huge amount of user data and conducting preprocessing & feature engineering.
 
 
 
 
 
Teaching Assistant
Institute of Computer Software, Department of Computer Science and Technology, Tsinghua University
Sep 2018 – Jan 2022 Beijing
  • Taught basic knowledge on software engineering;
  • Given lectures about git and other tools;
  • Helped student teams to develop their own software.
 
 
 
 
 
Assistant Researcher
EMS Group, Department of Electrical Engineering, Tsinghua University
Aug 2018 – Present Beijing
  • Deeply involved in 10+ projects with State Grid;
  • Been prized the Laboratory Construction Contribution Award for Students;
  • Maintaining the Gitlab & cloud disk for EMS group.

Recent Publications

Haotian Liu, Wenchuan Wu, Yao Wang. Bi-Level Off-policy Reinforcement Learning for Two-Timescale Volt/VAR Control in Active Distribution Networks. IEEE Transactions on Power Systems, 2022.
Cite DOI
Haotian Liu, Wenchuan Wu. Federated Reinforcement Learning for Decentralized Voltage Control in Distribution Networks. IEEE Transactions on Smart Grid, 2022.
Cite DOI
Haotian Liu, Wenchuan Wu. Two-Stage Deep Reinforcement Learning for Inverter-Based Volt-VAR Control in Active Distribution Networks. IEEE Transactions on Smart Grid, 2021.
Cite DOI
Haotian Liu, Wenchuan Wu. Online Multi-Agent Reinforcement Learning for Decentralized Inverter-Based Volt-VAR Control. IEEE Transactions on Smart Grid, 2021.
Cite DOI
Haotian Liu, Wenchuan Wu, Anjan Bose. Model-Free Voltage Control for Inverter-Based Energy Resources: Algorithm, Simulation and Field Test Verification. IEEE Transactions on Energy Conversion, 2021.
Cite DOI
See all publications

Open-Source Projects

*
All Frontend Tools
Dictconv

Dictconv

A Mac dictionary converter based on Node.js. You could convert some additional dictionaries and install them on your Mac dictionary app.

Code
Hupcup

Hupcup

Sync your github forks without Git or Node.

Code
Xuetangxd

Xuetangxd

A downloader for next.xuetangx.com. NPM package is provided.

Code
Official account visualization

Official account visualization

Analyze the wechat official accounts.

Code Video
Shakespeare

Shakespeare

Visualize shakespeare’s works.

Code
Colorana

Colorana

Analyze the color of an image in the HSL space.

Code
Thubeamer

Thubeamer

A beamer template for Tsinghua University.

PDF Code

Accomplish­ments

Gold Medal in Geneva Invention Exhibition 2022
International Exhibition of Inventions of Geneva Mar 2022
The International Exhibition of Inventions of Geneva was founded in 1973 and held once a year. It was not held in 2020 due to the COVID-19 epidemic. Under the patronage of the Swiss Federal Government, the State, the City of Geneva and the World Intellectual Property Organization, the annual exhibition is one of the oldest, largest and most well-known invention exhibitions around the world.
Comprehensive Excellence Scholarship
Tsinghua University Dec 2021
One of the most significant scholarships in Tsinghua University.
RONG Scholarship
Tsinghua University Big Data Research Center Dec 2021
The selection of RONG scholarship is one of the characteristic activities of Tsinghua University’s Big Data Capability Improvement Project, which aims to promote the cultivation of compound big data talents and attract outstanding students from all departments of the university.
China Collegiate Computing Contest - Third Prize
Tsinghua University & Wechat May 2021 – Aug 2021
WeChat Big Data Challenge: This competition is based on desensitized and sampled data information. For a given number of users who have visited the WeChat video account Highlights, according to the historical n-day behavior data of these users in the video account, the algorithm will On the test set, the occurrence probability of these users' interactive behaviors (including likes, clicks on avatars, favorites, and forwards) for different video contents is predicted. The competition is scored with weighted uAUC values for multiple behavioral predictions.
Outstanding Graduates
Tsinghua University Jun 2018
Approximately the TOP 2% graduates in Tsinghua University.

Contact