AIxRL Lab

AIxRL is a reinforcement learning research group organized by Professor Li Xia in the School of Business at Sun Yat-sen University. Our team works on reinforcement learning, Markov decision process, queuing theory, game theory, and operations management. For more details, please visit http:/aixrl/

Profile

Li Xia received the Bachelor and the Ph.D. degree in control theory both from Tsinghua University, Beijing, China, in 2002 and 2007, respectively. He is currently a professor with the Business School, Sun Yat-Sen University, Guangzhou 510275, China. After PhD graduation, he worked at IBM Research China as a research staff member (2007-2009) and at the King Abdullah University of Science and Technology (KAUST) Saudi Arabia as a postdoctoral research fellow (2009-2011). Then he returned to Tsinghua University as a lecturer in 2011 and was promoted as an associate professor in 2013. In 2019, he joined Sun Yat-Sen University as a full professor. He was a visiting scholar at Stanford University, the Hong Kong University of Science and Technology, etc. He serves as an Associate Editor of IEEE Transactions on Automation Science and Engineering, Discrete Event Dynamic Systems, Energy Informatics, etc.

His research interests include the methodology research in stochastic learning and optimization, Markov decision processes, reinforcement learning, queueing theory, game theory, and the application research in energy systems, smart building, financial technology, etc.

Enrollment direction

PhD Students（Management Science and Engineering, System Engineering, Operation Research）
Master Students（Management Science and Engineering, System Engineering, Operation Research）
PostDoctoral Fellow（Management Science and Engineering, System Engineering, Control Science and Engineering, Operation Research）
Research Associates（Management Science and Engineering, System Engineering, Control Science and Engineering, Operation Research）

Educational experience

· Sep. 2002 – Jul. 2007, Ph.D. (Supervisor: Prof. Xi-Ren Cao, the Hong Kong University of Science and Technology), CFINS, Department of Automation, Tsinghua University.

· Sep. 1998 – Jul. 2002, Bachelor, Department of Automation, Tsinghua University, with Cum Laude Graduate Honor. 

Professional experience

· Jan. 2019 – Present, Professor, Business School, Sun Yat-Sen University.

· Dec. 2013 – Jan. 2019, Associate Professor, Department of Automation, Tsinghua University.

· Dec. 2011 – Dec. 2013, Lecturer, Department of Automation, Tsinghua University.

· Nov. 2009 – Nov. 2011, Postdoctoral research fellow of the Division of Mathematical and Computer Sciences & Engineering, King Abdullah University of Science and Technology (KAUST), Saudi Arabia.

· Jul. 2007 – Oct. 2009,  Research staff member of IBM China Research.

· Mar. 2015 – Sep. 2015, visiting scholar in the Department of Management Science and Engineering, Stanford University, USA.  Host: Prof. Peter Glynn

· 2005 – 2007, visiting student in the Department of Electronic and Computer Engineering, The Hong Kong University of Science & Technology.  Supervisor: Prof. Xi-Ren Cao

Courses

Prababilities（Undergraduate）
Big Data and Business Intelligence（Undergraduate）
Operation Research for Management（Undergraduate）
Computer Networks and Applications (Undergraduate)
Intelligent Decison-Making and Reinforcement Learning（Graduate）
Queueing Theory and Stochastic Service Systems（Graduate）

Research Grant

· The National Natural Science Foundation of China (NSFC 72371253): CVaR-based Markov decision processes, reinforcement learning and applications, 2024.1 – 2027.12, PI.
· The National Natural Science Foundation of China (NSFC 62073346): Risk-sensitive Markov decision processes, reinforcement learning and applications, 2021.1 – 2024.12, PI.
· The National Natural Science Foundation of China (NSFC 61573206): Fairness-based optimization theory of queueing systems and its application, 2016.1 – 2019.12, PI.
· The National Natural Science Foundation of China (NSFC 61203039): Performance optimization of queueing systems based on difference sensitivity information, 2013.1 – 2015.12, PI.
· The Specialized Research Fund for the Doctoral Program of Higher Education (20120002120009): Optimization method and game theoretical analysis of queueing model based on performance potentials, 2013.1 – 2015.12, PI.
· The National Natural Science Foundation of China (NSFC U1301254): Optimization based matching and scheduling for smart grid supply and demand based on energy information sensing and analysis, 2014.1 – 2017.12, Co-PI.
· The Key R&D Program of China (2017YFC0704100): New generation intelligent building platform techniques, 2017.7-2020.12, Co-PI.
· The Key R&D Program of China (2016YFB0901900): Fundamental theory of planning, operating, and trading of energy Internet, 2016.7-2020.6, Co-PI.
· United Technology Corporation: Smart building energy research, 2011.1-2015.12, Co-PI.
· Tsinghua National Lab of Information Science of Technology: Research of Trustable Network Space, 2015.1-2016.12, Co-PI.

Academic Activity

· IEEE Senior member, INFORM member, Chinese Operational Research Society Member
· Associate Editor: IEEE Transactions on Automation Science and Engineering, since 2019; Discrete Event Dynamic Systems: Theory and Applications since 2017; Energy Informatics, since 2017; Journal of Dynamics and Games, since 2017; International Journal of Simulation and Process Modelling since 2016
· Guest Editor of International Journal of Simulation and Process Modelling (2015)
· Associate Editor of CEB (Conference Editorial Board) of IEEE CSS (Control System Society), including the IEEE CDC and ACC conference, since 2016
· Associate Editor of IEEE Conference on Automation Science and Engineering (CASE2015, CASE2016, CASE2017, CASE2018)
· Publication Chair of IEEE CASE 2017
· Program Committee Member of the 13th International Workshop on Discrete Event Systems (WODES2016); the Chinese Control Conference (CCC2014, CCC2015, CCC2016,CCC2017); the 11th IEEE International Conference on Networking, Sensing and Control (ICNSC2014); the 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO2014, ROBIO2015); the International Conference on Simulation and Modeling Methodologies, Technologies and Applications (SIMULTECH2015, SIMULTECH2016)
· General Chair of The 14th EAI International Conference on Performance Evaluation Methodologies and Tools (ValueTools'2021)

Research

[Book Chapter]

•  Li Xia and Xi-Ren Cao, “Perturbation Analysis, Dynamic Programming, and Beyond,”  Chapter 7 (pp. 127-156) of the Book Stochastic Simulation Optimization for Discrete Event Systems – Perturbation Analysis, Ordinal Optimization, and Beyond, (Edited by C.H. Chen, Q.S. Jia, L.H Lee), World Scientific Publishing, 2013.

•  Quan-Lin Li, Jing-Yu Ma, Rui-Na Fan, and Li Xia, “An Overview for Markov Decision Processes in Queues and Networks,” (pp. 44-71) of the BookStochastic Models in Reliability, Network Security and System Safety, (Edited by Q.-L. Li, J. Wang, H.Yu), Springer, 2019. https://doi.org/10.1007/978-981-15-0864-6_3.

[Journal]:

•  Li Xia*, Luyao Zhang, Peter W. Glynn. “Risk-sensitive Markov decision processes with long-run CVaR criterion”. Production and Operations Management. 2023. https://doi.org/10.1111/poms.14077

•  Shuai Ma, Xiaoteng Ma, Li Xia*. “A unified algorithm framework for mean-variance optimization in discounted Markov decision processes,” European Journal of Operational Research  311(3), 1057-1067, 2023.

•  Li Xia, Xianping Guo, Xi-Ren Cao*, "A note on the existence of optimal stationary policies for average Markov decision processes with countable states," Automatica 151, 110877, 2023. https://doi.org/10.1016/j.automatica.2023.110877

•  Zhihui Yu, Xianping Guo, Li Xia*, "Zero-sum semi-Markov games with state-action-dependent discount factors," Discrete Event Dynamic Systems: Theory and Applications 32, 545-571, 2022.  

•  Xiaoteng Ma, Shuai Ma, Li Xia*, Qianchuan Zhao, "Mean-semivariance policy optimization via risk-averse reinforcement learning," Journal of Artificial Intelligence Research 75, 569-595, 2022.

•  Shuai Ma, Xiaoteng Ma, Li Xia*, "An optimistic value iteration for mean–variance optimization in discounted Markov decision processes," Results in Control and Optimization 8, 100165, 2022.

•  Gang Chen, Li Xia*, Zhaoyu Jiang, Xi Peng, Huiying Xu, "A two class MAP/PH/1 weighted fair queueing system and its application to telecommunications," Journal of Ambient Intelligence and Humanized Computing, 2022. https://doi.org/10.1007/s12652-022-03857-2 

•  Victor F. Araman*，Hong Chen, Peter W. Glynn, Li Xia, “On a single server queue fed by scheduled traffic with Pareto perturbations,” Queueing Systems 100, 61-91, 2022. https://doi.org/10.1007/s11134-021-09732-9.

•  Gang Chen, Zaiming Liu, Li Xia*, “Event-based optimization of service rate control in retrial queues,” Journal of the Operational Research Society, 2022.

•  Jing-Yu Ma*, Quan-Lin Li, Li Xia. “Optimal asynchronous dynamic policies in energy-efficient data centers,” Systems 2022, 10(2), 27. https://doi.org/10.3390/systems10020027.

•  Li Xia, Zhe George Zhang*, Quan-Lin Li, “A c/μ-Rule for Job Assignment in Heterogeneous Group-Server Queues,” Production and Operations Management 31(3), 1191-1215, 2022. https://doi.org/10.1111/poms.13605.

•  Xin Wen, Xianping Guo, Li Xia*. “Optimal dividend problems with a risk probability criterion,” Naval Research Logistics 69(3), 421-430, 2022. doi: 10.1002/nav.22026.

•  Zhen Yang, Jinhong Du, Yiting Lin, Zhen Du, Li Xia*, Qianchuan Zhao, Xiaohong Guan. “Increasing the energy efficiency of a data center based on machine learning,” Journal of Industrial Ecology 26(1), 323-335, 2022, http://doi.org/10.1111/jiec.13155.

•  Zhen Yang, Xiaoteng Ma, Li Xia*, Qianchuan Zhao, Xiaohong Guan, “Reinforcement learning for fluctuation reduction of wind power with energy storage,” Results In Control and Optimization 4, 100030, 2021. https://doi.org/10.1016/j.rico.2021.100030.

•  Li Xia, “Risk-sensitive Markov decision processes with combined metrics of mean and variance,” Production and Operations Management, Vol. 29, No. 12, pp. 2808-2827, 2020. doi:10.1111/poms.13252.

•  Zhen Yang, Li Xia*, Xiaohong Guan. “Fluctuation reduction of wind power and sizing of battery energy storage systems in microgrids,” IEEE Transactions on Automation Science and Engineering, Vol. 17, No. 3, pp. 1195-1207, 2020, doi: 10.1109/TASE.2020.2977944.

•  Mingzhou Xie, Li Xia*, Jun Xu, “On M/G[b]/1/K queue with multiple state-dependent vacations: A real problem from media-based cache in hard disk drives,” Performance Evaluation, 2020. https://doi.org/10.1016/j.peva.2020.102085

•  Jingyu Ma, Li Xia*, Quanlin Li, “Optimal energy-efficient policies for data centers through sensitivity-based optimization,” Discrete Event Dynamic Systems: Theory and Applications, Vol. 29, pp. 567–606, 2019.

•  Yiqin Yang, Li Xia*, Qianchuan Zhao, “An automated grader for Chinese essay combining shallow and deep semantic attributes,” IEEE Access,10.1109/ACCESS.2019.2957582, Vol. 7, pp.176306-176316, 2019.

•  Li Xia, “Mean-variance optimization of discrete time discounted Markov decision processes,” Automatica, Vol. 88, pp. 76-82, 2018.

•  Li Xia and Sha Chen, “Dynamic pricing control for open queueing networks,” IEEE Transactions on Automatic Control, Vol. 63, No. 10, pp. 3290-3300, 2018.

•  Li Xia, “Variance minimization of parameterized Markov decision processes,” Discrete Event Dynamic Systems: Theory and Applications, Vol. 28, pp. 63-81, 2018.

•  Junpeng Niu, Mingzhou Xie, Jun Xu, Lihua Xie, and Li Xia, “SMR drive performance analysis under different workload environments,” Control Engineering Practice, Vol. 75, pp. 86-97, 2018.

•  Qianchuan Zhao, Li Xia, and Ziyan Jiang, “New generation intelligent building platform techniques,” Energy Informatics, https://doi.org/10.1007/s42162-018-0011-9,Vol.1, No.2, 2018.

•  Li Xia, Daniel Miller, Zhengyuan Zhou, and Nicholas Bambos, “Service rate control of tandem queues with power constraints,” IEEE Transactions on Automatic Control, Vol. 62, No. 10, pp. 5111-5123, 2017. (the 2018 Ho-Pan-Chi-Yi Best Paper Award)

•  Li Xia, Qi-Ming He and Attahiru Alfa, “Optimal control of state-dependent service rates in a MAP/M/1 queue,” IEEE Transactions on Automatic Control, Vol. 62, No. 10, pp. 4965-4979, 2017.

•  Li Xia, “Optimization of Markov decision processes under the variance criterion,” Automatica, Vol. 73, pp. 269-278, 2016.

•  Zhijin Cheng, Qianchuan Zhao, Fulin Wang, Yi Jiang, Li Xia, Jinlei Ding, “Satisfaction based Q-learning for integrated lighting and blind control,” Energy and Buildings, Vol. 127, pp. 43-55, 2016.

•  Li Xia and Qing-Shan Jia, “Parameterized Markov decision process and its application to service rate control,” Automatica, Vol.54, pp. 29-35, 2015.

•  Li Xia and Basem Shihada, “A Jackson network model and threshold policy for joint optimization of energy and delay in multi-hop wireless networks,” European Journal of Operational Research, Vol. 242, pp. 778-787, 2015.

•  Li Xia, “Service rate control of closed Jackson networks from game theoretic perspective,” European Journal of Operational Research, Vol. 237, No. 2, pp. 546-554, 2014.

•  Li Xia, “Event-based optimization of admission control in open queueing networks,” Discrete Event Dynamic Systems: Theory and Applications, Vol. 24, No. 2, pp. 133-151, 2014.

•  Li Xia, “Policy gradient approach of event-based optimization and its online implementation,” Asian Journal of Control, Vol. 16, No. 6, pp. 1735-1743, 2014.

•  Li Xia and Basem Shihada, “Power and delay optimization in multi-hop wireless networks,” International Journal of Control, Vol. 87, No. 6, pp. 1252-1265, 2014.

•  Li Xia, Qing-Shan Jia, and Xi-Ren Cao, “A tutorial on event-based optimization -- A new optimization framework,” Discrete Event Dynamic Systems: Theory and Applications, Vol. 24, No. 2, pp. 103-132, 2014.

•  Li Xia and Basem Shihada, “Max-Min optimality of service rate control in closed queueing networks,” IEEE Transactions on Automatic Control, Vol. 58, pp. 1051-1056, 2013.

•  Li Xia and Xi-Ren Cao, “Performance optimization of queueing systems with perturbation realization,” European Journal of Operational Research, Vol. 218, pp. 293-304, 2012.

•  Li Xia, Wenjun Yin, Jin Dong, Teresa Wu , Ming Xie, Yanjia Zhao, “A hybrid nested partitions algorithm for banking facility location problems,” IEEE Transactions on Automation Science and Engineering, Vol.7, No.3, pp. 654-658, 2010.

•  Li Xia, Xi Chen, Xi-Ren Cao, “Policy iteration for customer-average performance optimization of closed queueing systems,” Automatica, Vol. 45, No. 7, pp. 1639-1648, 2009.

•  Li Xia, Qianchuan Zhao, and Qing-Shan Jia, “A structure property of optimal policies for maintenance problems with safety-critical components,” IEEE Transactions on Automation Science and Engineering, Vol. 5, No. 3, pp. 519-531, 2008.

•  Xi Chen, Hongxing Bai, Li Xia, and Yu-Chi Ho, “Design of a randomly distributed sensor network for target detection,” Automatica, Vol. 43, No. 10, pp. 1713-1722, 2007.

•  Li Xia and Xi-Ren Cao, “Relationship between perturbation realization factors with queueing   models and Markov models,” IEEE Transactions on Automatic Control, Vol. 51, No. 10, pp. 1699-1704, 2006.

•  Li Xia, Xi Chen, and Xiaohong Guan, “A new gradient-based routing protocol in wireless sensor networks,” Springer LECTURE NOTES IN COMPUTER SCIENCE 3605: 318-325, 2005. 

[Chinese Journal]

•  马帅, 夏俐*, 风险敏感马氏决策过程与状态扩充变换," 《澳门新葡平台网址8883网站学报》, Vol. 62, No. 1, pp. 181-191, 2023.

•  杨震,赵静洲,林依挺,夏恒,夏俐*,赵千川,管晓宏, “数据中心PUE能效优化的机器学习方法,”《系统工程理论与实践》, Vol. 42, No. 3, pp. 801-810, 2022.

•  张俊玉, 吴怡婷, 夏俐, 曹希仁*, “可数状态空间的平均成本马氏决策过程,”《控制理论与应用》, Vol. 38, 1707-1716, 2021.

•  杨震,赵静洲,林依挺,夏恒,夏俐*,赵千川,管晓宏, “数据中心PUE能效优化的机器学习方法,”《系统工程理论与实践》, 2020.

•  陈莎, 夏俐, “排队系统定价控制问题的研究综述”, 《控制理论与应用》, Vol. 35, No. 1, pp.41-55, 2018.

•  贾庆山, 杨玉, 夏俐, 管晓宏, “基于事件的优化方法简介及其在能源互联网中的应用,” 《控制理论与应用》, Vol. 35, No. 1, pp.32-40, 2018.

•  杨震, 夏俐, 管晓宏, “带有储能的可再生能源调度问题研究”, 《智慧电力》, Vol. 45, pp. 25-31, 2017.

•  夏俐, 陈曦, 赵千川, 江永恒, 管晓宏, “无线传感器网络简介及应用”,《自动化博览》, 2004, vol.21, no.1, pp.34-37. (2005年中国自动化领域最佳综述论文奖)

Li Xia, Xi Chen, Qianchuan Zhao, Yongheng Jiang, and Xiaohong Guan, “Introduction to wireless sensor networks and their Applications,” Automation Panorama (Chinese Journal), 2004, vol.21, no.1, pp.34-37. (best review paper award in Chinese Automation field in 2005) 

[Conference]:

•  Jinyan Pan, Li Xia*, Xi Peng, Qingqing Yang, Renhai Chen, Gong Zhang, "Cooperative multi-agent learning for stabilizing the joint microburst rate in passive optical networks," the 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE'2023), 26-30 August 2023, Auckland, New Zealand, presentation only. 

•  Jinyan Pan, Gang Chen, Haoran Wu, Xi Peng, Li Xia*, "Deep reinforcement learning-based dynamic bandwidth allocation in weighted fair queues of routers," Proceedings of the 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE'2022), 20-24 August 2022, Mexico City, Mexico, pp. 1580-1587, doi: 10.1109/CASE49997.2022.9926628.

•  Gang Chen, Li Xia*, Zhaoyu Jiang, Xi Peng, Li Chen, Bo Bai, "A Two-Step Fitting Approach of Batch Markovian Arrival Processes for Teletraffic Data,"  Proceedings of the 2021 EAI 14th International Conference on Performance Evaluation Methodologies and Tools, October 30-31, pp. 22-35, 2021.

•  Xiaoteng Ma, Xiaohang Tang, Li Xia*, Jun Yang*, Qianchuan Zhao, “Average-reward reinforcement learning with trust region methods”, Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (IJCAI'2021), pp. 2797-2803.

•  Xiaoyan Hu, Li Xia, Yang Jun, Qianchuan Zhao, “A fast-convergence method of Monte Carlo counterfactual regret minimization for imperfect information dynamic games,” Proceedings of the 2020 IEEE 9th Data Driven Control and Learning Systems Conference (DDCLS’2020), November 20-22, 2020, Liuzhou, Guangxi, China.

•  Xi Yan, Li Xia, Yang Jun, Qianchuan Zhao, “Opponent modeling in poker games,” Proceedings of the 2020 IEEE 9th Data Driven Control and Learning Systems Conference (DDCLS’2020), November 20-22, 2020, Liuzhou, Guangxi, China.

•  Jian Yao, Zeyu Zhang, Li Xia, Yang Jun, Qianchuan Zhao, “Solving imperfect information poker games using Monte Carlo search and POMDP models,” Proceedings of the 2020 IEEE 9th Data Driven Control and Learning Systems Conference (DDCLS’2020), November 20-22, 2020, Liuzhou, Guangxi, China.

•  Ming Zhang, Yawei Wang, Xiaoteng Ma, Li Xia, Jun Yang, Zhiheng Li, Xiu Li, “Wasserstein distance guided adversarial imitation learning with reward shape exploration,” Proceedings of the 2020 IEEE 9th Data Driven Control and Learning Systems Conference (DDCLS’2020), November 20-22, 2020, Liuzhou, Guangxi, China.

•  Chenghao Li, Xiaoteng Ma, Li Xia, Qianchuan Zhao, and Jun Yang, “Fairness control of traffic light via deep reinforcement learning,” Proceedings of the 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE’2020), August 20-21, 2020, HongKong, China.

•  Zhen Yang, Xiaoteng Ma, Li Xia, Qianchuan Zhao, and Xiaohong Guan, “Reinforcement learning for long-term smoothing of wind power with battery energy storage systems,” the 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE’2019), presentation only, August 20-21, 2020, HongKong, China.

•  Li Xia, “Risk-sensitive control of Markov decision processes with combined metrics of mean and variance,” the 2019 IEEE International Conference on Automation Science and Engineering (CASE’2019), presentation only, August 20-24, 2019, Vancouver, BC, Canada.

•  Li Xia, Zhen Yang, “A new method for mean-variance optimization of stochastic dynamic systems,” Proceedings of the 2019 IEEE Conference on Control Technology and Applications (CCTA’2019), August 19-21, 2019, HongKong.

•  Xiaoteng Ma, Li Xia, and Qianchuan Zhao, “Probabilistic Decision Tree: Optimizing Decision Rules with Gradient Information,” Proceedings of the 38th Chinese Control Conference (CCC’2019), July 27-30, 2019, Guangzhou, China.

•  Yang Zhen, Li Xia, Xiaohong Guan, “Fluctuation reduction and sizing of battery storage systems with renewable energy in microgrids,” the 38th Chinese Control Conference (CCC’2019), presentation only, July 27-30, 2019, Guangzhou, China.

•  Lingfeng Wang, Li Xia, Hao Ye, Ming Jiang, Jia Wang, Yijing Wang, “A fast optimization method for automatic train stop control,” Proceedings of the 15th IEEE International Conference on Control and Automation (ICCA2019), July 16-19, 2019, Edinburgh, Scotland.

•  Xiaoteng Ma, Li Xia, and Qianchuan Zhao, “Air-combat strategy using deep Q-learning,” Proceedings of 2018 Chinese Automation Congress (CAC’2018), December 1-2, 2018, Xi’an, China, pp.5031-5036.

•  Zhen Yang, Li Xia, and Xiaohong Guan, “Fluctuation reduction of wind power with battery energy storage systems,” Proceedings of the 2018 IEEE International Conference on Automation Science and Engineering (CASE’2018), August 20-23, 2018, Munich, Germany, pp. 762-767.

•  Quan-Lin Li, Jing-Yu Ma, Mingzhou Xie, and Li Xia, “Group-server queues,”  Proceedings of the12th International Conference on Queueing Theory and Network Applications (QNTA’2017), August 21-23, 2017, Qinhuangdao, China, LNCS 10591, pp. 49-72.

•  Sha Chen and Li Xia, “Dynamic pricing control for open queueing networks,” the12th International Conference on Queueing Theory and Network Applications (QNTA’2017), presentation only, August 21-23, 2017, Qinhuangdao, China.

•  Mingzhou Xie, Li Xia, and Jun Xu, “State-dependent M/G/1/K queuing model for hard disk drives,” Proceedings of the 2017 IEEE International Conference on Automation Science and Engineering (CASE’2017), August 20-23, 2017, Xi’an, China.

•  Bocheng Li, Li Xia, and Qianchuan Zhao, “Complexity analysis of reinforcement learning and its application to robotics,” the 2017 IEEE International Conference on Automation Science and Engineering (CASE’2017), presentation only, August 20-23, 2017, Xi’an, China.

•  Sha Chen and Li Xia, “Optimal control of admission prices and service rates in open queueing networks,” Proceedings of the 20th IFAC World Congress, Toulouse, France, July 9-14, 2017.

•  Daniel Miller, Li Xia, Zhengyuan Zhou, and Nicholas Bambos, “Dynamic control of data center network and computation resources,” the 2017 International Conference on Computing, Networking and Communications (ICNC’2017), January 26-29, 2017, Silicon Valley, CA, USA.

•  Mingzhou Xie, Jun Xu, and Li Xia, “Performance analysis of media-based cache via analytical and simulation model,” the 2016 IEEE TENCON, November 22-25, 2016, Singapore.

•  Li Xia, Qi-Ming He and Attahiru Alfa, “Optimal control of service rates in a MAP/M/1 queue,” the 9th International Conference on Matrix-Analytic Methods in Stochastic Models (MAM’2016), presentation only, June 28-30, 2016, Budapest, Hungary.

•  Li Xia, “Optimization of parametric policies of Markov decision processes under a variance criterion,” the 13th International Workshop on Discrete Event Systems (WODES’2016), May 30-June 1, 2016, Xi’an, China, pp. 332-337.

•  Fenfang Zhou, Li Xia, Wei Dong, Xinya Sun, Xiang Yan, and Qianchuan Zhao, “Fault diagnosis of high-speed railway turnout based on support vector machine,” the 2016 IEEE International Conference on Industrial Technology (ICIT’2016), March 14-17, 2016, Taipei, Taiwan, pp. 1539-1544.

•  Bocheng Li and Li Xia, “A multi-grid reinforcement learning method for energy conservation and comfort of HVAC in buildings,” the 2015 IEEE International Conference on Automation Science and Engineering (CASE’2015), August 24-28, 2015, Gothenburg, Sweden.

•  Li Xia, “An iterative approach to reduce the variance of stochastic dynamic systems,” Proceedings of the 19th IFAC World Congress, August 24-29, 2014, Cape Town, South Africa, pp. 10487-10492.

•  Li Xia, “Some results of Markov decision processes under variance criterion,” the 2014 IEEE International Conference on Automation Science and Engineering (CASE’2014), presentation only, August 18-22, 2014, Taipei, Taiwan.

•  Qilong Huang, Qing-Shan Jia, Li Xia, Xiaohong Guan, and Xiaolan Xie, “EV Charging Load Scheduling Following Uncertain Renewable Energy Supply by Stochastic Matching,” Proceedings of the 2014 IEEE International Conference on Automation Science and Engineering (CASE’2014), August 18-22, 2014, Taipei, Taiwan, pp. 137-142.

•  Yuanming Zhang, Qing-Shan Jia, Li Xia, “Weather-forecast based optimal unit scheduling with solar power integration,” Proceedings of the 33rd Chinese Control Conference (CCC’2014), July 28-30, 2014, Nanjing, China.

•  Qilong Huang, Qing-Shan Jia, Li Xia, and Xiaohong Guan, “Event-Based Optimization for Stochastic Matching EV Charging Load with Uncertain Renewable Energy,” Proceedings of the 11th World Congress on Intelligent Control and Automation (WCICA’2014), June 29-July 4, 2014, Shenyang, China. (the AIAG Best Paper Award on Supply Chains)

•  Fenfang Zhou, Li Xia, Qianchuan Zhao, and Ming Jiang,  “Statistical analysis of the random failure model of high-speed railway equipments,” Proceedings of the 11th IEEE International Conference on Networking, Sensing and Control (ICNSC’2014), April 7-9, 2014, Miami, FL, USA.

•  Yulin Lei, Qing-Shan Jia, Li Xia, “Local event-based sensor activation for occupant distribution estimation in buildings,” Proceedings of the 11th IEEE International Conference on Networking, Sensing and Control (ICNSC’2014), April 7-9, 2014, Miami, FL, USA.

•  Zhijin Cheng, Li Xia, Qianchuan Zhao, Yin Zhao, Fulin Wang, and Fangting Song, “Integrated control of blind and lights in daily office environment,” Proceedings of the 9th annual IEEE International Conference on Automation Science and Engineering (CASE’2013), August 17-21, 2013, Madison, Wisconsin, USA, pp. 599-604.

•  Yin Zhao, Qianchuan Zhao, Li Xia, Zhijin Cheng, Fulin Wang, and Fangting Song, “A unified control framework of HVAC system for thermal and acoustic comforts in office building,” Proceedings of the 9th annual IEEE International Conference on Automation Science and Engineering (CASE’2013), August 17-21, 2013, Madison, Wisconsin, USA, pp. 422-427.

•  Li Xia and Qing-Shan Jia, “Policy iteration for parameterized Markov decision processes and its application,” Proceedings of the 9th Asian Control Conference (ASCC’2013), June 23-26, 2013, Istanbul, Turkey.

•  Li Xia and Basem Shihada, “Decentralized control of transmission rates in energy-critical wireless networks,” Proceedings of the 2013 American Control Conference (ACC’2013), June 17-19, 2013, Washington, DC., USA, pp. 113-118.

•  Li Xia and Qing-Shan Jia, “Game theoretical control of service rates in closed Jackson networks,” Proceedings of the 25th Chinese Control and Decision Conference (CCDC’2013), May 25-27, 2013, Guiyang, China, pp. 4559-4564.

•  Qing-Shan Jia, Zhe Wen, and Li Xia, “Event-based sensor activation for indoor occupant distribution estimation,” Proceedings of the 12th International Conference on Control, Automation, Robotics and Vision (ICARCV’2012), December 5-7, 2012, Guangzhou, China.

•  Qing-Shan Jia and Li Xia, “Approximate event-based optimization for evacuation,” Proceedings of the 11th IFAC International Workshop on Discrete Event Systems (WODES’2012), October 3-5, 2012, Guadalajara, Mexico, pp. 372-377.

•  Li Xia, “Optimal control of customer admission to an open Jackson network,” Proceedings of the 31st Chinese Control Conference (CCC’2012), July 25-27, 2012, Hefei, China, pp. 2362-2367.

•  Li Xia, “Optimality property of service rates in closed Jackson networks,” the 2012 INFORMS International Conference, June 24-27, 2012, Beijing, China.

•  Kamran Jamshaid, Basem Shihada, Li Xia, and Philip Levis, “Buffer sizing in 802.11 wireless mesh networks,” Proceedings of the 8th IEEE International Conference on Mobile Ad-hoc and Sensor Systems (MASS’2011), October 17-21, 2011, Valencia, Spain, pp. 272-281.

•  Li Xia, Wenjun Yin, Weida Xu, Ming Xie, and Jinyan Shao, “Efficient optimization of maximal covering location problems using extreme value estimation,” Proceedings of the 2009 Winter Simulation Conference (WSC’2009), December 13-16, 2009, Austin, Texas, USA, pp. 2395-2404.

•  Li Xia, Ming Xie, Weida Xu, Wenjun Yin, and Jin Dong, “An empirical comparison of five efficient heuristics for maximal covering location problems,” Proceedings of the 2009 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI'2009), July 22-24, 2009, Chicago, IL, USA, pp.747-753.

•  Li Xia, Ming Xie, Wenjun Yin, and Jin Dong, “MAX-MIN optimality of service rates in queueing systems with customer-average performance criterion,” Proceedings of the 2008 Winter Simulation Conference (WSC'2008), December 7-10, 2008, Miami, FL, USA, pp. 509-515.

•  Jinyan Shao, Ming Xie, Li Xia, Wenjun Yin, and Jin Dong, “Optimal service channel reconfiguration based on multi-agent simulation”, Proceedings of the 2008 Winter Simulation Conference (WSC'2008), December 7-10, 2008, Miami, FL, USA, pp. 2950-2950.

•  Li Xia, Yanjia Zhao, Ming Xie, Jinyan Shao, and Jin Dong, “Mixed integer programming based nested partition algorithm for facility location optimization problems,” Proceedings of the 2008 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI'2008), October 12-15, 2008, Beijing, China, pp.2375-2381.

•  Li Xia, Ming Xie, Wenjun Yin, Jin Dong, and Jinyan Shao, “Markov decision processes formulation for stochastic and dynamic bank branches location problems,” Proceedings of the 2008 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI'2008), October 12-15, Beijing, China, pp. 419-424.

•  Li Xia and Xi-Ren Cao, “Aggregation of perturbation realization factors and service rate-based policy iteration of queueing systems,” Proceedings of the 45th IEEE Conference on Decision and Control (CDC'2006), December 13-15, 2006, San Diego, CA, USA, pp.1063-1068.

•  Li Xia, Qianchuan Zhao, and Qing-Shan Jia, “The SRLF rule in multi-unit joint replacement maintenance problem and its optimality,” 12th INFORMS/APS Conference, June 23-25, 2004, Beijing, China. 

[Other Publications]:

•  Li Xia, Zhe George Zhang, Quan-Lin Li, Peter W. Glynn, “A c/μ-rule for service resource allocation in group-server queues,” arXiv:1807.05367 [math.OC], Jul. 2018.

•  Li Xia, “Mean-variance optimization of discrete time discounted Markov decision processes,”arXiv:1708.07095, Aug. 2017.

•  Li Xia, Peter W. Glynn, “A generalized fundamental matrix for computing fundamental quantities of Markov systems,” arXiv:1604.04343, Apr. 2016.

•  Li Xia, Book Review of “Iterative Learning Control: An Optimization Paradigm”, by David H. Owens (Springer-Verlag, 2016), IEEE Control Systems Magazine, Vol. 37, No. 2, pp. 185-186, 2017.

•  Li Xia, Book Review of “Analytical Methods for Dynamic Modelers”, by Hazir Rahmandad, Rogelio Oliva and Nathaniel D. Osgood (MIT Press, 2015), International Journal of Simulation and Process Modelling, 2016.

•  Li Xia, Jie Song, Hui Xiao, Enlu Zhou, Preface to the Special Issue on “Simulation Modelling and Optimization of Large-Scale Systems”, International Journal of Simulation and Process Modelling, 2016. 

[Patent]:

US Patent

•  Jin Dong, Li Xia, Ming Xie, Wen Jun Yin, Li Li Zhao, “Method for highlighting topic element and system thereof,” Patent No. US 8482575 B2, Date of Patent 2013.7.9.

•  Jin Dong, Ta-Hsin Li, Jin Yan Shao, Li Xia, Ming Xie, Wen Jun Yin, Bin Zhang, “Method and apparatus for outlet location selection using the market region partition and marginal increment assignment algorithm,” Patent No. US 8458008 B2, Date of Patent 2013.6.4.

•  Jin Dong, Ta-Hsin Li, Jin Yan Shao, Li Xia, Ming Xie, Wen Jun Yin, Bin Zhang, “Method and apparatus for optimal service channel reconfiguration based on multi-agent simulation,” Publication No. US 20110188404 A1, Patent No. US 8482575 B2, Date of Patent 2013.12.31.

P.R.C. Patent

•  赵丽丽, 董进, 尹文君, 谢明, 夏俐, “突出显示主题元素的方法及其系统”, 中华人民共和国发明专利授权, 专利授权号ZL 200910132264, 授权日2013.1.2.

•  夏俐, 赵千川, 赵寅, 程志金, 王福林, 宋芳婷, “基于学习用户行为的多维舒适度室内环境控制系统”, 中华人民共和国实用新型专利授权, 专利授权号: ZL 201320416241.5, 授权日2014.2.19.

•  夏俐, 赵千川, 程志金, 王福林, 赵寅, 宋芳婷, “具有参数学习能力的百叶与灯光的集成控制方法”, 中华人民共和国发明专利授权, 专利授权号: ZL 201310190381.X, 授权日2015.12.9.

•  夏俐, 赵千川, 赵寅, 程志金, 王福林, 宋芳婷, “基于学习用户行为的多维舒适度室内环境控制方法及系统”, 中华人民共和国发明专利授权, 专利授权号: ZL 201310294325.0, 授权日2016.1.20.

•  夏俐, 王福林, 崔傲, 赵千川, 管晓宏, “智能开关及火线取电方法”, 中华人民共和国发明专利授权, 专利授权号: ZL 201510417376.7, 授权日2018.10.8.

•  夏俐, 崔傲, 赵千川, 王福林, 管晓宏, “一种基于无线信号强度的设备自动配对方法”, 中华人民共和国发明专利申请, 专利申请号: CN 201510413641.4, 申请日2015.7.14.

•  夏俐, 周芬芳, 赵千川, 董炜, 孙新亚, “基于支持向量机的道岔故障诊断方法及系统”, 中华人民共和国发明专利申请, 专利申请号: CN 201610109726.8, 申请日2016.2.26.

•  夏俐, 赵千川, 赵明国, “两轮自平衡车的机器学习控制方法”, 中华人民共和国发明专利授权, 专利授权号: ZL 201710343873.6, 授权日2019.11.22.

•  夏俐, 杨震, 赵千川,管晓宏, “带有储能的新能源输出功率波动最小化调度方法及装置”, 中华人民共和国发明专利授权,  专利授权号: ZL 201810343620.3, 授权日2020.6.12.

•  夏俐, “一种中文作文自动评分方法及教辅系统”, 中华人民共和国发明专利授权, 专利授权号: ZL 201911059419.3, 授权日2023.3.17.

•  贾庆山; 唐静娴; 赵千川; 夏俐; 管晓宏; 高江; 岳上; 韩建军; 黄现东; 栗权; 林森; 赵静洲; 徐东; 郑焕琼，电池状态监测方法、装置，中华人民共和国发明专利申请, 专利申请号: CN110927606A，2019.11.05

•  夏俐; 朱华; 高江; 岳上; 韩建军; 杨震; 夏恒; 栗权; 林森; 赵静洲; 徐东; 黄现东; 郑焕琼; 赵千川; 贾庆山; 管晓宏，能源使用效率PUE的预测方法、装置、终端及介质，中华人民共和国发明专利申请, 专利申请号: CN110781595A，2020.02.11

•  贾庆山; 唐静娴; 高江; 岳上; 韩建军; 夏恒; 朱华; 栗权; 林森; 赵静洲; 徐东; 黄现东; 郑焕琼; 赵千川; 夏俐; 管晓宏，电池健康评估方法、装置、存储介质及电子设备，中华人民共和国发明专利申请, 专利申请号: CN110806546A，2020.02.18

•  夏俐; 朱华; 高江; 岳上; 韩建军; 杨震; 夏恒; 栗权; 林森; 赵静洲; 徐东; 黄现东; 郑焕琼; 赵千川; 贾庆山; 管晓宏，能源使用效率的预测方法、装置及存储介质和终端设备，中华人民共和国发明专利申请, 专利申请号: CN110826784A，2020.02.21

•  夏俐; 赵千川; 贾庆山; 管晓宏; 杨震; 朱华; 高江; 岳上; 韩建军; 栗权; 林森; 赵静洲; 徐东; 黄现东; 郑焕琼，模型训练方法、装置、能效预测方法、装置和存储介质，中华人民共和国发明专利申请, 专利申请号: CN110866592A，2020.03.06

•  夏恒; 夏俐; 赵千川; 贾庆山; 管晓宏; 杨震; 朱华; 高江; 岳上; 韩建军; 栗权; 林森; 赵静洲; 徐东; 黄现东; 郑焕琼,  一种模型训练方法、能耗使用效率预测方法、装置和介质，中华人民共和国发明专利申请, 专利申请号: CN110866528A，2020.03.06

•  夏俐, 陈刚, 程志金, 张亮, 彭曦, 齐美玉, 姜兆宇. 一种通信网络流量数据的学习与装置, 中华人民共和国发明专利申请, 专利申请号: 202110441829.5, 2021.

•  赵俊雄, 吴倩妮, 夏俐. 一种基于区块链的碳排放权质押融资方法与系统，中华人民共和国发明专利申请, 专利申请号: 202210111638.7，2022.01.29