Market Making with Learned Beta Policies

Wang, Yongzhao, Savani, Rahul, Gu, Anri, Mascioli, Chris, Turocy, Theodore and Wellman, Michael (2024) Market Making with Learned Beta Policies. In: ICAIF 2024 - 5th ACM International Conference on AI in Finance. UNSPECIFIED, pp. 643-651. ISBN 9798400710810

Preview

PDF (icaif24-29) - Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract

In market making, a market maker (MM) can concurrently place many buy and sell limit orders at various prices and volumes, re- sulting in a vast action space. To handle this large action space, beta policies were introduced, utilizing a scaled beta distribution to concisely represent the volume distribution of an MM’s orders across different price levels. However, in these policies, the param- eters of the scaled beta distributions are either fixed or adjusted only according to predefined rules based on the MM’s inventory. As we show, this approach potentially limits the effectiveness of market-making policies and overlooks the significance of other market characteristics in a dynamic market. To address this limita- tion, we introduce a general adaptive MM based on beta policies by employing deep reinforcement learning (RL) to dynamically control the scaled beta distribution parameters and generate orders based on current market conditions. A sophisticated market simulator is employed to evaluate a wide range of existing market-making policies and to train the RL policy in markets with varying levels of inventory risk, ensuring a comprehensive assessment of their performance and effectiveness. By carefully designing the reward function and observation features, we demonstrate that our RL beta policy outperforms baseline policies across multiple metrics in dif- ferent market settings. We emphasize the strong adaptability of the learned RL beta policy, underscoring its pivotal role in achieving superior performance compared to other market-making policies.

Item Type:	Book Section
Uncontrolled Keywords:	beta policy,deep reinforcement learning,market making,artificial intelligence,finance ,/dk/atira/pure/subjectarea/asjc/1700/1702
Faculty \ School:	Faculty of Social Sciences > School of Economics
UEA Research Groups:	Faculty of Social Sciences > Research Groups > Environment, Resources and Conflict Faculty of Social Sciences > Research Groups > Economic Theory Faculty of Social Sciences > Research Groups > Behavioural Economics Faculty of Social Sciences > Research Centres > Centre for Competition Policy Faculty of Social Sciences > Research Centres > Centre for Behavioural and Experimental Social Sciences
Related URLs:	http://www.scopus.com/inward/record.url?...
Depositing User:	LivePure Connector
Date Deposited:	05 Nov 2024 17:30
Last Modified:	13 Feb 2025 01:52
URI:	https://ueaeprints.uea.ac.uk/id/eprint/97527
DOI:	10.1145/3677052.3698623

Downloads

Actions (login required)

View Item