MT
⋅
HS21
Thesis Page
Contents
- Thesis
- Thesis. Contains the up-to-date results.
- Reservoir Computing Examples
-
-
- Sinusoidal:
- Features RC-RNN Comparison on Sine functions. RC displays superiority over
RNN in terms of speed and accuracy.
-
- House of the Rising Sun:
- Features RC on learning melodies using output feedback method. Showcases the problem with periodic inputs and how to tackle it. Includes RC-RNN comparison.
-
- Mackey-Glass Equations:
- Features RC-RNN Comparison on Mackey-Glass equations. RC displays superiority over
RNN in terms of speed, accuracy, generativity and robustness to smaller dataset.
-
- Mid-price Forecasting:
- Features a Reservoir Computing approach to the work done in SPHS20.
- Reinforcement Learning Examples
-
-
- Cartpole(ESN):
- Features Echo State Network (ESN) trained on the cartpole environment.
-
- Mid-price Trading:
- Features reinforcement learning algorithms trading on mid-prices using high frequency limit order book data. The models used are fully trained feedforward networks, Extreme Learning Machines and Echo State Networks.
- Links
-
-
- Github:
- Contains the pdf of the thesis and the programming resources, which can be used to reproduce the results shown in the thesis.
-
- Thesis:
- Thesis on Github.
-
- EchoStateNetwork:
- Documentation of the framework written for Echo State Network applications.
- Log
- Progress updates and changes made to the website.
- Sunday, 29 May 2022
- Added Thesis. Removed Literature Summary (WIP).
- Friday, 14 January 2022
- Added Reinforcement Learning Examples: Cartpole(ESN)/ESN-PPO-POMDP.
- Updated Reinforcement Learning Examples: Cartpole(ESN)/ESN-PPO.
- Wednesday, 12 January 2022
- Added Reinforcement Learning Examples: Mid-price Trading/Analysis.
- Updated Reinforcement Learning Examples: Mid-price Trading/Partially Trained FNN after matching the minibatching in PPO to the reservoir case.
- Friday, 24 December 2021
- Updated Reinforcement Learning Examples: Mid-price Trading/Partially Trained FNN after correctly initializing Model 2 by the standard normal distribution.
- Tuesday, 21 December 2021
- Updated Reinforcement Learning Examples: Mid-price Trading/Partially Trained FNN after adding model with larger untrained hidden size and more trainable parameters.
- Sunday, 19 December 2021
- Updated Reinforcement Learning Examples: Mid-price Trading/ESN-PPO after using larger reservoir and separate value & policy networks.
- Monday, 13 December 2021
- Added Reinforcement Learning Examples: Mid-price Trading/ESN-PPO.
- Friday, 10 December 2021
- Updated Reinforcement Learning Examples: Cartpole(ESN)/ESN-PPO after using 0 as initial reservoir layer state.
- Wednesday, 8 December 2021
- Added Reinforcement Learning Examples: Cartpole(ESN)/ESN-PPO.
- Monday, 6 December 2021
- Updated Reinforcement Learning Examples: Cartpole(ESN)/ESNRLS-Q after allowing initial transient to pass during reservoir updates.
- Wednesday, 1 December 2021
- Updated Reinforcement Learning Examples: Mid-price Trading/ Fully and Partially Trained FNN after correctly vectorizing environments.
- Tuesday, 30 November 2021
- Updated Reinforcement Learning Examples: Mid-price Trading.
- Sunday, 28 November 2021
- Added Reinforcement Learning Examples: Cartpole(ESN)/ESNRLS-Q, Mid-price Trading.
- Tuesday, 14 September 2021
- Removed Triple-Barrier Method from RC Examples and Literature Summary.
- Uploaded ESN python class to GitHub.
- Friday, 11 June 2021
- Updated Triple-Barrier Method.
- Wednesday, 9 June 2021
- Updated Literature Summary (WIP). Updated Triple-Barrier Method section.
- Monday, 24 May 2021
- Uploaded Triple-Barrier Method (WIP).
- Friday, 21 May 2021
- Updated RC example (Mid-price Forecasting).
Added comparison with LOB,LIQ and LOB+LIQ datasets.
Now it also showcases the ESN class written for the thesis.
- Tuesday, 18 May 2021
- Added RC example (Mid-price Forecasting)
- Sunday, 16 May 2021
- Added RC example (House of the Rising Sun)
- Saturday, 15 May 2021
- Added RC example (Sinusoidal)
- Improved RC example (Mackey-Glass)
- Thursday, 13 May 2021
- Added RC example (Mackey-Glass)
- Wednesday, 12 May 2021
- Created the webpage
- Added literature summary