LSTM acceleration by SVD

December 20, 2022

Initially my Linear Algebra final project and continued as a research project, the idea here is to perform rank-reduction on long short-term memory (LSTM) cells, then decompose them to into a smaller form. The reduced models take less memory and computer quicker!

Model performance with increasing rank reduction.

Time series visualization of model performance as with increasing rank-reduction.

RMSE increasing as weights reduced from model.

RMSE trend as weights are reduced from the model.

You can see the project here.