This is the one thing that gets me stuck and my biggest criticism towards how teachers choose to teach languages: by hard hitting you memory, which you have so little of.
I've done 2 semesters of German at university and it went terribly. The number one reason for this failure IMO is the way they tried to teach it, by simply speaking German non-stop at class and asking each time for you to memorize by heart this giant list of verbs/words etc, that you'd be tested on later. Nothing about the logic of the language, its syntax construction etc so you have something to start with and do not end up just memorizing stuff you don't understand and re-spitting from memory it whilst you have ZERO idea about it. That is not to mention that in my world, past the age of 14, asking me to memorize anything by heart amounts basically to an insult to my intelligence.