I think it's more difficult for an English speaker to learn Spanish. In Spanish there are thousands of ways of writing/saying something, and most of the rules that you're taught about grammar have a few exceptions which than you have to memorize. Now, when it comes to speaking it, English is harder, you have to learn all these accents that words have and some words that are written the same way but are spelled differently.