Yes, it really looks like a magnesium deficiency! Before fertilizing it, though, check the pH of both the water you're using and the runoff, as it might be a pH issue that you can solve easily :) If it's fine, go ahead with magnesium (or cal-mag) and you'll be all set! :) Happy growing