To me, the issues look like being induced by being in over wet soil and possibly an over humid atmosphere and not caused by insects at all.
In my country, neem products are illegal to use on ANY plant intended for human consumption.
Try letting the soil dry out properly before watering again. When the top inch, inch and a half is dry, this is when to water again.
The leaf problems seem more fungal related than insect damage to me and may be the result of an over moist atmosphere; try removing all sources of open/standing water and this will help.
One other thing, roots need complete darkness to grow properly and using clear or opaque plastic bottles which let light through, will limit root growth and health. Either paint them black or buy some cheap black plastic pots for your next grow. Also, your soil mix seems like it has a lot of bark in it, this is not ideal for plants as it provides no nutritional value and will actually rob your soil of nutrients as it breaks down, denying your plant of access to these nutrients. Spending big on soil will pay dividends, with much better and healthier plants, that will yield much more too.
Remember, moist, not wet and not too dry. It may take a little juggling to get right, but once mastered, will become instinctive.
It may be a little late to expect any great revival for this plant, sadly.
Hope this helps,.... Organoman.