Growing a herb garden, but its not growing!?

I started a small herb garden in my backyard. In this spot last year I had 4 large tomatoe plants that did quite well. This year I added some topsoil, small amount fo compost and sheep manure. I have two tomatoe plants which are doing well, but the herbs are floundering. I have basil, thymem rosemary, mint and dill. I planted chamomile and lemon balm in containers and they are 3x thier starting size. The other herbs have not grown at all and the bugs are attacking them badly, especially the basil. I have tried small containers with beer, crushed egg shells, and today I used the diametaceous earth powder. I also tried insectisde at one point with no effect but to kill some leaves on the basil. Why arent these herbs growing? I did use some miracle grown as well 2x. They have been in the ground for 4 weeks now. Should I pull them up and put them in containers, or add something to the soil and start again?