Don't plant rosemary seeds, it's not worth it. Go get a plant or two, they're perennial in your area and grow into a good sized shrub. Put it where it'll get lots of sun in sandy soil, water it until it gets established, then ignore it. It's better to water deep once a week or so than every day. Hey, you could get a prostrate rosemary and put it in your corner bed or in front of the peppers in the bed where the boxwoods were. It will spill attractively down over the front like a vine.
Sage and thyme should be perennials, too. Personally I'd buy them as plants, too, but they're not as difficult as rosemary. You're going to want several clumps of thyme, and at least two sage plants.
Oregano is another perennial, but make sure you don't have common oregano, it doesn't have as much flavor as the other kinds. It also runs almost as much as mint. I like Italian upright oregano best because to me, it has a delicately intense flavor. The most common one seen in stores these days is Greek Oregano, which is also a nice oregano. It grows in short (6 to 12 inches) clumps, so two are three should be enough once they're established. If it were me, I'd start several seeds in the same cup.
Basil is a wonderful summer herb, they love heat and light. If your plan is to dry some for winter, get an Italian variety like Lettuce Leaf or Italian Large Leaf. How many to plant depends on what you're going to do with it. One of the nice things about basil is that as you pick it, it gets bushier. I make a lot of pesto in the summer, so I like having at least 5 or 6 of the Italian basils going. I think I've mentioned the plague of Lemon Basil that reseeds itself in my yard every year, and it's a wonderful basil for fish dishes or stuffing peppers. It makes a very tart pesto, too.
Parsley is a biennial, and usually grows best that second year. They also grow better in cool weather. Oh, it'll grow in the summer, bit it always takes off for me in the fall. This is another one that you can plant several seeds in each cup.
Get your dill and cilantro going now or it will be too hot and they'll bolt to seed as soon as you move them outside. I grow mine as spring and fall crops. Put several seeds in each cup, and I'd plant at least 6 cups. When I use cilantro or dill, I use a lot!
Now, if you're growing parsley and dill, you're likely to get black swallowtail caterpillars at some point. You are NOT allowed to murder them! Get a fennel plant and move the caterpillars over when you find them. They look like bird droppings when they're tiny and grow to this:
http://insects.tamu.edu/fieldguide/cimg266.html
Seriously, they need our help. And it's *so* exciting to watch them grow and pupate. Plus you can be a big hit with any children around the neighborhood.
When you're not using your fennel as caterpillar food, it's really nice for fish on the grill.
