a window sill would only work if it gets several hours of direct sunlight every day. Indirect won't work, they'll get really leggy.
If you're planning on growing outside, it's way too late to start peppers. If you're going to grow them inside you might as well buy the lights now. You could also grow plants on a really wide window sill that gets 6+ hours of direct sunlight a day.