Scaling down was/is a gradual process for me. I went from several dozen varieties and over a hundred plants a few years ago to less than a dozen varieties this year, and from almost 30 plants on my patio to only 8 this year. Next year will be even less, as I notice I only use the chillies from a few plants on a regular basis. I now have more room for flowers and herbs. I think 95% of the chillies I used regularly for cooking came from 3 individual plants that were in pots (De arbol, Jwala, and Aruna), the rest came from the jalapenos and serranos in the garden. I noticed that I don't use any chinensis any more even though I love the aroma and looks of them, but to me Indian food just doesn't taste right when using them. Anyway, next year I see myself having even less numbers and varieties. It can be done!