thrips aren't the worst pest out there as long as you monitor it, if you let them build out of control then you'll have problems, so yeah you're doing the right thing, keep an eye under the leaves for the babies, small yellow wormy looking things usually.
I found amblyseius to work very well...