Probably caterpillars and once they get inside the bud it will start to rot. Be diligent with BT sprays. I spray my outside girls every Friday. Start investigating the buds, pull any worms out to start.
Edit - Almost forgot, the eggs look like tiny black honeycombs, underside of the leaves. If you see any, pull those leaves.