The gem blocks explode when you cause damage to them with matches or birds. Making a match with items that have the same color as the gem block causes the gem block to explode right away. In case you make the matches with items that do not have the same color as the gem block, you'll need three matches to get the gem block to explode.