OR, you're not a totally evil Bond villain style overlord, and actually a decent human being at heart, but you are somewhat scared of THE TERRORISTS...
Patents are very rarely relevant since they have nothing to do with whether the grantee ever intends to use them. It might be worth getting concerned...