Sometimes enemies have skills that restrict your passive skills from triggering! Just remember to keep adjusting your tactics in battle and you'll be able to overcome any challenge!