Permanent spells can be learned from shrines dedicated to Beliar or Innos, and from Water Magicians/Druids. Those spells show up in your magic tab, and can be added to any hotkey for easy access.

Also, you need a certain amount of Ancient Knowledge to cast specific spells. This can also be gained from the shrines/water magicians/druids.