You can purchase gems from Nessa(Act 1).
Nessa is the first important character the player comes across and, along with Bestel and Tarkleigh, she provides the initial quests for the player.
She is also a medicines and trinkets vendor who will purchase items from the player and sell a small stock of goods.