The original castle of the Lhagyari family built in the thirteenth century in Eyul in the northeast of Samye in present day Chusum county. It was Nangso Damepa, one of the early ancestors of the family, who built the castle which from the family took its name. The ruins of the castle are still standing.