It can also be increased by other relevant conditions, such as being purple born in the Byzantine Empire, or baptised for Christians.
Alongside other effects, an Imperial Court with dangerously high influence may decide to replace the current emperor with one of their own. Society Influence plays a very big role here.