Answer: Many of his rivals feared Caesar's abuse of power, especially considering Caesar had total power and there were no legal means to remove him from office.
