The system state is a large data structure which holds not only all accounts and balances, but a machine state, which can change from block to block according to a predefined set of rules, and which can execute arbitrary machine code (bytecode). The specific rules of changing state from block to block are defined by the EVM.