There's a patch coming out next week that's supposed to bump the difficulty up. I haven't been able to play much, but ToB does feel pretty easy. I've taken over most of Ireland mostly via just attacking people while their armies are away or during rebellions.