Why are ceramics like this?

The interesting question is why ceramics behave like this—and the no-less-interesting answer boils down to materials science: it's all to do with how the atoms inside are bonded together. That explains how most materials work.