Diamond is hard due to its tetrahedral structure, while graphite is soft and slippery because of its layered structure where layers can slide over one another. This gives them distinct physical properties despite both being forms of carbon.