Shmita - Rest for the Man or for the Land?

Is it the land lying fallow that is the central theme, or are the Jews who do not work it during the shmita year the focus?