This is where I will post my working sketches / nonsense, until I can figure out a better solution.
Bad terrain
In which you click the red apple (an apple i made in blender (it looks weird because it's actually apple slices))
Somewhat similar thing with shadows and light
Trying shadows and light
Second working three.js project
First working three.js project