The direction of gravity on earth is always vertical. But generally it just acts as a force, so it could come from multiple - any - direction (and even multiple at the same time, water being attracted the earth but also attracted by the moon, creating tides, shows exactly that).
But yes, plumb lines are not always straight in geodesy.
