I’m looking for a reference on to whom to give and where to begin. For example - where does it say that we should begin to give at home, then in our community and finally to the rest of the world.

The Rambam in the "Laws of Gifts to the Poor" VII 13 and the Shulchan Aruch Yoreh Deah 251 3 give the list of priorites you refer to.