I found this post here:

http://www.unixtutorial.org/2008/03/find-large-files-and-directories/

that helped me out a bunch, and in the comments, the author responds to the question how to check the directory size, and then narrow down from directory to directory from there. Turns out my problem was backup retention; 3 separate copies of backups was choking me.