Actually the scare crow could have something to do with this quest. Ive done 4 playthroughs in this game, each time doing this quest. My current run this quest is bugged, and the only difference this run is that I encountered the scare crow BEFORE going to any one of the altars. The quest will not start/trigger and Ive been to all 3 altars and interacted with them yet have not gained source point. In my experience, it seems likely that the scare crow event might possibly break this questline.