Are you doing some praying and watching your motivation?
I got mine in about 4, two hours tries in world 2 and am on my 10th hours on world 4. Hopefully in about 30 minutes I will find out that I got it now. I would really like to have that 180 ex points.
I am in my third week of no flag. I just throw an hour at it here and there as it isn't really that important anymore since it is only 25% of a level now.
Well guard the fort was a good job for me at early levels so I didn't mind spending time doing it. I finally got the flag just after I reached the level the quest is available, but I still don't have enough leather.