It would really help to have a complete description of when/where/how this happens, what, if anything, causes it to vary. The information so far doesn't really give much to go on.
The only things moving out front are the tire/wheel/brake rotors. So things like the wheel bearings, the brake pads might be an issue. Is it possible that there is something loose like the front fender?