Im thinking this is a control arm bushing issue. Look at the rubber see if it is torn up or wallowed out. Even if its not though they can still be bad.