They could have attacked us at any time but they didn't. These objects have been seen in the skies for centuries or even longer and never did a huge effort to damage or attack.