Because it took a whole 4 billion years for our technologcial civilization to evolve (basically all the time up until the present). It was only in the past 100 years that we became capable of communicating with aliens if any exist. As for civilization of any type, it was like what? 10,000? years back to the transition from hunting gathering to agriculture? And 17,000 years back to the first aparent flouishing of culture--with painting, decorations, and long distance trade. So basically, it took the whole age of the Earth for our civilization to appear. If humans were wiped out, a new intelligent species might not even have time to rebound and reevolve before the Earth gets too hot, from the warming sun. From the little mammal mice to us was 60 million years, right? We (animals) have got only about 400 million good years left before the Earth becomes too hot for life--by too hot I mean the oceans start to boil, and boil away. (Sorry to be a bummer).
Also, if you assume your life to be taking place at some random point between the beginning and end of civilization (adjusting for population levels) well either we just happen to live WAY at the very beginning of technological civilization, or the party's not going to last very long.

Which is why I take comfort in the others have come before us idea--somewhere, sometime. I am pessimistic about faster-than-speed-of-light travel, and I suspect that civilizations, if they do tend to be long-lived, probably plataue out eventually at some (hopefully high) technological level--rather than continue growing ever more amazing forever and ever.