[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
How come search engines don't crawl the list and I can't find 'robots.txt'?
On Mon, 14 Apr 2014 07:22:00 +0300
Georgi Guninski <[email protected]> wrote:
> >
> > https://www.google.com/search?q=test+site%3Acpunks.org%2Fpipermail%2Fcypherpunks%2F
> >
> >
> > the archives are indeed indexed?
>
> search on google for:
>
> Heartbleed site:cpunks.org/pipermail/cypherpunks/
>
> doesn't return anything for me.
>
> (and searching for openssl doesn't return
> anything from 2014 for me).
Hm, you're right. Seems that the indexing stopped at some point
in 2013....
>
>