Skip to main content

Focused Crawls

Internet Archive

Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.



rss RSS

702,759
RESULTS


Show sorted alphabetically

Show sorted alphabetically

SHOW DETAILS
up-solid down-solid
eye
Title
Date Archived
Creator
Top Domains
collection
350,607
ITEMS
3.7B
VIEWS
collection

eye 3.7B

A daily collection of thousands of the most popular web sites according to Alexa.com's top sites rankings .
Topics: daily, popular sites, Alexa
Top News
collection
247,379
ITEMS
1.6B
VIEWS
collection

eye 1.6B

A daily collection of hundreds of the world's top news sites.
Topics: daily, news
top_domains-00300
top_domains-00300
collection
9,437
ITEMS
109.3M
VIEWS
by Internet Archive
collection

eye 109.3M

top_domains-00500
top_domains-00500
collection
18,547
ITEMS
121.1M
VIEWS
by Internet Archive
collection

eye 121.1M

top_domains-00900
top_domains-00900
collection
5,487
ITEMS
108.5M
VIEWS
by Internet Archive
collection

eye 108.5M

nytimes.com
nytimes.com
collection
2,947
ITEMS
59.6M
VIEWS
by http://nytimes.com
collection

eye 59.6M

top_domains-00600
top_domains-00600
collection
10,354
ITEMS
102.6M
VIEWS
by Internet Archive
collection

eye 102.6M

top_domains-00350
top_domains-00350
collection
3,343
ITEMS
81M
VIEWS
by Internet Archive
collection

eye 81M

edgi monitor
edgi monitor
collection
20,124
ITEMS
53.4M
VIEWS
collection

eye 53.4M

top_domains-00800
top_domains-00800
collection
14,941
ITEMS
82.9M
VIEWS
by Internet Archive
collection

eye 82.9M

top_domains-02500
top_domains-02500
collection
5,338
ITEMS
71.6M
VIEWS
by Internet Archive
collection

eye 71.6M

buzzfeed.com
buzzfeed.com
collection
4,123
ITEMS
47.1M
VIEWS
by buzzfeed.com
collection

eye 47.1M

top_domains-01500
top_domains-01500
collection
4,138
ITEMS
77.7M
VIEWS
by Internet Archive
collection

eye 77.7M

nbcnews.com
nbcnews.com
collection
1,832
ITEMS
54M
VIEWS
by nbcnews.com
collection

eye 54M

top_domains-00700
top_domains-00700
collection
1,974
ITEMS
66.7M
VIEWS
by Internet Archive
collection

eye 66.7M

top_domains-00400
top_domains-00400
collection
4,267
ITEMS
66.6M
VIEWS
by Internet Archive
collection

eye 66.6M

top_domains-00250
top_domains-00250
collection
2,652
ITEMS
83.5M
VIEWS
by Internet Archive
collection

eye 83.5M

top_domains-07500
top_domains-07500
collection
3,504
ITEMS
59.4M
VIEWS
by Internet Archive
collection

eye 59.4M

top_domains-02000
top_domains-02000
collection
5,061
ITEMS
60.3M
VIEWS
by Internet Archive
collection

eye 60.3M

top_domains-00450
top_domains-00450
collection
3,864
ITEMS
65.4M
VIEWS
by Internet Archive
collection

eye 65.4M

yahoo.com
yahoo.com
collection
2,842
ITEMS
66M
VIEWS
collection

eye 66M

top_domains-04250
top_domains-04250
collection
3,236
ITEMS
45.4M
VIEWS
by Internet Archive
collection

eye 45.4M

foxnews.com
foxnews.com
collection
2,205
ITEMS
40.6M
VIEWS
by http://foxnews.com
collection

eye 40.6M

top_domains-03500
top_domains-03500
collection
2,598
ITEMS
44.8M
VIEWS
by Internet Archive
collection

eye 44.8M

top_domains-02750
top_domains-02750
collection
3,199
ITEMS
61.2M
VIEWS
by Internet Archive
collection

eye 61.2M

top_domains-08000
top_domains-08000
collection
2,433
ITEMS
47.6M
VIEWS
by Internet Archive
collection

eye 47.6M

top_domains-09500
top_domains-09500
collection
4,891
ITEMS
49.8M
VIEWS
by Internet Archive
collection

eye 49.8M

top_domains-06000
top_domains-06000
collection
4,842
ITEMS
45.3M
VIEWS
by Internet Archive
collection

eye 45.3M

top_domains-04750
top_domains-04750
collection
3,237
ITEMS
39.8M
VIEWS
by Internet Archive
collection

eye 39.8M

top_domains-04500
top_domains-04500
collection
3,560
ITEMS
48M
VIEWS
by Internet Archive
collection

eye 48M

top_domains-03000
top_domains-03000
collection
2,820
ITEMS
48.6M
VIEWS
by Internet Archive
collection

eye 48.6M

msnbc.msn.com
msnbc.msn.com
collection
15,549
ITEMS
32.9M
VIEWS
by http://msnbc.msn.com/
collection

eye 32.9M

welt.de
welt.de
collection
3,453
ITEMS
36.5M
VIEWS
by http://welt.de/
collection

eye 36.5M

top_domains-03750
top_domains-03750
collection
2,558
ITEMS
39M
VIEWS
by Internet Archive
collection

eye 39M

top_domains-04000
top_domains-04000
collection
3,601
ITEMS
47.3M
VIEWS
by Internet Archive
collection

eye 47.3M

top_domains-02250
top_domains-02250
collection
3,420
ITEMS
56.5M
VIEWS
by Internet Archive
collection

eye 56.5M

top_domains-03250
top_domains-03250
collection
1,833
ITEMS
37.1M
VIEWS
by Internet Archive
collection

eye 37.1M

top_domains-01000
top_domains-01000
collection
5,363
ITEMS
49.7M
VIEWS
by Internet Archive
collection

eye 49.7M

top_domains-01250
top_domains-01250
collection
2,182
ITEMS
36M
VIEWS
by Internet Archive
collection

eye 36M

top_domains-05750
top_domains-05750
collection
1,919
ITEMS
32.7M
VIEWS
by Internet Archive
collection

eye 32.7M

top_domains-05000
top_domains-05000
collection
1,489
ITEMS
28.8M
VIEWS
by Internet Archive
collection

eye 28.8M

top_domains-08750
top_domains-08750
collection
3,474
ITEMS
44.8M
VIEWS
by Internet Archive
collection

eye 44.8M

top_domains-09000
top_domains-09000
collection
3,877
ITEMS
42.4M
VIEWS
by Internet Archive
collection

eye 42.4M

top_domains-06750
top_domains-06750
collection
3,635
ITEMS
38.3M
VIEWS
by Internet Archive
collection

eye 38.3M

worldpress.org
worldpress.org
collection
672
ITEMS
55.7M
VIEWS
by http://worldpress.org/
collection

eye 55.7M

abcnews.go.com
abcnews.go.com
collection
2,783
ITEMS
26.6M
VIEWS
by http://abcnews.go.com/
collection

eye 26.6M

top_domains-07250
top_domains-07250
collection
2,648
ITEMS
27M
VIEWS
by Internet Archive
collection

eye 27M

time.com
time.com
collection
894
ITEMS
43.6M
VIEWS
by http://time.com
collection

eye 43.6M

taringa.net
taringa.net
collection
1,400
ITEMS
44.4M
VIEWS
by taringa.net
collection

eye 44.4M

top_domains-08250
top_domains-08250
collection
4,115
ITEMS
34.9M
VIEWS
by Internet Archive
collection

eye 34.9M

top_domains-06250
top_domains-06250
collection
2,511
ITEMS
38.3M
VIEWS
by Internet Archive
collection

eye 38.3M

theweek.com
theweek.com
collection
1,892
ITEMS
17M
VIEWS
by http://theweek.com
collection

eye 17M

bild.de
bild.de
collection
7,481
ITEMS
16.9M
VIEWS
by http://bild.de/
collection

eye 16.9M

top_domains-01750
top_domains-01750
collection
1,710
ITEMS
39.8M
VIEWS
by Internet Archive
collection

eye 39.8M

top_domains-05500
top_domains-05500
collection
8,265
ITEMS
38.4M
VIEWS
by Internet Archive
collection

eye 38.4M

top_domains-06500
top_domains-06500
collection
3,071
ITEMS
34.5M
VIEWS
by Internet Archive
collection

eye 34.5M

top_domains-05250
top_domains-05250
collection
6,002
ITEMS
38.7M
VIEWS
by Internet Archive
collection

eye 38.7M

blogspot.in
blogspot.in
collection
1,374
ITEMS
26.2M
VIEWS
by blogspot.in
collection

eye 26.2M

sfgate.com
sfgate.com
collection
3,634
ITEMS
31.7M
VIEWS
by http://sfgate.com
collection

eye 31.7M

latimes.com
latimes.com
collection
1,063
ITEMS
29.9M
VIEWS
by http://latimes.com
collection

eye 29.9M

huffingtonpost.com
huffingtonpost.com
collection
12,544
ITEMS
36.7M
VIEWS
by http://huffingtonpost.com
collection

eye 36.7M

top_domains-07000
top_domains-07000
collection
2,669
ITEMS
34.3M
VIEWS
by Internet Archive
collection

eye 34.3M

top_domains-08500
top_domains-08500
collection
1,616
ITEMS
27.5M
VIEWS
by Internet Archive
collection

eye 27.5M

top_domains-07750
top_domains-07750
collection
1,715
ITEMS
44.7M
VIEWS
by Internet Archive
collection

eye 44.7M

themeforest.net
themeforest.net
collection
744
ITEMS
41M
VIEWS
by themeforest.net
collection

eye 41M

indiatimes.com
indiatimes.com
collection
1,100
ITEMS
16.2M
VIEWS
by http://indiatimes.com
collection

eye 16.2M

chicagotribune.com
chicagotribune.com
collection
617
ITEMS
26.1M
VIEWS
by http://chicagotribune.com/
collection

eye 26.1M

weather.com
weather.com
collection
1,329
ITEMS
22.3M
VIEWS
by http://weather.com/
collection

eye 22.3M

top_domains-09750
top_domains-09750
collection
1,882
ITEMS
24.5M
VIEWS
by Internet Archive
collection

eye 24.5M

ameblo.jp
ameblo.jp
collection
246
ITEMS
14M
VIEWS
by http://ameblo.jp
collection

eye 14M

bbc.co.uk
bbc.co.uk
collection
1,087
ITEMS
22.5M
VIEWS
by http://bbc.co.uk
collection

eye 22.5M

usnews.com
usnews.com
collection
479
ITEMS
14.3M
VIEWS
by http://usnews.com/
collection

eye 14.3M

abc.net.au-news
abc.net.au-news
collection
2,018
ITEMS
14.2M
VIEWS
by http://abc.net.au/news/
collection

eye 14.2M

fbdailycrawl.io
fbdailycrawl.io
collection
10,064
ITEMS
12.1M
VIEWS
by Internet Archive
collection

eye 12.1M

haaretz.com
haaretz.com
collection
1,420
ITEMS
15.3M
VIEWS
by http://haaretz.com/
collection

eye 15.3M