Skip to main content

The sixteenth crawl of the Portuguese web (incremental), performed in 2014 (AWP16).

Item Preview

There Is No Preview Available For This Item

This item does not appear to have any files that can be experienced on Archive.org.

Show all files

web

The sixteenth crawl of the Portuguese web (incremental), performed in 2014 (AWP16).

by
Portuguese Web Archive

Publication date
2014
Topics
Incremental crawl of the Portuguese web, Portuguese Web Archive, Portuguese online publications, pwacrawlid:AWP16, 2014
Contributor
Portuguese Web Archive
Language
Portuguese
Incremental crawl of the Portuguese web performed between 23 September 2014 and 24 October 2014 mainly from .PT domain. The AWP16 crawl is incremental because it was performed using DeDuplicator (http://landsbokasafn.github.io/DeDuplicator/) taking the content of AWP15 as baseline. Thus, the files that remained unchanged from the AWP15 complete crawl were not archived (duplicated) on the AWP16 incremental crawl.

Notes

All the items of the AWP12 incremental crawl are identified by the custom field pwacrawlid:AWP16. The AWP16 crawl is incremental because it was performed using DeDuplicator (http://landsbokasafn.github.io/DeDuplicator/). The previous complete crawl performed without DeDuplicator has the pwacrawlid:AWP15. The files of AWP16 that were duplicates from AWP15 were not archived. To see the complete content of AWP16 (e.g. pages containing duplicate images from AWP15) it must be combined with AWP15.

Addeddate
2016-06-19 05:15:13
External-identifier
urn:X-pwacrawlid:AWP16
Firstfiledate
20141007211910
Identifier
portuguese-web-archive-AWP162014-639
Lastfiledate
20141007221934
Location
203 407 698 web files (8.495 TB) crawled between 23 September 2014 and 24 October 2014 mainly from .PT domain and web sites crawled during the previous crawl.
Pages
260127
Pwacrawlid
AWP16
Scandate
20141007211910

plus-circle Add Review
comment
Reviews

There are no reviews yet. Be the first one to write a review.

200 Views

DOWNLOAD OPTIONS

No suitable files to display here.

download 3 Files
download 3 Original
SHOW ALL

IN COLLECTIONS

Arquivo.pt: the Portuguese web-archive Data Collection

Uploaded by Daniel Gomes on

SIMILAR ITEMS (based on metadata)

Terms of Service (last updated 12/31/2014)