Characteristics of .au Websites: An Analysis of Large-Scale Web Crawl Data from 2005

Ackland, Robert, Spink, Amanda H., & Bailey, Peter (2007) Characteristics of .au Websites: An Analysis of Large-Scale Web Crawl Data from 2005. In The Thirteenth Australasian World Wide Web Conference (AusWeb07), 30 June - 4 July 2007, Charlesworth Bay, NSW.


This paper presents a preliminary analysis of Websites contained in a large-scale crawl of the .au domain that was collected by the Commonwealth Scientific and Industrial Research Organisation (CSIRO) in late 2005. Our analysis is based on a 10 percent random sample of the CSIRO crawl dataset, which contains around 10 million Web pages from approximately 200,000 Websites. This paper represents the first step in a larger planned project which we title the ".au Census", the aim of which is to use large-scale Web crawls to conduct research into commercial and social aspects of the Australian public Web. The primary aim of the present paper is to analyse the data's properties. We find that the dataset predominantly consists of commercial Websites (78 percent of sites are "") while, and sites each account for around 5-6 percent of all sites (and sites are approximately 2 percent).

Impact and interest:

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

281 since deposited on 21 Aug 2008
35 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 14470
Item Type: Conference Paper
Refereed: Yes
Additional Information: The contents of this conference can be freely accessed online via the conference's web page (see hypertext link).
Additional URLs:
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > LIBRARY AND INFORMATION STUDIES (080700) > Information Retrieval and Web Search (080704)
Divisions: Past > QUT Faculties & Divisions > Faculty of Science and Technology
Copyright Owner: Copyright 2007 Robert Ackland, Amanda Spink & Peter Bailey
Deposited On: 21 Aug 2008 00:00
Last Modified: 29 Feb 2012 13:35

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page