Corpus of Australian and New Zealand Spoken English

Version 6.1

Coats, Steven, 2022, "Corpus of Australian and New Zealand Spoken English", https://doi.org/10.7910/DVN/GW35AK, Harvard Dataverse, V6

Learn about Data Citation Standards.

Contact Owner

Dataset Metrics

103 Downloads

Description	The Corpus of Australian and New Zealand Spoken English (CoANZSE) is a 196-million-word corpus of geolocated automatic speech recognition (ASR) YouTube transcripts from local government channels in Australia and New Zealand, created for the study of lexical, grammatical, and discourse-pragmatic phenomena of spoken language, as well as for content and language analysis in digital humanities and social science fields. Annotation includes individual word timings and video IDs of transcripts, making it easy to instantly view the video(s) for any given search. The corpus was created from 55,896 ASR transcripts from 472 YouTube channels, corresponding to almost 24,007 hours of video. The size of the corpus is 195,583,873 tokens. The channels sampled in the corpus are associated with local government entities such as local, city, county, district, and regional councils, and transcripts are from a range of video types. Recordings of public meetings are well-represented. Related resources are the Corpus of North American Spoken English and the Corpus of British Isles Spoken English. A searchable online version of this data is available at coanzse.org. The resource also includes audio and forced alignments. (2024-11-06)
Subject	Arts and Humanities; Computer and Information Science; Social Sciences; Other
Keyword	corpus linguistics, dialectology, spoken language, speech transcripts, Australia, New Zealand
Notes	The untagged corpus is contained in the file coanzse_tokens_distributable_02072023.csv.gz. The PoS-tagged corpus with word timings is coanzse_textpos_distributable_02072023.csv.gz. The separator for both files is the pipe character "\|". The files have the columns 'country', 'state', 'council_name', 'channel_title', 'channel_url', 'video_title', 'video_id', 'upload_date', 'video_length', 'location','nr_words','text_pos' (or 'text', in the untagged version), and 'latlong'. Each row corresponds to an individual transcript. In order to comply with Fair Use provisions of US copyright law, the original ASR transcript files from YouTube have been transformed in this version of the corpus: Every 200 words, ten words have been replaced with "@". In the PoS-tagged and word-timed corpus, these tokens have the form @_XX_1.0. See also https://cc.oulu.fi/~scoats/CoANZSE.html
License/Data Use Agreement	Custom Dataset Terms

Filter by

	1 to 2 of 2 Files	Request Access
	coanzse_textpos_distributable_07092023.csv.gz Gzip Archive - 1023.7 MB Published Sep 7, 2023 44 Downloads MD5: 9f537ef824aadcff4e2637eb2c9108d5	Access File File Access Restricted Request Access Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX
	coanzse_tokens_distributable_02072023.csv.gz Gzip Archive - 303.2 MB Published Jul 5, 2023 34 Downloads MD5: 291f80b31bb1167f41d7843385a079a7	Access File File Access Restricted Request Access Download Metadata Data File Citation Download EndNote XML Download RIS Download BibTeX

Citation Metadata

Persistent Identifier	doi:10.7910/DVN/GW35AK
Publication Date	2022-08-30
Title	Corpus of Australian and New Zealand Spoken English
Author	University of Oulu0000-0002-7295-3893
Point of Contact	Use email button above to contact. Coats, Steven (University of Oulu)
Description	The Corpus of Australian and New Zealand Spoken English (CoANZSE) is a 196-million-word corpus of geolocated automatic speech recognition (ASR) YouTube transcripts from local government channels in Australia and New Zealand, created for the study of lexical, grammatical, and discourse-pragmatic phenomena of spoken language, as well as for content and language analysis in digital humanities and social science fields. Annotation includes individual word timings and video IDs of transcripts, making it easy to instantly view the video(s) for any given search. The corpus was created from 55,896 ASR transcripts from 472 YouTube channels, corresponding to almost 24,007 hours of video. The size of the corpus is 195,583,873 tokens. The channels sampled in the corpus are associated with local government entities such as local, city, county, district, and regional councils, and transcripts are from a range of video types. Recordings of public meetings are well-represented. Related resources are the Corpus of North American Spoken English and the Corpus of British Isles Spoken English. A searchable online version of this data is available at coanzse.org. The resource also includes audio and forced alignments. (2024-11-06)
Subject	Arts and Humanities; Computer and Information Science; Social Sciences; Other
Keyword	corpus linguistics dialectology spoken language speech transcripts Australia New Zealand
Notes	The untagged corpus is contained in the file coanzse_tokens_distributable_02072023.csv.gz. The PoS-tagged corpus with word timings is coanzse_textpos_distributable_02072023.csv.gz. The separator for both files is the pipe character "\|". The files have the columns 'country', 'state', 'council_name', 'channel_title', 'channel_url', 'video_title', 'video_id', 'upload_date', 'video_length', 'location','nr_words','text_pos' (or 'text', in the untagged version), and 'latlong'. Each row corresponds to an individual transcript. In order to comply with Fair Use provisions of US copyright law, the original ASR transcript files from YouTube have been transformed in this version of the corpus: Every 200 words, ten words have been replaced with "@". In the PoS-tagged and word-timed corpus, these tokens have the form @_XX_1.0. See also https://cc.oulu.fi/~scoats/CoANZSE.html
Language	English
Depositor	Coats, Steven
Deposit Date	2022-05-20
Time Period	Start Date: 2007-03-28; End Date: 2022-04-14
Date of Collection	Start Date: 2022-02-01; End Date: 2022-04-15
Related Dataset	Corpus of North American Spoken English; Corpus of British Isles Spoken English; Corpus of German Speech
Other Reference	https://coanzse.org

Dataset Terms

License/Data Use Agreement

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the dataset page.

Custom Dataset Terms - the following Custom Dataset Terms have been defined for this dataset.

I. Acceptance of this Agreement By downloading or otherwise accessing the Materials, the Downloader acknowledges and agrees to the terms of this Agreement. II. Modification of this Agreement This Agreement may be updated at any time. Any modifications shall apply only to future downloads and will not affect prior agreements in effect at the time of earlier downloads. III. Permitted Use The Materials are made available strictly for research, scholarship, and educational purposes. Use of the Materials is permitted under: The fair use doctrine of United States copyright law (17 U.S.C. § 107), Article 5 of the European Union Directive 2019/790 on copyright and related rights in the Digital Single Market, Fair dealing provisions in Australian law, including sections 40 and 41 of the Copyright Act 1968 (Cth), which permit use for research, study, criticism, review, and news reporting, and Fair dealing under New Zealand copyright law, as provided in sections 42–44 of the Copyright Act 1994 (NZ), covering use for research or private study, criticism, review, and news reporting. Permitted uses include but are not limited to: viewing, analyzing, comparing, and incorporating portions of the Materials into research outputs, educational projects, and scholarly publications, provided such use remains lawful and non-commercial. 1. Representations The Downloader represents that: (a) They are not bound by any laws or obligations prohibiting access or use of the Materials. (b) They will use the Materials only in ways permitted by applicable law. (c) They are not aware of restrictions beyond those described in this Agreement. (d) They accept that the content may include errors, omissions, or inaccuracies for which they are solely responsible in subsequent use. 2. Restrictions The Downloader agrees not to: (a) Attempt to re-identify individuals or entities from the Materials using any means, including linkage with other data. (b) Use the Materials to derive contact information for any subjects or individuals. (c) Violate any applicable data protection or privacy regulations. IV. Warranty Disclaimer The Materials are provided "as is" and "as available" without warranty of any kind. No guarantees are made regarding accuracy, completeness, security, or fitness for any particular purpose. Use of the Materials is at the Downloader’s own risk. V. Limitation of Liability The provider shall not be liable for any damages, including direct, indirect, incidental, or consequential damages arising from use of the Materials. VI. Indemnification The Downloader agrees to indemnify and hold harmless the provider from any claims, liabilities, or expenses resulting from unauthorized use or violation of this Agreement. VII. Governing Law and Dispute Resolution This Agreement shall be interpreted under applicable laws relevant to the institution or entity providing the Materials. Any disputes must be brought within one (1) year of the alleged cause and shall be resolved in a competent jurisdiction selected by the provider. VIII. Integration and Severability This Agreement constitutes the entire agreement regarding use of the Materials. If any part is found unenforceable, the rest remains in full effect. IX. Miscellaneous No agency or partnership is created by this Agreement. The provider may transfer or delegate its rights under this Agreement. The prevailing party in any enforcement action shall be entitled to recover reasonable legal costs.

Restrictions

The corpus is available for the non-commercial purposes of research, education, and scholarship. To be approved for download, users must request access using an email address from a domain associated with a university or research institution.

Restricted Files + Terms of Access

Restricted Files

There are 2 restricted files in this dataset.

Terms of Access for Restricted Files

The corpus is available for the purposes of research, education, and scholarship. Users may not redistribute the the corpus or use the corpus for commercial purposes. Users are individually responsible for compliance with these terms.

Request Access

Users may request access to files.

	Dataset Version	Summary	Contributors	Published on
No records found.

Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Access

Restricting limits access to published files. People who want to use the restricted files can request access by default. If you disable request access, you must add information about access to the Terms of Access field.

Learn about restricting files and dataset access in the User Guide.

Request Access

Enable access request

You must enable request access or add terms of access to restrict file access.

Terms of Access for Restricted Files

Save Changes

Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.

Edit Retention Period

The selected file or files have already been published. Contact an administrator to change the retention period date or reason of the file or files.

Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Select File(s)

Please select one or more files.

Share Dataset

Share this dataset on your favorite social media networks.

Continue

Dataset Citations

Citations for this dataset are retrieved from Crossref via DataCite using Make Data Count standards. For more information about dataset metrics, please refer to the User Guide.

Sorry, no citations were found.

Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired or the files can only be transferred via Globus.

You may request access to any restricted file(s) by clicking the Request Access button.

Ineligible Files Selected

The selected file(s) may not be transferred because you have not been granted access or the file(s) have a retention period that has expired or the files are not Globus accessible.

You may request access to any restricted file(s) by clicking the Request Access button.

Download Options

The files selected are too large to download as a ZIP.

You can select individual files that are below the 15.0 GB download limit from the files table, or use the Data Access API for programmatic access to the files.

Select File(s)

Please select a file or files to be downloaded.

Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired.

Click Continue to download the files you have access to download.

Ineligible Files Selected

Some file(s) cannot be transferred. (They are restricted, embargoed, with an expired retention period, or not Globus accessible.)

Click Continue to transfer the elligible files.

Delete Dataset

Are you sure you want to delete this dataset and all of its files? You cannot undelete this dataset.

Delete Draft Version

Are you sure you want to delete this draft version? Files will be reverted to the most recently published version. You cannot undelete this draft.

Unpublished Dataset Preview URL

Preview URL can only be used with unpublished versions of datasets.

Unpublished Dataset Preview URL

Are you sure you want to disable the Preview URL? If you have shared the Preview URL with others they will no longer be able to use it to access your unpublished dataset.

Delete Files

The file(s) will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Compute

This dataset contains restricted files you may not compute on because you have not been granted access.

Deaccession Dataset

Are you sure you want to deaccession? This is permanent and the selected version(s) will no longer be viewable by the public.

Deaccession Dataset

Are you sure you want to deaccession this dataset? This is permanent an it will no longer be viewable by the public.

Version Differences Details

Please select two versions to view the differences.

Version Differences Details

Version:
Last Updated:

Select File(s)

Please select a file or files for access request.

Select File(s)

Embargoed files cannot be accessed. Please select an unembargoed file or files for your access request.

Edit Tags

Select existing file tags or create new tags to describe your files. Each file can have more than one tag.

Request Access

You need to Sign Up or Log In to request access.

Dataset Terms

Please confirm and/or complete the information needed below in order to request access to files in this dataset.

This dataset is made available under the following terms. Please confirm and/or complete the information needed below in order to continue.

License/Data Use Agreement

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the dataset page.

Custom terms specific to this dataset Custom Dataset Terms - the following Custom Dataset Terms have been defined for this dataset.

Terms of Use I. Acceptance of this Agreement By downloading or otherwise accessing the Materials, the Downloader acknowledges and agrees to the terms of this Agreement. II. Modification of this Agreement This Agreement may be updated at any time. Any modifications shall apply only to future downloads and will not affect prior agreements in effect at the time of earlier downloads. III. Permitted Use The Materials are made available strictly for research, scholarship, and educational purposes. Use of the Materials is permitted under: The fair use doctrine of United States copyright law (17 U.S.C. § 107), Article 5 of the European Union Directive 2019/790 on copyright and related rights in the Digital Single Market, Fair dealing provisions in Australian law, including sections 40 and 41 of the Copyright Act 1968 (Cth), which permit use for research, study, criticism, review, and news reporting, and Fair dealing under New Zealand copyright law, as provided in sections 42–44 of the Copyright Act 1994 (NZ), covering use for research or private study, criticism, review, and news reporting. Permitted uses include but are not limited to: viewing, analyzing, comparing, and incorporating portions of the Materials into research outputs, educational projects, and scholarly publications, provided such use remains lawful and non-commercial. 1. Representations The Downloader represents that: (a) They are not bound by any laws or obligations prohibiting access or use of the Materials. (b) They will use the Materials only in ways permitted by applicable law. (c) They are not aware of restrictions beyond those described in this Agreement. (d) They accept that the content may include errors, omissions, or inaccuracies for which they are solely responsible in subsequent use. 2. Restrictions The Downloader agrees not to: (a) Attempt to re-identify individuals or entities from the Materials using any means, including linkage with other data. (b) Use the Materials to derive contact information for any subjects or individuals. (c) Violate any applicable data protection or privacy regulations. IV. Warranty Disclaimer The Materials are provided "as is" and "as available" without warranty of any kind. No guarantees are made regarding accuracy, completeness, security, or fitness for any particular purpose. Use of the Materials is at the Downloader’s own risk. V. Limitation of Liability The provider shall not be liable for any damages, including direct, indirect, incidental, or consequential damages arising from use of the Materials. VI. Indemnification The Downloader agrees to indemnify and hold harmless the provider from any claims, liabilities, or expenses resulting from unauthorized use or violation of this Agreement. VII. Governing Law and Dispute Resolution This Agreement shall be interpreted under applicable laws relevant to the institution or entity providing the Materials. Any disputes must be brought within one (1) year of the alleged cause and shall be resolved in a competent jurisdiction selected by the provider. VIII. Integration and Severability This Agreement constitutes the entire agreement regarding use of the Materials. If any part is found unenforceable, the rest remains in full effect. IX. Miscellaneous No agency or partnership is created by this Agreement. The provider may transfer or delegate its rights under this Agreement. The prevailing party in any enforcement action shall be entitled to recover reasonable legal costs.

Restrictions The corpus is available for the non-commercial purposes of research, education, and scholarship. To be approved for download, users must request access using an email address from a domain associated with a university or research institution.

Preview Guestbook

Upon downloading files the guestbook asks for the following information.

Guestbook Name

Collected Data

Account Information

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

Download URL

https://qa.dataverse.org/api/access/datafile/

Compute Batch

Clear Batch

Dataset	Persistent Identifier	Change Compute Batch

Compute Batch

Submit for Review

You will not be able to make changes to this dataset while it is in review.

Publish Dataset

Are you sure you want to republish this dataset?

By default datasets are published with the CC0-“Public Domain Dedication” waiver. Learn more about the CC0 waiver here.

To publish with custom Terms of Use, click the Cancel button and go to the Terms tab for this dataset.

Select if this is a minor or major version update.

Minor Release (6.2)

Major Release (7.0)

Publish Dataset

This dataset cannot be published until Harvard Dataverse is published by its administrator.

Return to Author

Return this dataset to contributor for modification. The reason for return entered below will be sent by email to the author.

Curation Status History

Status	Date	Assigner
No records found.

Add/Edit a Version Note

Styled Citation