Census-block-level-TSGI

Version 3.0
Fu, Xiaokang; Jain, Devika; Hayes, Jack, 2023, "Census-block-level-TSGI", https://doi.org/10.7910/DVN/IAYJOC, Harvard Dataverse, V3
Learn about Data Citation Standards.
Dataset Metrics
0 Downloads
Description

Harvard CGA Geotweet Census Archive is a subset of Harvard CGA Geotweet Archive v2.0 enriched with nationwide census data. It contains the tweet and user identification records along with census variables and sentiment scores for more than 2 billion geo-tagged tweets from January 2012 to July 2023. The sentiment scores are derived from the BERT sentiment scores from the Harvard CGA Geotweet Sentiment Archive. This dataset is available to the academic community at large, unlike the Harvard CGA Geotweet Archive v2.0 which is under Twitter's redistribution policy restriction for public sharing. It could serve as cross-validation data for publications that used data from Harvard CGA Geotweet Archive v2.0 .

If you are interested in accessing this archive, please fill out our Geotweet Request Form. Before requesting or receiving Tweet IDs, requestors must agree to Twitter's Terms of Service, Twitter's Privacy Policy, and Twitter's Developer Policy . Geotweets IDs data provided by CGA can only be used for not-for-profit research and academic purposes. Recipients may not share CGA provided Tweet IDs or content derived from them without written permission from the CGA.

Citations:

If you use the Geotweet Archive in your research please reference it: "Harvard CGA Geotweet IDs Archive".

========================================================

Schema of Geotweet Census Archive

Field name____TYPE____Description

day----TEXT----The date of the tweet (YYYY-MM-DD)

GEOID20----TEXT----Census block geoid

tweet_count----INTEGER----Number of tweets in the census block

user_count----INTEGER----Number of unique users in the census block

avg_score----FLOAT----The average tweet sentiment score in the census block

max_score----FLOAT----The maximum tweet sentiment score in the census block

min_score----FLOAT----The minimum tweet sentiment score in the census block

std_score----FLOAT----The standard deviation of tweet sentiment scores in the census block

score_10q----FLOAT----The 10th quantile tweet sentiment score in the census block

score_25q----FLOAT----The 25th quantile tweet sentiment score in the census block

score_50q----FLOAT----The 50th quantile (median) tweet sentiment score in the census block

score_75q----FLOAT----The 75th quantile tweet sentiment score in the census block

score_90q----FLOAT----The 90th quantile tweet sentiment score in the census block

Subject Arts and Humanities; Earth and Environmental Sciences; Social Sciences
Keyword Geospatial, Big Data, Open Source, Social Media, Twitter
License/Data Use Agreement

Custom Dataset Terms

Filter by
1 to 10 of 21 Files
 Request Access
statistics-2012_day_GEOID20__no_topic.parquet
Unknown - 155.7 MB
Published Feb 3, 2025
0 Downloads
MD5: 6fd9c5692c074bbe7b1b37184ac60cae
2012 daily tweet data enriched with TSGI and census-level geometry
statistics-2013_day_GEOID20__no_topic_0.parquet
Unknown - 2.0 GB
Published Feb 3, 2025
0 Downloads
MD5: 27da609a1983e2a2a8619d0d4025b61b
2013 daily tweet data enriched with TSGI and census-level geometry. file 1/4 since 2013 was so large
statistics-2013_day_GEOID20__no_topic_1.parquet
Unknown - 2.0 GB
Published Feb 3, 2025
0 Downloads
MD5: f27f1057cae95b668d2ad2cadcf0d344
2013 daily tweet data enriched with TSGI and census-level geometry. file 2/4 since 2013 was so large
statistics-2013_day_GEOID20__no_topic_2.parquet
Unknown - 2.0 GB
Published Feb 3, 2025
0 Downloads
MD5: 926a13d91bf4453e6e7a3c380956f621
2013 daily tweet data enriched with TSGI and census-level geometry. file 3/4 since 2013 was so large
statistics-2013_day_GEOID20__no_topic_3.parquet
Unknown - 2.0 GB
Published Feb 3, 2025
0 Downloads
MD5: 8b03adffb7657d927e2268959cb9470b
2013 daily tweet data enriched with TSGI and census-level geometry. file 4/4 since 2013 was so large
statistics-2014_day_GEOID20__no_topic_0.parquet
Unknown - 1.7 GB
Published Feb 3, 2025
0 Downloads
MD5: 645e52885a21dc7583dc10ff2f9ed5c3
2014 daily tweet data enriched with TSGI and census-level geometry. file 1/4 since 2014 was so large
statistics-2014_day_GEOID20__no_topic_1.parquet
Unknown - 1.7 GB
Published Feb 3, 2025
0 Downloads
MD5: 0c5ef5411b5d03eb73050b35e3feb389
2014 daily tweet data enriched with TSGI and census-level geometry. file 2/4 since 2014 was so large
statistics-2014_day_GEOID20__no_topic_2.parquet
Unknown - 1.7 GB
Published Feb 3, 2025
0 Downloads
MD5: e92f4502de9f9f472506654bdcbf30ea
2014 daily tweet data enriched with TSGI and census-level geometry. file 3/4 since 2014 was so large
statistics-2014_day_GEOID20__no_topic_3.parquet
Unknown - 1.7 GB
Published Feb 3, 2025
0 Downloads
MD5: 96f6caf5954cebb1d301af34a37c8234
2014 daily tweet data enriched with TSGI and census-level geometry. file 4/4 since 2014 was so large
statistics-2015_day_GEOID20__no_topic_0.parquet
Unknown - 1.4 GB
Published Feb 3, 2025
0 Downloads
MD5: 20da6fa7fcfeea696b3a413696301370
2015 daily tweet data enriched with TSGI and census-level geometry. file 1/4 since 2015 was so large
Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Access

Restricting limits access to published files. People who want to use the restricted files can request access by default. If you disable request access, you must add information about access to the Terms of Access field.

Learn about restricting files and dataset access in the User Guide.

Enable access request
You must enable request access or add terms of access to restrict file access.
Save Changes
Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.
Edit Retention Period

The selected file or files have already been published. Contact an administrator to change the retention period date or reason of the file or files.
Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Select File(s)

Please select one or more files.

Share Dataset

Share this dataset on your favorite social media networks.

Continue
Dataset Citations

Citations for this dataset are retrieved from Crossref via DataCite using Make Data Count standards. For more information about dataset metrics, please refer to the User Guide.

Sorry, no citations were found.
Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired or the files can only be transferred via Globus.

You may request access to any restricted file(s) by clicking the Request Access button.

Ineligible Files Selected

The selected file(s) may not be transferred because you have not been granted access or the file(s) have a retention period that has expired or the files are not Globus accessible.

You may request access to any restricted file(s) by clicking the Request Access button.

Download Options

The files selected are too large to download as a ZIP.

You can select individual files that are below the 15.0 GB download limit from the files table, or use the Data Access API for programmatic access to the files.

Select File(s)

Please select a file or files to be downloaded.

Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired.

Click Continue to download the files you have access to download.

Ineligible Files Selected

Some file(s) cannot be transferred. (They are restricted, embargoed, with an expired retention period, or not Globus accessible.)

Click Continue to transfer the elligible files.

Delete Dataset

Are you sure you want to delete this dataset and all of its files? You cannot undelete this dataset.

Delete Draft Version

Are you sure you want to delete this draft version? Files will be reverted to the most recently published version. You cannot undelete this draft.

Unpublished Dataset Preview URL

Preview URL can only be used with unpublished versions of datasets.

Unpublished Dataset Preview URL

Are you sure you want to disable the Preview URL? If you have shared the Preview URL with others they will no longer be able to use it to access your unpublished dataset.

Delete Files

The file(s) will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Compute

This dataset contains restricted files you may not compute on because you have not been granted access.

Deaccession Dataset

Are you sure you want to deaccession? This is permanent and the selected version(s) will no longer be viewable by the public.

Deaccession Dataset

Are you sure you want to deaccession this dataset? This is permanent an it will no longer be viewable by the public.

Version Differences Details

Please select two versions to view the differences.

Version Differences Details
 
Version:
Last Updated:
Version:
Last Updated:
Select File(s)

Please select a file or files for access request.

Select File(s)

Embargoed files cannot be accessed. Please select an unembargoed file or files for your access request.

Edit Tags

Select existing file tags or create new tags to describe your files. Each file can have more than one tag.

Request Access

  You need to Sign Up or Log In to request access.

Dataset Terms

Please confirm and/or complete the information needed below in order to request access to files in this dataset.

This dataset is made available under the following terms. Please confirm and/or complete the information needed below in order to continue.

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the dataset page.

Custom Dataset Terms - the following Custom Dataset Terms have been defined for this dataset.

Before requesting or receiving Tweet IDs, requestors must agree to Twitter's Terms of Service, Twitter's Privacy Policy, and Developer Policy. Geotweets IDs data provided by CGA may only be used for not-for-profit research and academic purposes. Recipients may not share CGA provided Tweet IDs or content derived from them without written permission from the CGA.

If you use the Geotweet Archive in your research please reference it: "Harvard Center for Geographic Analysis Geotweet IDs Archive".

Preview Guestbook

Upon downloading files the guestbook asks for the following information.

Account Information

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

https://qa.dataverse.org/api/access/datafile/

Compute Batch
Clear Batch
Dataset Persistent Identifier Change Compute Batch
Compute Batch
Submit for Review

You will not be able to make changes to this dataset while it is in review.

Publish Dataset

Are you sure you want to republish this dataset?

By default datasets are published with the CC0-“Public Domain Dedication” waiver. Learn more about the CC0 waiver here.

To publish with custom Terms of Use, click the Cancel button and go to the Terms tab for this dataset.

Select if this is a minor or major version update.

Publish Dataset

This dataset cannot be published until Harvard Dataverse is published by its administrator.

Return to Author

Return this dataset to contributor for modification. The reason for return entered below will be sent by email to the author.

Curation Status History
StatusDateAssigner
No records found.
Add/Edit a Version Note
Styled Citation