Data Science

Datasets are collections of raw data gathered during the research process, usually in the form of numerical data. Many organizations, such as government agencies, universities, or research institutions, make the data they have collected freely available on the web for other researchers to use.

Note: Data is the raw information from which statistics are created. Statistics give an interpretation of the data.

To identify relevant datasets for use in your research, you can:

• Search for articles in CityUHK LibraryFind using your topic keywords and include the terms dataset OR "data set" in the search. Alternatively, search in CityUHK LibraryFind using your topic keywords and filter the results by Datasets (under Resource Type).
• Search the website or publications of an organization or government department that collects the type of data that you need.
• Try searching through an extensive data archive. 

Government & Public Data

• DATA.GOV.HK (Hong Kong)
• National Bureau of Statistics (China)
• Data.gov (USA) 
• data.gov.uk (UK)
• European Data Portal
• UN Data
• World Bank Open Data

General Purpose & Popular Repositories

• Kaggle Datasets
  It hosts thousands of community-shared datasets on various topics and is the leading platform for data science competitions. 
• Google Dataset Search
  A search engine specifically for datasets.
• Data Commons (Google)
  This is an initiative from Google. It brings together the world's public data, making it simple to explore.
• Registry of Open Data on AWS
  Hosts massive public datasets (climate, genomics, etc.) on AWS.
• Microsoft Azure Open Datasets
  Hosts curated datasets (climate, demographics, etc.) within Azure services.

Academic & Research

• DataCite Commons
  DataCite provides persistent identifiers (DOIs) for research data and other research outputs, making them more discoverable.
• Dryad
  Dryad is an open data publishing platform and a community committed to the open availability and routine re-use of all research data.
• Figshare 
  Research outputs including datasets, figures, and code.
• Harvard Dataverse 
  Research datasets across disciplines.
• Mendeley Data
  Search millions of datasets from domain-specific and cross-domain repositories.
• OpenML
  It is an open platform for sharing datasets, code, and experiments for machine learning research.
• re3data.org  
  A global registry of research data repositories across disciplines.
• Zenodo
  An open repository for EU-funded research outputs. Hosts datasets, software, and reports.

Domain-Specific Sources

Economics & Finance

• Federal Reserve Economic Data (FRED) (USA)
• IMF Data
• WRDS (Wharton Research Data Services)
  A library-subscribed database for business intelligence and data analytics.

Health & Biology

• NIH / NCBI
• PhysioNet
• WHO Data

Geography & Climate

• NOAA Climate Data
• NASA EarthData
• OpenStreetMap

Social Sciences

• ICPSR
• Pew Research Data
  Public surveys on social issues, demographics, and trends.
• Links to Data Sets and Repositories (American Psychological Association)

Text & Natural Language Processing (NLP), & Machine Learning

• Hugging Face Datasets
• Common Crawl
• Scikit-learn datasets
• TensorFlow Datasets
• The Pile
• UCI Machine Learning Repository

APIs & Live Data

• GitHub (search “dataset”)
• GitHub Awesome Public Datasets
• GitHub Public APIs 

Not sure how to cite the data and statistics you have used in your research? Take a look at the following guides:

Other Useful Library Guides