• Skip to main content
  • Skip to secondary menu
  • Skip to primary sidebar
  • Skip to footer
  • Articles
  • News
  • Events
  • Advertize
  • Jobs
  • Courses
  • Contact
  • (0)
  • LoginRegister
    • Facebook
    • LinkedIn
    • RSS
      Articles
      News
      Events
      Job Posts
    • Twitter
Datafloq

Datafloq

Data and Technology Insights

  • Categories
    • Big Data
    • Blockchain
    • Cloud
    • Internet Of Things
    • Metaverse
    • Robotics
    • Cybersecurity
    • Startups
    • Strategy
    • Technical
  • Big Data
  • Blockchain
  • Cloud
  • Metaverse
  • Internet Of Things
  • Robotics
  • Cybersecurity
  • Startups
  • Strategy
  • Technical

20 Awesome Websites For Collecting Big Data

Kayla Matthews / 5 min read.
March 9, 2017
Datafloq AI Score
×

Datafloq AI Score: 54.33

Datafloq enables anyone to contribute articles, but we value high-quality content. This means that we do not accept SEO link building content, spammy articles, clickbait, articles written by bots and especially not misinformation. Therefore, we have developed an AI, built using multiple built open-source and proprietary tools to instantly define whether an article is written by a human or a bot and determine the level of bias, objectivity, whether it is fact-based or not, sentiment and overall quality.

Articles published on Datafloq need to have a minimum AI score of 60% and we provide this graph to give more detailed information on how we rate this article. Please note that this is a work in progress and if you have any suggestions, feel free to contact us.

floq.to/37y8w

Big data is a big deal. Thats why so many companies are working to deploy analytical systems that can track and collect the data they need if they havent already. With it, you can learn a lot about customer behaviors, habits and tendencies, your own products and services, and much more. It can also provide insights into the future, like how to tailor specific marketing campaigns or what new products you should launch.

From 2011 to 2013, more data had been created in those two years than in the entire history of the human race. And that was years ago. Its exploded even more since then. By the year 2020, there will be an estimated 44 trillion gigabytes.

As valuable as this information can be, not everyone has the capacity to collect and access or even analyze this much information. Whats the solution if you dont have access to a system that can facilitate the data for you? What if you dont have access to data banks or databases? Where can you go? Where can small businesses get the information they need?

Believe it or not, there are many websites on the internet you can use to reference and collect data. These online resources are readily available to anyone and include a plethora of information.

Where to Find the Data You Need

Depending on the type of data you need, there are different places you can go. To make this easier, we separated the resources by category.

General Data Sources

1. Carnegie Mellon Data and Story Library: The website may be dated and plain in terms of design, but theres a lot of information available here. The library includes a variety of datafiles and stories that help explain basic statistics methods and similar concepts.

2. Data.gov: This massive resource is the home of the United States governments open-source data collection. You can find research, tools and data on a huge list of topics, from agriculture to public safety.

3. UC Berkeley Data Lab: Offered as part of the Berkeley University of California library system, this treasure trove of information includes a huge selection of resources. You can find research and data on economics, politics, science, business, health and much more.

4. UCLA Statistics Data Sets: This data haven includes a variety of resources and information that UCLA employs during statistics labs and assignments.

5. TelephoneLists.biz: Comprehensive contact lists for consumers based on a variety of factors, such as demographics, family income, location and more.

6. Internet UPC Database: This is a massive database of UPC codes. Even though the UPC was effectively retired, it continues to be useful thanks to people uploading new data.

7. Amazon Public Data Sets: Access the massive blocks of data that Amazon uses to make informed decisions. The data is publicly available, and anyone can access it for free.

8. European Union Open Data Portal: All the European government-related data you could want.


Interested in what the future will bring? Download our 2023 Technology Trends eBook for free.

Consent

9. Programmable Web: A lot of sites and data providers make information available via APIs. Twitter, Google and Yahoo are great examples of this. Programmable Web is a detailed catalog where you can find these APIs.

10. New York Public Library e-Journals: Includes a huge, searchable database of educational journals hosted through the New York Public Library. Theres a lot of good information here if you take the time to look.

Geographic Data

11. USGS Earthquake Catalog: Everything you need to know about past or present earthquakes can be found in this online catalog. You can narrow down your search for an event by world region, data and even magnitude.

12. GeoCommons: A massive collection of geographic data stored in the GeoJSON format. The archive can be searched and browsed, and you can preview, download and even open the data in ArcGIS an online mapping tool.

13. OpenStreetMap: A Google Maps-type data and map service, created with help from an active community. It is crowdsourced, which means people like you or me are free to update and use data from the platform.

14. TIGER: TIGER stands for Topologically Integrated Geographic Encoding and Referencing and includes data from the United States Census Bureau. The data contains references roads, railroads, zip codes, rivers and more.

15. Flickr Shapefiles: Every picture uploaded to Flickr is geotagged with location data. It uses that to build shapes or boundaries, which provide a more accurate contour of a specific location.

News, World and Health Data Sources

16. The New York Times: The complete NYT archive can be searched and viewed online, which includes over 13 million articles. It dates all the way back to 1851 and includes information up until present day. You do need to have an active subscription to access the content, however.

17. Wall Street Journal: Like the NYT, the Wall Street Journal has an article archive for content its published over the years.

18. The Guardian: No matter how you feel about the publication, the Guardian offers a lot of freely available data you can export as Google spreadsheets. It could be an incredibly useful resource depending on what youre looking for.

19. World Health Organization: Anything you could ever want to know about global health or world news can be found right here, in the World Health Organizations database.

20. DataSF: The city of San Francisco launched a database full of information you can use to your advantage. Hopefully other cities will do the same.

Keep Looking If These Arent What You Need

We dont have the time or space to list every single data source or collection thats available If you dont see something you need on the list, dont be afraid to seek it out. Just because you dont have the systems and resources to collect this information yourself doesnt mean you cannot gain access to it.

There are so many places you can find information, from baseball stats all the way to political contributions. If you need it, theres a good chance its out there somewhere.

Categories: Big Data
Tags: Big Data, big data knowledge, data sets, data sources, public data

About Kayla Matthews

Kayla Matthews is a technology writer covering big data, IoT tech and connected technology issues. You can find her other work on ProductivityBytes.com, as well as on Information Age, KDnuggets, The Week and Digital Trends.

Primary Sidebar

E-mail Newsletter

Sign up to receive email updates daily and to hear what's going on with us!

Publish
AN Article
Submit
a press release
List
AN Event
Create
A Job Post

Related Articles

The Advantages of IT Staff Augmentation Over Traditional Hiring

May 4, 2023 By Mukesh Ram

The State of Digital Asset Management in 2023

May 3, 2023 By pimcoremkt

Test Data Management – Implementation Challenges and Tools Available

May 1, 2023 By yash.mehta262

Related Jobs

  • Software Engineer | South Yorkshire, GB - February 07, 2023
  • Software Engineer with C# .net Investment House | London, GB - February 07, 2023
  • Senior Java Developer | London, GB - February 07, 2023
  • Software Engineer – Growing Digital Media Company | London, GB - February 07, 2023
  • LBG Returners – Senior Data Analyst | Chester Moor, GB - February 07, 2023
More Jobs

Tags

AI Amazon analysis analytics app application Artificial Intelligence BI Big Data blockchain business China Cloud Companies company costs crypto customers Data development digital engineer environment experience future Google+ government information learning machine learning market mobile Musk news public research security share skills social social media software strategy technology twitter

Related Events

  • 6th Middle East Banking AI & Analytics Summit 2023 | Riyadh, Saudi Arabia - May 10, 2023
  • Data Science Salon NYC: AI & Machine Learning in Finance & Technology | The Theater Center - December 7, 2022
  • Big Data LDN 2023 | Olympia London - September 20, 2023
More events

Related Online Courses

  • Oracle Cloud Data Management Foundations Workshop
  • Data Science at Scale
  • Statistics with Python
More courses

Footer


Datafloq is the one-stop source for big data, blockchain and artificial intelligence. We offer information, insights and opportunities to drive innovation with emerging technologies.

  • Facebook
  • LinkedIn
  • RSS
  • Twitter

Recent

  • 5 Reasons Why Modern Data Integration Gives You a Competitive Advantage
  • 5 Most Common Database Structures for Small Businesses
  • 6 Ways to Reduce IT Costs Through Observability
  • How is Big Data Analytics Used in Business? These 5 Use Cases Share Valuable Insights
  • How Realistic Are Self-Driving Cars?

Search

Tags

AI Amazon analysis analytics app application Artificial Intelligence BI Big Data blockchain business China Cloud Companies company costs crypto customers Data development digital engineer environment experience future Google+ government information learning machine learning market mobile Musk news public research security share skills social social media software strategy technology twitter

Copyright © 2023 Datafloq
HTML Sitemap| Privacy| Terms| Cookies

  • Facebook
  • Twitter
  • LinkedIn
  • WhatsApp

In order to optimize the website and to continuously improve Datafloq, we use cookies. For more information click here.

settings

Dear visitor,
Thank you for visiting Datafloq. If you find our content interesting, please subscribe to our weekly newsletter:

Did you know that you can publish job posts for free on Datafloq? You can start immediately and find the best candidates for free! Click here to get started.

Not Now Subscribe

Thanks for visiting Datafloq
If you enjoyed our content on emerging technologies, why not subscribe to our weekly newsletter to receive the latest news straight into your mailbox?

Subscribe

No thanks

Privacy Overview

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Necessary Cookies

Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.

If you disable this cookie, we will not be able to save your preferences. This means that every time you visit this website you will need to enable or disable cookies again.

Marketing cookies

This website uses Google Analytics to collect anonymous information such as the number of visitors to the site, and the most popular pages.

Keeping this cookie enabled helps us to improve our website.

Please enable Strictly Necessary Cookies first so that we can save your preferences!