Here is a non-exhausting list of curious problems that could greatly benefit from data analysis. If you think you can’t get a job as a data scientist (because you only apply to jobs at Facebook, LinkedIn, Twitter or Apple), here’s a way to find or create new jobs, broaden your horizons, and make Earth a better world not just for human beings, but for all living creatures. Even beyond Earth indeed. Help us grow this list of 33 problems, to 100+.
The actual number is higher than 33, as I’m adding new entries.
Figure 1: related to problem #33
33 unusual problems that can be solved with data science
- Automated translation, including translating one programming language into another one (for instance, SQL to Python – the converse is not possible)
- Spell checks, especially for people writing in multiple languages – lot’s of progress to be made here, including automatically recognizing the language when you type, and stop trying to correct the same word every single time (some browsers have tried to change Ning to Nong hundreds of times, and I have no idea why after 50 failures they continue to try – I call this machine unlearning)
- Detection of earth-like planets – focus on planetary systems with many planets to increase odds of finding inhabitable planets, rather than stars and planets matching our Sun and Earth
- Distinguishing between noise and signal on millions of NASA pictures or videos, to identify patterns
- Automated piloting (drones, cars without pilots)
- Customized, patient-specific medications and diets
- Predicting and legally manipulating elections
- Sport bets
- Predicting oil demand, oil reserves, oil price, impact of coal usage
- Predicting chances that a container in a port contains a nuclear bomb
- Assessing the probability that a convict is really the culprit, especially when a chain of events resulted in a crime or accident (think about a civil airplane shot down by a missile)
- Computing correct average time-to-crime statistics for an average gun (using censored models to compensate for the bias caused by new guns not having a criminal history attached to them)
- Predicting iceberg paths: this occasionally requires icebergs to be towed to avoid collisions
- Oil wells drilling optimization: how to digg as few test wells as possible to detect the entire area where oil can be found
- Predicting solar flares: timing, duration, intensity and localization
- Predicting Earthquakes
- Predicting very local weather (short-term) or global weather (long-term); reconstructing past weather (like 200 million years old)
- Predicting weather on Mars to identify best time and spots for a landing
- Predict riots based on tweets
- Designing metrics to predict student success, or employee attrition
- Predicting book sales, determining correct price, price elasticity and whether a specific book should be accepted or rejected by a publisher, based on projected ROI
- Predicting volcano risk, to evacuate populations or cancel flights, while minimizing expenses caused by these decisions
- Predicting 500-year floods, to build dams
- Actuarial science: predict your death, and health expenditures, to compute your premiums (based on which population segment you belong to)
- Predicting reproduction rate in animal populations
- Predicting food reserves each year (fish, meat, crops including crop failures caused by diseases or other problems). Same with electricity and water consumption, as well as rare metals or elements that are critical to build computers and other modern products.
- Predicting longevity of a product, or a customer
- Asteroid risks
- Predicting duration, extent and severity of draught or fires
- Predicting racial and religious mix in a population, detecting change point (e.g. when more people speak Spanish than English, in California) to adapt policies accordingly
- Attribution modeling to optimize advertising mix, branding efforts and organic traffic
- Predicting new flu viruses to design efficient vaccines each year
- Explaing hexagonal patterns in this Death Valley picture (see Figure 1)
- Road constructions, HOV lanes, and traffic lights designed to optimize highway traffic. Major bottlenecks are caused by 3-lanes highways suddenly narrowing down to 2-lanes on a short section and for no reasons, usually less than 100 yards long. No need for big data to understand and fix this, though if you don’t know basic physics (fluids theory) and your job is traffic planning / optimization / engineering, then big data – if used smartly – will help you find the cause, and compensate for your lack of good judgement. These bottlenecks should be your top proprity, and not expensive to fix.
- Google algorithm to predict duration of a road trip, doing much better than GPS systems not connected to the Internet. Potential improvement: when Google tells me that I will arrive in Portland at 5pm when I’m currently in Seattle at 2pm, it should incorporate forecasted traffic in Portland at 5pm: that is, congestion due to peak telecommuting time, rather than making computations based on Portland traffic at 2pm.
Other articles
- Data science apprenticeship
- Data science certification
- Previous digests
- Data science resources
- Competitions and Challenges
- Salary surveys
- Training
- Data science books
- How to detect spurious correlations, and how to find the real ones
- Data science job ads that do not attract candidates, versus those t…
- Data Science and Analytics Jobs
- Hadoop resources
- 17 short tutorials all data scientists should read (and practice)
- 10 types of data scientists
- 66 job interview questions for data scientists
- Our Wiley Book on Data Science
- Data Science Top Articles
- Our Data Science Weekly Newsletter
- Practical illustration of Map-Reduce (Hadoop-style), on real data
- What makes up data science?
- DSC webinar series
