Tag: data science
-
Don't want to deal with a problem? Put it under a spotlight
Two weeks ago, I published a research paper Ethnic Divisions Within Unity: Insights into Intra-Group Segregation from Israel’s Ultra-Orthodox Society. It is my first paper in so many aspects First...
-
Dual axis with shared x-axis — a much better way
I recently came across a financial update with a plot that looks like the one below: a bar plot of revenue with a line plot of growth rate. The growth...
-
Modern tools make your skills obsolete. So what?
Read this if you are a data scientist (or another professional) worried about your career. So many people, including me, write about how fields such as copywriting, drawing, or data...
-
35 (and more) Ways Data Go Bad — Stats With Cats Blog
If you plan working data analysis or processing, read the excellent post in the “stats with cats blog” titled “35 Ways Data Go Bad” post. I did experience each and...
-
Online data science conference on May, 28
NDR is a family of machine learning/data science conferences. Their next conference will be held online on May, 28 and the agenda looks great. Now, I’m not super objective here,...
-
Why is forecasting s-curves hard?
Constance Crozier (@clcrozier on Twitter) shared an interesting simulation in which she tried to fit a sigmoid curve (s-curve) to predict a plateau in a time-series. The result was a...
-
Not a wasted time
Being a freelancer data scientist, I get to talk to people about proposals that don’t materialize into projects. These conversations take time, but strangely enough, I enjoy them very much,...
-
Career advice. A research pharmacist wants to become a data scientist.
Recently, I received an email from a pharmacist who considers becoming a data scientist. Since this is not a first (or last) similar email that I receive, I think others...
-
Staying employable and relevant as a data scientist
One common wisdom is that creative jobs are immune to becoming irrelevant. This is what Brian Solis, the author of “Lifescale” says on this matter On the positive side, historically,...
-
Cow shit, virtual patient, big data, and the future of the human species
Yesterday, a new episode was published in the Popcorn podcast, where the host, Lior Frenkel, interviewed me. Everyone who knows me knows how much I love talking about myself and...
-
Data science tools with a graphical user interface
A Quora user asked about data science tools with a graphical user interface. Here’s my answer. I should mention though that I don’t usually use GUI for data science. Not...
-
Bootstrapping the right way?
Many years ago, I terribly overfit a model which caused losses of a lot of shekels (a LOT). It’s not that I wasn’t aware of the potential overfitting. I was....
-
The third wave data scientist - a useful point of view
In 2019, it’s hard to find a data-related blogger who doesn’t write about the essence and the future of data science as a profession. Most of these posts (like this...
-
To specialize, or not to specialize, that is the data scientists' question
In my last post on data science career, I heavily promoted the idea that a data scientist needs to find his or her specialization. I back my opinion with my...
-
The data science umbrella or should you study data science as a career move (the 2019 edition)?
TL/DR: Studying data science is OK as long as you know that it’s only a starting point. Almost two years ago, I wrote a post titled “Don’t study data science...
-
Against A/B tests
Traditional A/B testsing rests on a fundamentally flawed premise. Most of the time, version A will be better for some subgroups, and version B will be better for others. Choosing...
-
Back to Mississippi: Black migration in the 21st century. By Charles Earl
I wonder how this analysis of remained unnoticed by the social media The recent election of Doug Jones […] got me thinking: What if the Black populations of Southern cities...
-
Evolution of a complex graph. Part 1. What do you want to say?
From time to time, people ask me for help with non-trivial data visualization tasks. A couple of weeks ago, a friend-of-a-friend-of-a-friend showed me a set of graphs with the following...
-
I will host a data visualization workshop at Israel’s biggest data science event
TL/DR What: Data Visualization from default to outstanding. Test cases of tough data visualization **Why: ** You would never settle for default settings of a machine learning algorithm. Instead, you...
-
Whoever owns the metric owns the results — don't trust benchmarks
Other factors being equal, what language would you choose for heavy numeric computations: Python or PHP? This is not a language war but a serious question. For me, the choice...
-
On algorithmic fairness & transparency
My teammate, Charles Earl has recently attended the Conference on Fairness, Accountability, andTransparency (FAT*). The conference site is full of very interesting material, including proceedings and video recording of lectures...
-
Five misconceptions about data science
One item on my todo list is to write a post about “three common misconceptions about data science. Today, I found this interesting post that lists misconceptions much better than...
-
Overfitting reading list
Overfitting is a situation in which a model accurately describes some data but not the phenomenon that generates that data. Overfitting was a huge problem in the good old times,...
-
Once again on becoming a data scientist
My stand on learning data science is known: I think that learning “data science” as a career move is a mistake. You may read this long rant of mine to...
-
Is Data Science a Science?
Is Data Science a Science? I think that there is no data scientist who doesn’t ask his- or herself this question once in a while. I recalled this question today...
-
What is the best way to collect feedback after a lecture or a presentation?
I consider teaching and presenting an integral part of my job as a data scientist. One way to become better at teaching is to collect feedback from the learners. I...
-
Data is the new
I stumbled upon a rant titled Data is not the new oil — Tech Insights You’ve heard it many times and so have I: “Data is the new oil” Well...
-
Don't take career advises from people who mistreat graphs this badly
Recently, I stumbled upon a report called “Understanding Today’s Chief Data Scientist” published by an HR company called Heidrick & Struggles. This document tries to draw a profile of the...
-
The Keys to Effective Data Science Projects — Operationalize
Recently, I’ve stumbled upon an interesting series of posts about effective management of data science projects. One of the posts in the series says: “Operationalization” – a term only a...
-
Buzzword shift
Many years ago, I tried to build something that today would have been called “Google Trends for Pubmed”. One thing that I’ve found during that process was how the emergence...
-
On alert fatigue
I developed an anomaly detection system for Automattic internal dashboard. When presenting this system (“When good enough is just good enough”), I used to tell that in our particular case,...
-
What's the most important thing about communicating uncertainty?
Sigrid Keydana, in her post Plus/minus what? Let’s talk about uncertainty (talk) — recurrent null, said What’s the most important thing about communicating uncertainty? You’re doing it Really? Here, for...
-
The fastest way to get first N items in each group of a Pandas DataFrame
In my work, the speed of code writing and reading is usually more important than the speed of its execution. Right now, I’m facing a challenge of optimizing the running...
-
On machine learning, job security, professional pride, and network trolling
If you are a data scientist, I am sure you wondered whether deep neural networks will replace you at your job one day. Every time I read about reports of...
-
Good information + bad visualization = BAD
I went through my Machine Learning tag feed. Suddenly, I stumbled upon a pie chart that looked so terrible, I was sure the post would be about bad practices in...
-
What are the best practices in planning & interpreting A/B tests?
Compiled by my teammate Yanir Serourssi, the following is a reading list an A/B tests that you should read even if you don’t plan to perform an A/B test anytime...
-
Data Science or Data Hype?
In his blog post Big Data Or Big Hype? , Rick Ciesla is asking a question whether the “Big Data” phenomenon is “a real thing” or just a hype? I...
-
Although it is easy to lie with statistics, it is easier to lie without
I really recommend reading this (longish) post by Tom Breur called “Data Dredging” (and following his blog. The post is dedicated to overfitting – the most scaring problem in machine...
-
Gartner: More than 40% of data science tasks will be automated by 2020. So what?
Recently, I gave a data science career advice, in which I suggested the perspective data scientists not to study data science as a career move. Two of my main arguments...
-
Why is it (almost) impossible to set deadlines for data science projects?
In many cases, attempts to set a deadline to a data science project result in a complete fiasco. Why is that? Why, in many software projects, managers can have a...
-
What is the best thing that can happen to your career?
Today, I’ve read a tweet by Sinan Aral (@sinanaral) from the MIT: https://twitter.com/sinanaral/status/917162872362463232 I’ve just realized that Ikigai is what happened to my career as a data scientist. There was...
-
Advice for aspiring data scientists and other FAQs — Yanir Seroussi
It seems that career in data science is the hottest topic many data scientists are asked about. To help an aspiring data scientist, I’m reposting here a FAQ by my...
-
What you need to know to start a career as a data scientist
It’s hard to overestimate how I adore StackOverflow. One of the recent blog posts on StackOverflow.blog is “What you need to know to start a career as a data scientist”...
-
Identifying and overcoming bias in machine learning
Data scientists build models using data. Real-life data captures real-life injustice and stereotypes. Are data scientists observers whose job is to describe the world, no matter how unjust it is?...
-
Fashion, data, science
Zalando is an e-commerce company that sells shoes, clothing and other fashion items. Zalando isn’t a small company. According to Wikipedia, it’s 2015 revenue was almost 3 billion Euro. As...