Two truths: 1] Turns out the readers of Occam’s Razor are exceptionally gifted, they understand the challenges of web data 2] They are deeply motivated to do something about it, just not totally sure what. This is a special unplanned post just for you, to help with issue #2. My last post, Web Data Quality: A Six Step Process To Evolve Your Mental Model , unleashed an unusually exceptional set of comments from you all (sweet!). Today I want to share a cogent set of “next steps” ideas. Practical strategies to deal with the problems you highlighted, nuances you can…
-
-
It seems absolutely dumb to argue that while the quality of data used to make decisions is important, it is actually not that important to have the highest data quality. Generations of Analysts, Data “People”, Decision Makers have grown up with the principle of GIGO. Garbage in, garbage out. It made a lot of sense for a very long time. Especially because we used to collect so little data, its lack of even a little quality crapified the decision a lot. GIGO also fueled our every expanding quest for data perfection and data quality. There are entire companies built around…