Comments on: 10 Signs You Need Help With Big Data & Analytics Testing https://cigniti.com/blog/10-signs-you-need-help-with-big-data-analytics-testing-2/ Digital Assurance & Digital Engineering Insights | Cigniti Wed, 03 Oct 2018 10:44:03 +0000 hourly 1 https://wordpress.org/?v=5.9.5 By: Aaron Evans https://cigniti.com/blog/10-signs-you-need-help-with-big-data-analytics-testing-2/#comment-4548 Wed, 23 Sep 2015 20:21:00 +0000 http://www.gallop.net/blog/?p=718#comment-4548 Agree. Big data testing can be a challenge. Both the volume & variety of data, as well as the inconsistencies that come from unstructured data sets.

You need to be able to test both your inputs (GIGO) and outputs. I’ve seen lots of instances where analytics is garbage because the data is not sane as it is entered into the system (which can be alleviated with broad unit tests on ETL), but even more where it mishandled after processing (which requires more traditional QA).

]]>