You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I think one of the base datasets did a join which created duplicates.
Since we materialized one of the base datasets for faster access, and this base dataset also has duplicates, its difficult to isolate the root cause. (not very difficult, but we will have to figure out culprit datasets from which we materialized this one, fix the join condition and snapshot (materialize) again)
As you said, its an easy fix. I think one very simple tweak is modify the base dataset to use the DISTINCT keyword in the query.
Activity
shrjain commentedon Aug 6, 2015
I think one of the base datasets did a join which created duplicates.
Since we materialized one of the base datasets for faster access, and this base dataset also has duplicates, its difficult to isolate the root cause. (not very difficult, but we will have to figure out culprit datasets from which we materialized this one, fix the join condition and snapshot (materialize) again)
As you said, its an easy fix. I think one very simple tweak is modify the base dataset to use the DISTINCT keyword in the query.