This question was marked as "assumed answered." Is that correct? If you still need help let us know? Otherwise please share the solution!
Sorry for the late respond. Yes this is answered. The issue is with my SQL customer query which does not remove the duplicates completely. I modify using " RANK() OVER (PARTITION BY A ORDER BY B DESC)" to de-dupe and problem is solved.