Fuzzy lookup can be used in place where we have a large.

However, SSIS Fuzzy Grouping Transformation does not require any reference table to correct the data. Fuzzy lookup transformation uses an equi join to do a check for the matching records across the tables. Lookup Task matches the dataset with customer table Adventureworksdw2012 on firstname,lastname ,birth date and identifies 3 duplicates and sends the remaining 6 records to fuzzy lookup which does a fuzzy lookupДЇuzzy lookup than matches the new dataset with the customer table of Adventureworksdw2012 using first name,last name and address and assigns a score ,we than use a conditional split to filter records with score greater than. This SSIS transformation is the same as the Fuzzy Lookup Transformation. The fuzzy part of the transformation name refers to data coupling based on selected data mapping using defined similarity and confidence measurements. The sort is the second de duplicate task which is used to remove duplicate email addresses from the new dataset and removes 1 duplicate email and passes to the next sortДЇor identifieng any duplicate records based on firstname ,lastname and birth date ,it doesnt find any duplicates and passes the records to fuzzygrouping taskДЇuzzy Grouping task than gives a similarity score on the existing dataset and we use a conditional split to filter ,the conditional split filters one record for a similairty score less than 1 as duplicate and passes the remaining records to lookup The two fuzzy transformations within SSIS, Fuzzy Lookup and Fuzzy Grouping, deal with associating data through data similarity, rather than exact data matching. LetвЂ™s open up the fuzzy grouping task and see whatвЂ™s inside. I open up the data flow task we just added, added a SQL server source, and linked it to a fuzzy grouping task. The package as shown in the image above starts the data flow with a total of 39 newly extracted records from a sample dataset,which are passed into the first de duplicate task Lookup, which than compares the newly extracted records with the existing reference dataset( in my case i'm using customer table from Adentureworksdw2012 )based on email address column ,the lookup than identifies the 28 duplicate records and passes the non matching 11 records to the sort The fuzzy logic tasks only appear under the context of a data flow. SSIS Lookup Transform tasks retrieve only exact matches (Lookup Match) or non matches (Lookup No Match).

Fuzzy lookup ssis