Duplicate Remover
Cleaned and error free data; this is the common phrase that we normally listen from most of the data warehouse users. So to make this statement true, SQL Lion team has come up with a tool named “Duplicate Remover“.
This tool will search for the presence of duplicate records (redundancy in tables at record level) as per the selected databases and tables from SQL Server instance, and list them. After checking the redundant tables, the user can customize the delete operations to limit the deletion to certain tables.
Screenshots:
This tool comes in two versions, for SQL Server 2005 and SQL Server 2008. Both the versions are given below. Download it for free.
For SQL Server 2008:
Minimum Configuration -
- .Net Framework 3.5 Service pack 1
- SQL Server 2008
For SQL Server 2005:
Minimum Configuration -
- .Net Framework 2.0
- SQL Server 2005
To see details about the mechanism of deleting redundant rows from a table safely, visit the link “Delete Duplicate Records “below.
http://www.sqllion.com/2009/05/delete-duplicate-records/
Feel free to share your comments to develop this product.
Is it possible to have the same logic in a SSIS package that will go thru all the staging tables in a database and delete duplicates .. I really need help on this or a store procedures.
Thanks
Yup, its possible.
U can iterate through a foreach loop container for each table in your staging database and delete the duplicates there. Its easy, have fun.
Follow this link for some hints in the code:
http://www.sqllion.com/2009/05/delete-duplicate-records/
Bug fixed for “Duplicate Remover”, now it can connect to any SQL SERVER across the network provided the names are given perfectly, especially, if you are connecting to any remote SQL Server and there are more than one instance of SQL Server running on the Remote System, then give the port no along with the Server Name.