SSIS-based ETL process that migrates data from a CSV file to a production SQL Server table
- Extract: created a comma separated value (.csv) file with data from a portable document (.pdf) file
- Transform: changed data types on a staging Table, as per the destination Table, and cleaned data (deleted duplicate vaues, and discarded values that did not meet quality standards)
- Load: loaded data from a staging Table into a prod Table
- Install SQL Server Management Studio
- Install Visual Studio 2022
- Locate flat file and convert to Comma Separated Value (.csv) format
- Create Database, schema(s), and table(s)
- Create, test, and run SSIS packages in Visual Studio 2022
- Implement: Data FLow Task
- Configure: OLE DB Source, OLE DB Destination, Sort, and Derived Column
- Researched error codes and adjusted SQL queries, step by step
- Ran queries focusing on indivisual tasks (e.g.: adjusted SQL expressions during transformation)
- Hardware limitations prevented me to run the latest version of SSMS
- Time constrains due to prior commitments
- Created a SSIS package to extract, transform, and load data into a production table
- Enhanced my knowledge of SQL, Visual Studio 2022, and SQL Server Management Studio
- Inserted 29 new records
- Ignored 4 duplicate rows
- Transformed values