Job Details

Title: Data Migration Developer(Netezza to Snowflake)
Location: Remote
Duration: 6 Months of Contract

Must-Have Skills:
Strong hands-on experience with Python or Jython scripting for data extraction and synchronization
Proficiency with Stream Sets for orchestration, scheduling, and automation of data pipelines
Advanced knowledge of Snowflake, including development of stored procedures, custom logic, and incremental load strategies
Experience with Netezza data structures and ability to map, transform, and migrate to Snowflake
Experience performing data profiling, cleansing, and validation to ensure accuracy and integrity
Proven ability to monitor production data loads and maintain performance during migration activities
Strong troubleshooting and problem-solving skills to resolve migration issues effectively
Familiarity with data quality frameworks and post-migration validation processes

Detailed Job Description:
This role supports the Enterprise Data Warehouse (EDW) Migration Program from Netezza to Snowflake. The Senior Developer will be responsible for designing and building data synchronization scripts to manage both historical and incremental data migration from Netezza to Snowflake. A framework for this data synchronization exists already but the candidate will be responsible to move the data and resolve issues in doing so. The ideal candidate will have strong experience in Python/Jython scripting, Stream Sets orchestration, and Snowflake stored procedures.

Key Responsibilities:
Analyze legacy Netezza data structures and develop mapping strategies to Snowflake.
Create, test, and deploy Python/Jython scripts for extracting and syncing data from Netezza to Snowflake.
Develop, test, orchestrate, and schedule Stream Sets jobs to execute data sync scripts.
Conduct data profiling, cleansing, and quality checks to ensure data integrity and completeness.
Create and maintain custom Snowflake stored procedures for data extraction using custom logic, including checksum calculations for incremental loads.
Create, modify, maintain, and deploy Stream Sets manifests for data sync activities.
Monitor Netezza production loads to ensure no disruption during data extraction.
Provide proactive suggestions and assistance in identifying and resolving potential issues.
Update and manage scheduling timelines for Stream Sets jobs.
Ensure optimal balancing of data pulls from Netezza to avoid performance impacts.
Execute post-migration data validation to confirm successful and accurate data transfer.