Location
Irving, TX | United States
Job description
U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.
Data Engineer
Location: Irving TX.
Duration: 12 months
Summary The
Data Engineer will be responsible for designing, configuring, and implementing data validation tools which will validate the data transferred between 2 systems.
Client is currently onboarding their new digital platform (Spark) which is built on Kubernetes running in AZURE.
Job responsibilities
- Highly skilled and motivated Data Engineer
- As a Data Engineer, you will be responsible for validating the data between two systems, ensuring accuracy and consistency.
- Implement data quality checks and monitoring processes.
- Design and Develop data entity validation scripts using python.
- Validate and reconcile data between two systems, ensuring accuracy and consistency.
- Collaborate with cross-functional teams to identify and resolve data discrepancies and issues.
- Develop and implement data quality checks and monitoring processes to ensure data integrity.
- Design and maintain data pipelines and ETL processes to extract, transform, and load data from various sources.
- Optimize data storage and retrieval processes to improve performance and efficiency.
- Perform data analysis and profiling to identify data quality issues and recommend solutions.
- Develop and maintain documentation for data validation processes, data mappings, and data lineage.
- Stay up to date with industry trends and best practices in data engineering and data validation.
- Support migration of North American OPCOs, enabling data validation on the new platform.
- Gather business requirements from key client stakeholders and translate these into technical tracking specifications based on standards and industry best practice.
Required Skills
- Strong knowledge of IPAAS and data validation for migration of applications.
- Demonstrable experience in delivering end to end data validation.
- Confident understanding of web development and its languages and possess Python proficiency .
- Proactive and highly organized with strong time management and planning skills.
- Able to change direction and work on multiple projects across a wide range of topics.
- [Desired] Knowledge of Python/Google BigQuery architecture
Please share your resume with sharaq (AT) scadea (DOT) net
Nine Zero Nine- (636)- Two Seven Two Seven (EXTN: 2228)
Report this job
- Dice Id: 10430918
- Position Id: SSI_S_
Job tags
Salary
