Location
Columbus, OH | United States
Job description
Role: Data Engineer
Location: Columbus OH (Onsite)
Duration: Long Term
Contract Role
Job Description:
- Data transformation using strem sets Spark knowledge
- Designing and implementing data ingestion pipelines from multiple sources using Azure Data bricks
- Developing scalable and reusable frameworks for ingestion datasets
- Linux commands and Shell/Pearl Scripting.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition operational efficiency and other key business performance metrics.
- Working experience in ETL testing including Master Data Management Data Completeness Data Cataloging Data Leverage and Data Quality for various data feeds coming from the source
- Should have experience working on complex data architecture
- Oncall support
- Experience working in Agile/ Scrum methodology.
- IBM Sterling B2B Integrator and IBM Sterling File Gateway.
- Strong communication and documentation skills
Competencies: Digital:
Databricks Digital : Pyspark
Experience (Years):
68
Essential Skills:
- Hands on development experience in Spark Scripting (R Scala) and DHF tools
- Should have Good Communication skills and be a Good Team player
Desirable Skills:
- Expertise in designing and deploying data applications on cloud solutions such as Azure or AWS.
Job tags
Salary
