Location
Cupertino, CA | United States
Job description
Title: Data Engineer
Duration: 03+ months contract with quarterly extension
Location: Cupertino, CA
Qualifications:
- Bachelor s or master s degree in computer science, Engineering, Information Systems or relevant degree is required
- 5+ years of professional work experience designing and implementing data pipelines in on-prem and cloud environments (S3, EKS)
- Experience with SQL/Relational databases.
- Experience with manipulating structured and unstructured data.
- Experience with distributed data systems such as Hadoop and related technologies (Spark, Trino, etc.).
- Background in both programming languages (Python & Scala).
- Experience working with databases that power APIs for front-end applications.
- Experience with modern schedulers (Airflow).
Responsibilities:
- Support, Design, develop, test, deploy, maintain, and improve the data pipeline.
- Designing and developing data processing techniques: automating manual processes, data delivery, data validation, data quality, and integrity.
- Support, test, deploy, and maintain the AWS ecosystem from an infrastructure standpoint (Hybrid Cloud SDK upgrade, security fixes, etc.)
- Communicate effectively with customers/team members & help with site-up challenges.
Must have skills:
- Python
- SOL
- Spark
- Scala
- AWS ecosystem (S3, EKS)
- Airflow
- Kafka
- Catalog store (hive or similar)
Nice to have skills:
Report this job
- Dice Id: 10110940
- Position Id: 8212389
Job tags
Salary
