Location
Philadelphia, PA | United States
Job description
Title: Data Architect
Location: Philadelphia, PA (On-site)
Duration: 6+ months
Implementation Partner: Infosys
End Client: To be disclosed
JD:
- Bachelor's Degree in Engineering (Computer Science or IT or equivalent technical discipline) with 10+ years of equivalent work experience
Develop new or enhance big data applications, data pipelines, and reports/dashboards. - Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.
- Reformulating existing frameworks to optimize their functioning.
- Testing such structures to ensure that they are fit for use.
- Preparing raw data from streaming high volume for manipulation by data scientists.
- Detecting and correcting errors in your work.
Preferred Skills:
- Must have core skill sets or experience in deploying big data applications in a Cloud native environment, preferably leveraging Spark, Airflow, Database management and SQL.
- Familiarity with SQL, Kafka, Hadoop, ELK, Jupyter notebook, DevOps methodologies is advantageous.
- Unix/Linux basics & Shell Scripting
- Good knowledge of git
Knowledge, Skills and Abilities:
- Experience using DevOps toolchain and container orchestrations such as Kubernetes and Docker.
- Experience with cloud platforms including Openstack (preferred) and AWS
- Experience in building and operating scalable infrastructure stacks
- Experience in Linux systems administration.
- Experience with deploying applications built on Python and leveraging Jupyter notebook or Spark on Kubernetes platform.
- Understanding of scaling Spark and Airflow on Kubernetes is nice to have.
- The ability to prioritize tasks and multitask as needed.
- Ability to communicate professionally and collegially with technical and management colleagues and team members.
Job tags
Salary
