---

---

Location

McLean, VA | United States

---

Job description

Job Role : ETL/Spark Developer

Location: Mclean VA

• Your expertise in Python PySpark ETL processes CI/CD (Jenkins or GitHub) and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients
• Collaborate with crossfunctional teams to understand data requirements and design robust data architecture solutions
• Implement ETL processes to extract transform and load data from various sources
• Ensure data quality integrity and consistency throughout the ETL pipeline
• Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts
• Optimize code for performance and scalability keeping uptodate with the latest industry best practices
• Integrate data from different systems and sources to provide a unified view for analytical purposes
• Collaborate with data analysts to implement solutions that meet their data integration needs
• Design and implement streaming workflows using PySpark Streaming or other relevant technologies
• Develop batch processing workflows for largescale data processing and analysis

Java Tech Lead

Mclean VA

10 years of experience in solution design and development of applications using Java 8/J2EE Spring SpringBoot Micro Services RESTful Services and with experience in Big Data and with experience working in heavy data background needed

Must have strong experience in Big Data and with experience working in heavy data background needed

Must be strong in Cloud AWS eventbased architecture Kubernetes ELK (Elasticsearch Logstash & Kibana)

Must have excellent experience in designing and Implementing cloudbased solutions in various AWS Services (: s3 Lambda Step Function AMQ SNS SQS CloudWatch Events etc.)

Must be well experienced in design and development of Microservice using SpringBoot and REST API and with GraphQL

Must have solid knowledge and experience in NoSQL (MongoDB)

Good knowledge and experience in any Queue based implementations

Strong knowledge/experience in ORM Framework JPA / Hibernate

Good knowledge in technical concepts Security Transaction Monitoring Performance

Should we well versed with TDD/ATDD

Should have experience on Java Python and Spark

2 years of experience in designing and Implementing cloudbased solutions in various AWS Services

Strong experience in DevOps tool chain (Jenkins Artifactory Ansible/Chef/Puppet/Spinnaker Maven/Gradle Atlassian Tool suite)

Very Good knowledge and experience in NonFunctional (Technical) Requirements like Security Transaction Performance etc.

Nice to have:

Experience in any one of the UI Framework Angular / ReactJS

Experience in Experience with OAuth implementation using Ping Identity

Experience in API Management (Apigee) or Service Mesh (Istio)

Good knowledge and experience in Queue/Topic (ActiveMQ) based implementations

Good knowledge and experience in Scheduler and Batch Jobs

Experience with scripting languages using Unix

Preferably certified in AWS

New Data Engineer

We are looking for a strong Data Engineer with skills as listed below:

Must have: Java AWS Data Processing experience SQL

Good to have:

---

Job tags

---

---

Salary