ETL / Spark Developer - MC Lean , VA (Hybrid) - Long Term - Lorven Technologies Inc.
Location
Mc Lean, VA | United States
Job description
Hi Professional ,
Hope You Doing Good .
Our client is looking ETL / Spark Developer for Long Term project in MC Lean , VA (Hybrid) below is the detailed requirements.
Job Title : ETL / Spark Developer
Location : MC Lean , VA (Hybrid)
Duration : Long Term
Job description:
- Bachelor's degree in Computer science or equivalent, with 10+ years of relevant hands-on working knowledge on the following.
- Your Expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub)
- Experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients
- Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions
- Implement ETL processes to extract, transform, and load data from various sources
- Ensure data quality, integrity, and consistency throughout the ETL pipeline
- Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts
- Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices
- Integrate data from different systems and sources to provide a unified view for analytical purposes
- Collaborate with data analysts to implement solutions that meet their data integration needs
- Design and implement streaming workflows using PySpark Streaming or other relevant technologies
- Develop batch processing workflows for large-scale data processing and analysis
- Ability to use strong industry knowledge to relate to customer needs and dissolve customer concerns and high level of focus and attention to detail.
- Strong work ethic with good time management with ability to work with diverse teams and lead meetings
Job tags
Salary