---

---

Location

Alpharetta, GA | United States

---

Job description

Title: QC Data Testing Engineer (Big Data)

Location: Alpharetta GA (north of Atlanta GA) onsite From day 1

Mandatory:

• 3-7+ years of QA/QC Data Testing of Big Data
• Large Data Warehouse environments in the GB, Terabit, or PB levels
• Large pipeline scripting/testing in daily volume in the 5-20GB range
• Strong SQL & Python programming for mid to complex queries and data manipulation
• SQL and Python; Java, and Korn Shell are also good
• Unix/Linux commands and some SSIS (ideal)
• ETL (ingestion, normalize, transform), data cleaning, formatting, manipulation, testing
• Familiar with Data JSON format, working with simple data models
• Understands TDD (test-driven development), code coverage, Scrum/Agile methods, Git/GitLab/GitHub, Jira
• Embraces testing and process standards - Execute test cases via manual & automated scripts and tools
• Understands business logic
• Self-starter, committed, reliable, has integrity, desire to learn new processes and technologies
• Analytical, smart, excellent problem-solving skills, ability to follow through logic and instructions
• Clear oral & written communications skills
• Degree in BS Engineering/Computer Science or equivalent experience

Optional:

• SSIS, Hadoop, Informatica, Scala, Spark, PySpark
• PowerBI, Tableau
• MapReduce, Hive, HBase, NoSQL, Parquet, GLUE, Athena (queries), Kafka, Data Bricks, Snowflake, Tableau, Yarn, API, Java, C/C++, HTML, XML, Windows, UNIX

Job Duties:

• Analyze large data within HPCC (high performance cluster computing) environment
• Write scripts for day to day analysis and manipulation activities
• Perform moderate/complex QC testing of large datasets (manual/automated) within HPCC
• Perform research, design, software development assignments. Develop scripts/ programs to make "Big Data" management easier.
• Role includes extracting, loading, cleansing, translating, manipulating, analyzing, linking and indexing massive amounts of data utilizing cutting edge technology and techniques.
• Utilize ECL language (Enterprise Control Language) and others. ECL training provided
• Run/manage test execution & results validation; May modify manual or automated testing scripts
• Review portions of detailed specs for development of system components of moderate complexity
• Full testing of new development code and bug fixes, Resolve technical issues as necessary
• Work closely with programming/development team members & Business to understand product requirements, translate them testing procedures
• Operate in various development environments (Agile, Waterfall, etc.)
• Keep abreast of new technology developments
• Make suggestions for code design, changes, be accountable for your testing procedures
• Collaborate w/ Data Engineers, Dev, other QA, Business to understand product requirements & translate into successful data testing to help ensure high quality output
• Keep abreast of new Big Data and Testing technology developments

Kind Regards,

Kartik Bhardwaj | Absolute IT | Recruitment Manager

116 Village Blvd Suite 200 Princeton New Jersey 08540

Report this job

• Dice Id: 91102145
• Position Id: 2024-25115

---

Job tags

---

---

Salary