Cis Tec
Location
Texas | United States
Job description
ETL Manager
Katy TX Onsite
Responsibilities:
1. Data Extraction: Extract data from various sources such as databases, files, APIs, and web services using ETL tools or programming languages.
2. Data Transformation: Cleanse, validate, and transform the extracted data to ensure its accuracy, consistency, and integrity. This may involve data mapping, data conversion, data aggregation, and data enrichment.
3. Data Loading: Load the transformed data into the target systems such as data warehouses, data marts, or operational databases. This includes defining data structures, creating tables, and optimizing data loading processes.
4. ETL Process Development: Design, develop, and maintain ETL processes and workflows using ETL tools (e.g., Informatica, Talend, SSIS) or programming languages (e.g., Python, SQL). This involves writing efficient and scalable code to handle large volumes of data.
5. Data Quality Assurance: Perform data quality checks and implement data validation rules to ensure the accuracy, completeness, and consistency of the data. Identify and resolve data quality issues or anomalies.
6. Performance Optimization: Optimize ETL processes for improved performance, scalability, and efficiency. Identify and resolve performance bottlenecks, optimize data transformations, and fine-tune data loading processes.
7. Documentation and Reporting: Document ETL processes, data mappings, and data lineage for future reference. Generate reports and provide insights on data quality, data lineage, and ETL process performance.
8. Collaboration and Communication: Collaborate with cross-functional teams including data analysts, data engineers, business analysts, and stakeholders to understand data requirements, gather feedback, and ensure successful ETL implementation.
Requirements:
- Strong knowledge of ETL concepts, methodologies, and best practices.
- Proficiency in ETL tools such as Informatica, Talend, SSIS, or programming languages like Python, SQL.
- Experience with data modeling, data integration, and data warehousing concepts.
- Familiarity with databases (e.g., Oracle, SQL Server, MySQL, BigQuery) and data formats (e.g., CSV, JSON, XML).
- knowledge of GCP cloud
- Aware of various services related to ETL on google cloud
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
- Attention to detail and ability to work with large datasets.
- Experience with cloud-based ETL platforms (e.g., AWS Glue, Azure Data Factory) is a plus.
Job tags
Salary
