System Soft Technologies
Location
Delhi | India
Job description
System Soft Technologies is a leading technology company that provides innovative technology solutions and consulting services to enhance innovation, business value, and competitiveness. For over 20 years, our focus on becoming a trusted partner to each client has allowed us to become a $140MM+ company with a pool of over 800 associates who cover the full spectrum of IT expertise. We are distinguished by our ability to anticipate the unique needs of our clients and deliver a level of quality that far exceeds their expectations.
Why System Soft Technologies? At System Soft Technologies, we are a family unit powered by diversity, inclusion, transparency, respect, integrity, and passion for our clients and our people. Our business growth depends on your professional development, as we collaborate, share ideas and innovation, and invest in our future. By forging a meaningful partnership with our people, we come together with the same purpose, exceeding our goals. This keeps us nimble, ahead of the competition, and on top of our industry. Our continued success begins with you. Location: Remote Position Title: Data Engineer Position Travel: N/A Job type: Contract Job Description: REQUIRED SKILLS AND EXPERIENCE 3-6 years of hard-core data warehouse experience using Azure data factory Strong SQL Skills using SQL Server – ability to profile data, verify data movement, validate data matches, advanced SQLs expertise, performance tuning of SQLs, Azure SQL managed instance experience, experience in working with large enterprise databases. Comfortable with documenting and drawing data flows, data mappings, etc. Extensive Data Ingestion experience Familiar with best practices for data flow patterns for data ingestion into Data warehouse including progression through Staging, ODS and Data Warehouse (Dims/Facts) schemas. Experienced handling Production data loads and designing error handling and alerting into all steps to best support Experience with data retention/archiving policies and procedures Experience with both event triggers and schedule triggers to trigger pipeline start. Experience ingesting from SQL and file-based sources, with Azure blob storage experience JOB DESCRIPTION Existing ADF data ingestion pipelines: Review existing pipelines to improve performance, data security, data quality Define tasks needed to address any issues found during the review, including detailing what work is needed, LOE Assist in identifying root cause of data flow issues with existing pipelines Suggest areas of optimization, reuse of pipelines Verify level of error handling and alerting is sufficient for all eventualities. Advanced performance turning of the new and existing SQL code New ADF data ingestion pipelines: Design new ADF pipelines for data ingestion for new sources including error handling, alerts, notifications. Break up work for new pipelines to identify tasks, LOE, etc. Enter work into DevOps. Monitor progress in Dev Ops Review work Deploy changes to QA, Production Production Support – support production data loads during normal business hours (daytime). Able to perform root cause analysis on any issues found. Ability to determine best way forward to restart pipeline, backfill missed data, etc. System Soft Technologies is a proud equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, disability status, sexual orientation, or any other characteristic protected by law. We are committed to the full inclusion of all qualified individuals. If you are an individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to access job openings or apply for a job on this site as a result of your disability. You can request reasonable accommodations by contacting us at [email protected].Job tags
Salary
