Data Engineer
BH-277504
Posted: 19/08/2024
- based on exp.
- Canada Alberta Calgary
- Contract
-
Oil & Gas
Key Accountabilities:
Skills & Qualifications:
With over 90 years' combined experience, NES Fircroft (NES) is proud to be the world's leading engineering staffing provider spanning the Oil & Gas, Power & Renewables, Chemicals, Construction & Infrastructure, Life Sciences, Mining and Manufacturing sectors worldwide. With more than 80 offices in 45 countries, we are able to provide our clients with the engineering and technical expertise they need, wherever and whenever it is needed. We offer contractors far more than a traditional recruitment service, supporting with everything from securing visas and work permits, to providing market-leading benefits packages and accommodation, ensuring they are safely and compliantly able to support our clients.
- Estimate, design and develop scalable, optimized data pipelines to enable our business through Business Intelligence and Advanced Analytics solutions.
- Develop and update standards and best practices, use DevOps Continuous Integration and Delivery (CI/CD) process
- Provide hands-on data integration support as part of daily operations; this includes monitoring, configuration, troubleshooting, user administration, and optimizing data objects for consumers
- Follow ITIL processes to transition activities from project to production
- Conduct root cause analysis and resolve incidents reported by monitoring systems and end-users
- Configure and administer tools such as HVR, Magnotix, PowerBi, Tableau, and Informatica for reporting and data integration
- Establish and maintain best practices and data engineering templates and standards for each toolset and function, ie. ML/AI vs BI Analytics.
Skills & Qualifications:
- Post-secondary degree in Computer Science/Software Engineering or a related field of study or equivalent experience in data integration or data engineering
- 5+ years experience developing cost-optimized, scalable and configurable, ETL/ELT data pipeline or data integration
- 5+ years of experience with Python, SQL, and PySpark; DevOps/CI/CD pipelines, performant data stores and operational REST APIs
- Experience in Cloud environments and tools including MS Azure, AWS, Databricks, Synapse Analytics, Data Lakes, Azure Data Factory, HVR, Magnotix, KQL, Scala, PowerBi, Tableau, and Informatica
With over 90 years' combined experience, NES Fircroft (NES) is proud to be the world's leading engineering staffing provider spanning the Oil & Gas, Power & Renewables, Chemicals, Construction & Infrastructure, Life Sciences, Mining and Manufacturing sectors worldwide. With more than 80 offices in 45 countries, we are able to provide our clients with the engineering and technical expertise they need, wherever and whenever it is needed. We offer contractors far more than a traditional recruitment service, supporting with everything from securing visas and work permits, to providing market-leading benefits packages and accommodation, ensuring they are safely and compliantly able to support our clients.