Data Engineer

• Finding trends in data sets and developing algorithms to help make raw data more useful to the enterprise.
• Collecting the data from various sources, transforming it into desire formats, and storing it into data stores like Data Lake, Azure Synapse Analytics.
• Implementing complex, large-scale big data projects focusing on collecting, managing, analyzing, and visualizing large datasets.
• Taking part in designing and running bespoke data services for individual projects.
• Staying up to date with leading-edge processes in using, retrieving data, building machine learning models.
• Crafting and use effective metrics and monitoring processes.
• Support deal teams by providing subject knowledge and solutions for client proposals

You’re a Data Engineer who knows how to find, store, analyze, transform and present a range of information from different sources so that everyone can access what they need effectively.

Your skills and experience likely include:

• Hands-on in structured problem-solving.
• Excellent collaboration skills with business analysts and data scientists. 
• The ability to apply methods to tackle business problems using one or more Azure Data and Analytics services combined with building data pipelines, data streams, and system integration.
• Being engaged in end-to-end Data Ingestion → Data Transformation → Data Persistence → Performance Optimization process.

Minimum technical requirements:

• At least three years of commercial experience with at least two of the following platforms \ frameworks:

• One or more years of commercial experience with object-oriented languages (Python and\or C# is strongly preferred, but could be Java/C++ as long as you are willing to learn Python and\or C#)
• SQL Server, Azure Data Lake, CosmosDB
• Git
• Good understanding of batch and streaming typical architectures.