Data Engineering Operational Support
Country:
Cities:
Area of expertise:
Job Description
Do you love making sure that information is accessible and easy to use? So do we.- Use your knowledge to plan and deliver data warehouses and storage
- Take part in crafting and running bespoke data services for individual projects
- Stay up to date with business best practice in using and retrieving data
- Support client's application within data and applications operations team as primary support member
- Monitor and troubleshoot client's data pipeline using Python, SQL and Spark skills
- Respond to incident tickets/concerns raised by client, attend weekly meetings with client to provide updates and answer questions
- Utilize Python programming, Azure DevOps and Hadoop ecosystem (HDFS, YARN, Hive, Oozie) to support the application
- Collaborate with various teams to stabilize the application by fixing bugs in the code, data reconciliation, automation, etc.
- Design, develop, adapt, and maintain data warehouse architecture and relational databases that support data mining
- Customize storage and extraction, metadata, and information repositories
- Build and use effective metrics and monitoring processes
- Help to develop business intelligence tools
- Craft and maintain report forms and formats, information dashboards, data generators and canned reports, as well as other information portals and resources
- Data Pipeline tools with preference for Azure Data Factory, Azure Databricks
- Strong knowledge of Python, Spark, and T-SQL
- Experience participating in a data migration to Cloud Services
- Database, storage, collection and aggregation models, techniques, and technologies - and how to apply them in business
- Experience in structured problem solving
- Data modelling
- Strong communication skills
- Ability to use technology to aim business problems using one or more Microsoft Analytics services for building data pipelines, data streams, and system integration
- Knowledge of Azure tools such as Azure Data Factory, Azure Data Lake, Azure SQL DW or Azure SQL
- Knowledge of Big Data tools such as Hadoop AND Spark, Azure Cosmos DB, Azure Databricks, Azure Stream Analytics
- Experience preparing data for Data Science and Machine Learning
- Crafting and building Data Pipelines using streams of IoT data
- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals
- You’re likely to have a Bachelor’s degree in IT, Applied Mathematics, Statistics or another meaningful field, or an equivalent combination of education and experience.
- You also have several years of relevant professional experience
- A fast paced and growing environment of Data professionals and peers to learn with and from
- Investment in your training and certifications
- Internal mobility and constant learning
Share this job:
About Avanade
Avanade is the leading provider of innovative digital, cloud and advisory services, industry solutions and design-led experiences across the Microsoft ecosystem. Every day, our 56,000 professionals in 26 countries make a genuine human impact for our clients, their employees and their customers.
We have been recognized as Microsoft’s Global SI Partner of the Year more than any other company. With the most Microsoft certifications (60,000+) and 18 (out of 18) Gold-level Microsoft competencies, we are uniquely positioned to help businesses grow and solve their toughest challenges.
We are a people first company, committed to providing an inclusive workplace where employees feel comfortable being their authentic selves. As a responsible business, we are building a sustainable world and helping young people from underrepresented communities fulfil their potential.
Majority owned by Accenture, Avanade was founded in 2000 by Accenture LLP and Microsoft Corporation. Learn more at www.avanade.com.
