Data Migration Lead (with Databricks/Azure)
Country:
Singapore
Cities:
Singapore
Area of expertise:
Analytics
Job Description
As a Data Engineering Manager at Avanade, you will use comprehensive modern data engineer techniques and methods with Advanced Analytics to support business decisions for Avanade clients. You can collect, aggregate, and analyze structured/unstructured data from multiple internal and external sources and patterns, insights, and trends to decision-makers. Your goal is to support the use of data-driven insights to help our Clients achieve business outcomes and objectives. In this role, you will collect, aggregate, store, and reconcile data in support of Client business decisions. You will help design and build data pipelines, data streams, reporting tools, information dashboards, data service APIs, data generators and other end-user information portals and insight tools. You will be a critical part of the data supply chain, ensuring that stakeholders can access and manipulate data for routine and ad hoc analysis to drive business outcomes using Advanced Analytics.
Key Role Responsibilities:
Day-to-day, you will
- Translate business requirements to technical solutions leveraging strong business acumen
- Analyzes current business practices, processes, and procedures and identifies future business opportunities for leveraging Microsoft Azure Data & Analytics Services.
- Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments.
- Delivery of data transformations and modernizations of enterprise data solutions using Azure cloud data technologies.
- Design and Build Modern Data Pipelines and Data Streams.
- Design and Build Data Service APIs
- Responsible for designing and providing technical direction to data engineers, data analysts, data integration developers, and database administrators.
- Responsible for the quality assurance of all architecture and design deliverables (e.g., technical documents)
- Responsible for preparing High-Level Design (HLD) document
- Manage, highlight, and resolve any design integration risks/issues with relevant business and stakeholder
- Develop and maintain data warehouse schematics, layouts, architectures, and relational/non-relational databases for data access and Advanced Analytics.
- Expose data to end users using PowerBI, Azure API Apps, or any other modern visualization platform or experience.
- Implement effective metrics and monitoring processes.
- Manage Data Governance in the enterprise and improve data governance, data quality, and master data practice
- Act as an Advisor for Data Governance processes, frameworks, standards, and architectures
- Travel as needed
Key Role Skill & Capability Requirements:
Your technical and non-technical skills include:
- Minimum 12 years experience with 4+ years of experience working with large complex enterprises, architecting & implementing large-scale data projects through Azure Data services
- Enterprise-scale technical experience with cloud and hybrid infrastructures, architecture designs, data migrations, and technology management. required
- Collaboration and Communication. Known for driving decisions collaboratively, resolving conflicts, and ensuring follow-through with exceptional verbal and written communication skills.
- Demonstrated experience in turning business use cases and requirements into technical solutions.
- Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flow.
- Ability to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration.
- Expert knowledge of Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL, and Data Bricks is required.
- Knowledge of Azure IoT, Azure HDInsight + Spark, Azure Cosmos DB, Azure Stream Analytics & Python is a plus.
- End-to-end data migration from legacy data platform to cloud data services experience is plus
- Experience in Big Data management & processing using tools such as Hadoop, Spark
- Experience in Data Transformation using ETL/ELT tools such as AWS Glue, Factory, Talend, EAI
- Experience in database and data warehousing with SQL, NoSQL & RDBMS such as MS SQL, AWS DynamoDB, etc.
- Knowledge of Lambda and Kappa architecture patterns.
- Knowledge of Master Data Management (MDM) and Data Quality tools and processes
- Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals.
- Working experience with Visual Studio, PowerShell Scripting, and ARM templates
- Ability to orchestrate, lead, and influence remote teams, ensuring successful implementation of customer projects
Preferred Certifications:
Microsoft Certified: Azure Data Engineer Associate, Solution Architect
Preferred Years of Work Experience:
You likely have about 12+ years of relevant professional experience.
Preferred Years of Management Experience:
5+ years managing & leadership of 3 or more associates in management consulting or industry.
What we offer you
Come for the distinctive experiences you have helping forward-thinking corporations, non-profits, and governments push the boundaries of digital innovation. Stay for the limitless learning opportunities that encourage you to master Microsoft and pursue big ideas. Enjoy ambitious growth for yourself as part of Avanade’s people-first culture with benefits like employee share purchasing, flexible work arrangements, a commitment to diversity and inclusion, and competitive pay.
Apply now
Share this job:
About Avanade
Avanade is the leading provider of innovative digital, cloud and advisory services, industry solutions and design-led experiences across the Microsoft ecosystem. Every day, our 59,000 professionals in 26 countries make a genuine human impact for our clients, their employees and their customers.
We have been recognized as Microsoft’s Global SI Partner of the Year more than any other company. With the most Microsoft certifications (60,000+) and 18 (out of 18) Gold-level Microsoft competencies, we are uniquely positioned to help businesses grow and solve their toughest challenges.
We are a people first company, committed to providing an inclusive workplace where employees feel comfortable being their authentic selves. As a responsible business, we are building a sustainable world and helping people from underrepresented communities fulfil their potential.
Majority owned by Accenture, Avanade was founded in 2000 by Accenture LLP and Microsoft Corporation. Learn more at www.avanade.com.
