Data Eng, Mgmt & Governance Specialist

Accenture is a global professional services company with leading capabilities in digital, cloud and security. Find out more about us at accenture.com.

Responsibilities:

• Support multiple solutions (Apache NIFI, Starburst) that are critical for Day-to-Day operational issues and production support and development.

• Build end-to-end ETL/ELT workflows for batch and real-time data processing across multiple source and target systems.

• Develop complex data flows using NiFi processors, process groups, templates, controller services, and parameter contexts.

• Implement data transformation, enrichment, validation, routing, and error-handling mechanisms within NiFi workflows.

• Integrate NiFi with Kafka, AWS S3, REST APIs, databases, HDFS, and enterprise messaging platforms.

• Design reusable and scalable NiFi frameworks to accelerate onboarding of new data sources.

• Perform flow optimization to improve throughput, reduce latency, and minimize resource consumption.

• Administer multi-node Apache NiFi clusters in Production and Non-Production environments.

• Manage NiFi cluster upgrades, patching, deployment, and platform lifecycle activities.

• Configure NiFi Registry for version control, flow promotion, and CI/CD integration.

• Implement secure authentication and authorization using LDAP, SSO, Kerberos, and certificate-based authentication.

• Manage SSL/TLS certificates, keystores, truststores, and secure communication across NiFi clusters.

• Perform cluster health monitoring, troubleshooting, and capacity planning activities.

• Configure and manage NiFi repositories (FlowFile, Content, Provenance, and State Management).

• Implement disaster recovery and backup strategies for NiFi environments.

• Lead performance tuning initiatives to improve cluster stability and throughput.

• Lead a team of NiFi developers and platform engineers in delivering enterprise data integration solutions.

• Conduct code reviews, design reviews, and technical mentoring for development teams.

• Collaborate with Data Engineering, Architecture, Security, Cloud, and Operations teams.

• Be part of supporting project involved in 24/5 support to running the processes for on-going maintenance monitoring support and security patching of a NFI, THOR ,Starburst applications.

• Initiate alarms in New relic by creating the policies for monitoring different cluster databases in THOR.

• Participate in EKS RDS Instance upgrade activities.

• Support and administer the Starburst Data Virtualization platform across Production and Non-Production environments.

• Perform platform monitoring, performance tuning, capacity management, and troubleshooting to ensure high availability and optimal query performance.

• Collaborate with business stakeholders, architects, and data engineering teams to understand requirements and onboard new THOR datasets into the Data Virtualization platform.

• Perform root cause analysis (RCA) for production incidents and implement permanent remediation actions to improve platform stability and reliability.

• Manage release, deployment, and change management activities in compliance with organizational governance and support processes.

• Provide operational support and administration for the Immuta SaaS data access governance platform across Production and Non-Production environments.

• Manage data access policies, user entitlements, role assignments, and attribute-based access control (ABAC) configurations within Immuta.

• Support user onboarding, access provisioning, access modifications, and troubleshooting of data access-related issues.

• Monitor Immuta platform health, policy enforcement, user access requests, and integration workflows to ensure compliance with data governance standards.

• Work closely with business users, data owners, and security teams to implement and maintain data access policies in accordance with organizational requirements.

• Investigate and resolve issues related to user access, policy tagging, group synchronization, and metadata integration.

• Support integration of Immuta with Starburst, Active Directory/LDAP, and enterprise authentication platforms.

• Utilize Jira and Confluence for incident tracking, service requests, knowledge management, and operational documentation.

• Collaborate with data governance, security, and platform engineering teams to ensure compliance with data privacy, security, and regulatory requirements.

• Monitor audit logs, access requests, and policy compliance to support governance and security objectives.

Qualifications:

• Bachelor's degree in Electronics & Communication or a related field.

• Minimum 5+ years of experience in data engineering, ETL/ELT development, and administration of Apache NiFi in enterprise environments.

• Strong hands-on experience with data integration technologies, including Apache Kafka, REST APIs, databases, cloud platforms, and real-time/batch data processing.

• Proven experience supporting and administering Starburst and data governance solutions such as Immuta, including user access management, policy enforcement, and platform monitoring.

• Excellent troubleshooting, performance tuning, and leadership skills, with the ability to perform root cause analysis, support production environments, and collaborate effectively with cross-functional teams.

Equal Employment Opportunity Statement for Australia and New Zealand:

At Accenture, our intention is to foster a culture and a workplace in which all of our people feel a sense of belonging and are respected and empowered to do their best work.

We encourage applications from all people with the relevant skillset, and we are committed to removing barriers to the recruitment process and employee lifecycle. All employment decisions shall be made without regard to age, disability status, ethnicity, gender, gender identity or expression, religion or sexual orientation and we do not tolerate discrimination. If you require any accommodations or adjustments for interviews and/or at work, please reach out to exectalent@accenture.com or contact us at +61 2 9005 5000 (Australia) or +64 44666056 (New Zealand).

Learn how Accenture protects your personal data and know your rights in relation to your personal data. Read more about our Privacy Statement.