Lead Data Engineer
Black Pearl
Blackpearl Group, the fastest growing technology company listed on the NZX, is hiring a Lead Data Engineer for a newly created role in Wellington. Blackpearl Group (NZX:BPG) is a market-leading data technology company pioneering AI-driven sales and marketing solutions for the US market. Their cutting-edge services and products are on the forefront of the data utilisation movement and they are leading the way with exciting initiatives and critical thinking.
With headquarters in Wellington and offices in Auckland and Arizona, Blackpearl offers employees exposure to international best practice within an agile environment. The company’s mantra ‘Better Growth Together’ reflects its belief in shared achievement: when customers succeed so does every member of the team. For more information visit: https://www.blackpearl.com/
What you'll do:
You'll design and build cutting-edge systems that process 20+ billion rows daily, creating the foundation for breakthrough AI applications and commercial data products that generate millions in revenue. This is your opportunity to work with massive datasets in a rapidly scaling, ambitious company where your engineering excellence directly impacts business growth and innovation
- Engineer high-performance data pipelines that handle 20+ billion rows daily using Azure Data Factory and Python
- Help to build and grow their Snowflake Enterprise Datawarehouse through continuous data pipeline development
- Build sophisticated data models and transformations using modern data transformation tools
- Optimise Snowflake warehouse architecture for enterprise-scale performance and cost efficiency
- Create intelligent automated testing and monitoring systems for bulletproof data quality
- Design and implement data infrastructure specifically optimised for AI and machine learning workloads
- Build feature stores and model training pipelines that serve massive datasets efficiently
- Create real-time and batch inference infrastructure for AI applications
- Architect data flows that support advanced analytics and predictive modelling at scale
- Architect and implement data infrastructure solutions in Azure (primary) and AWS
- Design data storage solutions optimising for performance, cost, and scalability
- Implement CI/CD processes for data pipeline deployment and version control
- Build reusable frameworks and tools to accelerate data engineering workflows
- Establish best practices for data security, access controls, and privacy
What you bring:
- 5+ years' experience in data engineering or similar technical roles
- Strong proficiency in SQL and Python for data processing
- Hands-on experience with cloud data platforms (Azure preferred, AWS valuable)
- Experience with modern data stack tools (Snowflake, data transformation tools, orchestration platforms)
- Knowledge of data modelling, ETL/ELT patterns, and pipeline architecture
- Understanding of data governance, security, and compliance principles
For more information or a strictly confidential chat please contact Justin Purdie on +64 4 4719770 Justin.Purdie@robertwalters.co.nz or Sean Caulfield +64 4 4719732
Sean.Caulfield@robertwalters.co.nz
Robert Walters endeavours to review all applications in a maximum of five working days. If you have not received correspondence within this timeframe please do not hesitate to contact Justin Purdie on 04 471 9770.
