Data Enginner
JOIN A TEAM OF CURIOUS MINDS, PROBLEM-SOLVERS, AND INNOVATORS DRIVING HIGH-IMPACT CHANGE FOR OUR CLIENTS, COMMUNITIES, AND THE WORLD.
We’re excited for new talent!
Our goal is to recruit and build an exceptional cadre of professionals who are passionate about doing work that matters. Successful candidates are placed into a niche practice area that best suits their skill set, interests and personal capability.
Opportunities do not follow a set timeline. Instead, opportunities at this level are advertised when they become available on an ongoing basis.
Your application must consist of:
- A copy of your identity document or passport
- Copies of all academic certificates obtained.
Process:
- The application is received and screened against required skills, competencies and experience
- The candidate is required to complete a technical case study
- Face-to-face and online psychometric assessments are conducted
- An interview is conducted
- Credential checks and references are completed
- If the candidate is successful, an offer of employment is made.
Job Description – Starburst Data Engineer
Role Purpose
We are seeking a Starburst Data Engineer to support and maintain an enterprise Starburst platform and assist with the migration of workloads from Apache Hive to Starburst.
The role focuses on production support, troubleshooting, SQL query optimisation, platform stability, and helping users successfully run analytical workloads on Starburst. StrongSQL skills and Knowledge of Presto, Starburst or Trino are essential.
Key Responsibilities
Assist with the migration of data workloads from Apache Hive to Starburst (Trino)
Investigate and resolve migration issues while providing support for production stability and operational continuity.
Monitor platform health, availability, query performance, and resource usage.
Investigate and resolve platform, connectivity, access, and SQL query issues.
Rewrite and optimize SQL queries for Starburst compatibility, maintainability, and query performance.
Optimize Starburst query performance through effective use of partitioning, file formats, caching, and related tuning techniques.
Troubleshoot slow or failed queries and recommend improvements.
Assess existing Hive schemas, queries, and pipelines for migration readiness.
Work with engineering, architecture, infrastructure, and business teams to resolve issues and improve platform performance.
Support platform upgrades, configuration changes, deployments, and operational improvements.
Maintain technical documentation, troubleshooting guides, and support procedures.
Participate in incident resolution and root-cause analysis.
Promote automation, monitoring, security, and operational best practices.
Required Skills
Advanced SQL skills, including query optimization, complex joins, and window functions.
Understanding of partitioning, bucketing, indexing, and related data optimization strategies.
Strong debugging, troubleshooting, and performance tuning skills.
Experience with Apache Hive and distributed data processing environments.
Good to have Knowledge of Presto, Starburst or Trino.
Experience working with big data ecosystems such as HDFS, S3, and data lake architectures.
Knowledge of modern table for formats such as Parquet, ORC.
Knowledge of analytical file formats such as Parquet
Good to have knowledge of modern table formats such as Iceberg and Delta
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform.
Preferred Skills
Experience supporting large-scale data platform modernization or migration initiatives.
Familiarity with performance benchmarking and workload optimization in distributed query environments.
Exposure to data governance, metadata management, and secure data access practices.
Ability to create clear technical documentation and communicate effectively with cross-functional teams.
Self-starter with strong ownership and accountability.
Strong support and customer-service mindset.
Disciplined, reliable, and highly committed to delivering quality work.
Strong team player with excellent collaboration and communication skills.
Quick learner with the ability to adapt to new technologies and environments.
Proactive approach to troubleshooting and problem-solving.
Able to work independently as well as in cross-functional teams.
Focused on continuous improvement, automation, and operational excellence.
Strong analytical and platform support mindset.
Skills
Apache Hive Architecture C R SQL Troubleshooting
We don’t feel that you need to go to an office every day to have impact, but we do want our team members to have options.
Our Newsletter
Subscribe to our mailing list to get the updates to your email inbox. By clicking subscribe below, you consent to allow iDbase Software to store and process the personal information submitted above to provide you the content requested.
Have a question, need a solution, or want to explore how iDbase Software can support your digital goals? We’re here to help. Reach out to our team – we’ll get back to you promptly.
Real-world lessons in digital transformation – going beyond theory
#J-18808-Ljbffr