Talent.com
This job offer is not available in your country.
Cloudera Big Data Administrator / Engineer

Cloudera Big Data Administrator / Engineer

IOCOJohannesburg, South Africa
2 days ago
Job description

iOCO is seeking a skilled Big Data Administrator / Engineer with strong hands-on experience in Cloudera’s ecosystem (Hive, Impala, HDFS, Ozone, Hue, NiFi) and proven expertise in Informatica BDM / DEI . The role involves administering and configuring big data platforms, deploying / supporting clusters, and building optimized pipelines to move and transform large-scale datasets. Experience with alternate platforms such as Hortonworks, MapR, AWS EMR, Azure HDInsight, or Google Dataproc will be advantageous.

What you'll do :

  • Platform Administration : Install, configure, upgrade, and monitor Cloudera / CDP clusters, manage HDFS / Ozone storage, and ensure security (Kerberos, Ranger, Sentry).
  • Data Pipelines : Build and optimize ingestion and processing pipelines using NiFi and Informatica BDM / DEI, supporting both real-time and batch flows.
  • ETL Integration : Develop Informatica mappings and workflows, leveraging pushdown execution to Hive / Impala / Spark; integrate diverse on-prem and cloud data sources.
  • Performance Governance : Optimize queries, orchestrate jobs (Airflow, Oozie, Control-M), and ensure compliance with governance / security standards.

Your Expertise :

  • Strong hands-on expertise in Cloudera tools : Hive, Impala, HDFS, Ozone, Hue, NiFi.
  • Proficiency with Informatica BDM / DEI (ETL / ELT, pushdown optimization, data quality).
  • Solid SQL, Linux administration, and scripting (Bash, Python).
  • Familiarity with cloud data platforms (AWS, Azure, GCP) and orchestration tools.
  • 4+ years in big data administration / engineering, including 2+ years in Informatica BDM / DEI.
  • Qualifications :

  • Bachelor’s degree in Computer Science, Engineering, or related field.
  • Experience in hybrid or cloud-based big data environments.
  • Soft Skills :

  • Strong troubleshooting and problem-solving mindset.
  • Ability to work independently and within cross-functional teams.
  • Clear communication and documentation skills.
  • Other information applicable to the opportunity :

  • Contract position
  • Location : Johannesburg
  • Why work for us?

    Want to work for an organization that solves complex real-world problems with innovative software solutions? At iOCO, we believe anything is possible with modern technology, software, and development expertise. We are continuously pushing the boundaries of innovative solutions across multiple industries using an array of technologies. 

    You will be part of a consultancy, working with some of the most knowledgeable minds in the industry on interesting solutions across different business domains. 

    Our culture of continuous learning will ensure that you will have all the opportunities, tools, and support to hone and grow your craft. 

    By joining IOCO you will have an open invitation to developer inspiring forums. A place where you will be able to connect and learn from and with your peers by sharing ideas, experiences, practices, and solutions. 

    iOCO is an equal opportunity employer with an obligation to achieve its own unique EE objectives in the context of Employment Equity targets. Therefore, our employment strategy gives primary preference to previously disadvantaged individuals or groups.

    Create a job alert for this search

    Data • Johannesburg, South Africa

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Recru-itJohannesburg, South Africa
    Our client is seeking a highly skilled Senior Data Engineer with deep expertise in Snowflake and Matillion to design, build, and optimize scalable data pipelines and integration solutions.The ideal...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer – Johannesburg - R800k to R1mil per annum

    AWS Data Engineer – Johannesburg - R800k to R1mil per annum

    E-MergeJohannesburg, South Africa
    A leader in intelligence automation offering specialised software and services aimed at leveraging advances in machine learning and artificial intelligence. Design, build, and manage scalable data p...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer – Johannesburg – R650k up to R850k per annum

    Azure Data Engineer – Johannesburg – R650k up to R850k per annum

    E-MergeJohannesburg, South Africa
    Design and maintain a comprehensive data architecture across multiple application platforms.Analyze data elements and systems to ensure accuracy, consistency, and usability.Develop, manage, and opt...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer (Azure) - 6 month contract

    Data Engineer (Azure) - 6 month contract

    Ace StaffingJohannesburg, South Africa
    Bryanston, Johannesburg (Hybrid / remote).Contract : 6 months starting asap / 1 July 2025.A leading digital strategy and technology services company is seeking a skilled. This role involves designing, bu...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer – Contract – Sandton – R650 to R680 Per hour

    Senior Data Engineer – Contract – Sandton – R650 to R680 Per hour

    E-MergeJohannesburg, South Africa
    This role is ideal for a professional who thrives on designing robust data solutions while ensuring governance and creating impactful data visualizations. Does this sound like a role youd like to pu...Show moreLast updated: 30+ days ago
    • Promoted
    Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum

    Intermediate or Senior AWS Data Engineer – Johannesburg – up to R900k per annum

    E-MergeJohannesburg, South Africa
    A Technology and Business Consulting Firm that was founded through a combination of technology, data, financial and actuarial science principles. Intermediate or Senior AWS Data Engineer.You will wo...Show moreLast updated: 30+ days ago
    • Promoted
    Intermediate Cloud Data Engineer – Johannesburg – up to R600k per annum

    Intermediate Cloud Data Engineer – Johannesburg – up to R600k per annum

    E-MergeJohannesburg, South Africa
    An independent, results-focused management consulting firm specialising in working with industry-leading banks and insurance companies around the world, including institutions in the United Kingdom...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer – Johannesburg – R900k to R 1.1mil per annum

    AWS Data Engineer – Johannesburg – R900k to R 1.1mil per annum

    E-MergeJohannesburg, South Africa
    A Group propelled forward by its efficiency in providing professional financial solutions and products to bring data and insights in collaboration to showing partners how their behaviour accelerate...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer – Johannesburg – R1.2mil up to R1.5mil per annum

    Lead Data Engineer – Johannesburg – R1.2mil up to R1.5mil per annum

    E-MergeJohannesburg, South Africa
    An international client is seeking a hands-on.This is a high-impact role where you''ll shape and scale our data platform to power strategic initiatives across the business.Reporting directly to the...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    Dina Gates Recruitment (Pty) LtdKempton Park, South Africa
    We are seeking a skilled Azure Data Engineer with a minimum of 2 years of experience to join our dynamic data team.The ideal candidate will have a strong background in SQL, Microsoft Azure, data wa...Show moreLast updated: 22 days ago
    • Promoted
    Big Data Data Engineer

    Big Data Data Engineer

    PBT GroupJohannesburg, South Africa
    We are seeking a skilled Data Engineer to design and develop scalable data pipelines that ingest raw, unstructured JSON data from source systems and transform it into clean, structured datasets wit...Show moreLast updated: 23 days ago
    • Promoted
    SQL Data Engineer

    SQL Data Engineer

    Datonomy SolutionsSandton, South Africa
    We are looking for a capable and detail-oriented.You will play a key role in ensuring the reliability, performance, and quality of data pipelines, with a strong emphasis on compliance and metadata ...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer – Johannesburg – R600k to R800k per annum

    AWS Data Engineer – Johannesburg – R600k to R800k per annum

    E-MergeJohannesburg, South Africa
    A leader in intelligence automation offering specialised software and services aimed at leveraging advances in machine learning and artificial intelligence. Design, build, and manage scalable data p...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Network RecruitmentJohannesburg, South Africa
    Lead the architectural design and implementation of the new Azure-based data warehouse.Own the data governance framework, ensuring standards for data quality, security, and access control are embed...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Oostelike Personeel KonsultanteCenturion, South Africa
    Legal requirements : Must be a South African Citizen with a clean criminal background and ITC (no bad debt) - checks will be done on shortlisted applicants. Appointment : Permanent, full-time position...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    PBT GroupJohannesburg, South Africa
    Ready to take your data engineering career to new heights?.Architect modern data analytics frameworks.Translate complex requirements into scalable, secure, high-performance pipelines.Build & optimi...Show moreLast updated: 22 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    OttoBauthenticJohannesburg, South Africa
    To lead the design, development, and governance of the company’s enterprise data infrastructure, transitioning from the current SSIS-based ETL environment to a modern, scalable, Azure-based cloud d...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer – Johannesburg – R530 to R630 per hour

    AWS Data Engineer – Johannesburg – R530 to R630 per hour

    E-MergeJohannesburg, South Africa
    An IT South Africa Hub delivering cutting-edge IT solutions to the global Group and specialising in innovative and comprehensive IT services, including Development and Operations for.IT methodology...Show moreLast updated: 30+ days ago