Job Title: GCP Data Engineer
Company:PBT Group
Job description: Job SummaryOur team is seeking an experienced Google Cloud Platform (GCP) Data Engineer with a passion for building and optimising data pipelines, architectures, and data sets on GCP. This role involves collaborating closely with data analysts, data scientists, and other stakeholders to ensure high-quality data availability for advanced analytics and machine learning initiatives.Key Responsibilities:
- Design, build, and maintain scalable data pipelines and ETL processes on GCP to support a variety of data applications, including analytics, reporting, and machine learning.
- Implement and manage data warehouses and data lakes using GCP services such as BigQuery, Cloud Storage, Cloud Dataflow, and Cloud Composer.
- Develop, maintain, and enhance data models in line with business requirements, optimising for performance and scalability.
- Collaborate with cross-functional teams to understand business needs, translate them into technical solutions, and provide data access solutions tailored to specific use cases.
- Conduct regular performance tuning, capacity management, and data quality checks to ensure the efficiency, security, and reliability of data infrastructure.
- Implement security best practices, including data encryption, access control, and compliance with organisational and regulatory standards.
- Develop and maintain comprehensive documentation on data architecture, data models, and processes.
Qualifications:
- Bachelor’s Degree in Computer Science, Information Systems, Engineering, or a related field.
- 3+ years of experience as a Data Engineer with hands-on expertise in designing, building, and optimising data architectures on GCP.
- Proficiency in SQL and Python for data transformation, automation, and integration.
- Strong knowledge of GCP tools: BigQuery, Cloud Dataflow, Cloud Storage, Cloud Composer (Apache Airflow), Pub/Sub, and Cloud Functions.
- Experience with data modelling, ETL processes, and data warehousing concepts.
- Experience with Apache Kafka or other streaming platforms is beneficial.
- Familiarity with CI/CD tools and DevOps practices for data pipelines, such as Docker, Terraform, or Kubernetes, is advantageous.
Skills:
- Analytical and problem-solving skills: Ability to diagnose complex data issues, recommend and implement solutions efficiently.
- Attention to detail and commitment to data quality: Ensures that data is accurate, reliable, and adheres to company standards.
- Communication and collaboration skills: Strong written and verbal communication abilities, capable of working well with both technical and non-technical stakeholders.
- Self-motivated and adaptable: Able to work independently in a fast-paced environment, with a proactive approach to learning and adopting new technologies.
Preferred Competencies:
- Certifications in Google Cloud (e.g., Professional Data Engineer) are a plus.
- Experience with machine learning workflows and integration with data pipelines.
- Knowledge of data governance principles and experience implementing data quality frameworks.
Why Join Us: This role offers the opportunity to work with cutting-edge cloud technology within a dynamic and collaborative environment. You’ll have the chance to make a significant impact on our data strategy and contribute to innovative projects that push the boundaries of data engineering on GCP. If you’re a dedicated GCP Data Engineer with a vision for data-driven success, we’d love to hear from you!PBT GroupRecruiter
Expected salary: R16000 – 19000 per month
Location: Cape Town, Western Cape
Job date: Thu, 31 Oct 2024 00:45:21 GMT
Professional CV Tips for Success – jobsguru.co.za
- Contact Information: Use a professional email address and include a phone number. LinkedIn or a personal website can also add value.
- Personal Statement: In 2-3 lines, summarize your strengths and career goals, tailored to the job you’re applying for.
- Work Experience: List roles in reverse-chronological order. Focus on achievements with measurable results, e.g., “Increased sales by 20%.”
- Education: Only list qualifications relevant to the job or recent achievements if early in your career.
- Skills: Include both technical and soft skills. Use keywords from the job description to improve ATS compatibility.
- Formatting: Stick to one or two clean fonts, consistent margins, and ample white space. Avoid graphics unless you’re in a creative field.
- Proofreading: Errors harm your credibility. Review carefully or ask someone else to check for mistakes.
For more guidance, visit jobsguru.co.za.