Data Engineer- Redshift Data Architecture

  • Software Engineering
  • Professional

Data Engineer- Redshift Data Architecture

  • Software Engineering
  • Professional

Introduction
In this role, you’ll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world.​ Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

Your Role and Responsibilities
Day-to-day troubleshooting of forecasting systems, mainly working through data anomalies that cause inaccurate forecasts or prevent forecasts’ generation.
Collaborate with the data science team to enhance existing forecasting systems for the trade floors.
Create dynamic object-oriented methods, full stack solutions, and integrations to existing code solutions.
Develop individual Python classes, methods, functions that support the data flow of existing and new projects.
Work on code additions to seamlessly support projects for data flows, including logging and support, with little to no supervision.
Experience in modifying packages, testing, and repository instances to support CI/CD.

MXCON24

Required Technical and Professional Expertise
Lead Redshift Data Engineering Projects: Manage and oversee data engineering projects involving Redshift from conception to completion, ensuring deliverables meet quality standards and deadlines.
• Redshift Data Architecture and Pipeline Development: Design and implement efficient data pipelines within Redshift to gather, store, and process large volumes of data from various sources.
• Team Leadership: Mentor and guide junior data engineers, promoting development best practices and advocating for a collaborative team environment.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver actionable insights.
• Optimization: Continuously improve existing Redshift data infrastructure for performance, scalability, and reliability.
• Redshift Performance Tuning: Optimize Redshift performance including indexing, query optimization, and maintenance tasks.
• Documentation: Create and maintain comprehensive documentation for Redshift data processes, workflows, and system architectures.
• Compliance and Security: Ensure data solutions adhere to legal and company compliance standards, including data privacy and security protocols. Required Qualifications
• Education: Bachelor’s degree in Computer Science, Information Technology, Data Science, or related field. Master’s degree preferred.
• Extensive experience managing multi-terabyte size Amazon Redshift instances, including data warehousing, Data Lakes, ETL processes, and performance tuning.


Preferred Technical and Professional Expertise
NA

Quer saber como é ser um IBMista?


About IBM

IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 50 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

Detalhes importantes do cargo

Não encontrou uma oportunidade para este momento?

Não se preocupe. Junte-se à nossa Rede de Talentos e receba notícias sobre as últimas oportunidades.