Data Engineer- Redshift Data Architecture
-
- Software Engineering
- Professional
Data Engineer- Redshift Data Architecture
-
- Software Engineering
- Professional
In this role, you’ll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
Your Role and Responsibilities
Day-to-day troubleshooting of forecasting systems, mainly working through data anomalies that cause inaccurate forecasts or prevent forecasts’ generation.
Collaborate with the data science team to enhance existing forecasting systems for the trade floors.
Create dynamic object-oriented methods, full stack solutions, and integrations to existing code solutions.
Develop individual Python classes, methods, functions that support the data flow of existing and new projects.
Work on code additions to seamlessly support projects for data flows, including logging and support, with little to no supervision.
Experience in modifying packages, testing, and repository instances to support CI/CD.
MXCON24
Required Technical and Professional Expertise
Lead Redshift Data Engineering Projects: Manage and oversee data engineering projects involving Redshift from conception to completion, ensuring deliverables meet quality standards and deadlines.
• Redshift Data Architecture and Pipeline Development: Design and implement efficient data pipelines within Redshift to gather, store, and process large volumes of data from various sources.
• Team Leadership: Mentor and guide junior data engineers, promoting development best practices and advocating for a collaborative team environment.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver actionable insights.
• Optimization: Continuously improve existing Redshift data infrastructure for performance, scalability, and reliability.
• Redshift Performance Tuning: Optimize Redshift performance including indexing, query optimization, and maintenance tasks.
• Documentation: Create and maintain comprehensive documentation for Redshift data processes, workflows, and system architectures.
• Compliance and Security: Ensure data solutions adhere to legal and company compliance standards, including data privacy and security protocols. Required Qualifications
• Education: Bachelor’s degree in Computer Science, Information Technology, Data Science, or related field. Master’s degree preferred.
• Extensive experience managing multi-terabyte size Amazon Redshift instances, including data warehousing, Data Lakes, ETL processes, and performance tuning.
Preferred Technical and Professional Expertise
NA
Want to know what it’s like to be an IBMer?
Key Job Details
Don’t see a fit at this time?
Don’t worry. Join our Talent Network and get notified about the latest opportunities.