Note: The job is a remote job and is open to candidates in USA. IBM is hiring a Senior Data Engineer specializing in Google data platforms to design, build, and maintain data engineering solutions in Google Cloud. The role develops and operates batch and real-time data pipelines, manages data platforms, ensures data quality, and optimizes solutions with stakeholders.
Responsibilities
- Design and build data pipelines using Google DataProc, DataFlow, PubSub, BigQuery, and other Google services to meet business requirements
- Utilize Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, and Google DataFlow with Apache Beam or Python to develop and manage data engineering solutions
- Schedule and manage the data platform using Google Cloud Scheduler and Cloud Composer (Airflow) to ensure seamless data pipeline operations
- Develop and manage batch and real-time data pipelines for Data Warehouse and Datalake to ensure high-quality data delivery
- Collaborate with stakeholders to optimize data solutions and ensure alignment with business objectives
Skills
- Bachelor's Degree
- Experience with designing, building, and maintaining data engineering solutions on Google's Cloud ecosystem, including services such as Google DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB
- Experience in developing and managing batch and real-time data pipelines for Data Warehouse and Datalake using Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, and Google DataFlow with Apache Beam or Python
- Experience with open source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala in data engineering solutions
- Experience in scheduling and managing the data platform using Google Cloud Scheduler and Cloud Composer (Airflow) to ensure seamless data pipeline operations
- Experience with utilizing various data engineering tools and technologies to develop and manage data engineering solutions on Google's Cloud ecosystem
- IBM will not be providing visa sponsorship for this position now or in the future. Therefore, in order to be considered for this position, you must have the ability to work without a need for current or future visa sponsorship
- Experience with open source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala in data engineering solutions, enabling the development of efficient data pipelines and scalable data architectures
- Experience with utilizing various data engineering tools and technologies to develop and manage data engineering solutions on Google's Cloud ecosystem, ensuring seamless integration and data flow
- Experience in optimizing data solutions and ensuring alignment with business objectives, collaborating with stakeholders to drive business outcomes through data-driven insights
Benefits
- Hybrid work arrangement; this position can be performed from anywhere in the United States of America.
- Healthcare benefits including medical & prescription drug coverage, dental, vision, and mental health & well being
- Financial programs such as 401(k), cash balance pension plan, the IBM Employee Stock Purchase Plan, financial counseling, life insurance, short & long- term disability coverage, and opportunities for performance based salary incentive programs
- Generous paid time off including 12 holidays, minimum 56 hours sick time, 120 hours vacation, 12 weeks parental bonding leave in accordance with IBM Policy, and other Paid Care Leave programs.
- Paid family leave benefits to eligible employees where required by applicable law
- Training and educational resources on our personalized, AI-driven learning platform where IBMers can grow skills and obtain industry-recognized certifications to achieve their career goals
- Diverse and inclusive employee resource groups
- Giving & volunteer opportunities
- Discounts on retail products, services & experiences
Company Overview