Note: The job is a remote job and is open to candidates in USA. SouthState Bank is a financial institution focused on helping customers and communities move forward through trusted relationships and forward-thinking solutions. The IT Data Engineer IV serves as a senior technical lead responsible for designing and improving enterprise data platforms, Snowflake solutions, and dbt-based transformation frameworks. The role also provides technical leadership, mentors engineers, and ensures data solutions meet quality, governance, security, architecture, and regulatory expectations.
Responsibilities
- Architect, design, and deliver enterprise data platform solutions leveraging Snowflake, dbt, SQL, Python, and modern data integration technologies, ensuring scalable, secure, reliable, and maintainable data pipelines and analytical data products
- Establish and enforce data engineering standards, best practices, and governance frameworks for code quality, CI/CD, data testing, observability, documentation, metadata management, security, and operational excellence
- Partner with business stakeholders, data owners, architects, compliance teams, and technology partners to translate business requirements into data solutions, data models, integration patterns, and implementation roadmaps that deliver measurable business value
- Lead the support, monitoring, and continuous improvement of enterprise data platforms by resolving complex production issues, improving performance, enhancing data quality, and ensuring operational reliability
- Provide technical leadership, mentorship, and strategic direction for the data engineering practice, including architectural reviews, coaching engineers, evaluating emerging technologies, and supporting advanced analytics, AI/ML, and enterprise data initiatives
- It is the responsibility of this role to take ownership of all tasks and challenges that they encounter in the operation of their assigned position. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions
Skills
- Minimum: Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related technical field, or equivalent combination of education and relevant professional experience
- 8-10+ years of progressive data engineering experience, with at least 3 years in a senior or lead technical capacity
- 5+ years of hands-on experience designing, developing, and optimizing solutions in Snowflake, including SQL development, data modeling, performance tuning, security/access patterns, and production support
- 5+ years serving in a senior engineer, technical lead, solution lead, or architecture-influencing capacity
- 5+ years of hands-on experience with dbt, including model development, testing, documentation, macros, environment promotion, and CI/CD integration
- 5+ years of experience with SQL and Python for data engineering, automation, transformation, and data quality validation
- 3+ years of experience with pipeline orchestration tools
- Experience partnering directly with business departments, data owners, reporting teams, architects, compliance, and other technology groups to gather requirements, communicate design decisions, and deliver production data solutions
- Experience supporting production data pipelines, troubleshooting data quality issues, conducting root cause analysis, and implementing monitoring or preventive controls
- Demonstrated experience architecting ML/AI data infrastructure including feature stores, MLOps pipelines, and LLM-based data processing workflows
- Ability to sit for extended periods and work extensively on a computer for sustained periods
- Expert-level ability to design maintainable data pipelines using SQL, Python, Snowflake, dbt, and enterprise orchestration patterns
- Strong understanding of production-grade engineering practices, including code reviews, version control, CI/CD, environment promotion, automated testing, documentation, monitoring, and incident response
- Ability to troubleshoot complex pipeline, transformation, performance, and data quality issues across multiple systems
- Advanced command of dbt for analytics engineering: incremental models, snapshots, seeds, macros, tests, and multi-environment deployment strategies
- Advanced hands-on experience with Snowflake, including schema design, role-based access patterns, warehouse sizing, query optimization, data sharing concepts, cost/performance tradeoffs, and integration with cloud storage and transformation tools
- Strong proficiency with cloud-native data warehouses and lakehouses: Snowflake, AWS Redshift, Azure Synapse Analytics, or GCP BigQuery
- Experience with lakehouse storage formats: Delta Lake, Apache Iceberg, or Apache Hudi
- Working knowledge of modern cloud data architecture patterns across Azure, AWS, or GCP, with preference for experience integrating Snowflake into enterprise data ecosystems
- Proficiency with containerization and orchestration: Docker and Kubernetes for deploying data workloads
- Demonstrated understanding of data engineering patterns that support AI/ML and advanced analytics use cases, including semantic model development, reusable feature data, model-ready datasets, feature store design and management, and scalable analytical data products
- Experience integrating AI-enabled workflows into data pipelines and analytics applications, including unstructured data processing, semantic search patterns, embedding-based approaches, and workflow orchestration
- Knowledge of MLOps and production analytics practices, including model lifecycle support, workflow automation, environment promotion, monitoring frameworks, governance considerations, performance monitoring, drift awareness, and continuous improvement of data inputs and outputs
- Familiarity with orchestrating AL agent workflows and tool-calling patterns using frameworks such as MCP or similar technologies
- Proficiency with real-time and event-driven data platform concepts, including message streaming, event ingestion, pub/sub patterns, and integration with enterprise data platforms
- Experience designing or supporting stream processing patterns for near-real-time transformation, enrichment, aggregation, and delivery of data to downstream consumers
- Knowledge of change data capture and incremental data movement patterns used to keep analytical, operational, and reporting data assets current and reliable
- Strong understanding of data quality frameworks, automated data observability and lineage tracking (Atlan, Monte Carlo)
- Experience with metadata management, data cataloging (Collibra, Alation, or Apache Atlas), and data classification practices in regulated environments
- Familiarity with data mesh and data product ownership principles
- Ability to design scalable, cost-optimized data architectures applying medallion (Bronze/Silver/Gold), data vault, or dimensional modeling patterns
- Strong technical communication skills: able to produce architecture decision records (ADRs), design documents, and present complex technical concepts to both technical peers and non-technical business stakeholders
- Ability to facilitate requirements gathering and design sessions with business stakeholders and technical teams
- Proven ability to influence cross-functional teams and drive consensus on enterprise data initiatives
- Proven ability to mentor engineers, lead code and design reviews, and drive adoption of engineering best practices across a team
- Detail-oriented with strong analytical skills; able to organize complex data landscapes and identify actionable insights and improvement opportunities
- Exceptional written and verbal communication skills with the ability to facilitate requirements workshops, present architectural recommendations, document design decisions, communicate project status, and influence stakeholders across technical and non-technical audiences
- Demonstrated initiative and ownership in ambiguous, fast-paced environments
- Ability to communicate in person, on the phone, and through electronic channels
- Ability to use a computer on a frequent basis, including typing and sustained attention to a monitor
- Ability to sit, walk, and/or stand for extended periods of time
- Ability to bend and reach
- For remote or hybrid positions, a secure and distraction-free setting is required, with a reliable internet connection (cable or fiber preferred, mobile hotspots not acceptable)
- Preferred: Master's degree in Computer Science, Data Engineering, Information Systems, Data Science, or related discipline
- Experience with streaming, lakehouse architecture, metadata management, data observability, or AI/ML data preparation is preferred
- Prior experience in financial services, banking, or another regulated industry is strongly preferred
- Preferred: Cloud data platform certification such as AWS Certified Data Analytics – Specialty, Microsoft Certified: Azure Data Engineer Associate, GCP Professional Data Engineer, or Snowflake SnowPro Certifications (Core, Associate, Advanced)
- Preferred: dbt Certification or equivalent analytics engineering credential
- Exposure to vector databases or retrieval-augmented generation (RAG) pipelines is preferred
Benefits
- Remote work arrangement
Company Overview
Company H1B Sponsorship