Note: The job is a remote job and is open to candidates in USA. Creative Testing Solutions is seeking a Principal Data Engineer to enable data-driven decision-making across the organization. The role designs, builds, and maintains data models, pipelines, databases, warehouses, cloud architecture, and analytics solutions while collaborating with technical and business stakeholders to improve data quality, scalability, and operational efficiency.
Responsibilities
- Conceptualizes and implements foundational data models, Data Lake, ETL pipelines and curated layer servicing multiple reporting platforms
- Writes and optimizes SQL queries for high performance and cost-effectiveness in large-scale data environments
- Develops and manages data engineering architecture, and designs and implements Lakehouse and analytics solutions
- Develops and coordinates cloud architecture across diverse areas including application development, identity and access management, network and data management, and security
- Implements data management best practices including cleansing, deduplication, validation, and governance to ensure data integrity and quality
- Designs, develops, and maintains robust scalable ETL/ELT data pipelines across multiple data sources and destinations
- Collaborates with data analysts, data scientists, and software engineers to understand data needs and translates them into technical solutions
- Optimizes data workflows for performance, scalability, and reliability
- Builds and maintains data models and warehouse schemas in support of analytics and business intelligence initiatives
- Optimizes query performance and database operations
- Ensures data quality, integrity, and compliance across all systems
- Participates in architectural discussions and help drive best practices in data engineering
- Collaborates with fellow data & analytics colleagues to foster a culture of teamwork and innovation
- Mentors junior data engineers and contributes to the development of team standards and practices
- Monitors data pipelines and resolves production issues in a timely manner
- Partners closely with DevOps and platform teams to manage infrastructure and deployment of data tools
- Performs all assigned duties in compliance with internal SOPs and external regulations. Brings compliance issues to the attention of management
- Assures quality customer service to all customers
- Maintains good attendance and punctuality per the absence policy
- Performs all other duties, at the discretion of management, as assigned
Skills
- Education: Bachelor's degree in Computer Engineering or related field of study, or equivalent technical experience
- Experience: A minimum of ten (10) years of data engineering related experience
- Experience designing and implementing Data Warehouse Architectures, preferably in a lead or architect capacity
- Experience with ETL/ELT pipelines, to-and-from various datastores (incl. operating systems, network share protocols, web APIs, and databases), as well as for data processing automation
- Advanced experience with database concepts; solid understanding of query languages (e.g., SQL), data transformation techniques, data modeling, warehousing concepts, and best practices
- Strong business acumen, critical thinking, and ability to work cross functionally through collaboration with engineering and business partners
- Ability to read and understand various data structures
- Ability to work independently and as part of a team
- Strong analytical, technical, and troubleshooting skills
- Familiarity with data governance, privacy, and compliance standards
- Must possess the skills and abilities to successfully perform all assigned duties and responsibilities
- Must be able to maintain confidentiality
- Ability to work in a team environment and participate as an active team member
- Effective oral and written communication skills
- Able to organize, prioritize, and execute a variable workload and multiple priorities
- Office work environment
- Travel: < 10%
- 5+ hours per shift: Sitting, finger dexterity, reaching waist to shoulder
- Up to 3 hours per shift: Standing, walking, bending, squatting, kneeling, handling, driving, reaching above shoulders, reaching waist to shoulder, reaching knee to waist, reaching floor to knee, grasping items, lift/carry/move items up to 40 pounds, push/pull items up to 10 pounds
- This is a remote role, but you must reside in one of the following states: Arizona, Colorado, Florida, Illinois, Indiana, Minnesota, Missouri, North Carolina, South Carolina, Tennessee, Texas, Wisconsin
- Knowledge of Azure cloud platform, Fabric data platform, ADF and DevOps is highly preferred
- Professional database certification
Benefits
- Remote role; must reside in Arizona, Colorado, Florida, Illinois, Indiana, Minnesota, Missouri, North Carolina, South Carolina, Tennessee, Texas, or Wisconsin.
Company Overview