Note: The job is a remote job and is open to candidates in USA. Deltek is a provider of software and information solutions for project-based businesses. The Sr Data Engineer will design enterprise data architectures, build scalable and reliable data pipelines, support data governance and compliance, and lead modernization initiatives while collaborating with analytics and data science teams and mentoring junior engineers.
Responsibilities
- Design and implement data architecture for enterprise data platforms (data lakes, warehouses, lakehouse architectures)
- Build scalable data pipelines using modern ETL/ELT frameworks (e.g., Airflow, DBT); ensure data quality, reliability, and performance
- Implement Change Data Capture (CDC) and real-time streaming solutions using technologies such as Kafka and Spark Streaming
- Optimize data infrastructure for performance and cost, including partitioning, compression, and caching strategies
- Establish data governance practices: data lineage, quality monitoring, schema management, and access controls
- Lead technical initiatives for data platform modernization; evaluate and adopt new technologies and tools
- Mentor junior data engineers, conduct code reviews, and establish best practices
- Collaborate with data science and analytics teams to deliver data solutions for advanced analytics
- Support compliance requirements for data security, privacy, and regulatory needs (e.g., GDPR, SOC2)
Skills
- 5+ years of data engineering experience building large-scale data platforms on cloud infrastructure
- Extensive experience with cloud data platforms: AWS (Redshift, Glue, EMR, S3), Azure (Synapse, Data Factory, ADLS), or GCP (BigQuery, Dataflow, GCS)
- Expertise in SQL; proficiency in Python or Scala; experience with Spark for distributed data processing
- Hands-on experience with data pipeline orchestration tools (Airflow, DBT, Luigi, or similar)
- Experience with streaming platforms (Kafka, Kinesis, Pub/Sub) and event-driven architectures
- Deep knowledge of relational databases (PostgreSQL, Oracle, SQL Server) and NoSQL databases (MongoDB, Cassandra, DynamoDB)
- Strong skills in dimensional modeling, data normalization, and schema design
- Experience with Infrastructure as Code tools (Terraform, CloudFormation, or similar)
- Bachelor's degree in Computer Science, Engineering, or related field
- This position requires US Citizenship
- Master's degree in Computer Science, Engineering, or related field
- Experience with data compliance requirements (FedRAMP, ITAR, HIPAA)
- Experience with lakehouse platforms (Databricks, Delta Lake)
- Experience with CDC tools (GoldenGate, Debezium)
- Oracle Cloud experience
Benefits
- Certain roles are eligible for additional rewards, including incentive compensation and equity.
- Healthcare benefits
- A 401(k) plan and company match
- Paid vacation time and holidays
- Well-living programs
- Short-term and long-term disability coverage
- Basic life insurance
- Tuition reimbursement
Company Overview