Note: The job is a remote job and is open to candidates in USA. Thunderyard Solutions develops advanced technology solutions for mission-driven clients and projects. The ETL Developer/Data Engineer will lead data engineering activities, overseeing the development and deployment of pipelines and platforms that organize disparate structured and unstructured data into meaningful insights.
Responsibilities
- As a data engineer at Thunderyard, you’ll use your expertise to help build advanced technology solutions and lead data engineering activities on some of the most mission-driven projects in the industry
- You’ll guide data engineering activities by overseeing the development and deployment of pipelines and platforms that organize and make disparate data meaningful
Skills
- 7+ years of experience in application development and in designing, developing, operationalizing, and maintaining complex enterprise‑scale data applications
- 5+ years of experience developing software and solutions for retrieving, parsing, and processing structured and unstructured data, including scalable ETL/ELT workflows for reporting and analytics
- Experience developing scripts, programs, and automated processes to convert various data types into usable formats and support scalable, monitored, and reliable data platforms
- Experience with data architecture, data engineering, and enterprise data migration, including leading modernization initiatives and migration efforts involving multiple applications or delivery teams
- Experience with ETL design and optimization using Informatica PowerCenter including Designer, Workflow Manager, Monitor, mapping, and session development and Informatica Developer for data transformation
- Experience with relational databases such as SQL Server, Oracle, and PostgreSQL including SQL development, data modeling, heterogeneous migrations, stored procedures, and performance tuning
- Experience with Linux fundamentals, AWS cloud data architectures such as S3, RDS, cloud‑based processing, and migration and scalable distributed data platforms
- Experience supporting CI/CD and DevOps practices using Git, GitLab, GitHub, pipeline implementation, automated deployments, Ansible, and workflow orchestration including Control‑M
- Public Trust
- Bachelor's degree in a Computer Science, Information Systems, or Engineering field
- 10+ years of experience using Python, SQL, Scala, or Java
- 5+ years of experience with a public cloud including AWS, Microsoft Azure, or Google Cloud
- 5+ years of experience with Distributed data and computing tools including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka
- 5+ years of experience working on real-time data and streaming applications
- 5+ years of experience with NoSQL implementation, including MongoDB or Cassandra
- 5+ years of experience with data warehousing, including AWS Redshift, MySQL, or Snowflake
- 5+ years of experience with UNIX/Linux, including basic commands and Shell scripting
- 5+ years of experience with Agile engineering practices
- Experience executing full data migration lifecycle activities, including unit testing, UAT support, reconciliation, validation, production deployment, and implementing data security controls
- Experience working for the IRS or another government agency
- Public Trust clearance
Benefits
- Medical/dental/vision coverage
- PTO
- A partial 401k match
Company Overview